2023-10-16T23:12:21.856 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-16T23:12:21.857 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file} --owner scheduled_yuriw@teuthology --name yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi --verbose --archive /home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526 -- /home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526/orig.config.yaml 2023-10-16T23:12:21.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T23:12:21.978 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526 branch: wip-yuri4-testing-2023-10-11-0735-reef description: fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file} email: yweinste@redhat.com first_in_suite: false job_id: '7429526' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuri4-testing-2023-10-11-0735-reef ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: ab9fe43522bc41de59746200b95f65d4fbcccffe ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ab9fe43522bc41de59746200b95f65d4fbcccffe thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri4-testing-2023-10-11-0735-reef sha1: ab9fe43522bc41de59746200b95f65d4fbcccffe owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 - - client.1 - - client.2 seed: 3743 sha1: ab9fe43522bc41de59746200b95f65d4fbcccffe sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri4-testing-2023-10-11-0735-reef suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_ab9fe43522bc41de59746200b95f65d4fbcccffe/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: ab9fe43522bc41de59746200b95f65d4fbcccffe syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi012.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMxAWQppE48F403WDGJsdsQyiDaEu4+p1ofBC4gxaVoFttdj0/M9w7TEZVP76fWdOhqx8/MLnefW1JJv9yEC1gw= smithi031.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDm1x/fmXG3KROxUPCqJXA4e96W7HQNf5+6CI0iJowdpSxfKt9lfTsuLZug7Pi8QIlDzFfVAPPWqfQ+fv/mZl3k= smithi033.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK/nAGApqx0VNNkrmqQAz+LU9/R0Q3vIETJvMXf92q/w3MTqUlnVwultvLaCdOzrS/WT/OvHo+APpB0R0JfPOQ4= smithi072.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCuL74Xu58QHvckEI31wgy0qjUJB2IzOwO1byfnLnRDXZdKbmDlS0mpWOBHJ0DeQsnhDw6n/Lj2cS8qSxuZx2xo= smithi138.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGktYTOmphqzUFGOpOfDH/SIj8g9vzxqkQ52gDiN44/QGExzrXBgT5LGiQZ+QxKKiIDT29dOQTX/rhaXDXq/iQc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - pexec: clients: - cd $TESTDIR - wget http://download.ceph.com/qa/ior.tbz2 - tar xvfj ior.tbz2 - cd ior - ./configure - make - make install DESTDIR=$TESTDIR/binary/ - cd $TESTDIR/ - rm ior.tbz2 - rm -r ior - ln -s $TESTDIR/mnt.* $TESTDIR/gmnt - ssh_keys: null - mpi: exec: $TESTDIR/binary/usr/local/bin/ior -e -w -r -W -b 10m -a POSIX -o $TESTDIR/gmnt/ior.testfile - pexec: clients: - rm -f $TESTDIR/gmnt/ior.testfile - rm -f $TESTDIR/gmnt - rm -rf $TESTDIR/binary teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-16_14:43:00 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-16T23:12:21.979 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_ab9fe43522bc41de59746200b95f65d4fbcccffe/qa; will attempt to use it 2023-10-16T23:12:21.979 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_ab9fe43522bc41de59746200b95f65d4fbcccffe/qa/tasks 2023-10-16T23:12:21.980 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-16T23:12:21.982 INFO:teuthology.task.internal:Checking packages... 2023-10-16T23:12:22.004 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'ab9fe43522bc41de59746200b95f65d4fbcccffe' 2023-10-16T23:12:22.004 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-16T23:12:22.005 INFO:teuthology.packaging:ref: None 2023-10-16T23:12:22.005 INFO:teuthology.packaging:tag: None 2023-10-16T23:12:22.005 INFO:teuthology.packaging:branch: wip-yuri4-testing-2023-10-11-0735-reef 2023-10-16T23:12:22.006 INFO:teuthology.packaging:sha1: ab9fe43522bc41de59746200b95f65d4fbcccffe 2023-10-16T23:12:22.006 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuri4-testing-2023-10-11-0735-reef 2023-10-16T23:12:22.150 INFO:teuthology.task.internal:Found packages for ceph version 18.2.0-668-gab9fe435-1jammy 2023-10-16T23:12:22.151 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-16T23:12:22.158 INFO:teuthology.task.internal:no buildpackages task found 2023-10-16T23:12:22.158 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-16T23:12:22.195 INFO:teuthology.task.internal:Saving configuration 2023-10-16T23:12:22.212 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-16T23:12:22.219 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T23:12:22.243 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 23:05:30.462800', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDHTkBo14Hyuop1cdl23xO1e9bcm77TakJD+la7Yejq4'} 2023-10-16T23:12:22.264 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 23:05:30.457350', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILsAdwRKpdaoAaVMKjSD5KZZtZwnMybQIOYJSuV9dRVz'} 2023-10-16T23:12:22.285 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 23:05:30.459312', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKM1l2V5gx7vS+vWsD6OV5oPwSS6K8Di5bmEqND9RdKh'} 2023-10-16T23:12:22.305 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 23:05:30.461056', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIE9rvqEkR1gQcDUH+59+EzQ8FuvABiYqJcPOb9S1vKPs'} 2023-10-16T23:12:22.327 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 23:05:30.464343', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIK88M73ihhNNId54++N8tGT0snJVGJ8MN+/5EAM55oED'} 2023-10-16T23:12:22.328 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-16T23:12:22.334 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-10-16T23:12:22.335 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-10-16T23:12:22.335 INFO:teuthology.task.internal:roles: ubuntu@smithi033.front.sepia.ceph.com - ['client.0'] 2023-10-16T23:12:22.335 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['client.1'] 2023-10-16T23:12:22.335 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['client.2'] 2023-10-16T23:12:22.336 INFO:teuthology.run_tasks:Running task console_log... 2023-10-16T23:12:22.519 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0c3fef0b80>, signals=[15]) 2023-10-16T23:12:22.521 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-16T23:12:22.527 INFO:teuthology.task.internal:Opening connections... 2023-10-16T23:12:22.528 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi012.front.sepia.ceph.com 2023-10-16T23:12:22.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:12:22.610 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi031.front.sepia.ceph.com 2023-10-16T23:12:22.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:12:22.687 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi033.front.sepia.ceph.com 2023-10-16T23:12:22.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:12:22.762 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi072.front.sepia.ceph.com 2023-10-16T23:12:22.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:12:22.840 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi138.front.sepia.ceph.com 2023-10-16T23:12:22.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:12:22.914 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-16T23:12:22.922 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2023-10-16T23:12:22.928 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2023-10-16T23:12:22.929 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-10-16T23:12:22.974 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-16T23:12:22.974 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="Ubuntu" 2023-10-16T23:12:22.974 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="22.04" 2023-10-16T23:12:22.975 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-16T23:12:22.975 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_CODENAME=jammy 2023-10-16T23:12:22.975 INFO:teuthology.orchestra.run.smithi012.stdout:ID=ubuntu 2023-10-16T23:12:22.975 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE=debian 2023-10-16T23:12:22.975 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-16T23:12:22.976 INFO:teuthology.orchestra.run.smithi012.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-16T23:12:22.976 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-16T23:12:22.976 INFO:teuthology.orchestra.run.smithi012.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-16T23:12:22.976 INFO:teuthology.orchestra.run.smithi012.stdout:UBUNTU_CODENAME=jammy 2023-10-16T23:12:22.977 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-10-16T23:12:23.002 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2023-10-16T23:12:23.008 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2023-10-16T23:12:23.009 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-10-16T23:12:23.054 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-16T23:12:23.054 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Ubuntu" 2023-10-16T23:12:23.054 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="22.04" 2023-10-16T23:12:23.055 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-16T23:12:23.055 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_CODENAME=jammy 2023-10-16T23:12:23.055 INFO:teuthology.orchestra.run.smithi031.stdout:ID=ubuntu 2023-10-16T23:12:23.055 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE=debian 2023-10-16T23:12:23.055 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-16T23:12:23.055 INFO:teuthology.orchestra.run.smithi031.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-16T23:12:23.056 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-16T23:12:23.056 INFO:teuthology.orchestra.run.smithi031.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-16T23:12:23.056 INFO:teuthology.orchestra.run.smithi031.stdout:UBUNTU_CODENAME=jammy 2023-10-16T23:12:23.056 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-10-16T23:12:23.086 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2023-10-16T23:12:23.092 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2023-10-16T23:12:23.092 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-10-16T23:12:23.139 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-16T23:12:23.139 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Ubuntu" 2023-10-16T23:12:23.139 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="22.04" 2023-10-16T23:12:23.139 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-16T23:12:23.140 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_CODENAME=jammy 2023-10-16T23:12:23.140 INFO:teuthology.orchestra.run.smithi033.stdout:ID=ubuntu 2023-10-16T23:12:23.140 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE=debian 2023-10-16T23:12:23.140 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-16T23:12:23.140 INFO:teuthology.orchestra.run.smithi033.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-16T23:12:23.141 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-16T23:12:23.141 INFO:teuthology.orchestra.run.smithi033.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-16T23:12:23.141 INFO:teuthology.orchestra.run.smithi033.stdout:UBUNTU_CODENAME=jammy 2023-10-16T23:12:23.141 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-10-16T23:12:23.169 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2023-10-16T23:12:23.175 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2023-10-16T23:12:23.175 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-10-16T23:12:23.221 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-16T23:12:23.222 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Ubuntu" 2023-10-16T23:12:23.222 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="22.04" 2023-10-16T23:12:23.222 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-16T23:12:23.222 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_CODENAME=jammy 2023-10-16T23:12:23.223 INFO:teuthology.orchestra.run.smithi072.stdout:ID=ubuntu 2023-10-16T23:12:23.223 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE=debian 2023-10-16T23:12:23.223 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-16T23:12:23.223 INFO:teuthology.orchestra.run.smithi072.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-16T23:12:23.223 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-16T23:12:23.223 INFO:teuthology.orchestra.run.smithi072.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-16T23:12:23.224 INFO:teuthology.orchestra.run.smithi072.stdout:UBUNTU_CODENAME=jammy 2023-10-16T23:12:23.224 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-10-16T23:12:23.244 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2023-10-16T23:12:23.250 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2023-10-16T23:12:23.250 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2023-10-16T23:12:23.297 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-16T23:12:23.298 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Ubuntu" 2023-10-16T23:12:23.298 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="22.04" 2023-10-16T23:12:23.298 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-16T23:12:23.298 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_CODENAME=jammy 2023-10-16T23:12:23.298 INFO:teuthology.orchestra.run.smithi138.stdout:ID=ubuntu 2023-10-16T23:12:23.299 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE=debian 2023-10-16T23:12:23.299 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-16T23:12:23.299 INFO:teuthology.orchestra.run.smithi138.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-16T23:12:23.299 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-16T23:12:23.299 INFO:teuthology.orchestra.run.smithi138.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-16T23:12:23.299 INFO:teuthology.orchestra.run.smithi138.stdout:UBUNTU_CODENAME=jammy 2023-10-16T23:12:23.300 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2023-10-16T23:12:23.327 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-16T23:12:23.337 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-16T23:12:23.371 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-16T23:12:23.371 DEBUG:teuthology.orchestra.run.smithi012:> test '!' -e /home/ubuntu/cephtest 2023-10-16T23:12:23.374 DEBUG:teuthology.orchestra.run.smithi031:> test '!' -e /home/ubuntu/cephtest 2023-10-16T23:12:23.377 DEBUG:teuthology.orchestra.run.smithi033:> test '!' -e /home/ubuntu/cephtest 2023-10-16T23:12:23.380 DEBUG:teuthology.orchestra.run.smithi072:> test '!' -e /home/ubuntu/cephtest 2023-10-16T23:12:23.382 DEBUG:teuthology.orchestra.run.smithi138:> test '!' -e /home/ubuntu/cephtest 2023-10-16T23:12:23.387 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-16T23:12:23.393 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-16T23:12:23.394 DEBUG:teuthology.orchestra.run.smithi012:> test -z $(ls -A /var/lib/ceph) 2023-10-16T23:12:23.419 DEBUG:teuthology.orchestra.run.smithi031:> test -z $(ls -A /var/lib/ceph) 2023-10-16T23:12:23.423 DEBUG:teuthology.orchestra.run.smithi033:> test -z $(ls -A /var/lib/ceph) 2023-10-16T23:12:23.427 DEBUG:teuthology.orchestra.run.smithi072:> test -z $(ls -A /var/lib/ceph) 2023-10-16T23:12:23.430 DEBUG:teuthology.orchestra.run.smithi138:> test -z $(ls -A /var/lib/ceph) 2023-10-16T23:12:23.508 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-16T23:12:23.637 INFO:teuthology.run_tasks:Running task kernel... 2023-10-16T23:12:23.651 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-16T23:12:23.652 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'client.2': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-16T23:12:23.653 DEBUG:teuthology.orchestra.run.smithi012:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-16T23:12:23.653 DEBUG:teuthology.orchestra.run.smithi031:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-16T23:12:23.654 DEBUG:teuthology.orchestra.run.smithi033:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-16T23:12:23.655 DEBUG:teuthology.orchestra.run.smithi072:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-16T23:12:23.655 DEBUG:teuthology.orchestra.run.smithi138:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-16T23:12:23.663 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T23:12:23.663 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T23:12:23.663 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T23:12:23.664 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T23:12:23.664 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T23:12:23.665 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2023-10-16T23:12:23.666 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2023-10-16T23:12:23.666 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2023-10-16T23:12:23.667 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2023-10-16T23:12:23.667 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2023-10-16T23:12:23.709 INFO:teuthology.orchestra.run.smithi138.stdout:5.15.0-56-generic 2023-10-16T23:12:23.710 INFO:teuthology.task.kernel:Running kernel on smithi138: 5.15.0-56-generic 2023-10-16T23:12:23.710 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get clean 2023-10-16T23:12:23.713 INFO:teuthology.orchestra.run.smithi033.stdout:5.15.0-56-generic 2023-10-16T23:12:23.713 INFO:teuthology.orchestra.run.smithi012.stdout:5.15.0-56-generic 2023-10-16T23:12:23.714 INFO:teuthology.orchestra.run.smithi031.stdout:5.15.0-56-generic 2023-10-16T23:12:23.714 INFO:teuthology.task.kernel:Running kernel on smithi033: 5.15.0-56-generic 2023-10-16T23:12:23.714 DEBUG:teuthology.orchestra.run.smithi033:> sudo apt-get clean 2023-10-16T23:12:23.715 INFO:teuthology.task.kernel:Running kernel on smithi012: 5.15.0-56-generic 2023-10-16T23:12:23.715 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-get clean 2023-10-16T23:12:23.716 INFO:teuthology.task.kernel:Running kernel on smithi031: 5.15.0-56-generic 2023-10-16T23:12:23.716 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-get clean 2023-10-16T23:12:23.717 INFO:teuthology.orchestra.run.smithi072.stdout:5.15.0-56-generic 2023-10-16T23:12:23.718 INFO:teuthology.task.kernel:Running kernel on smithi072: 5.15.0-56-generic 2023-10-16T23:12:23.718 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get clean 2023-10-16T23:12:23.822 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-get update 2023-10-16T23:12:23.842 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-get update 2023-10-16T23:12:23.844 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2023-10-16T23:12:23.853 DEBUG:teuthology.orchestra.run.smithi033:> sudo apt-get update 2023-10-16T23:12:23.871 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get update 2023-10-16T23:12:23.978 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-16T23:12:23.985 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-16T23:12:23.988 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-16T23:12:24.008 INFO:teuthology.orchestra.run.smithi031.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-10-16T23:12:24.015 INFO:teuthology.orchestra.run.smithi012.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-10-16T23:12:24.017 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-10-16T23:12:24.052 INFO:teuthology.orchestra.run.smithi033.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-10-16T23:12:24.082 INFO:teuthology.orchestra.run.smithi031.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-10-16T23:12:24.083 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-10-16T23:12:24.088 INFO:teuthology.orchestra.run.smithi012.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-10-16T23:12:24.092 INFO:teuthology.orchestra.run.smithi031.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-10-16T23:12:24.093 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-10-16T23:12:24.095 INFO:teuthology.orchestra.run.smithi012.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-10-16T23:12:24.140 INFO:teuthology.orchestra.run.smithi033.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-16T23:12:24.164 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-16T23:12:24.164 INFO:teuthology.orchestra.run.smithi072.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-10-16T23:12:24.216 INFO:teuthology.orchestra.run.smithi033.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-10-16T23:12:24.218 INFO:teuthology.orchestra.run.smithi072.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-10-16T23:12:24.241 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [507 kB] 2023-10-16T23:12:24.243 INFO:teuthology.orchestra.run.smithi031.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [507 kB] 2023-10-16T23:12:24.245 INFO:teuthology.orchestra.run.smithi012.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,062 kB] 2023-10-16T23:12:24.300 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,062 kB] 2023-10-16T23:12:24.318 INFO:teuthology.orchestra.run.smithi033.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [856 kB] 2023-10-16T23:12:24.326 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [234 kB] 2023-10-16T23:12:24.331 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.0 kB] 2023-10-16T23:12:24.331 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.3 kB] 2023-10-16T23:12:24.332 INFO:teuthology.orchestra.run.smithi138.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [974 kB] 2023-10-16T23:12:24.342 INFO:teuthology.orchestra.run.smithi138.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [157 kB] 2023-10-16T23:12:24.344 INFO:teuthology.orchestra.run.smithi138.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [532 B] 2023-10-16T23:12:24.344 INFO:teuthology.orchestra.run.smithi138.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [658 kB] 2023-10-16T23:12:24.349 INFO:teuthology.orchestra.run.smithi138.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [992 kB] 2023-10-16T23:12:24.353 INFO:teuthology.orchestra.run.smithi012.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [507 kB] 2023-10-16T23:12:24.355 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,062 kB] 2023-10-16T23:12:24.369 INFO:teuthology.orchestra.run.smithi012.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [234 kB] 2023-10-16T23:12:24.374 INFO:teuthology.orchestra.run.smithi012.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.0 kB] 2023-10-16T23:12:24.374 INFO:teuthology.orchestra.run.smithi012.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [974 kB] 2023-10-16T23:12:24.380 INFO:teuthology.orchestra.run.smithi138.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [217 kB] 2023-10-16T23:12:24.383 INFO:teuthology.orchestra.run.smithi138.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.0 kB] 2023-10-16T23:12:24.383 INFO:teuthology.orchestra.run.smithi138.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-10-16T23:12:24.384 INFO:teuthology.orchestra.run.smithi138.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-10-16T23:12:24.384 INFO:teuthology.orchestra.run.smithi138.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-10-16T23:12:24.384 INFO:teuthology.orchestra.run.smithi138.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2023-10-16T23:12:24.385 INFO:teuthology.orchestra.run.smithi138.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2023-10-16T23:12:24.385 INFO:teuthology.orchestra.run.smithi138.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2023-10-16T23:12:24.385 INFO:teuthology.orchestra.run.smithi138.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-10-16T23:12:24.393 INFO:teuthology.orchestra.run.smithi012.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.3 kB] 2023-10-16T23:12:24.394 INFO:teuthology.orchestra.run.smithi012.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [157 kB] 2023-10-16T23:12:24.398 INFO:teuthology.orchestra.run.smithi138.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-10-16T23:12:24.401 INFO:teuthology.orchestra.run.smithi012.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [532 B] 2023-10-16T23:12:24.402 INFO:teuthology.orchestra.run.smithi012.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [992 kB] 2023-10-16T23:12:24.415 INFO:teuthology.orchestra.run.smithi138.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2023-10-16T23:12:24.415 INFO:teuthology.orchestra.run.smithi138.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2023-10-16T23:12:24.416 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [234 kB] 2023-10-16T23:12:24.416 INFO:teuthology.orchestra.run.smithi138.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.4 kB] 2023-10-16T23:12:24.417 INFO:teuthology.orchestra.run.smithi138.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [640 B] 2023-10-16T23:12:24.426 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.0 kB] 2023-10-16T23:12:24.431 INFO:teuthology.orchestra.run.smithi031.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [974 kB] 2023-10-16T23:12:24.446 INFO:teuthology.orchestra.run.smithi012.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [658 kB] 2023-10-16T23:12:24.452 INFO:teuthology.orchestra.run.smithi012.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [217 kB] 2023-10-16T23:12:24.454 INFO:teuthology.orchestra.run.smithi012.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.0 kB] 2023-10-16T23:12:24.455 INFO:teuthology.orchestra.run.smithi012.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-10-16T23:12:24.455 INFO:teuthology.orchestra.run.smithi012.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-10-16T23:12:24.456 INFO:teuthology.orchestra.run.smithi012.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-10-16T23:12:24.457 INFO:teuthology.orchestra.run.smithi031.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.3 kB] 2023-10-16T23:12:24.457 INFO:teuthology.orchestra.run.smithi031.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [157 kB] 2023-10-16T23:12:24.457 INFO:teuthology.orchestra.run.smithi012.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2023-10-16T23:12:24.457 INFO:teuthology.orchestra.run.smithi012.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2023-10-16T23:12:24.458 INFO:teuthology.orchestra.run.smithi012.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2023-10-16T23:12:24.458 INFO:teuthology.orchestra.run.smithi031.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [532 B] 2023-10-16T23:12:24.459 INFO:teuthology.orchestra.run.smithi031.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [658 kB] 2023-10-16T23:12:24.476 INFO:teuthology.orchestra.run.smithi031.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [992 kB] 2023-10-16T23:12:24.477 INFO:teuthology.orchestra.run.smithi012.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-10-16T23:12:24.483 INFO:teuthology.orchestra.run.smithi033.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [346 kB] 2023-10-16T23:12:24.490 INFO:teuthology.orchestra.run.smithi031.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [217 kB] 2023-10-16T23:12:24.492 INFO:teuthology.orchestra.run.smithi031.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.0 kB] 2023-10-16T23:12:24.495 INFO:teuthology.orchestra.run.smithi033.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [175 kB] 2023-10-16T23:12:24.497 INFO:teuthology.orchestra.run.smithi012.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-10-16T23:12:24.498 INFO:teuthology.orchestra.run.smithi012.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2023-10-16T23:12:24.498 INFO:teuthology.orchestra.run.smithi012.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2023-10-16T23:12:24.499 INFO:teuthology.orchestra.run.smithi012.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.4 kB] 2023-10-16T23:12:24.499 INFO:teuthology.orchestra.run.smithi012.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [640 B] 2023-10-16T23:12:24.499 INFO:teuthology.orchestra.run.smithi033.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2023-10-16T23:12:24.500 INFO:teuthology.orchestra.run.smithi033.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.0 kB] 2023-10-16T23:12:24.501 INFO:teuthology.orchestra.run.smithi033.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [953 kB] 2023-10-16T23:12:24.503 INFO:teuthology.orchestra.run.smithi031.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-10-16T23:12:24.504 INFO:teuthology.orchestra.run.smithi031.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-10-16T23:12:24.511 INFO:teuthology.orchestra.run.smithi031.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-10-16T23:12:24.511 INFO:teuthology.orchestra.run.smithi031.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2023-10-16T23:12:24.512 INFO:teuthology.orchestra.run.smithi031.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2023-10-16T23:12:24.512 INFO:teuthology.orchestra.run.smithi031.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2023-10-16T23:12:24.513 INFO:teuthology.orchestra.run.smithi031.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [346 kB] 2023-10-16T23:12:24.513 INFO:teuthology.orchestra.run.smithi031.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-10-16T23:12:24.533 INFO:teuthology.orchestra.run.smithi033.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [154 kB] 2023-10-16T23:12:24.534 INFO:teuthology.orchestra.run.smithi138.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [346 kB] 2023-10-16T23:12:24.536 INFO:teuthology.orchestra.run.smithi031.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-10-16T23:12:24.536 INFO:teuthology.orchestra.run.smithi031.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2023-10-16T23:12:24.537 INFO:teuthology.orchestra.run.smithi031.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2023-10-16T23:12:24.538 INFO:teuthology.orchestra.run.smithi033.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [532 B] 2023-10-16T23:12:24.538 INFO:teuthology.orchestra.run.smithi033.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [790 kB] 2023-10-16T23:12:24.538 INFO:teuthology.orchestra.run.smithi031.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.4 kB] 2023-10-16T23:12:24.538 INFO:teuthology.orchestra.run.smithi031.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [640 B] 2023-10-16T23:12:24.560 INFO:teuthology.orchestra.run.smithi012.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [346 kB] 2023-10-16T23:12:24.572 INFO:teuthology.orchestra.run.smithi072.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-10-16T23:12:24.574 INFO:teuthology.orchestra.run.smithi072.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [856 kB] 2023-10-16T23:12:24.579 INFO:teuthology.orchestra.run.smithi033.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [560 kB] 2023-10-16T23:12:24.579 INFO:teuthology.orchestra.run.smithi033.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-10-16T23:12:24.583 INFO:teuthology.orchestra.run.smithi033.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [145 kB] 2023-10-16T23:12:24.584 INFO:teuthology.orchestra.run.smithi033.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2023-10-16T23:12:24.585 INFO:teuthology.orchestra.run.smithi033.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-10-16T23:12:24.585 INFO:teuthology.orchestra.run.smithi033.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-10-16T23:12:24.586 INFO:teuthology.orchestra.run.smithi033.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-10-16T23:12:24.586 INFO:teuthology.orchestra.run.smithi033.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-10-16T23:12:24.706 INFO:teuthology.orchestra.run.smithi033.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [507 kB] 2023-10-16T23:12:24.710 INFO:teuthology.orchestra.run.smithi072.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [507 kB] 2023-10-16T23:12:24.773 INFO:teuthology.orchestra.run.smithi031.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [856 kB] 2023-10-16T23:12:24.794 INFO:teuthology.orchestra.run.smithi138.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [856 kB] 2023-10-16T23:12:24.819 INFO:teuthology.orchestra.run.smithi012.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [856 kB] 2023-10-16T23:12:24.888 INFO:teuthology.orchestra.run.smithi033.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,062 kB] 2023-10-16T23:12:24.892 INFO:teuthology.orchestra.run.smithi072.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,062 kB] 2023-10-16T23:12:24.916 INFO:teuthology.orchestra.run.smithi031.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [175 kB] 2023-10-16T23:12:24.936 INFO:teuthology.orchestra.run.smithi031.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2023-10-16T23:12:24.938 INFO:teuthology.orchestra.run.smithi138.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [175 kB] 2023-10-16T23:12:24.938 INFO:teuthology.orchestra.run.smithi031.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.0 kB] 2023-10-16T23:12:24.940 INFO:teuthology.orchestra.run.smithi031.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [953 kB] 2023-10-16T23:12:24.958 INFO:teuthology.orchestra.run.smithi138.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2023-10-16T23:12:24.959 INFO:teuthology.orchestra.run.smithi138.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [953 kB] 2023-10-16T23:12:24.962 INFO:teuthology.orchestra.run.smithi012.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [175 kB] 2023-10-16T23:12:24.970 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [346 kB] 2023-10-16T23:12:24.982 INFO:teuthology.orchestra.run.smithi012.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2023-10-16T23:12:24.983 INFO:teuthology.orchestra.run.smithi012.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [953 kB] 2023-10-16T23:12:24.993 INFO:teuthology.orchestra.run.smithi072.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [175 kB] 2023-10-16T23:12:25.003 INFO:teuthology.orchestra.run.smithi031.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [154 kB] 2023-10-16T23:12:25.004 INFO:teuthology.orchestra.run.smithi072.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2023-10-16T23:12:25.005 INFO:teuthology.orchestra.run.smithi072.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.0 kB] 2023-10-16T23:12:25.007 INFO:teuthology.orchestra.run.smithi072.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [953 kB] 2023-10-16T23:12:25.012 INFO:teuthology.orchestra.run.smithi031.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [532 B] 2023-10-16T23:12:25.013 INFO:teuthology.orchestra.run.smithi031.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [560 kB] 2023-10-16T23:12:25.013 INFO:teuthology.orchestra.run.smithi033.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [234 kB] 2023-10-16T23:12:25.017 INFO:teuthology.orchestra.run.smithi072.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [234 kB] 2023-10-16T23:12:25.022 INFO:teuthology.orchestra.run.smithi138.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.0 kB] 2023-10-16T23:12:25.024 INFO:teuthology.orchestra.run.smithi138.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [154 kB] 2023-10-16T23:12:25.027 INFO:teuthology.orchestra.run.smithi033.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.0 kB] 2023-10-16T23:12:25.029 INFO:teuthology.orchestra.run.smithi033.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.3 kB] 2023-10-16T23:12:25.032 INFO:teuthology.orchestra.run.smithi072.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.0 kB] 2023-10-16T23:12:25.033 INFO:teuthology.orchestra.run.smithi033.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [974 kB] 2023-10-16T23:12:25.034 INFO:teuthology.orchestra.run.smithi138.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [532 B] 2023-10-16T23:12:25.034 INFO:teuthology.orchestra.run.smithi138.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [560 kB] 2023-10-16T23:12:25.035 INFO:teuthology.orchestra.run.smithi072.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [974 kB] 2023-10-16T23:12:25.039 INFO:teuthology.orchestra.run.smithi031.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [790 kB] 2023-10-16T23:12:25.046 INFO:teuthology.orchestra.run.smithi012.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.0 kB] 2023-10-16T23:12:25.048 INFO:teuthology.orchestra.run.smithi012.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [154 kB] 2023-10-16T23:12:25.057 INFO:teuthology.orchestra.run.smithi012.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [532 B] 2023-10-16T23:12:25.058 INFO:teuthology.orchestra.run.smithi012.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [790 kB] 2023-10-16T23:12:25.061 INFO:teuthology.orchestra.run.smithi138.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [790 kB] 2023-10-16T23:12:25.083 INFO:teuthology.orchestra.run.smithi033.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [157 kB] 2023-10-16T23:12:25.089 INFO:teuthology.orchestra.run.smithi033.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [532 B] 2023-10-16T23:12:25.090 INFO:teuthology.orchestra.run.smithi072.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.3 kB] 2023-10-16T23:12:25.091 INFO:teuthology.orchestra.run.smithi072.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [154 kB] 2023-10-16T23:12:25.091 INFO:teuthology.orchestra.run.smithi072.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [157 kB] 2023-10-16T23:12:25.092 INFO:teuthology.orchestra.run.smithi012.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [560 kB] 2023-10-16T23:12:25.095 INFO:teuthology.orchestra.run.smithi072.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [532 B] 2023-10-16T23:12:25.100 INFO:teuthology.orchestra.run.smithi072.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [532 B] 2023-10-16T23:12:25.101 INFO:teuthology.orchestra.run.smithi072.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [560 kB] 2023-10-16T23:12:25.131 INFO:teuthology.orchestra.run.smithi072.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [790 kB] 2023-10-16T23:12:25.230 INFO:teuthology.orchestra.run.smithi031.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [145 kB] 2023-10-16T23:12:25.252 INFO:teuthology.orchestra.run.smithi138.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [145 kB] 2023-10-16T23:12:25.253 INFO:teuthology.orchestra.run.smithi033.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [992 kB] 2023-10-16T23:12:25.259 INFO:teuthology.orchestra.run.smithi072.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [658 kB] 2023-10-16T23:12:25.275 INFO:teuthology.orchestra.run.smithi012.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [145 kB] 2023-10-16T23:12:25.320 INFO:teuthology.orchestra.run.smithi072.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [145 kB] 2023-10-16T23:12:25.612 INFO:teuthology.orchestra.run.smithi031.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2023-10-16T23:12:25.618 INFO:teuthology.orchestra.run.smithi031.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-10-16T23:12:25.619 INFO:teuthology.orchestra.run.smithi031.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-10-16T23:12:25.635 INFO:teuthology.orchestra.run.smithi138.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2023-10-16T23:12:25.636 INFO:teuthology.orchestra.run.smithi031.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-10-16T23:12:25.637 INFO:teuthology.orchestra.run.smithi031.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-10-16T23:12:25.642 INFO:teuthology.orchestra.run.smithi138.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-10-16T23:12:25.643 INFO:teuthology.orchestra.run.smithi138.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-10-16T23:12:25.655 INFO:teuthology.orchestra.run.smithi012.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2023-10-16T23:12:25.658 INFO:teuthology.orchestra.run.smithi138.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-10-16T23:12:25.661 INFO:teuthology.orchestra.run.smithi012.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-10-16T23:12:25.661 INFO:teuthology.orchestra.run.smithi138.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-10-16T23:12:25.677 INFO:teuthology.orchestra.run.smithi012.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-10-16T23:12:25.677 INFO:teuthology.orchestra.run.smithi012.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-10-16T23:12:25.680 INFO:teuthology.orchestra.run.smithi012.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-10-16T23:12:25.703 INFO:teuthology.orchestra.run.smithi072.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2023-10-16T23:12:25.710 INFO:teuthology.orchestra.run.smithi072.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-10-16T23:12:25.725 INFO:teuthology.orchestra.run.smithi072.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-10-16T23:12:25.725 INFO:teuthology.orchestra.run.smithi072.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-10-16T23:12:25.729 INFO:teuthology.orchestra.run.smithi072.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-10-16T23:12:25.830 INFO:teuthology.orchestra.run.smithi072.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [992 kB] 2023-10-16T23:12:25.869 INFO:teuthology.orchestra.run.smithi033.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [658 kB] 2023-10-16T23:12:25.907 INFO:teuthology.orchestra.run.smithi033.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [217 kB] 2023-10-16T23:12:25.920 INFO:teuthology.orchestra.run.smithi033.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.0 kB] 2023-10-16T23:12:25.921 INFO:teuthology.orchestra.run.smithi033.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-10-16T23:12:25.923 INFO:teuthology.orchestra.run.smithi033.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-10-16T23:12:25.923 INFO:teuthology.orchestra.run.smithi033.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-10-16T23:12:25.925 INFO:teuthology.orchestra.run.smithi033.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2023-10-16T23:12:25.925 INFO:teuthology.orchestra.run.smithi033.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2023-10-16T23:12:25.926 INFO:teuthology.orchestra.run.smithi033.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2023-10-16T23:12:25.940 INFO:teuthology.orchestra.run.smithi072.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [217 kB] 2023-10-16T23:12:25.951 INFO:teuthology.orchestra.run.smithi033.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-10-16T23:12:25.959 INFO:teuthology.orchestra.run.smithi072.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.0 kB] 2023-10-16T23:12:25.961 INFO:teuthology.orchestra.run.smithi072.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-10-16T23:12:25.964 INFO:teuthology.orchestra.run.smithi072.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-10-16T23:12:25.965 INFO:teuthology.orchestra.run.smithi072.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-10-16T23:12:25.966 INFO:teuthology.orchestra.run.smithi072.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2023-10-16T23:12:25.966 INFO:teuthology.orchestra.run.smithi072.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2023-10-16T23:12:25.969 INFO:teuthology.orchestra.run.smithi072.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2023-10-16T23:12:25.971 INFO:teuthology.orchestra.run.smithi072.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-10-16T23:12:26.118 INFO:teuthology.orchestra.run.smithi033.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-10-16T23:12:26.136 INFO:teuthology.orchestra.run.smithi072.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-10-16T23:12:26.200 INFO:teuthology.orchestra.run.smithi033.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2023-10-16T23:12:26.205 INFO:teuthology.orchestra.run.smithi033.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2023-10-16T23:12:26.218 INFO:teuthology.orchestra.run.smithi072.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2023-10-16T23:12:26.314 INFO:teuthology.orchestra.run.smithi072.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2023-10-16T23:12:26.324 INFO:teuthology.orchestra.run.smithi033.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.4 kB] 2023-10-16T23:12:26.343 INFO:teuthology.orchestra.run.smithi072.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.4 kB] 2023-10-16T23:12:26.375 INFO:teuthology.orchestra.run.smithi033.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [640 B] 2023-10-16T23:12:26.394 INFO:teuthology.orchestra.run.smithi072.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [640 B] 2023-10-16T23:12:29.978 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 9,491 kB in 2s (5,421 kB/s) 2023-10-16T23:12:30.107 INFO:teuthology.orchestra.run.smithi012.stdout:Fetched 9,491 kB in 2s (5,371 kB/s) 2023-10-16T23:12:30.355 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 9,491 kB in 2s (5,411 kB/s) 2023-10-16T23:12:30.734 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 9,491 kB in 2s (3,871 kB/s) 2023-10-16T23:12:30.946 INFO:teuthology.orchestra.run.smithi033.stdout:Fetched 9,491 kB in 2s (3,897 kB/s) 2023-10-16T23:12:31.203 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2023-10-16T23:12:31.218 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-16T23:12:31.280 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2023-10-16T23:12:31.422 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2023-10-16T23:12:31.440 DEBUG:teuthology.orchestra.run.smithi012:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-16T23:12:31.465 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2023-10-16T23:12:31.465 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2023-10-16T23:12:31.502 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2023-10-16T23:12:31.626 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2023-10-16T23:12:31.626 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-16T23:12:31.626 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-16T23:12:31.627 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-16T23:12:31.627 INFO:teuthology.orchestra.run.smithi138.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-10-16T23:12:31.628 INFO:teuthology.orchestra.run.smithi138.stdout: python2.7-minimal 2023-10-16T23:12:31.628 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-16T23:12:31.628 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2023-10-16T23:12:31.629 INFO:teuthology.orchestra.run.smithi138.stdout: linux-generic linux-headers-5.15.0-86 linux-headers-5.15.0-86-generic 2023-10-16T23:12:31.629 INFO:teuthology.orchestra.run.smithi138.stdout: linux-headers-generic linux-image-5.15.0-86-generic 2023-10-16T23:12:31.629 INFO:teuthology.orchestra.run.smithi138.stdout: linux-modules-5.15.0-86-generic linux-modules-extra-5.15.0-86-generic 2023-10-16T23:12:31.629 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2023-10-16T23:12:31.630 INFO:teuthology.orchestra.run.smithi138.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-10-16T23:12:31.630 INFO:teuthology.orchestra.run.smithi138.stdout:Recommended packages: 2023-10-16T23:12:31.630 INFO:teuthology.orchestra.run.smithi138.stdout: thermald 2023-10-16T23:12:31.662 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2023-10-16T23:12:31.679 DEBUG:teuthology.orchestra.run.smithi031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-16T23:12:31.680 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2023-10-16T23:12:31.681 INFO:teuthology.orchestra.run.smithi138.stdout: linux-headers-5.15.0-86 linux-headers-5.15.0-86-generic 2023-10-16T23:12:31.681 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.15.0-86-generic linux-modules-5.15.0-86-generic 2023-10-16T23:12:31.681 INFO:teuthology.orchestra.run.smithi138.stdout: linux-modules-extra-5.15.0-86-generic 2023-10-16T23:12:31.682 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages will be upgraded: 2023-10-16T23:12:31.682 INFO:teuthology.orchestra.run.smithi138.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-16T23:12:31.691 INFO:teuthology.orchestra.run.smithi012.stdout:Building dependency tree... 2023-10-16T23:12:31.692 INFO:teuthology.orchestra.run.smithi012.stdout:Reading state information... 2023-10-16T23:12:31.742 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2023-10-16T23:12:31.856 INFO:teuthology.orchestra.run.smithi012.stdout:The following packages were automatically installed and are no longer required: 2023-10-16T23:12:31.857 INFO:teuthology.orchestra.run.smithi012.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-16T23:12:31.857 INFO:teuthology.orchestra.run.smithi012.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-16T23:12:31.858 INFO:teuthology.orchestra.run.smithi012.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-16T23:12:31.858 INFO:teuthology.orchestra.run.smithi012.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-10-16T23:12:31.858 INFO:teuthology.orchestra.run.smithi012.stdout: python2.7-minimal 2023-10-16T23:12:31.858 INFO:teuthology.orchestra.run.smithi012.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-16T23:12:31.859 INFO:teuthology.orchestra.run.smithi012.stdout:The following additional packages will be installed: 2023-10-16T23:12:31.859 INFO:teuthology.orchestra.run.smithi012.stdout: linux-generic linux-headers-5.15.0-86 linux-headers-5.15.0-86-generic 2023-10-16T23:12:31.859 INFO:teuthology.orchestra.run.smithi012.stdout: linux-headers-generic linux-image-5.15.0-86-generic 2023-10-16T23:12:31.860 INFO:teuthology.orchestra.run.smithi012.stdout: linux-modules-5.15.0-86-generic linux-modules-extra-5.15.0-86-generic 2023-10-16T23:12:31.860 INFO:teuthology.orchestra.run.smithi012.stdout:Suggested packages: 2023-10-16T23:12:31.860 INFO:teuthology.orchestra.run.smithi012.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-10-16T23:12:31.860 INFO:teuthology.orchestra.run.smithi012.stdout:Recommended packages: 2023-10-16T23:12:31.861 INFO:teuthology.orchestra.run.smithi012.stdout: thermald 2023-10-16T23:12:31.861 INFO:teuthology.orchestra.run.smithi138.stdout:3 upgraded, 5 newly installed, 0 to remove and 268 not upgraded. 2023-10-16T23:12:31.862 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 113 MB of archives. 2023-10-16T23:12:31.862 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 582 MB of additional disk space will be used. 2023-10-16T23:12:31.862 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-86-generic amd64 5.15.0-86.96 [22.4 MB] 2023-10-16T23:12:31.908 INFO:teuthology.orchestra.run.smithi012.stdout:The following NEW packages will be installed: 2023-10-16T23:12:31.909 INFO:teuthology.orchestra.run.smithi012.stdout: linux-headers-5.15.0-86 linux-headers-5.15.0-86-generic 2023-10-16T23:12:31.909 INFO:teuthology.orchestra.run.smithi012.stdout: linux-image-5.15.0-86-generic linux-modules-5.15.0-86-generic 2023-10-16T23:12:31.909 INFO:teuthology.orchestra.run.smithi012.stdout: linux-modules-extra-5.15.0-86-generic 2023-10-16T23:12:31.910 INFO:teuthology.orchestra.run.smithi012.stdout:The following packages will be upgraded: 2023-10-16T23:12:31.911 INFO:teuthology.orchestra.run.smithi012.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-16T23:12:31.931 INFO:teuthology.orchestra.run.smithi031.stdout:Building dependency tree... 2023-10-16T23:12:31.932 INFO:teuthology.orchestra.run.smithi031.stdout:Reading state information... 2023-10-16T23:12:32.092 INFO:teuthology.orchestra.run.smithi012.stdout:3 upgraded, 5 newly installed, 0 to remove and 268 not upgraded. 2023-10-16T23:12:32.092 INFO:teuthology.orchestra.run.smithi012.stdout:Need to get 113 MB of archives. 2023-10-16T23:12:32.093 INFO:teuthology.orchestra.run.smithi012.stdout:After this operation, 582 MB of additional disk space will be used. 2023-10-16T23:12:32.093 INFO:teuthology.orchestra.run.smithi012.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-86-generic amd64 5.15.0-86.96 [22.4 MB] 2023-10-16T23:12:32.098 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages were automatically installed and are no longer required: 2023-10-16T23:12:32.099 INFO:teuthology.orchestra.run.smithi031.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-16T23:12:32.099 INFO:teuthology.orchestra.run.smithi031.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-16T23:12:32.100 INFO:teuthology.orchestra.run.smithi031.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-16T23:12:32.100 INFO:teuthology.orchestra.run.smithi031.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-10-16T23:12:32.100 INFO:teuthology.orchestra.run.smithi031.stdout: python2.7-minimal 2023-10-16T23:12:32.100 INFO:teuthology.orchestra.run.smithi031.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-16T23:12:32.101 INFO:teuthology.orchestra.run.smithi031.stdout:The following additional packages will be installed: 2023-10-16T23:12:32.101 INFO:teuthology.orchestra.run.smithi031.stdout: linux-generic linux-headers-5.15.0-86 linux-headers-5.15.0-86-generic 2023-10-16T23:12:32.101 INFO:teuthology.orchestra.run.smithi031.stdout: linux-headers-generic linux-image-5.15.0-86-generic 2023-10-16T23:12:32.102 INFO:teuthology.orchestra.run.smithi031.stdout: linux-modules-5.15.0-86-generic linux-modules-extra-5.15.0-86-generic 2023-10-16T23:12:32.102 INFO:teuthology.orchestra.run.smithi031.stdout:Suggested packages: 2023-10-16T23:12:32.103 INFO:teuthology.orchestra.run.smithi031.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-10-16T23:12:32.103 INFO:teuthology.orchestra.run.smithi031.stdout:Recommended packages: 2023-10-16T23:12:32.103 INFO:teuthology.orchestra.run.smithi031.stdout: thermald 2023-10-16T23:12:32.152 INFO:teuthology.orchestra.run.smithi031.stdout:The following NEW packages will be installed: 2023-10-16T23:12:32.152 INFO:teuthology.orchestra.run.smithi031.stdout: linux-headers-5.15.0-86 linux-headers-5.15.0-86-generic 2023-10-16T23:12:32.152 INFO:teuthology.orchestra.run.smithi031.stdout: linux-image-5.15.0-86-generic linux-modules-5.15.0-86-generic 2023-10-16T23:12:32.153 INFO:teuthology.orchestra.run.smithi031.stdout: linux-modules-extra-5.15.0-86-generic 2023-10-16T23:12:32.153 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages will be upgraded: 2023-10-16T23:12:32.154 INFO:teuthology.orchestra.run.smithi031.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-16T23:12:32.285 INFO:teuthology.orchestra.run.smithi033.stdout:Reading package lists... 2023-10-16T23:12:32.303 DEBUG:teuthology.orchestra.run.smithi033:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-16T23:12:32.334 INFO:teuthology.orchestra.run.smithi031.stdout:3 upgraded, 5 newly installed, 0 to remove and 268 not upgraded. 2023-10-16T23:12:32.335 INFO:teuthology.orchestra.run.smithi031.stdout:Need to get 113 MB of archives. 2023-10-16T23:12:32.335 INFO:teuthology.orchestra.run.smithi031.stdout:After this operation, 582 MB of additional disk space will be used. 2023-10-16T23:12:32.335 INFO:teuthology.orchestra.run.smithi031.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-86-generic amd64 5.15.0-86.96 [22.4 MB] 2023-10-16T23:12:32.356 INFO:teuthology.orchestra.run.smithi033.stdout:Reading package lists... 2023-10-16T23:12:32.524 INFO:teuthology.orchestra.run.smithi033.stdout:Building dependency tree... 2023-10-16T23:12:32.525 INFO:teuthology.orchestra.run.smithi033.stdout:Reading state information... 2023-10-16T23:12:32.672 INFO:teuthology.orchestra.run.smithi033.stdout:The following packages were automatically installed and are no longer required: 2023-10-16T23:12:32.672 INFO:teuthology.orchestra.run.smithi033.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-16T23:12:32.672 INFO:teuthology.orchestra.run.smithi033.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-16T23:12:32.673 INFO:teuthology.orchestra.run.smithi033.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-16T23:12:32.673 INFO:teuthology.orchestra.run.smithi033.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-10-16T23:12:32.673 INFO:teuthology.orchestra.run.smithi033.stdout: python2.7-minimal 2023-10-16T23:12:32.674 INFO:teuthology.orchestra.run.smithi033.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-16T23:12:32.674 INFO:teuthology.orchestra.run.smithi033.stdout:The following additional packages will be installed: 2023-10-16T23:12:32.675 INFO:teuthology.orchestra.run.smithi033.stdout: linux-generic linux-headers-5.15.0-86 linux-headers-5.15.0-86-generic 2023-10-16T23:12:32.675 INFO:teuthology.orchestra.run.smithi033.stdout: linux-headers-generic linux-image-5.15.0-86-generic 2023-10-16T23:12:32.675 INFO:teuthology.orchestra.run.smithi033.stdout: linux-modules-5.15.0-86-generic linux-modules-extra-5.15.0-86-generic 2023-10-16T23:12:32.675 INFO:teuthology.orchestra.run.smithi033.stdout:Suggested packages: 2023-10-16T23:12:32.676 INFO:teuthology.orchestra.run.smithi033.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-10-16T23:12:32.676 INFO:teuthology.orchestra.run.smithi033.stdout:Recommended packages: 2023-10-16T23:12:32.676 INFO:teuthology.orchestra.run.smithi033.stdout: thermald 2023-10-16T23:12:32.735 INFO:teuthology.orchestra.run.smithi033.stdout:The following NEW packages will be installed: 2023-10-16T23:12:32.736 INFO:teuthology.orchestra.run.smithi033.stdout: linux-headers-5.15.0-86 linux-headers-5.15.0-86-generic 2023-10-16T23:12:32.736 INFO:teuthology.orchestra.run.smithi033.stdout: linux-image-5.15.0-86-generic linux-modules-5.15.0-86-generic 2023-10-16T23:12:32.737 INFO:teuthology.orchestra.run.smithi033.stdout: linux-modules-extra-5.15.0-86-generic 2023-10-16T23:12:32.737 INFO:teuthology.orchestra.run.smithi033.stdout:The following packages will be upgraded: 2023-10-16T23:12:32.738 INFO:teuthology.orchestra.run.smithi033.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-16T23:12:32.787 INFO:teuthology.orchestra.run.smithi033.stdout:3 upgraded, 5 newly installed, 0 to remove and 268 not upgraded. 2023-10-16T23:12:32.787 INFO:teuthology.orchestra.run.smithi033.stdout:Need to get 113 MB of archives. 2023-10-16T23:12:32.787 INFO:teuthology.orchestra.run.smithi033.stdout:After this operation, 582 MB of additional disk space will be used. 2023-10-16T23:12:32.788 INFO:teuthology.orchestra.run.smithi033.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-86-generic amd64 5.15.0-86.96 [22.4 MB] 2023-10-16T23:12:32.992 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2023-10-16T23:12:33.010 DEBUG:teuthology.orchestra.run.smithi072:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-16T23:12:33.074 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2023-10-16T23:12:33.198 INFO:teuthology.orchestra.run.smithi033.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-86-generic amd64 5.15.0-86.96 [11.5 MB] 2023-10-16T23:12:33.266 INFO:teuthology.orchestra.run.smithi072.stdout:Building dependency tree... 2023-10-16T23:12:33.267 INFO:teuthology.orchestra.run.smithi072.stdout:Reading state information... 2023-10-16T23:12:33.294 INFO:teuthology.orchestra.run.smithi033.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-86-generic amd64 5.15.0-86.96 [63.9 MB] 2023-10-16T23:12:33.364 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-86-generic amd64 5.15.0-86.96 [11.5 MB] 2023-10-16T23:12:33.426 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages were automatically installed and are no longer required: 2023-10-16T23:12:33.426 INFO:teuthology.orchestra.run.smithi072.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-16T23:12:33.426 INFO:teuthology.orchestra.run.smithi072.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-16T23:12:33.427 INFO:teuthology.orchestra.run.smithi072.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-16T23:12:33.427 INFO:teuthology.orchestra.run.smithi072.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-10-16T23:12:33.427 INFO:teuthology.orchestra.run.smithi072.stdout: python2.7-minimal 2023-10-16T23:12:33.428 INFO:teuthology.orchestra.run.smithi072.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-16T23:12:33.428 INFO:teuthology.orchestra.run.smithi072.stdout:The following additional packages will be installed: 2023-10-16T23:12:33.428 INFO:teuthology.orchestra.run.smithi072.stdout: linux-generic linux-headers-5.15.0-86 linux-headers-5.15.0-86-generic 2023-10-16T23:12:33.429 INFO:teuthology.orchestra.run.smithi072.stdout: linux-headers-generic linux-image-5.15.0-86-generic 2023-10-16T23:12:33.429 INFO:teuthology.orchestra.run.smithi072.stdout: linux-modules-5.15.0-86-generic linux-modules-extra-5.15.0-86-generic 2023-10-16T23:12:33.429 INFO:teuthology.orchestra.run.smithi072.stdout:Suggested packages: 2023-10-16T23:12:33.430 INFO:teuthology.orchestra.run.smithi072.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-10-16T23:12:33.430 INFO:teuthology.orchestra.run.smithi072.stdout:Recommended packages: 2023-10-16T23:12:33.430 INFO:teuthology.orchestra.run.smithi072.stdout: thermald 2023-10-16T23:12:33.482 INFO:teuthology.orchestra.run.smithi072.stdout:The following NEW packages will be installed: 2023-10-16T23:12:33.482 INFO:teuthology.orchestra.run.smithi072.stdout: linux-headers-5.15.0-86 linux-headers-5.15.0-86-generic 2023-10-16T23:12:33.482 INFO:teuthology.orchestra.run.smithi072.stdout: linux-image-5.15.0-86-generic linux-modules-5.15.0-86-generic 2023-10-16T23:12:33.483 INFO:teuthology.orchestra.run.smithi072.stdout: linux-modules-extra-5.15.0-86-generic 2023-10-16T23:12:33.483 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages will be upgraded: 2023-10-16T23:12:33.484 INFO:teuthology.orchestra.run.smithi072.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-16T23:12:33.496 INFO:teuthology.orchestra.run.smithi012.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-86-generic amd64 5.15.0-86.96 [11.5 MB] 2023-10-16T23:12:33.664 INFO:teuthology.orchestra.run.smithi072.stdout:3 upgraded, 5 newly installed, 0 to remove and 268 not upgraded. 2023-10-16T23:12:33.665 INFO:teuthology.orchestra.run.smithi072.stdout:Need to get 113 MB of archives. 2023-10-16T23:12:33.665 INFO:teuthology.orchestra.run.smithi072.stdout:After this operation, 582 MB of additional disk space will be used. 2023-10-16T23:12:33.665 INFO:teuthology.orchestra.run.smithi072.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-86-generic amd64 5.15.0-86.96 [22.4 MB] 2023-10-16T23:12:33.711 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-86-generic amd64 5.15.0-86.96 [63.9 MB] 2023-10-16T23:12:33.743 INFO:teuthology.orchestra.run.smithi031.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-86-generic amd64 5.15.0-86.96 [11.5 MB] 2023-10-16T23:12:33.859 INFO:teuthology.orchestra.run.smithi012.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-86-generic amd64 5.15.0-86.96 [63.9 MB] 2023-10-16T23:12:34.092 INFO:teuthology.orchestra.run.smithi031.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-86-generic amd64 5.15.0-86.96 [63.9 MB] 2023-10-16T23:12:34.134 INFO:teuthology.orchestra.run.smithi033.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.86.83 [1,702 B] 2023-10-16T23:12:34.135 INFO:teuthology.orchestra.run.smithi033.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.86.83 [2,472 B] 2023-10-16T23:12:34.135 INFO:teuthology.orchestra.run.smithi033.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-86 all 5.15.0-86.96 [12.3 MB] 2023-10-16T23:12:34.265 INFO:teuthology.orchestra.run.smithi033.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-86-generic amd64 5.15.0-86.96 [2,882 kB] 2023-10-16T23:12:34.288 INFO:teuthology.orchestra.run.smithi033.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.86.83 [2,328 B] 2023-10-16T23:12:34.779 INFO:teuthology.orchestra.run.smithi033.stdout:Fetched 113 MB in 2s (70.0 MB/s) 2023-10-16T23:12:34.975 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package linux-modules-5.15.0-86-generic. 2023-10-16T23:12:35.083 INFO:teuthology.orchestra.run.smithi072.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-86-generic amd64 5.15.0-86.96 [11.5 MB] 2023-10-16T23:12:35.426 INFO:teuthology.orchestra.run.smithi072.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-86-generic amd64 5.15.0-86.96 [63.9 MB] 2023-10-16T23:12:35.913 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.86.83 [1,702 B] 2023-10-16T23:12:35.914 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.86.83 [2,472 B] 2023-10-16T23:12:35.914 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-86 all 5.15.0-86.96 [12.3 MB] 2023-10-16T23:12:36.067 INFO:teuthology.orchestra.run.smithi012.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.86.83 [1,702 B] 2023-10-16T23:12:36.067 INFO:teuthology.orchestra.run.smithi012.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.86.83 [2,472 B] 2023-10-16T23:12:36.068 INFO:teuthology.orchestra.run.smithi012.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-86 all 5.15.0-86.96 [12.3 MB] 2023-10-16T23:12:36.225 INFO:teuthology.orchestra.run.smithi031.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.86.83 [1,702 B] 2023-10-16T23:12:36.225 INFO:teuthology.orchestra.run.smithi031.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.86.83 [2,472 B] 2023-10-16T23:12:36.226 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-86 all 5.15.0-86.96 [12.3 MB] 2023-10-16T23:12:36.252 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-86-generic amd64 5.15.0-86.96 [2,882 kB] 2023-10-16T23:12:36.328 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.86.83 [2,328 B] 2023-10-16T23:12:36.527 INFO:teuthology.orchestra.run.smithi012.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-86-generic amd64 5.15.0-86.96 [2,882 kB] 2023-10-16T23:12:36.617 INFO:teuthology.orchestra.run.smithi012.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.86.83 [2,328 B] 2023-10-16T23:12:36.721 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 113 MB in 5s (24.4 MB/s) 2023-10-16T23:12:36.876 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-modules-5.15.0-86-generic. 2023-10-16T23:12:37.012 INFO:teuthology.orchestra.run.smithi012.stdout:Fetched 113 MB in 5s (24.1 MB/s) 2023-10-16T23:12:37.018 INFO:teuthology.orchestra.run.smithi033.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-10-16T23:12:37.023 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../0-linux-modules-5.15.0-86-generic_5.15.0-86.96_amd64.deb ... 2023-10-16T23:12:37.115 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking linux-modules-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:37.130 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-86-generic amd64 5.15.0-86.96 [2,882 kB] 2023-10-16T23:12:37.198 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package linux-modules-5.15.0-86-generic. 2023-10-16T23:12:37.265 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.86.83 [2,328 B] 2023-10-16T23:12:37.687 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 113 MB in 5s (22.2 MB/s) 2023-10-16T23:12:37.836 INFO:teuthology.orchestra.run.smithi072.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.86.83 [1,702 B] 2023-10-16T23:12:37.836 INFO:teuthology.orchestra.run.smithi072.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.86.83 [2,472 B] 2023-10-16T23:12:37.837 INFO:teuthology.orchestra.run.smithi072.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-86 all 5.15.0-86.96 [12.3 MB] 2023-10-16T23:12:37.845 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package linux-modules-5.15.0-86-generic. 2023-10-16T23:12:38.713 INFO:teuthology.orchestra.run.smithi072.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-86-generic amd64 5.15.0-86.96 [2,882 kB] 2023-10-16T23:12:38.811 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.86.83 [2,328 B] 2023-10-16T23:12:38.986 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-10-16T23:12:38.990 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../0-linux-modules-5.15.0-86-generic_5.15.0-86.96_amd64.deb ... 2023-10-16T23:12:39.194 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 113 MB in 5s (21.2 MB/s) 2023-10-16T23:12:39.225 INFO:teuthology.orchestra.run.smithi012.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-10-16T23:12:39.230 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../0-linux-modules-5.15.0-86-generic_5.15.0-86.96_amd64.deb ... 2023-10-16T23:12:39.240 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-modules-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:39.295 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-modules-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:39.387 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-modules-5.15.0-86-generic. 2023-10-16T23:12:39.666 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package linux-image-5.15.0-86-generic. 2023-10-16T23:12:39.688 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../1-linux-image-5.15.0-86-generic_5.15.0-86.96_amd64.deb ... 2023-10-16T23:12:39.782 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking linux-image-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:39.841 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-10-16T23:12:39.846 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../0-linux-modules-5.15.0-86-generic_5.15.0-86.96_amd64.deb ... 2023-10-16T23:12:39.900 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-modules-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:40.286 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-86-generic. 2023-10-16T23:12:40.307 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-86-generic_5.15.0-86.96_amd64.deb ... 2023-10-16T23:12:40.344 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking linux-modules-extra-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:41.366 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-image-5.15.0-86-generic. 2023-10-16T23:12:41.387 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../1-linux-image-5.15.0-86-generic_5.15.0-86.96_amd64.deb ... 2023-10-16T23:12:41.455 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package linux-image-5.15.0-86-generic. 2023-10-16T23:12:41.470 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-image-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:41.476 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../1-linux-image-5.15.0-86-generic_5.15.0-86.96_amd64.deb ... 2023-10-16T23:12:41.574 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-image-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:41.894 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-86-generic. 2023-10-16T23:12:41.914 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-86-generic_5.15.0-86.96_amd64.deb ... 2023-10-16T23:12:41.952 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-modules-extra-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:42.033 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-86-generic. 2023-10-16T23:12:42.055 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-86-generic_5.15.0-86.96_amd64.deb ... 2023-10-16T23:12:42.092 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-modules-extra-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:42.208 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package linux-image-5.15.0-86-generic. 2023-10-16T23:12:42.230 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../1-linux-image-5.15.0-86-generic_5.15.0-86.96_amd64.deb ... 2023-10-16T23:12:42.320 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-image-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:42.377 INFO:teuthology.orchestra.run.smithi072.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-10-16T23:12:42.382 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../0-linux-modules-5.15.0-86-generic_5.15.0-86.96_amd64.deb ... 2023-10-16T23:12:42.612 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-modules-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:42.736 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-86-generic. 2023-10-16T23:12:42.757 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-86-generic_5.15.0-86.96_amd64.deb ... 2023-10-16T23:12:42.786 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-modules-extra-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:45.083 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-image-5.15.0-86-generic. 2023-10-16T23:12:45.104 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../1-linux-image-5.15.0-86-generic_5.15.0-86.96_amd64.deb ... 2023-10-16T23:12:45.210 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-image-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:45.732 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-86-generic. 2023-10-16T23:12:45.752 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-86-generic_5.15.0-86.96_amd64.deb ... 2023-10-16T23:12:45.791 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-modules-extra-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:46.756 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../3-linux-generic_5.15.0.86.83_amd64.deb ... 2023-10-16T23:12:46.900 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking linux-generic (5.15.0.86.83) over (5.15.0.56.54) ... 2023-10-16T23:12:47.249 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.86.83_amd64.deb ... 2023-10-16T23:12:47.386 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking linux-image-generic (5.15.0.86.83) over (5.15.0.56.54) ... 2023-10-16T23:12:47.683 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package linux-headers-5.15.0-86. 2023-10-16T23:12:47.706 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../5-linux-headers-5.15.0-86_5.15.0-86.96_all.deb ... 2023-10-16T23:12:47.750 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking linux-headers-5.15.0-86 (5.15.0-86.96) ... 2023-10-16T23:12:48.760 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../3-linux-generic_5.15.0.86.83_amd64.deb ... 2023-10-16T23:12:48.862 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-generic (5.15.0.86.83) over (5.15.0.56.54) ... 2023-10-16T23:12:48.926 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../3-linux-generic_5.15.0.86.83_amd64.deb ... 2023-10-16T23:12:48.987 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../3-linux-generic_5.15.0.86.83_amd64.deb ... 2023-10-16T23:12:49.035 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-generic (5.15.0.86.83) over (5.15.0.56.54) ... 2023-10-16T23:12:49.126 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-generic (5.15.0.86.83) over (5.15.0.56.54) ... 2023-10-16T23:12:49.153 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.86.83_amd64.deb ... 2023-10-16T23:12:49.274 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-image-generic (5.15.0.86.83) over (5.15.0.56.54) ... 2023-10-16T23:12:49.360 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.86.83_amd64.deb ... 2023-10-16T23:12:49.452 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.86.83_amd64.deb ... 2023-10-16T23:12:49.480 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-image-generic (5.15.0.86.83) over (5.15.0.56.54) ... 2023-10-16T23:12:49.552 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-headers-5.15.0-86. 2023-10-16T23:12:49.556 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-image-generic (5.15.0.86.83) over (5.15.0.56.54) ... 2023-10-16T23:12:49.574 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../5-linux-headers-5.15.0-86_5.15.0-86.96_all.deb ... 2023-10-16T23:12:49.610 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-5.15.0-86 (5.15.0-86.96) ... 2023-10-16T23:12:49.767 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package linux-headers-5.15.0-86. 2023-10-16T23:12:49.790 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../5-linux-headers-5.15.0-86_5.15.0-86.96_all.deb ... 2023-10-16T23:12:49.859 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package linux-headers-5.15.0-86. 2023-10-16T23:12:49.875 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-headers-5.15.0-86 (5.15.0-86.96) ... 2023-10-16T23:12:49.882 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../5-linux-headers-5.15.0-86_5.15.0-86.96_all.deb ... 2023-10-16T23:12:49.925 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-headers-5.15.0-86 (5.15.0-86.96) ... 2023-10-16T23:12:53.331 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../3-linux-generic_5.15.0.86.83_amd64.deb ... 2023-10-16T23:12:53.450 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-generic (5.15.0.86.83) over (5.15.0.56.54) ... 2023-10-16T23:12:53.554 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package linux-headers-5.15.0-86-generic. 2023-10-16T23:12:53.592 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../6-linux-headers-5.15.0-86-generic_5.15.0-86.96_amd64.deb ... 2023-10-16T23:12:53.629 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking linux-headers-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:53.771 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.86.83_amd64.deb ... 2023-10-16T23:12:53.892 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-image-generic (5.15.0.86.83) over (5.15.0.56.54) ... 2023-10-16T23:12:54.205 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-headers-5.15.0-86. 2023-10-16T23:12:54.228 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../5-linux-headers-5.15.0-86_5.15.0-86.96_all.deb ... 2023-10-16T23:12:54.272 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-headers-5.15.0-86 (5.15.0-86.96) ... 2023-10-16T23:12:55.100 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-headers-5.15.0-86-generic. 2023-10-16T23:12:55.133 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../6-linux-headers-5.15.0-86-generic_5.15.0-86.96_amd64.deb ... 2023-10-16T23:12:55.175 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:55.407 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package linux-headers-5.15.0-86-generic. 2023-10-16T23:12:55.445 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../6-linux-headers-5.15.0-86-generic_5.15.0-86.96_amd64.deb ... 2023-10-16T23:12:55.482 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-headers-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:55.688 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package linux-headers-5.15.0-86-generic. 2023-10-16T23:12:55.724 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../6-linux-headers-5.15.0-86-generic_5.15.0-86.96_amd64.deb ... 2023-10-16T23:12:55.762 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-headers-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:56.427 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.86.83_amd64.deb ... 2023-10-16T23:12:56.548 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking linux-headers-generic (5.15.0.86.83) over (5.15.0.56.54) ... 2023-10-16T23:12:56.923 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up linux-headers-5.15.0-86 (5.15.0-86.96) ... 2023-10-16T23:12:57.027 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up linux-headers-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:57.153 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up linux-headers-generic (5.15.0.86.83) ... 2023-10-16T23:12:57.281 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up linux-image-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:57.888 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.86.83_amd64.deb ... 2023-10-16T23:12:58.013 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-generic (5.15.0.86.83) over (5.15.0.56.54) ... 2023-10-16T23:12:58.088 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.86.83_amd64.deb ... 2023-10-16T23:12:58.210 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-headers-generic (5.15.0.86.83) over (5.15.0.56.54) ... 2023-10-16T23:12:58.355 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-5.15.0-86 (5.15.0-86.96) ... 2023-10-16T23:12:58.452 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:58.506 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.86.83_amd64.deb ... 2023-10-16T23:12:58.527 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-headers-5.15.0-86 (5.15.0-86.96) ... 2023-10-16T23:12:58.578 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-generic (5.15.0.86.83) ... 2023-10-16T23:12:58.608 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-headers-generic (5.15.0.86.83) over (5.15.0.56.54) ... 2023-10-16T23:12:58.666 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-headers-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:58.699 INFO:teuthology.orchestra.run.smithi033.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-10-16T23:12:58.700 INFO:teuthology.orchestra.run.smithi033.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-10-16T23:12:58.700 INFO:teuthology.orchestra.run.smithi033.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-86-generic 2023-10-16T23:12:58.700 INFO:teuthology.orchestra.run.smithi033.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-86-generic 2023-10-16T23:12:58.705 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-image-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:58.792 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-headers-generic (5.15.0.86.83) ... 2023-10-16T23:12:58.851 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up linux-modules-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:58.927 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-image-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:58.941 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-headers-5.15.0-86 (5.15.0-86.96) ... 2023-10-16T23:12:59.038 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-headers-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:12:59.155 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-headers-generic (5.15.0.86.83) ... 2023-10-16T23:12:59.282 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-image-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:13:00.049 INFO:teuthology.orchestra.run.smithi138.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-10-16T23:13:00.049 INFO:teuthology.orchestra.run.smithi138.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-10-16T23:13:00.049 INFO:teuthology.orchestra.run.smithi138.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-86-generic 2023-10-16T23:13:00.050 INFO:teuthology.orchestra.run.smithi138.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-86-generic 2023-10-16T23:13:00.202 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-modules-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:13:00.317 INFO:teuthology.orchestra.run.smithi031.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-10-16T23:13:00.318 INFO:teuthology.orchestra.run.smithi031.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-10-16T23:13:00.318 INFO:teuthology.orchestra.run.smithi031.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-86-generic 2023-10-16T23:13:00.318 INFO:teuthology.orchestra.run.smithi031.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-86-generic 2023-10-16T23:13:00.376 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up linux-modules-extra-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:13:00.481 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-modules-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:13:00.949 INFO:teuthology.orchestra.run.smithi012.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-10-16T23:13:00.950 INFO:teuthology.orchestra.run.smithi012.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-10-16T23:13:00.950 INFO:teuthology.orchestra.run.smithi012.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-86-generic 2023-10-16T23:13:00.950 INFO:teuthology.orchestra.run.smithi012.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-86-generic 2023-10-16T23:13:01.112 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-modules-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:13:01.588 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package linux-headers-5.15.0-86-generic. 2023-10-16T23:13:01.626 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../6-linux-headers-5.15.0-86-generic_5.15.0-86.96_amd64.deb ... 2023-10-16T23:13:01.636 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-modules-extra-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:13:01.663 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-headers-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:13:01.803 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up linux-image-generic (5.15.0.86.83) ... 2023-10-16T23:13:01.923 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-modules-extra-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:13:01.937 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up linux-generic (5.15.0.86.83) ... 2023-10-16T23:13:02.064 INFO:teuthology.orchestra.run.smithi033.stdout:Processing triggers for linux-image-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:13:02.141 INFO:teuthology.orchestra.run.smithi033.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-16T23:13:02.141 INFO:teuthology.orchestra.run.smithi033.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-86-generic 2023-10-16T23:13:02.537 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-modules-extra-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:13:03.038 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-image-generic (5.15.0.86.83) ... 2023-10-16T23:13:03.163 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-generic (5.15.0.86.83) ... 2023-10-16T23:13:03.290 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for linux-image-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:13:03.333 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-image-generic (5.15.0.86.83) ... 2023-10-16T23:13:03.355 INFO:teuthology.orchestra.run.smithi138.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-16T23:13:03.356 INFO:teuthology.orchestra.run.smithi138.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-86-generic 2023-10-16T23:13:03.434 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-generic (5.15.0.86.83) ... 2023-10-16T23:13:03.560 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for linux-image-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:13:03.632 INFO:teuthology.orchestra.run.smithi031.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-16T23:13:03.632 INFO:teuthology.orchestra.run.smithi031.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-86-generic 2023-10-16T23:13:03.933 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.86.83_amd64.deb ... 2023-10-16T23:13:03.946 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-image-generic (5.15.0.86.83) ... 2023-10-16T23:13:04.073 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-generic (5.15.0.86.83) ... 2023-10-16T23:13:04.076 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking linux-headers-generic (5.15.0.86.83) over (5.15.0.56.54) ... 2023-10-16T23:13:04.198 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for linux-image-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:13:04.278 INFO:teuthology.orchestra.run.smithi012.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-16T23:13:04.278 INFO:teuthology.orchestra.run.smithi012.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-86-generic 2023-10-16T23:13:04.423 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-headers-5.15.0-86 (5.15.0-86.96) ... 2023-10-16T23:13:04.545 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-headers-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:13:04.672 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-headers-generic (5.15.0.86.83) ... 2023-10-16T23:13:04.810 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-image-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:13:06.388 INFO:teuthology.orchestra.run.smithi072.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-10-16T23:13:06.388 INFO:teuthology.orchestra.run.smithi072.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-10-16T23:13:06.388 INFO:teuthology.orchestra.run.smithi072.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-86-generic 2023-10-16T23:13:06.389 INFO:teuthology.orchestra.run.smithi072.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-86-generic 2023-10-16T23:13:06.595 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-modules-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:13:08.032 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-modules-extra-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:13:09.468 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-image-generic (5.15.0.86.83) ... 2023-10-16T23:13:09.611 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up linux-generic (5.15.0.86.83) ... 2023-10-16T23:13:09.740 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for linux-image-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-16T23:13:09.802 INFO:teuthology.orchestra.run.smithi072.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-16T23:13:09.802 INFO:teuthology.orchestra.run.smithi072.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-86-generic 2023-10-16T23:13:16.879 INFO:teuthology.orchestra.run.smithi033.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-16T23:13:16.880 INFO:teuthology.orchestra.run.smithi033.stdout:Sourcing file `/etc/default/grub' 2023-10-16T23:13:16.893 INFO:teuthology.orchestra.run.smithi033.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-16T23:13:16.925 INFO:teuthology.orchestra.run.smithi033.stdout:Generating grub configuration file ... 2023-10-16T23:13:17.182 INFO:teuthology.orchestra.run.smithi033.stdout:Found linux image: /boot/vmlinuz-5.15.0-86-generic 2023-10-16T23:13:17.209 INFO:teuthology.orchestra.run.smithi033.stdout:Found initrd image: /boot/initrd.img-5.15.0-86-generic 2023-10-16T23:13:17.255 INFO:teuthology.orchestra.run.smithi138.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-16T23:13:17.255 INFO:teuthology.orchestra.run.smithi138.stdout:Sourcing file `/etc/default/grub' 2023-10-16T23:13:17.266 INFO:teuthology.orchestra.run.smithi138.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-16T23:13:17.286 INFO:teuthology.orchestra.run.smithi138.stdout:Generating grub configuration file ... 2023-10-16T23:13:17.546 INFO:teuthology.orchestra.run.smithi033.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-16T23:13:17.552 INFO:teuthology.orchestra.run.smithi033.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-16T23:13:17.617 INFO:teuthology.orchestra.run.smithi138.stdout:Found linux image: /boot/vmlinuz-5.15.0-86-generic 2023-10-16T23:13:17.622 INFO:teuthology.orchestra.run.smithi033.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-16T23:13:17.628 INFO:teuthology.orchestra.run.smithi033.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-16T23:13:17.640 INFO:teuthology.orchestra.run.smithi138.stdout:Found initrd image: /boot/initrd.img-5.15.0-86-generic 2023-10-16T23:13:17.786 INFO:teuthology.orchestra.run.smithi033.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-16T23:13:17.786 INFO:teuthology.orchestra.run.smithi033.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-10-16T23:13:17.787 INFO:teuthology.orchestra.run.smithi033.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-16T23:13:17.827 INFO:teuthology.orchestra.run.smithi033.stdout:done 2023-10-16T23:13:17.857 INFO:teuthology.orchestra.run.smithi031.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-16T23:13:17.857 INFO:teuthology.orchestra.run.smithi031.stdout:Sourcing file `/etc/default/grub' 2023-10-16T23:13:17.860 INFO:teuthology.orchestra.run.smithi031.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-16T23:13:17.883 INFO:teuthology.orchestra.run.smithi031.stdout:Generating grub configuration file ... 2023-10-16T23:13:17.998 INFO:teuthology.orchestra.run.smithi138.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-16T23:13:18.003 INFO:teuthology.orchestra.run.smithi138.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-16T23:13:18.065 INFO:teuthology.orchestra.run.smithi138.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-16T23:13:18.071 INFO:teuthology.orchestra.run.smithi138.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-16T23:13:18.124 INFO:teuthology.orchestra.run.smithi031.stdout:Found linux image: /boot/vmlinuz-5.15.0-86-generic 2023-10-16T23:13:18.143 INFO:teuthology.orchestra.run.smithi031.stdout:Found initrd image: /boot/initrd.img-5.15.0-86-generic 2023-10-16T23:13:18.218 INFO:teuthology.orchestra.run.smithi138.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-16T23:13:18.218 INFO:teuthology.orchestra.run.smithi138.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-10-16T23:13:18.218 INFO:teuthology.orchestra.run.smithi138.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-16T23:13:18.263 INFO:teuthology.orchestra.run.smithi138.stdout:done 2023-10-16T23:13:18.288 DEBUG:teuthology.orchestra.run.smithi033:> dpkg -s linux-image-generic 2023-10-16T23:13:18.317 INFO:teuthology.orchestra.run.smithi033.stdout:Package: linux-image-generic 2023-10-16T23:13:18.317 INFO:teuthology.orchestra.run.smithi033.stdout:Status: install ok installed 2023-10-16T23:13:18.317 INFO:teuthology.orchestra.run.smithi033.stdout:Priority: optional 2023-10-16T23:13:18.318 INFO:teuthology.orchestra.run.smithi033.stdout:Section: kernel 2023-10-16T23:13:18.318 INFO:teuthology.orchestra.run.smithi033.stdout:Installed-Size: 20 2023-10-16T23:13:18.318 INFO:teuthology.orchestra.run.smithi033.stdout:Maintainer: Ubuntu Kernel Team 2023-10-16T23:13:18.318 INFO:teuthology.orchestra.run.smithi033.stdout:Architecture: amd64 2023-10-16T23:13:18.318 INFO:teuthology.orchestra.run.smithi033.stdout:Source: linux-meta 2023-10-16T23:13:18.319 INFO:teuthology.orchestra.run.smithi033.stdout:Version: 5.15.0.86.83 2023-10-16T23:13:18.319 INFO:teuthology.orchestra.run.smithi033.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-86), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-10-16T23:13:18.319 INFO:teuthology.orchestra.run.smithi033.stdout:Depends: linux-image-5.15.0-86-generic, linux-modules-extra-5.15.0-86-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-16T23:13:18.319 INFO:teuthology.orchestra.run.smithi033.stdout:Recommends: thermald 2023-10-16T23:13:18.319 INFO:teuthology.orchestra.run.smithi033.stdout:Description: Generic Linux kernel image 2023-10-16T23:13:18.320 INFO:teuthology.orchestra.run.smithi033.stdout: This package will always depend on the latest generic kernel image 2023-10-16T23:13:18.320 INFO:teuthology.orchestra.run.smithi033.stdout: available. 2023-10-16T23:13:18.320 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-86-generic 2023-10-16T23:13:18.320 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-16T23:13:18.321 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-16T23:13:18.321 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-16T23:13:18.321 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi033.front.sepia.ceph.com, path=None, version=distro) 2023-10-16T23:13:18.321 DEBUG:teuthology.orchestra.run.smithi033:> sudo apt-get clean 2023-10-16T23:13:18.397 INFO:teuthology.orchestra.run.smithi031.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-16T23:13:18.403 INFO:teuthology.orchestra.run.smithi031.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-16T23:13:18.473 INFO:teuthology.orchestra.run.smithi031.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-16T23:13:18.478 INFO:teuthology.orchestra.run.smithi031.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-16T23:13:18.489 DEBUG:teuthology.orchestra.run.smithi033:> sudo apt-get update 2023-10-16T23:13:18.639 INFO:teuthology.orchestra.run.smithi031.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-16T23:13:18.639 INFO:teuthology.orchestra.run.smithi031.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-10-16T23:13:18.639 INFO:teuthology.orchestra.run.smithi031.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-16T23:13:18.651 INFO:teuthology.orchestra.run.smithi033.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-16T23:13:18.652 INFO:teuthology.orchestra.run.smithi033.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-16T23:13:18.677 INFO:teuthology.orchestra.run.smithi033.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-16T23:13:18.687 INFO:teuthology.orchestra.run.smithi031.stdout:done 2023-10-16T23:13:18.708 INFO:teuthology.orchestra.run.smithi033.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-16T23:13:18.753 DEBUG:teuthology.orchestra.run.smithi138:> dpkg -s linux-image-generic 2023-10-16T23:13:18.777 INFO:teuthology.orchestra.run.smithi138.stdout:Package: linux-image-generic 2023-10-16T23:13:18.778 INFO:teuthology.orchestra.run.smithi138.stdout:Status: install ok installed 2023-10-16T23:13:18.778 INFO:teuthology.orchestra.run.smithi138.stdout:Priority: optional 2023-10-16T23:13:18.778 INFO:teuthology.orchestra.run.smithi138.stdout:Section: kernel 2023-10-16T23:13:18.778 INFO:teuthology.orchestra.run.smithi138.stdout:Installed-Size: 20 2023-10-16T23:13:18.778 INFO:teuthology.orchestra.run.smithi138.stdout:Maintainer: Ubuntu Kernel Team 2023-10-16T23:13:18.779 INFO:teuthology.orchestra.run.smithi138.stdout:Architecture: amd64 2023-10-16T23:13:18.779 INFO:teuthology.orchestra.run.smithi138.stdout:Source: linux-meta 2023-10-16T23:13:18.779 INFO:teuthology.orchestra.run.smithi138.stdout:Version: 5.15.0.86.83 2023-10-16T23:13:18.779 INFO:teuthology.orchestra.run.smithi138.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-86), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-10-16T23:13:18.780 INFO:teuthology.orchestra.run.smithi138.stdout:Depends: linux-image-5.15.0-86-generic, linux-modules-extra-5.15.0-86-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-16T23:13:18.780 INFO:teuthology.orchestra.run.smithi138.stdout:Recommends: thermald 2023-10-16T23:13:18.780 INFO:teuthology.orchestra.run.smithi138.stdout:Description: Generic Linux kernel image 2023-10-16T23:13:18.780 INFO:teuthology.orchestra.run.smithi138.stdout: This package will always depend on the latest generic kernel image 2023-10-16T23:13:18.781 INFO:teuthology.orchestra.run.smithi138.stdout: available. 2023-10-16T23:13:18.781 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-86-generic 2023-10-16T23:13:18.781 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-16T23:13:18.781 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-16T23:13:18.782 INFO:teuthology.task.kernel:Installing distro kernel on client.2... 2023-10-16T23:13:18.782 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi138.front.sepia.ceph.com, path=None, version=distro) 2023-10-16T23:13:18.782 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get clean 2023-10-16T23:13:18.960 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2023-10-16T23:13:18.977 INFO:teuthology.orchestra.run.smithi012.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-16T23:13:18.977 INFO:teuthology.orchestra.run.smithi012.stdout:Sourcing file `/etc/default/grub' 2023-10-16T23:13:18.989 INFO:teuthology.orchestra.run.smithi012.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-16T23:13:19.019 INFO:teuthology.orchestra.run.smithi012.stdout:Generating grub configuration file ... 2023-10-16T23:13:19.097 DEBUG:teuthology.orchestra.run.smithi031:> dpkg -s linux-image-generic 2023-10-16T23:13:19.122 INFO:teuthology.orchestra.run.smithi031.stdout:Package: linux-image-generic 2023-10-16T23:13:19.122 INFO:teuthology.orchestra.run.smithi031.stdout:Status: install ok installed 2023-10-16T23:13:19.122 INFO:teuthology.orchestra.run.smithi031.stdout:Priority: optional 2023-10-16T23:13:19.123 INFO:teuthology.orchestra.run.smithi031.stdout:Section: kernel 2023-10-16T23:13:19.123 INFO:teuthology.orchestra.run.smithi031.stdout:Installed-Size: 20 2023-10-16T23:13:19.123 INFO:teuthology.orchestra.run.smithi031.stdout:Maintainer: Ubuntu Kernel Team 2023-10-16T23:13:19.123 INFO:teuthology.orchestra.run.smithi031.stdout:Architecture: amd64 2023-10-16T23:13:19.123 INFO:teuthology.orchestra.run.smithi031.stdout:Source: linux-meta 2023-10-16T23:13:19.124 INFO:teuthology.orchestra.run.smithi031.stdout:Version: 5.15.0.86.83 2023-10-16T23:13:19.124 INFO:teuthology.orchestra.run.smithi031.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-86), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-10-16T23:13:19.124 INFO:teuthology.orchestra.run.smithi031.stdout:Depends: linux-image-5.15.0-86-generic, linux-modules-extra-5.15.0-86-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-16T23:13:19.124 INFO:teuthology.orchestra.run.smithi031.stdout:Recommends: thermald 2023-10-16T23:13:19.124 INFO:teuthology.orchestra.run.smithi031.stdout:Description: Generic Linux kernel image 2023-10-16T23:13:19.124 INFO:teuthology.orchestra.run.smithi031.stdout: This package will always depend on the latest generic kernel image 2023-10-16T23:13:19.125 INFO:teuthology.orchestra.run.smithi031.stdout: available. 2023-10-16T23:13:19.125 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-86-generic 2023-10-16T23:13:19.125 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-16T23:13:19.125 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-16T23:13:19.126 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-10-16T23:13:19.126 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi031.front.sepia.ceph.com, path=None, version=distro) 2023-10-16T23:13:19.126 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-get clean 2023-10-16T23:13:19.129 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-16T23:13:19.202 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-16T23:13:19.258 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-get update 2023-10-16T23:13:19.284 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-16T23:13:19.287 INFO:teuthology.orchestra.run.smithi012.stdout:Found linux image: /boot/vmlinuz-5.15.0-86-generic 2023-10-16T23:13:19.307 INFO:teuthology.orchestra.run.smithi012.stdout:Found initrd image: /boot/initrd.img-5.15.0-86-generic 2023-10-16T23:13:19.366 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-16T23:13:19.382 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-16T23:13:19.503 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-16T23:13:19.571 INFO:teuthology.orchestra.run.smithi012.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-16T23:13:19.577 INFO:teuthology.orchestra.run.smithi012.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-16T23:13:19.584 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-16T23:13:19.663 INFO:teuthology.orchestra.run.smithi012.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-16T23:13:19.665 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-16T23:13:19.669 INFO:teuthology.orchestra.run.smithi012.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-16T23:13:19.862 INFO:teuthology.orchestra.run.smithi012.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-16T23:13:19.863 INFO:teuthology.orchestra.run.smithi012.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-10-16T23:13:19.863 INFO:teuthology.orchestra.run.smithi012.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-16T23:13:19.904 INFO:teuthology.orchestra.run.smithi012.stdout:done 2023-10-16T23:13:20.065 INFO:teuthology.orchestra.run.smithi033.stdout:Reading package lists... 2023-10-16T23:13:20.083 DEBUG:teuthology.orchestra.run.smithi033:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-16T23:13:20.139 INFO:teuthology.orchestra.run.smithi033.stdout:Reading package lists... 2023-10-16T23:13:20.318 INFO:teuthology.orchestra.run.smithi033.stdout:Building dependency tree... 2023-10-16T23:13:20.319 INFO:teuthology.orchestra.run.smithi033.stdout:Reading state information... 2023-10-16T23:13:20.382 DEBUG:teuthology.orchestra.run.smithi012:> dpkg -s linux-image-generic 2023-10-16T23:13:20.410 INFO:teuthology.orchestra.run.smithi012.stdout:Package: linux-image-generic 2023-10-16T23:13:20.410 INFO:teuthology.orchestra.run.smithi012.stdout:Status: install ok installed 2023-10-16T23:13:20.411 INFO:teuthology.orchestra.run.smithi012.stdout:Priority: optional 2023-10-16T23:13:20.411 INFO:teuthology.orchestra.run.smithi012.stdout:Section: kernel 2023-10-16T23:13:20.411 INFO:teuthology.orchestra.run.smithi012.stdout:Installed-Size: 20 2023-10-16T23:13:20.411 INFO:teuthology.orchestra.run.smithi012.stdout:Maintainer: Ubuntu Kernel Team 2023-10-16T23:13:20.412 INFO:teuthology.orchestra.run.smithi012.stdout:Architecture: amd64 2023-10-16T23:13:20.412 INFO:teuthology.orchestra.run.smithi012.stdout:Source: linux-meta 2023-10-16T23:13:20.412 INFO:teuthology.orchestra.run.smithi012.stdout:Version: 5.15.0.86.83 2023-10-16T23:13:20.412 INFO:teuthology.orchestra.run.smithi012.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-86), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-10-16T23:13:20.413 INFO:teuthology.orchestra.run.smithi012.stdout:Depends: linux-image-5.15.0-86-generic, linux-modules-extra-5.15.0-86-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-16T23:13:20.413 INFO:teuthology.orchestra.run.smithi012.stdout:Recommends: thermald 2023-10-16T23:13:20.413 INFO:teuthology.orchestra.run.smithi012.stdout:Description: Generic Linux kernel image 2023-10-16T23:13:20.413 INFO:teuthology.orchestra.run.smithi012.stdout: This package will always depend on the latest generic kernel image 2023-10-16T23:13:20.413 INFO:teuthology.orchestra.run.smithi012.stdout: available. 2023-10-16T23:13:20.414 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-86-generic 2023-10-16T23:13:20.414 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-16T23:13:20.414 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-16T23:13:20.414 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-16T23:13:20.415 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi012.front.sepia.ceph.com, path=None, version=distro) 2023-10-16T23:13:20.415 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-get clean 2023-10-16T23:13:20.424 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2023-10-16T23:13:20.441 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-16T23:13:20.466 INFO:teuthology.orchestra.run.smithi033.stdout:linux-image-generic is already the newest version (5.15.0.86.83). 2023-10-16T23:13:20.467 INFO:teuthology.orchestra.run.smithi033.stdout:The following packages were automatically installed and are no longer required: 2023-10-16T23:13:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-16T23:13:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-16T23:13:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-16T23:13:20.467 INFO:teuthology.orchestra.run.smithi033.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-16T23:13:20.468 INFO:teuthology.orchestra.run.smithi033.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-16T23:13:20.468 INFO:teuthology.orchestra.run.smithi033.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-16T23:13:20.500 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2023-10-16T23:13:20.502 INFO:teuthology.orchestra.run.smithi033.stdout:0 upgraded, 0 newly installed, 0 to remove and 268 not upgraded. 2023-10-16T23:13:20.504 DEBUG:teuthology.orchestra.run.smithi033:> dpkg -s linux-image-generic 2023-10-16T23:13:20.560 INFO:teuthology.orchestra.run.smithi033.stdout:Package: linux-image-generic 2023-10-16T23:13:20.561 INFO:teuthology.orchestra.run.smithi033.stdout:Status: install ok installed 2023-10-16T23:13:20.561 INFO:teuthology.orchestra.run.smithi033.stdout:Priority: optional 2023-10-16T23:13:20.561 INFO:teuthology.orchestra.run.smithi033.stdout:Section: kernel 2023-10-16T23:13:20.561 INFO:teuthology.orchestra.run.smithi033.stdout:Installed-Size: 20 2023-10-16T23:13:20.562 INFO:teuthology.orchestra.run.smithi033.stdout:Maintainer: Ubuntu Kernel Team 2023-10-16T23:13:20.562 INFO:teuthology.orchestra.run.smithi033.stdout:Architecture: amd64 2023-10-16T23:13:20.562 INFO:teuthology.orchestra.run.smithi033.stdout:Source: linux-meta 2023-10-16T23:13:20.563 INFO:teuthology.orchestra.run.smithi033.stdout:Version: 5.15.0.86.83 2023-10-16T23:13:20.563 INFO:teuthology.orchestra.run.smithi033.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-86), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-10-16T23:13:20.563 INFO:teuthology.orchestra.run.smithi033.stdout:Depends: linux-image-5.15.0-86-generic, linux-modules-extra-5.15.0-86-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-16T23:13:20.563 INFO:teuthology.orchestra.run.smithi033.stdout:Recommends: thermald 2023-10-16T23:13:20.564 INFO:teuthology.orchestra.run.smithi033.stdout:Description: Generic Linux kernel image 2023-10-16T23:13:20.564 INFO:teuthology.orchestra.run.smithi033.stdout: This package will always depend on the latest generic kernel image 2023-10-16T23:13:20.564 INFO:teuthology.orchestra.run.smithi033.stdout: available. 2023-10-16T23:13:20.565 DEBUG:teuthology.orchestra.run.smithi033:> mktemp 2023-10-16T23:13:20.606 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/tmp.0v4AP3okAX 2023-10-16T23:13:20.606 DEBUG:teuthology.orchestra.run.smithi033:> sudo cp /boot/grub/grub.cfg /tmp/tmp.0v4AP3okAX 2023-10-16T23:13:20.663 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0666 /tmp/tmp.0v4AP3okAX 2023-10-16T23:13:20.691 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-get update 2023-10-16T23:13:20.692 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2023-10-16T23:13:20.694 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2023-10-16T23:13:20.730 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2023-10-16T23:13:20.748 DEBUG:teuthology.orchestra.run.smithi031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-16T23:13:20.777 DEBUG:teuthology.orchestra.remote:smithi033:/tmp/tmp.0v4AP3okAX is 10KB 2023-10-16T23:13:20.790 DEBUG:teuthology.orchestra.run.smithi033:> rm -fr /tmp/tmp.0v4AP3okAX 2023-10-16T23:13:20.796 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-16T23:13:20.809 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2023-10-16T23:13:20.842 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-16T23:13:20.851 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-16T23:13:20.852 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-16T23:13:20.852 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-16T23:13:20.859 INFO:teuthology.orchestra.run.smithi138.stdout:linux-image-generic is already the newest version (5.15.0.86.83). 2023-10-16T23:13:20.859 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2023-10-16T23:13:20.860 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-16T23:13:20.860 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-16T23:13:20.861 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-16T23:13:20.861 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-16T23:13:20.862 INFO:teuthology.orchestra.run.smithi138.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-16T23:13:20.862 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-16T23:13:20.898 INFO:teuthology.orchestra.run.smithi138.stdout:0 upgraded, 0 newly installed, 0 to remove and 268 not upgraded. 2023-10-16T23:13:20.900 DEBUG:teuthology.orchestra.run.smithi138:> dpkg -s linux-image-generic 2023-10-16T23:13:20.917 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-86-generic 2023-10-16T23:13:20.918 DEBUG:teuthology.orchestra.run.smithi033:> sudo update-grub 2023-10-16T23:13:20.924 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-16T23:13:20.963 INFO:teuthology.orchestra.run.smithi138.stdout:Package: linux-image-generic 2023-10-16T23:13:20.964 INFO:teuthology.orchestra.run.smithi138.stdout:Status: install ok installed 2023-10-16T23:13:20.964 INFO:teuthology.orchestra.run.smithi138.stdout:Priority: optional 2023-10-16T23:13:20.965 INFO:teuthology.orchestra.run.smithi138.stdout:Section: kernel 2023-10-16T23:13:20.965 INFO:teuthology.orchestra.run.smithi138.stdout:Installed-Size: 20 2023-10-16T23:13:20.966 INFO:teuthology.orchestra.run.smithi138.stdout:Maintainer: Ubuntu Kernel Team 2023-10-16T23:13:20.967 INFO:teuthology.orchestra.run.smithi138.stdout:Architecture: amd64 2023-10-16T23:13:20.967 INFO:teuthology.orchestra.run.smithi138.stdout:Source: linux-meta 2023-10-16T23:13:20.968 INFO:teuthology.orchestra.run.smithi138.stdout:Version: 5.15.0.86.83 2023-10-16T23:13:20.968 INFO:teuthology.orchestra.run.smithi138.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-86), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-10-16T23:13:20.969 INFO:teuthology.orchestra.run.smithi138.stdout:Depends: linux-image-5.15.0-86-generic, linux-modules-extra-5.15.0-86-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-16T23:13:20.969 INFO:teuthology.orchestra.run.smithi138.stdout:Recommends: thermald 2023-10-16T23:13:20.970 INFO:teuthology.orchestra.run.smithi138.stdout:Description: Generic Linux kernel image 2023-10-16T23:13:20.970 INFO:teuthology.orchestra.run.smithi138.stdout: This package will always depend on the latest generic kernel image 2023-10-16T23:13:20.971 INFO:teuthology.orchestra.run.smithi138.stdout: available. 2023-10-16T23:13:20.972 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2023-10-16T23:13:20.996 INFO:teuthology.orchestra.run.smithi031.stdout:Building dependency tree... 2023-10-16T23:13:20.997 INFO:teuthology.orchestra.run.smithi031.stdout:Reading state information... 2023-10-16T23:13:21.006 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-16T23:13:21.012 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.xjiI3h2qQt 2023-10-16T23:13:21.012 DEBUG:teuthology.orchestra.run.smithi138:> sudo cp /boot/grub/grub.cfg /tmp/tmp.xjiI3h2qQt 2023-10-16T23:13:21.069 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.xjiI3h2qQt 2023-10-16T23:13:21.087 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-16T23:13:21.160 INFO:teuthology.orchestra.run.smithi031.stdout:linux-image-generic is already the newest version (5.15.0.86.83). 2023-10-16T23:13:21.160 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages were automatically installed and are no longer required: 2023-10-16T23:13:21.161 INFO:teuthology.orchestra.run.smithi031.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-16T23:13:21.161 INFO:teuthology.orchestra.run.smithi031.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-16T23:13:21.161 INFO:teuthology.orchestra.run.smithi031.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-16T23:13:21.161 INFO:teuthology.orchestra.run.smithi031.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-16T23:13:21.162 INFO:teuthology.orchestra.run.smithi031.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-16T23:13:21.163 INFO:teuthology.orchestra.run.smithi031.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-16T23:13:21.188 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.xjiI3h2qQt is 10KB 2023-10-16T23:13:21.200 INFO:teuthology.orchestra.run.smithi031.stdout:0 upgraded, 0 newly installed, 0 to remove and 268 not upgraded. 2023-10-16T23:13:21.201 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.xjiI3h2qQt 2023-10-16T23:13:21.202 DEBUG:teuthology.orchestra.run.smithi031:> dpkg -s linux-image-generic 2023-10-16T23:13:21.207 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-16T23:13:21.260 INFO:teuthology.orchestra.run.smithi031.stdout:Package: linux-image-generic 2023-10-16T23:13:21.261 INFO:teuthology.orchestra.run.smithi031.stdout:Status: install ok installed 2023-10-16T23:13:21.261 INFO:teuthology.orchestra.run.smithi031.stdout:Priority: optional 2023-10-16T23:13:21.261 INFO:teuthology.orchestra.run.smithi031.stdout:Section: kernel 2023-10-16T23:13:21.261 INFO:teuthology.orchestra.run.smithi031.stdout:Installed-Size: 20 2023-10-16T23:13:21.261 INFO:teuthology.orchestra.run.smithi031.stdout:Maintainer: Ubuntu Kernel Team 2023-10-16T23:13:21.262 INFO:teuthology.orchestra.run.smithi031.stdout:Architecture: amd64 2023-10-16T23:13:21.262 INFO:teuthology.orchestra.run.smithi031.stdout:Source: linux-meta 2023-10-16T23:13:21.262 INFO:teuthology.orchestra.run.smithi031.stdout:Version: 5.15.0.86.83 2023-10-16T23:13:21.262 INFO:teuthology.orchestra.run.smithi031.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-86), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-10-16T23:13:21.263 INFO:teuthology.orchestra.run.smithi031.stdout:Depends: linux-image-5.15.0-86-generic, linux-modules-extra-5.15.0-86-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-16T23:13:21.263 INFO:teuthology.orchestra.run.smithi031.stdout:Recommends: thermald 2023-10-16T23:13:21.263 INFO:teuthology.orchestra.run.smithi031.stdout:Description: Generic Linux kernel image 2023-10-16T23:13:21.263 INFO:teuthology.orchestra.run.smithi031.stdout: This package will always depend on the latest generic kernel image 2023-10-16T23:13:21.264 INFO:teuthology.orchestra.run.smithi031.stdout: available. 2023-10-16T23:13:21.264 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2023-10-16T23:13:21.265 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-10-16T23:13:21.266 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-16T23:13:21.266 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-16T23:13:21.309 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.wBwXefknbt 2023-10-16T23:13:21.310 DEBUG:teuthology.orchestra.run.smithi031:> sudo cp /boot/grub/grub.cfg /tmp/tmp.wBwXefknbt 2023-10-16T23:13:21.345 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-86-generic 2023-10-16T23:13:21.345 DEBUG:teuthology.orchestra.run.smithi138:> sudo update-grub 2023-10-16T23:13:21.366 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.wBwXefknbt 2023-10-16T23:13:21.478 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.wBwXefknbt is 10KB 2023-10-16T23:13:21.491 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.wBwXefknbt 2023-10-16T23:13:21.497 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-16T23:13:21.553 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-16T23:13:21.553 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-16T23:13:21.553 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-16T23:13:21.620 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-86-generic 2023-10-16T23:13:21.620 DEBUG:teuthology.orchestra.run.smithi031:> sudo update-grub 2023-10-16T23:13:22.142 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2023-10-16T23:13:22.160 DEBUG:teuthology.orchestra.run.smithi012:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-16T23:13:22.225 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2023-10-16T23:13:22.266 INFO:teuthology.orchestra.run.smithi033.stderr:Sourcing file `/etc/default/grub' 2023-10-16T23:13:22.267 INFO:teuthology.orchestra.run.smithi033.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-16T23:13:22.270 INFO:teuthology.orchestra.run.smithi033.stderr:Generating grub configuration file ... 2023-10-16T23:13:22.413 INFO:teuthology.orchestra.run.smithi012.stdout:Building dependency tree... 2023-10-16T23:13:22.414 INFO:teuthology.orchestra.run.smithi012.stdout:Reading state information... 2023-10-16T23:13:22.445 INFO:teuthology.orchestra.run.smithi033.stderr:Found linux image: /boot/vmlinuz-5.15.0-86-generic 2023-10-16T23:13:22.452 INFO:teuthology.orchestra.run.smithi033.stderr:Found initrd image: /boot/initrd.img-5.15.0-86-generic 2023-10-16T23:13:22.544 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub' 2023-10-16T23:13:22.545 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-16T23:13:22.547 INFO:teuthology.orchestra.run.smithi138.stderr:Generating grub configuration file ... 2023-10-16T23:13:22.581 INFO:teuthology.orchestra.run.smithi012.stdout:linux-image-generic is already the newest version (5.15.0.86.83). 2023-10-16T23:13:22.581 INFO:teuthology.orchestra.run.smithi012.stdout:The following packages were automatically installed and are no longer required: 2023-10-16T23:13:22.582 INFO:teuthology.orchestra.run.smithi012.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-16T23:13:22.582 INFO:teuthology.orchestra.run.smithi012.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-16T23:13:22.583 INFO:teuthology.orchestra.run.smithi012.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-16T23:13:22.583 INFO:teuthology.orchestra.run.smithi012.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-16T23:13:22.583 INFO:teuthology.orchestra.run.smithi012.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-16T23:13:22.583 INFO:teuthology.orchestra.run.smithi012.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-16T23:13:22.611 INFO:teuthology.orchestra.run.smithi031.stderr:Sourcing file `/etc/default/grub' 2023-10-16T23:13:22.612 INFO:teuthology.orchestra.run.smithi031.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-16T23:13:22.614 INFO:teuthology.orchestra.run.smithi031.stderr:Generating grub configuration file ... 2023-10-16T23:13:22.624 INFO:teuthology.orchestra.run.smithi012.stdout:0 upgraded, 0 newly installed, 0 to remove and 268 not upgraded. 2023-10-16T23:13:22.626 DEBUG:teuthology.orchestra.run.smithi012:> dpkg -s linux-image-generic 2023-10-16T23:13:22.643 INFO:teuthology.orchestra.run.smithi012.stdout:Package: linux-image-generic 2023-10-16T23:13:22.643 INFO:teuthology.orchestra.run.smithi012.stdout:Status: install ok installed 2023-10-16T23:13:22.643 INFO:teuthology.orchestra.run.smithi012.stdout:Priority: optional 2023-10-16T23:13:22.643 INFO:teuthology.orchestra.run.smithi012.stdout:Section: kernel 2023-10-16T23:13:22.643 INFO:teuthology.orchestra.run.smithi012.stdout:Installed-Size: 20 2023-10-16T23:13:22.644 INFO:teuthology.orchestra.run.smithi012.stdout:Maintainer: Ubuntu Kernel Team 2023-10-16T23:13:22.644 INFO:teuthology.orchestra.run.smithi012.stdout:Architecture: amd64 2023-10-16T23:13:22.644 INFO:teuthology.orchestra.run.smithi012.stdout:Source: linux-meta 2023-10-16T23:13:22.644 INFO:teuthology.orchestra.run.smithi012.stdout:Version: 5.15.0.86.83 2023-10-16T23:13:22.644 INFO:teuthology.orchestra.run.smithi012.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-86), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-10-16T23:13:22.645 INFO:teuthology.orchestra.run.smithi012.stdout:Depends: linux-image-5.15.0-86-generic, linux-modules-extra-5.15.0-86-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-16T23:13:22.645 INFO:teuthology.orchestra.run.smithi012.stdout:Recommends: thermald 2023-10-16T23:13:22.645 INFO:teuthology.orchestra.run.smithi012.stdout:Description: Generic Linux kernel image 2023-10-16T23:13:22.645 INFO:teuthology.orchestra.run.smithi012.stdout: This package will always depend on the latest generic kernel image 2023-10-16T23:13:22.645 INFO:teuthology.orchestra.run.smithi012.stdout: available. 2023-10-16T23:13:22.646 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2023-10-16T23:13:22.655 INFO:teuthology.orchestra.run.smithi033.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-16T23:13:22.660 INFO:teuthology.orchestra.run.smithi033.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-16T23:13:22.689 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.U7kklTJZjZ 2023-10-16T23:13:22.689 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /boot/grub/grub.cfg /tmp/tmp.U7kklTJZjZ 2023-10-16T23:13:22.700 INFO:teuthology.orchestra.run.smithi033.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-16T23:13:22.705 INFO:teuthology.orchestra.run.smithi033.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-16T23:13:22.745 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.U7kklTJZjZ 2023-10-16T23:13:22.782 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-5.15.0-86-generic 2023-10-16T23:13:22.789 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-5.15.0-86-generic 2023-10-16T23:13:22.793 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.15.0-86-generic 2023-10-16T23:13:22.799 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.15.0-86-generic 2023-10-16T23:13:22.816 INFO:teuthology.orchestra.run.smithi033.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-16T23:13:22.817 INFO:teuthology.orchestra.run.smithi033.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-10-16T23:13:22.817 INFO:teuthology.orchestra.run.smithi033.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-16T23:13:22.844 INFO:teuthology.orchestra.run.smithi033.stderr:done 2023-10-16T23:13:22.853 DEBUG:teuthology.orchestra.run.smithi033:> sudo shutdown -r now 2023-10-16T23:13:22.869 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.U7kklTJZjZ is 10KB 2023-10-16T23:13:22.882 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.U7kklTJZjZ 2023-10-16T23:13:22.888 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-16T23:13:22.941 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-16T23:13:22.941 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-16T23:13:22.941 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-16T23:13:23.002 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-16T23:13:23.007 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-16T23:13:23.009 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-86-generic 2023-10-16T23:13:23.009 DEBUG:teuthology.orchestra.run.smithi012:> sudo update-grub 2023-10-16T23:13:23.049 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-16T23:13:23.057 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-16T23:13:23.099 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-16T23:13:23.105 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-16T23:13:23.146 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-16T23:13:23.151 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-16T23:13:23.184 INFO:teuthology.orchestra.run.smithi031.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-16T23:13:23.184 INFO:teuthology.orchestra.run.smithi031.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-10-16T23:13:23.184 INFO:teuthology.orchestra.run.smithi031.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-16T23:13:23.197 INFO:teuthology.orchestra.run.smithi031.stderr:done 2023-10-16T23:13:23.207 DEBUG:teuthology.orchestra.run.smithi031:> sudo shutdown -r now 2023-10-16T23:13:23.292 INFO:teuthology.orchestra.run.smithi138.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-16T23:13:23.293 INFO:teuthology.orchestra.run.smithi138.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-10-16T23:13:23.293 INFO:teuthology.orchestra.run.smithi138.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-16T23:13:23.304 INFO:teuthology.orchestra.run.smithi138.stderr:done 2023-10-16T23:13:23.320 DEBUG:teuthology.orchestra.run.smithi138:> sudo shutdown -r now 2023-10-16T23:13:24.151 INFO:teuthology.orchestra.run.smithi012.stderr:Sourcing file `/etc/default/grub' 2023-10-16T23:13:24.152 INFO:teuthology.orchestra.run.smithi012.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-16T23:13:24.154 INFO:teuthology.orchestra.run.smithi012.stderr:Generating grub configuration file ... 2023-10-16T23:13:24.310 INFO:teuthology.orchestra.run.smithi012.stderr:Found linux image: /boot/vmlinuz-5.15.0-86-generic 2023-10-16T23:13:24.317 INFO:teuthology.orchestra.run.smithi012.stderr:Found initrd image: /boot/initrd.img-5.15.0-86-generic 2023-10-16T23:13:24.525 INFO:teuthology.orchestra.run.smithi012.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-16T23:13:24.531 INFO:teuthology.orchestra.run.smithi012.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-16T23:13:24.574 INFO:teuthology.orchestra.run.smithi012.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-16T23:13:24.579 INFO:teuthology.orchestra.run.smithi012.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-16T23:13:24.709 INFO:teuthology.orchestra.run.smithi012.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-16T23:13:24.709 INFO:teuthology.orchestra.run.smithi012.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-10-16T23:13:24.709 INFO:teuthology.orchestra.run.smithi012.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-16T23:13:24.725 INFO:teuthology.orchestra.run.smithi012.stderr:done 2023-10-16T23:13:24.733 DEBUG:teuthology.orchestra.run.smithi012:> sudo shutdown -r now 2023-10-16T23:13:26.707 INFO:teuthology.orchestra.run.smithi072.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-16T23:13:26.707 INFO:teuthology.orchestra.run.smithi072.stdout:Sourcing file `/etc/default/grub' 2023-10-16T23:13:26.731 INFO:teuthology.orchestra.run.smithi072.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-16T23:13:26.744 INFO:teuthology.orchestra.run.smithi072.stdout:Generating grub configuration file ... 2023-10-16T23:13:27.040 INFO:teuthology.orchestra.run.smithi072.stdout:Found linux image: /boot/vmlinuz-5.15.0-86-generic 2023-10-16T23:13:27.095 INFO:teuthology.orchestra.run.smithi072.stdout:Found initrd image: /boot/initrd.img-5.15.0-86-generic 2023-10-16T23:13:27.382 INFO:teuthology.orchestra.run.smithi072.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-16T23:13:27.387 INFO:teuthology.orchestra.run.smithi072.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-16T23:13:27.469 INFO:teuthology.orchestra.run.smithi072.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-16T23:13:27.475 INFO:teuthology.orchestra.run.smithi072.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-16T23:13:27.768 INFO:teuthology.orchestra.run.smithi072.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-16T23:13:27.768 INFO:teuthology.orchestra.run.smithi072.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-10-16T23:13:27.768 INFO:teuthology.orchestra.run.smithi072.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-16T23:13:27.855 INFO:teuthology.orchestra.run.smithi072.stdout:done 2023-10-16T23:13:28.422 DEBUG:teuthology.orchestra.run.smithi072:> dpkg -s linux-image-generic 2023-10-16T23:13:28.448 INFO:teuthology.orchestra.run.smithi072.stdout:Package: linux-image-generic 2023-10-16T23:13:28.448 INFO:teuthology.orchestra.run.smithi072.stdout:Status: install ok installed 2023-10-16T23:13:28.448 INFO:teuthology.orchestra.run.smithi072.stdout:Priority: optional 2023-10-16T23:13:28.448 INFO:teuthology.orchestra.run.smithi072.stdout:Section: kernel 2023-10-16T23:13:28.448 INFO:teuthology.orchestra.run.smithi072.stdout:Installed-Size: 20 2023-10-16T23:13:28.449 INFO:teuthology.orchestra.run.smithi072.stdout:Maintainer: Ubuntu Kernel Team 2023-10-16T23:13:28.449 INFO:teuthology.orchestra.run.smithi072.stdout:Architecture: amd64 2023-10-16T23:13:28.449 INFO:teuthology.orchestra.run.smithi072.stdout:Source: linux-meta 2023-10-16T23:13:28.449 INFO:teuthology.orchestra.run.smithi072.stdout:Version: 5.15.0.86.83 2023-10-16T23:13:28.449 INFO:teuthology.orchestra.run.smithi072.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-86), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-10-16T23:13:28.450 INFO:teuthology.orchestra.run.smithi072.stdout:Depends: linux-image-5.15.0-86-generic, linux-modules-extra-5.15.0-86-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-16T23:13:28.450 INFO:teuthology.orchestra.run.smithi072.stdout:Recommends: thermald 2023-10-16T23:13:28.450 INFO:teuthology.orchestra.run.smithi072.stdout:Description: Generic Linux kernel image 2023-10-16T23:13:28.450 INFO:teuthology.orchestra.run.smithi072.stdout: This package will always depend on the latest generic kernel image 2023-10-16T23:13:28.450 INFO:teuthology.orchestra.run.smithi072.stdout: available. 2023-10-16T23:13:28.451 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-86-generic 2023-10-16T23:13:28.451 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-16T23:13:28.451 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-16T23:13:28.451 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-10-16T23:13:28.451 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi072.front.sepia.ceph.com, path=None, version=distro) 2023-10-16T23:13:28.452 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get clean 2023-10-16T23:13:28.615 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get update 2023-10-16T23:13:28.816 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-16T23:13:28.844 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-16T23:13:28.883 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-16T23:13:28.897 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-16T23:13:30.121 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2023-10-16T23:13:30.138 DEBUG:teuthology.orchestra.run.smithi072:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-16T23:13:30.200 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2023-10-16T23:13:30.382 INFO:teuthology.orchestra.run.smithi072.stdout:Building dependency tree... 2023-10-16T23:13:30.382 INFO:teuthology.orchestra.run.smithi072.stdout:Reading state information... 2023-10-16T23:13:30.544 INFO:teuthology.orchestra.run.smithi072.stdout:linux-image-generic is already the newest version (5.15.0.86.83). 2023-10-16T23:13:30.545 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages were automatically installed and are no longer required: 2023-10-16T23:13:30.545 INFO:teuthology.orchestra.run.smithi072.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-16T23:13:30.545 INFO:teuthology.orchestra.run.smithi072.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-16T23:13:30.545 INFO:teuthology.orchestra.run.smithi072.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-16T23:13:30.546 INFO:teuthology.orchestra.run.smithi072.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-16T23:13:30.546 INFO:teuthology.orchestra.run.smithi072.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-16T23:13:30.546 INFO:teuthology.orchestra.run.smithi072.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-16T23:13:30.583 INFO:teuthology.orchestra.run.smithi072.stdout:0 upgraded, 0 newly installed, 0 to remove and 268 not upgraded. 2023-10-16T23:13:30.585 DEBUG:teuthology.orchestra.run.smithi072:> dpkg -s linux-image-generic 2023-10-16T23:13:30.599 INFO:teuthology.orchestra.run.smithi072.stdout:Package: linux-image-generic 2023-10-16T23:13:30.599 INFO:teuthology.orchestra.run.smithi072.stdout:Status: install ok installed 2023-10-16T23:13:30.599 INFO:teuthology.orchestra.run.smithi072.stdout:Priority: optional 2023-10-16T23:13:30.600 INFO:teuthology.orchestra.run.smithi072.stdout:Section: kernel 2023-10-16T23:13:30.600 INFO:teuthology.orchestra.run.smithi072.stdout:Installed-Size: 20 2023-10-16T23:13:30.600 INFO:teuthology.orchestra.run.smithi072.stdout:Maintainer: Ubuntu Kernel Team 2023-10-16T23:13:30.600 INFO:teuthology.orchestra.run.smithi072.stdout:Architecture: amd64 2023-10-16T23:13:30.600 INFO:teuthology.orchestra.run.smithi072.stdout:Source: linux-meta 2023-10-16T23:13:30.601 INFO:teuthology.orchestra.run.smithi072.stdout:Version: 5.15.0.86.83 2023-10-16T23:13:30.601 INFO:teuthology.orchestra.run.smithi072.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-86), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-10-16T23:13:30.601 INFO:teuthology.orchestra.run.smithi072.stdout:Depends: linux-image-5.15.0-86-generic, linux-modules-extra-5.15.0-86-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-16T23:13:30.601 INFO:teuthology.orchestra.run.smithi072.stdout:Recommends: thermald 2023-10-16T23:13:30.601 INFO:teuthology.orchestra.run.smithi072.stdout:Description: Generic Linux kernel image 2023-10-16T23:13:30.602 INFO:teuthology.orchestra.run.smithi072.stdout: This package will always depend on the latest generic kernel image 2023-10-16T23:13:30.602 INFO:teuthology.orchestra.run.smithi072.stdout: available. 2023-10-16T23:13:30.602 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2023-10-16T23:13:30.644 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.qR704euYsY 2023-10-16T23:13:30.644 DEBUG:teuthology.orchestra.run.smithi072:> sudo cp /boot/grub/grub.cfg /tmp/tmp.qR704euYsY 2023-10-16T23:13:30.711 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.qR704euYsY 2023-10-16T23:13:30.841 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.qR704euYsY is 10KB 2023-10-16T23:13:30.854 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.qR704euYsY 2023-10-16T23:13:30.860 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-16T23:13:30.916 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-16T23:13:30.917 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-16T23:13:30.917 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-16T23:13:31.003 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-86-generic 2023-10-16T23:13:31.003 DEBUG:teuthology.orchestra.run.smithi072:> sudo update-grub 2023-10-16T23:13:33.036 INFO:teuthology.orchestra.run.smithi072.stderr:Sourcing file `/etc/default/grub' 2023-10-16T23:13:33.046 INFO:teuthology.orchestra.run.smithi072.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-16T23:13:33.060 INFO:teuthology.orchestra.run.smithi072.stderr:Generating grub configuration file ... 2023-10-16T23:13:33.272 INFO:teuthology.orchestra.run.smithi072.stderr:Found linux image: /boot/vmlinuz-5.15.0-86-generic 2023-10-16T23:13:33.278 INFO:teuthology.orchestra.run.smithi072.stderr:Found initrd image: /boot/initrd.img-5.15.0-86-generic 2023-10-16T23:13:33.523 INFO:teuthology.orchestra.run.smithi072.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-16T23:13:33.528 INFO:teuthology.orchestra.run.smithi072.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-16T23:13:33.567 INFO:teuthology.orchestra.run.smithi072.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-16T23:13:33.571 INFO:teuthology.orchestra.run.smithi072.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-16T23:13:33.688 INFO:teuthology.orchestra.run.smithi072.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-16T23:13:33.688 INFO:teuthology.orchestra.run.smithi072.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-10-16T23:13:33.689 INFO:teuthology.orchestra.run.smithi072.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-16T23:13:33.734 INFO:teuthology.orchestra.run.smithi072.stderr:done 2023-10-16T23:13:33.736 DEBUG:teuthology.orchestra.run.smithi072:> sudo shutdown -r now 2023-10-16T23:13:52.870 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-16T23:13:52.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-16T23:13:52.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:13:53.211 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-16T23:13:53.211 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-10-16T23:13:53.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:13:53.322 INFO:teuthology.task.kernel:Checking client client.2 for new kernel version... 2023-10-16T23:13:53.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-10-16T23:13:53.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:13:54.737 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-16T23:13:54.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-16T23:13:54.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:14:03.746 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-16T23:14:03.747 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-16T23:14:03.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:14:11.194 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-10-16T23:14:11.706 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-10-16T23:14:11.707 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-10-16T23:14:13.242 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-10-16T23:14:20.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-16T23:14:20.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:14:20.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-10-16T23:14:20.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:14:20.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-10-16T23:14:20.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:14:22.202 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-10-16T23:14:22.243 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-16T23:14:22.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:14:23.770 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-10-16T23:14:31.207 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-16T23:14:31.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:14:34.266 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-10-16T23:14:35.772 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-10-16T23:14:35.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:14:38.586 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-10-16T23:14:39.098 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-10-16T23:14:40.638 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-10-16T23:14:46.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-16T23:14:46.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:14:50.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-16T23:14:50.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:14:51.100 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-10-16T23:14:51.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:14:52.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-16T23:14:52.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:14:53.658 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-10-16T23:14:54.170 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-10-16T23:14:54.206 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-10-16T23:14:55.710 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-10-16T23:15:04.698 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-10-16T23:15:08.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-16T23:15:08.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:15:08.941 DEBUG:teuthology.orchestra.run.smithi033:> true 2023-10-16T23:15:09.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-10-16T23:15:09.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:15:09.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-10-16T23:15:09.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:15:09.314 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-10-16T23:15:09.455 DEBUG:teuthology.orchestra.run.smithi138:> true 2023-10-16T23:15:09.555 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-16T23:15:09.555 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.15.0-86-generic"... 2023-10-16T23:15:09.556 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2023-10-16T23:15:09.601 INFO:teuthology.orchestra.run.smithi033.stdout:5.15.0-86-generic 2023-10-16T23:15:09.601 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-86-generic vs 5.15.0-86-generic 2023-10-16T23:15:09.601 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-16T23:15:09.602 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-16T23:15:09.818 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-10-16T23:15:09.818 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-86-generic"... 2023-10-16T23:15:09.819 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2023-10-16T23:15:09.865 INFO:teuthology.orchestra.run.smithi031.stdout:5.15.0-86-generic 2023-10-16T23:15:09.865 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-86-generic vs 5.15.0-86-generic 2023-10-16T23:15:09.866 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-16T23:15:09.866 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-16T23:15:10.064 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-10-16T23:15:10.064 INFO:teuthology.task.kernel:Checking kernel version of client.2, want "5.15.0-86-generic"... 2023-10-16T23:15:10.064 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2023-10-16T23:15:10.112 INFO:teuthology.orchestra.run.smithi138.stdout:5.15.0-86-generic 2023-10-16T23:15:10.112 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-86-generic vs 5.15.0-86-generic 2023-10-16T23:15:10.113 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-16T23:15:10.113 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-16T23:15:10.603 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2023-10-16T23:15:10.603 DEBUG:teuthology.orchestra.run.smithi033:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-16T23:15:10.674 INFO:teuthology.orchestra.run.smithi033.stdout:ttyS1 2023-10-16T23:15:10.703 DEBUG:teuthology.parallel:result is None 2023-10-16T23:15:10.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-16T23:15:10.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:15:10.831 DEBUG:teuthology.orchestra.run.smithi012:> true 2023-10-16T23:15:10.867 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-16T23:15:10.868 DEBUG:teuthology.orchestra.run.smithi031:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-16T23:15:10.957 INFO:teuthology.orchestra.run.smithi031.stdout:ttyS1 2023-10-16T23:15:10.987 DEBUG:teuthology.parallel:result is None 2023-10-16T23:15:11.114 INFO:teuthology.task.kernel:Enabling kdb on client.2... 2023-10-16T23:15:11.115 DEBUG:teuthology.orchestra.run.smithi138:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-16T23:15:11.175 INFO:teuthology.orchestra.run.smithi138.stdout:ttyS1 2023-10-16T23:15:11.202 DEBUG:teuthology.parallel:result is None 2023-10-16T23:15:11.409 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-16T23:15:11.409 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-86-generic"... 2023-10-16T23:15:11.410 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2023-10-16T23:15:11.455 INFO:teuthology.orchestra.run.smithi012.stdout:5.15.0-86-generic 2023-10-16T23:15:11.456 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-86-generic vs 5.15.0-86-generic 2023-10-16T23:15:11.456 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-16T23:15:11.456 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-16T23:15:12.457 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-16T23:15:12.458 DEBUG:teuthology.orchestra.run.smithi012:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-16T23:15:12.546 INFO:teuthology.orchestra.run.smithi012.stdout:ttyS1 2023-10-16T23:15:12.573 DEBUG:teuthology.parallel:result is None 2023-10-16T23:15:19.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-16T23:15:19.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:15:19.702 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-10-16T23:15:37.704 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-16T23:15:37.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:15:37.937 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-10-16T23:15:39.231 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-16T23:15:39.231 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.15.0-86-generic"... 2023-10-16T23:15:39.231 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2023-10-16T23:15:39.237 INFO:teuthology.orchestra.run.smithi072.stdout:5.15.0-86-generic 2023-10-16T23:15:39.237 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-86-generic vs 5.15.0-86-generic 2023-10-16T23:15:39.238 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-16T23:15:39.238 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-16T23:15:40.238 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2023-10-16T23:15:40.239 DEBUG:teuthology.orchestra.run.smithi072:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-16T23:15:40.363 INFO:teuthology.orchestra.run.smithi072.stdout:ttyS1 2023-10-16T23:15:40.385 DEBUG:teuthology.parallel:result is None 2023-10-16T23:15:40.385 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-16T23:15:40.394 INFO:teuthology.task.internal:Creating test directory... 2023-10-16T23:15:40.395 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-16T23:15:40.397 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-16T23:15:40.400 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-16T23:15:40.403 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-16T23:15:40.406 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-16T23:15:40.413 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-16T23:15:40.434 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-16T23:15:40.484 INFO:teuthology.task.internal:Creating archive directory... 2023-10-16T23:15:40.484 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-16T23:15:40.487 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-16T23:15:40.489 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-16T23:15:40.492 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-16T23:15:40.494 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-16T23:15:40.516 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-16T23:15:40.534 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-16T23:15:40.534 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-16T23:15:40.541 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-16T23:15:40.550 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-16T23:15:40.553 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-16T23:15:40.555 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-16T23:15:40.565 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T23:15:40.565 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T23:15:40.572 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T23:15:40.573 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T23:15:40.573 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T23:15:40.576 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T23:15:40.580 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T23:15:40.586 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T23:15:40.620 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T23:15:40.628 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T23:15:40.630 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-16T23:15:40.637 INFO:teuthology.task.internal:Configuring sudo... 2023-10-16T23:15:40.637 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-16T23:15:40.640 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-16T23:15:40.642 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-16T23:15:40.645 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-16T23:15:40.647 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-16T23:15:40.660 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-16T23:15:40.669 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-16T23:15:40.669 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-16T23:15:40.697 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-16T23:15:40.699 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-16T23:15:40.702 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-16T23:15:40.704 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-16T23:15:40.710 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T23:15:40.748 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T23:15:40.796 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-16T23:15:40.796 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-16T23:15:40.862 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T23:15:40.868 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T23:15:40.913 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-16T23:15:40.913 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-16T23:15:40.978 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T23:15:40.984 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T23:15:41.033 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-16T23:15:41.033 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-16T23:15:41.096 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T23:15:41.102 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T23:15:41.151 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-16T23:15:41.151 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-16T23:15:41.213 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T23:15:41.219 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T23:15:41.264 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-10-16T23:15:41.265 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-16T23:15:41.339 DEBUG:teuthology.orchestra.run.smithi012:> sudo service rsyslog restart 2023-10-16T23:15:41.342 DEBUG:teuthology.orchestra.run.smithi031:> sudo service rsyslog restart 2023-10-16T23:15:41.344 DEBUG:teuthology.orchestra.run.smithi033:> sudo service rsyslog restart 2023-10-16T23:15:41.346 DEBUG:teuthology.orchestra.run.smithi072:> sudo service rsyslog restart 2023-10-16T23:15:41.349 DEBUG:teuthology.orchestra.run.smithi138:> sudo service rsyslog restart 2023-10-16T23:15:41.479 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-16T23:15:41.487 INFO:teuthology.task.internal:Starting timer... 2023-10-16T23:15:41.487 INFO:teuthology.run_tasks:Running task pcp... 2023-10-16T23:15:41.529 INFO:teuthology.run_tasks:Running task selinux... 2023-10-16T23:15:41.577 DEBUG:teuthology.task.selinux:Excluding smithi012: OS 'ubuntu' does not support SELinux 2023-10-16T23:15:41.577 DEBUG:teuthology.task.selinux:Excluding smithi031: OS 'ubuntu' does not support SELinux 2023-10-16T23:15:41.577 DEBUG:teuthology.task.selinux:Excluding smithi033: OS 'ubuntu' does not support SELinux 2023-10-16T23:15:41.578 DEBUG:teuthology.task.selinux:Excluding smithi072: OS 'ubuntu' does not support SELinux 2023-10-16T23:15:41.578 DEBUG:teuthology.task.selinux:Excluding smithi138: OS 'ubuntu' does not support SELinux 2023-10-16T23:15:41.578 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-16T23:15:41.579 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-10-16T23:15:41.579 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-16T23:15:41.579 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-16T23:15:41.628 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-16T23:15:41.632 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-16T23:15:41.746 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-16T23:15:41.761 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-16T23:15:41.762 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi012.front.sepia.ceph.com,smithi031.front.sepia.ceph.com,smithi033.front.sepia.ceph.com,smithi072.front.sepia.ceph.com,smithi138.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-16T23:23:34.147 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi012.front.sepia.ceph.com'), Remote(name='ubuntu@smithi031.front.sepia.ceph.com'), Remote(name='ubuntu@smithi033.front.sepia.ceph.com'), Remote(name='ubuntu@smithi072.front.sepia.ceph.com'), Remote(name='ubuntu@smithi138.front.sepia.ceph.com')] 2023-10-16T23:23:34.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-16T23:23:34.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:23:34.234 DEBUG:teuthology.orchestra.run.smithi012:> true 2023-10-16T23:23:34.359 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-16T23:23:34.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-10-16T23:23:34.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:23:34.437 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-10-16T23:23:34.554 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-10-16T23:23:34.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-16T23:23:34.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:23:34.633 DEBUG:teuthology.orchestra.run.smithi033:> true 2023-10-16T23:23:34.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-16T23:23:34.771 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-16T23:23:34.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:23:34.848 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-10-16T23:23:34.962 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-16T23:23:34.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-10-16T23:23:34.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T23:23:35.041 DEBUG:teuthology.orchestra.run.smithi138:> true 2023-10-16T23:23:35.154 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-10-16T23:23:35.156 INFO:teuthology.run_tasks:Running task clock... 2023-10-16T23:23:35.169 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-16T23:23:35.170 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-16T23:23:35.171 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T23:23:35.173 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-16T23:23:35.174 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T23:23:35.176 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-16T23:23:35.176 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T23:23:35.179 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-16T23:23:35.179 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T23:23:35.182 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-16T23:23:35.182 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T23:23:35.205 INFO:teuthology.orchestra.run.smithi031.stdout:16 Oct 23:23:35 ntpd[27888]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-10-16T23:23:35.205 INFO:teuthology.orchestra.run.smithi031.stdout:16 Oct 23:23:35 ntpd[27888]: Command line: ntpd -gq 2023-10-16T23:23:35.205 INFO:teuthology.orchestra.run.smithi031.stdout:16 Oct 23:23:35 ntpd[27888]: ---------------------------------------------------- 2023-10-16T23:23:35.205 INFO:teuthology.orchestra.run.smithi031.stdout:16 Oct 23:23:35 ntpd[27888]: ntp-4 is maintained by Network Time Foundation, 2023-10-16T23:23:35.206 INFO:teuthology.orchestra.run.smithi031.stdout:16 Oct 23:23:35 ntpd[27888]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-10-16T23:23:35.206 INFO:teuthology.orchestra.run.smithi031.stdout:16 Oct 23:23:35 ntpd[27888]: corporation. Support and training for ntp-4 are 2023-10-16T23:23:35.206 INFO:teuthology.orchestra.run.smithi031.stdout:16 Oct 23:23:35 ntpd[27888]: available at https://www.nwtime.org/support 2023-10-16T23:23:35.206 INFO:teuthology.orchestra.run.smithi031.stdout:16 Oct 23:23:35 ntpd[27888]: ---------------------------------------------------- 2023-10-16T23:23:35.207 INFO:teuthology.orchestra.run.smithi031.stdout:16 Oct 23:23:35 ntpd[27888]: proto: precision = 0.046 usec (-24) 2023-10-16T23:23:35.208 INFO:teuthology.orchestra.run.smithi031.stdout:16 Oct 23:23:35 ntpd[27888]: basedate set to 2022-02-04 2023-10-16T23:23:35.208 INFO:teuthology.orchestra.run.smithi031.stdout:16 Oct 23:23:35 ntpd[27888]: gps base set to 2022-02-06 (week 2196) 2023-10-16T23:23:35.208 INFO:teuthology.orchestra.run.smithi031.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-16T23:23:35.209 INFO:teuthology.orchestra.run.smithi012.stdout:16 Oct 23:23:35 ntpd[27901]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-10-16T23:23:35.209 INFO:teuthology.orchestra.run.smithi012.stdout:16 Oct 23:23:35 ntpd[27901]: Command line: ntpd -gq 2023-10-16T23:23:35.209 INFO:teuthology.orchestra.run.smithi012.stdout:16 Oct 23:23:35 ntpd[27901]: ---------------------------------------------------- 2023-10-16T23:23:35.209 INFO:teuthology.orchestra.run.smithi012.stdout:16 Oct 23:23:35 ntpd[27901]: ntp-4 is maintained by Network Time Foundation, 2023-10-16T23:23:35.209 INFO:teuthology.orchestra.run.smithi012.stdout:16 Oct 23:23:35 ntpd[27901]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-10-16T23:23:35.210 INFO:teuthology.orchestra.run.smithi012.stdout:16 Oct 23:23:35 ntpd[27901]: corporation. Support and training for ntp-4 are 2023-10-16T23:23:35.210 INFO:teuthology.orchestra.run.smithi012.stdout:16 Oct 23:23:35 ntpd[27901]: available at https://www.nwtime.org/support 2023-10-16T23:23:35.210 INFO:teuthology.orchestra.run.smithi012.stdout:16 Oct 23:23:35 ntpd[27901]: ---------------------------------------------------- 2023-10-16T23:23:35.210 INFO:teuthology.orchestra.run.smithi012.stdout:16 Oct 23:23:35 ntpd[27901]: proto: precision = 0.062 usec (-24) 2023-10-16T23:23:35.210 INFO:teuthology.orchestra.run.smithi012.stdout:16 Oct 23:23:35 ntpd[27901]: basedate set to 2022-02-04 2023-10-16T23:23:35.211 INFO:teuthology.orchestra.run.smithi012.stdout:16 Oct 23:23:35 ntpd[27901]: gps base set to 2022-02-06 (week 2196) 2023-10-16T23:23:35.211 INFO:teuthology.orchestra.run.smithi012.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-16T23:23:35.211 INFO:teuthology.orchestra.run.smithi031.stdout:16 Oct 23:23:35 ntpd[27888]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-16T23:23:35.212 INFO:teuthology.orchestra.run.smithi031.stdout:16 Oct 23:23:35 ntpd[27888]: restrict ::: KOD does nothing without LIMITED. 2023-10-16T23:23:35.212 INFO:teuthology.orchestra.run.smithi031.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-16T23:23:35.212 INFO:teuthology.orchestra.run.smithi012.stdout:16 Oct 23:23:35 ntpd[27901]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-16T23:23:35.213 INFO:teuthology.orchestra.run.smithi012.stdout:16 Oct 23:23:35 ntpd[27901]: restrict ::: KOD does nothing without LIMITED. 2023-10-16T23:23:35.213 INFO:teuthology.orchestra.run.smithi012.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-16T23:23:35.215 INFO:teuthology.orchestra.run.smithi031.stdout:16 Oct 23:23:35 ntpd[27888]: Listen and drop on 0 v6wildcard [::]:123 2023-10-16T23:23:35.215 INFO:teuthology.orchestra.run.smithi031.stdout:16 Oct 23:23:35 ntpd[27888]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-16T23:23:35.216 INFO:teuthology.orchestra.run.smithi031.stdout:16 Oct 23:23:35 ntpd[27888]: Listen normally on 2 lo 127.0.0.1:123 2023-10-16T23:23:35.216 INFO:teuthology.orchestra.run.smithi031.stdout:16 Oct 23:23:35 ntpd[27888]: Listen normally on 3 ens1f0 172.21.15.31:123 2023-10-16T23:23:35.216 INFO:teuthology.orchestra.run.smithi031.stdout:16 Oct 23:23:35 ntpd[27888]: Listen normally on 4 lo [::1]:123 2023-10-16T23:23:35.216 INFO:teuthology.orchestra.run.smithi031.stdout:16 Oct 23:23:35 ntpd[27888]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fea5:caba%4]:123 2023-10-16T23:23:35.216 INFO:teuthology.orchestra.run.smithi031.stdout:16 Oct 23:23:35 ntpd[27888]: Listening on routing socket on fd #22 for interface updates 2023-10-16T23:23:35.217 INFO:teuthology.orchestra.run.smithi072.stdout:16 Oct 23:23:35 ntpd[28062]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-10-16T23:23:35.217 INFO:teuthology.orchestra.run.smithi072.stdout:16 Oct 23:23:35 ntpd[28062]: Command line: ntpd -gq 2023-10-16T23:23:35.218 INFO:teuthology.orchestra.run.smithi072.stdout:16 Oct 23:23:35 ntpd[28062]: ---------------------------------------------------- 2023-10-16T23:23:35.218 INFO:teuthology.orchestra.run.smithi072.stdout:16 Oct 23:23:35 ntpd[28062]: ntp-4 is maintained by Network Time Foundation, 2023-10-16T23:23:35.218 INFO:teuthology.orchestra.run.smithi072.stdout:16 Oct 23:23:35 ntpd[28062]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-10-16T23:23:35.218 INFO:teuthology.orchestra.run.smithi072.stdout:16 Oct 23:23:35 ntpd[28062]: corporation. Support and training for ntp-4 are 2023-10-16T23:23:35.218 INFO:teuthology.orchestra.run.smithi072.stdout:16 Oct 23:23:35 ntpd[28062]: available at https://www.nwtime.org/support 2023-10-16T23:23:35.219 INFO:teuthology.orchestra.run.smithi072.stdout:16 Oct 23:23:35 ntpd[28062]: ---------------------------------------------------- 2023-10-16T23:23:35.219 INFO:teuthology.orchestra.run.smithi072.stdout:16 Oct 23:23:35 ntpd[28062]: proto: precision = 0.057 usec (-24) 2023-10-16T23:23:35.219 INFO:teuthology.orchestra.run.smithi072.stdout:16 Oct 23:23:35 ntpd[28062]: basedate set to 2022-02-04 2023-10-16T23:23:35.219 INFO:teuthology.orchestra.run.smithi072.stdout:16 Oct 23:23:35 ntpd[28062]: gps base set to 2022-02-06 (week 2196) 2023-10-16T23:23:35.220 INFO:teuthology.orchestra.run.smithi012.stdout:16 Oct 23:23:35 ntpd[27901]: Listen and drop on 0 v6wildcard [::]:123 2023-10-16T23:23:35.220 INFO:teuthology.orchestra.run.smithi012.stdout:16 Oct 23:23:35 ntpd[27901]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-16T23:23:35.220 INFO:teuthology.orchestra.run.smithi012.stdout:16 Oct 23:23:35 ntpd[27901]: Listen normally on 2 lo 127.0.0.1:123 2023-10-16T23:23:35.220 INFO:teuthology.orchestra.run.smithi012.stdout:16 Oct 23:23:35 ntpd[27901]: Listen normally on 3 ens1f0 172.21.15.12:123 2023-10-16T23:23:35.221 INFO:teuthology.orchestra.run.smithi012.stdout:16 Oct 23:23:35 ntpd[27901]: Listen normally on 4 lo [::1]:123 2023-10-16T23:23:35.221 INFO:teuthology.orchestra.run.smithi012.stdout:16 Oct 23:23:35 ntpd[27901]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:25ea%4]:123 2023-10-16T23:23:35.221 INFO:teuthology.orchestra.run.smithi012.stdout:16 Oct 23:23:35 ntpd[27901]: Listening on routing socket on fd #22 for interface updates 2023-10-16T23:23:35.221 INFO:teuthology.orchestra.run.smithi072.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-16T23:23:35.221 INFO:teuthology.orchestra.run.smithi033.stdout:16 Oct 23:23:35 ntpd[27921]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-10-16T23:23:35.222 INFO:teuthology.orchestra.run.smithi033.stdout:16 Oct 23:23:35 ntpd[27921]: Command line: ntpd -gq 2023-10-16T23:23:35.222 INFO:teuthology.orchestra.run.smithi033.stdout:16 Oct 23:23:35 ntpd[27921]: ---------------------------------------------------- 2023-10-16T23:23:35.222 INFO:teuthology.orchestra.run.smithi033.stdout:16 Oct 23:23:35 ntpd[27921]: ntp-4 is maintained by Network Time Foundation, 2023-10-16T23:23:35.222 INFO:teuthology.orchestra.run.smithi033.stdout:16 Oct 23:23:35 ntpd[27921]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-10-16T23:23:35.223 INFO:teuthology.orchestra.run.smithi033.stdout:16 Oct 23:23:35 ntpd[27921]: corporation. Support and training for ntp-4 are 2023-10-16T23:23:35.223 INFO:teuthology.orchestra.run.smithi033.stdout:16 Oct 23:23:35 ntpd[27921]: available at https://www.nwtime.org/support 2023-10-16T23:23:35.223 INFO:teuthology.orchestra.run.smithi033.stdout:16 Oct 23:23:35 ntpd[27921]: ---------------------------------------------------- 2023-10-16T23:23:35.223 INFO:teuthology.orchestra.run.smithi033.stdout:16 Oct 23:23:35 ntpd[27921]: proto: precision = 0.045 usec (-24) 2023-10-16T23:23:35.223 INFO:teuthology.orchestra.run.smithi033.stdout:16 Oct 23:23:35 ntpd[27921]: basedate set to 2022-02-04 2023-10-16T23:23:35.223 INFO:teuthology.orchestra.run.smithi033.stdout:16 Oct 23:23:35 ntpd[27921]: gps base set to 2022-02-06 (week 2196) 2023-10-16T23:23:35.224 INFO:teuthology.orchestra.run.smithi033.stdout:16 Oct 23:23:35 ntpd[27921]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-16T23:23:35.224 INFO:teuthology.orchestra.run.smithi033.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-16T23:23:35.224 INFO:teuthology.orchestra.run.smithi033.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-16T23:23:35.225 INFO:teuthology.orchestra.run.smithi072.stdout:16 Oct 23:23:35 ntpd[28062]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-16T23:23:35.225 INFO:teuthology.orchestra.run.smithi072.stdout:16 Oct 23:23:35 ntpd[28062]: restrict ::: KOD does nothing without LIMITED. 2023-10-16T23:23:35.226 INFO:teuthology.orchestra.run.smithi072.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-16T23:23:35.227 INFO:teuthology.orchestra.run.smithi138.stdout:16 Oct 23:23:35 ntpd[27989]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-10-16T23:23:35.228 INFO:teuthology.orchestra.run.smithi138.stdout:16 Oct 23:23:35 ntpd[27989]: Command line: ntpd -gq 2023-10-16T23:23:35.228 INFO:teuthology.orchestra.run.smithi138.stdout:16 Oct 23:23:35 ntpd[27989]: ---------------------------------------------------- 2023-10-16T23:23:35.228 INFO:teuthology.orchestra.run.smithi138.stdout:16 Oct 23:23:35 ntpd[27989]: ntp-4 is maintained by Network Time Foundation, 2023-10-16T23:23:35.228 INFO:teuthology.orchestra.run.smithi138.stdout:16 Oct 23:23:35 ntpd[27989]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-10-16T23:23:35.228 INFO:teuthology.orchestra.run.smithi138.stdout:16 Oct 23:23:35 ntpd[27989]: corporation. Support and training for ntp-4 are 2023-10-16T23:23:35.229 INFO:teuthology.orchestra.run.smithi138.stdout:16 Oct 23:23:35 ntpd[27989]: available at https://www.nwtime.org/support 2023-10-16T23:23:35.229 INFO:teuthology.orchestra.run.smithi138.stdout:16 Oct 23:23:35 ntpd[27989]: ---------------------------------------------------- 2023-10-16T23:23:35.229 INFO:teuthology.orchestra.run.smithi138.stdout:16 Oct 23:23:35 ntpd[27989]: proto: precision = 0.057 usec (-24) 2023-10-16T23:23:35.229 INFO:teuthology.orchestra.run.smithi138.stdout:16 Oct 23:23:35 ntpd[27989]: basedate set to 2022-02-04 2023-10-16T23:23:35.229 INFO:teuthology.orchestra.run.smithi138.stdout:16 Oct 23:23:35 ntpd[27989]: gps base set to 2022-02-06 (week 2196) 2023-10-16T23:23:35.230 INFO:teuthology.orchestra.run.smithi138.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-16T23:23:35.231 INFO:teuthology.orchestra.run.smithi033.stdout:16 Oct 23:23:35 ntpd[27921]: restrict ::: KOD does nothing without LIMITED. 2023-10-16T23:23:35.231 INFO:teuthology.orchestra.run.smithi033.stdout:16 Oct 23:23:35 ntpd[27921]: Listen and drop on 0 v6wildcard [::]:123 2023-10-16T23:23:35.231 INFO:teuthology.orchestra.run.smithi033.stdout:16 Oct 23:23:35 ntpd[27921]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-16T23:23:35.231 INFO:teuthology.orchestra.run.smithi033.stdout:16 Oct 23:23:35 ntpd[27921]: Listen normally on 2 lo 127.0.0.1:123 2023-10-16T23:23:35.231 INFO:teuthology.orchestra.run.smithi033.stdout:16 Oct 23:23:35 ntpd[27921]: Listen normally on 3 ens1f0 172.21.15.33:123 2023-10-16T23:23:35.232 INFO:teuthology.orchestra.run.smithi033.stdout:16 Oct 23:23:35 ntpd[27921]: Listen normally on 4 lo [::1]:123 2023-10-16T23:23:35.232 INFO:teuthology.orchestra.run.smithi033.stdout:16 Oct 23:23:35 ntpd[27921]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fea5:d294%4]:123 2023-10-16T23:23:35.232 INFO:teuthology.orchestra.run.smithi033.stdout:16 Oct 23:23:35 ntpd[27921]: Listening on routing socket on fd #22 for interface updates 2023-10-16T23:23:35.232 INFO:teuthology.orchestra.run.smithi072.stdout:16 Oct 23:23:35 ntpd[28062]: Listen and drop on 0 v6wildcard [::]:123 2023-10-16T23:23:35.232 INFO:teuthology.orchestra.run.smithi072.stdout:16 Oct 23:23:35 ntpd[28062]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-16T23:23:35.233 INFO:teuthology.orchestra.run.smithi072.stdout:16 Oct 23:23:35 ntpd[28062]: Listen normally on 2 lo 127.0.0.1:123 2023-10-16T23:23:35.233 INFO:teuthology.orchestra.run.smithi072.stdout:16 Oct 23:23:35 ntpd[28062]: Listen normally on 3 enp3s0f1 172.21.15.72:123 2023-10-16T23:23:35.233 INFO:teuthology.orchestra.run.smithi072.stdout:16 Oct 23:23:35 ntpd[28062]: Listen normally on 4 lo [::1]:123 2023-10-16T23:23:35.233 INFO:teuthology.orchestra.run.smithi072.stdout:16 Oct 23:23:35 ntpd[28062]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:b765%5]:123 2023-10-16T23:23:35.233 INFO:teuthology.orchestra.run.smithi072.stdout:16 Oct 23:23:35 ntpd[28062]: Listening on routing socket on fd #22 for interface updates 2023-10-16T23:23:35.234 INFO:teuthology.orchestra.run.smithi138.stdout:16 Oct 23:23:35 ntpd[27989]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-16T23:23:35.234 INFO:teuthology.orchestra.run.smithi138.stdout:16 Oct 23:23:35 ntpd[27989]: restrict ::: KOD does nothing without LIMITED. 2023-10-16T23:23:35.234 INFO:teuthology.orchestra.run.smithi138.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-16T23:23:35.235 INFO:teuthology.orchestra.run.smithi138.stdout:16 Oct 23:23:35 ntpd[27989]: Listen and drop on 0 v6wildcard [::]:123 2023-10-16T23:23:35.235 INFO:teuthology.orchestra.run.smithi138.stdout:16 Oct 23:23:35 ntpd[27989]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-16T23:23:35.235 INFO:teuthology.orchestra.run.smithi138.stdout:16 Oct 23:23:35 ntpd[27989]: Listen normally on 2 lo 127.0.0.1:123 2023-10-16T23:23:35.236 INFO:teuthology.orchestra.run.smithi138.stdout:16 Oct 23:23:35 ntpd[27989]: Listen normally on 3 enp3s0f1 172.21.15.138:123 2023-10-16T23:23:35.236 INFO:teuthology.orchestra.run.smithi138.stdout:16 Oct 23:23:35 ntpd[27989]: Listen normally on 4 lo [::1]:123 2023-10-16T23:23:35.236 INFO:teuthology.orchestra.run.smithi138.stdout:16 Oct 23:23:35 ntpd[27989]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f71%5]:123 2023-10-16T23:23:35.236 INFO:teuthology.orchestra.run.smithi138.stdout:16 Oct 23:23:35 ntpd[27989]: Listening on routing socket on fd #22 for interface updates 2023-10-16T23:23:36.206 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:36 ntpd[27888]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:36.206 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:36 ntpd[27888]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:36.207 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:36 ntpd[27888]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:36.207 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:36 ntpd[27888]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:36.207 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:36 ntpd[27888]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:36.207 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:36 ntpd[27888]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:36.207 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:36 ntpd[27888]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:36.208 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:36 ntpd[27888]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:36.208 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:36 ntpd[27888]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:36.208 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:36 ntpd[27888]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:36.208 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:36 ntpd[27888]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:36.208 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:36 ntpd[27888]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:36.208 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:36 ntpd[27888]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:36.209 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:36 ntpd[27888]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:36.210 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:36 ntpd[27921]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:36.210 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:36 ntpd[27921]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:36.211 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:36 ntpd[27921]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:36.211 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:36 ntpd[27921]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:36.211 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:36 ntpd[27921]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:36.211 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:36 ntpd[27921]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:36.212 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:36 ntpd[27901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:36.212 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:36 ntpd[27901]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:36.212 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:36 ntpd[27901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:36.212 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:36 ntpd[27901]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:36.212 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:36 ntpd[27901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:36.212 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:36 ntpd[27901]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:36.213 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:36 ntpd[27901]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:36.213 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:36 ntpd[27901]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:36.214 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:36 ntpd[28062]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:36.214 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:36 ntpd[28062]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:36.214 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:36 ntpd[28062]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:36.214 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:36 ntpd[28062]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:36.215 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:36 ntpd[28062]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:36.215 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:36 ntpd[28062]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:36.215 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:36 ntpd[28062]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:36.215 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:36 ntpd[28062]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:36.226 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:36 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:36.226 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:36 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:36.226 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:36 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:36.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:36 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:36.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:36 ntpd[27989]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:36.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:36 ntpd[27989]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:37.205 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:37 ntpd[27888]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:37.206 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:37 ntpd[27888]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:37.206 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:37 ntpd[27888]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:37.206 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:37 ntpd[27888]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:37.206 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:37 ntpd[27888]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:37.207 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:37 ntpd[27888]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:37 ntpd[27921]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:37 ntpd[27921]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:37 ntpd[27921]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:37 ntpd[27921]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:37.210 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:37 ntpd[27921]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:37.210 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:37 ntpd[27921]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:37.226 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:37 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:37.226 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:37 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:37.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:37 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:37.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:37 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:37.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:37 ntpd[27989]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:37.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:37 ntpd[27989]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:38.206 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:38 ntpd[27888]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:38.206 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:38 ntpd[27888]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:38.206 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:38 ntpd[27888]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:38.207 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:38 ntpd[27888]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:38.207 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:38 ntpd[27888]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:38.207 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:38 ntpd[27888]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:38.207 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:38 ntpd[27888]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:38.207 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:38 ntpd[27888]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:38.208 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:38 ntpd[27888]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:38.208 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:38 ntpd[27888]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:38.208 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:38 ntpd[27888]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:38.208 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:38 ntpd[27888]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:38.210 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:38 ntpd[27901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:38.210 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:38 ntpd[27901]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:38.210 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:38 ntpd[27901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:38.210 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:38 ntpd[27901]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:38.211 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:38 ntpd[27901]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:38.211 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:38 ntpd[27901]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:38.212 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:38 ntpd[27921]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:38.212 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:38 ntpd[27921]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:38.212 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:38 ntpd[27921]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:38.212 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:38 ntpd[27921]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:38.212 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:38 ntpd[27921]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:38.213 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:38 ntpd[27921]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:38.213 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:38 ntpd[27921]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:38.213 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:38 ntpd[27921]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:38.213 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:38 ntpd[27921]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:38.213 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:38 ntpd[27921]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:38.214 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:38 ntpd[27921]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:38.214 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:38 ntpd[27921]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:38.215 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:38 ntpd[28062]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:38.215 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:38 ntpd[28062]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:38.215 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:38 ntpd[28062]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:38.215 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:38 ntpd[28062]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:38.216 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:38 ntpd[28062]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:38.216 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:38 ntpd[28062]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:38.226 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:38 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:38.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:38 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:38.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:38 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:38.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:38 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:38.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:38 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:38.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:38 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:38.228 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:38 ntpd[27989]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:38.228 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:38 ntpd[27989]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:38.228 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:38 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:38.228 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:38 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:38.228 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:38 ntpd[27989]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:38.228 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:38 ntpd[27989]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:39.205 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:39 ntpd[27888]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:39.206 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:39 ntpd[27888]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:39.206 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:39 ntpd[27888]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:39.206 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:39 ntpd[27888]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:39.206 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:39 ntpd[27888]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:39.207 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:39 ntpd[27888]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:39.210 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:39 ntpd[27921]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:39.210 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:39 ntpd[27921]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:39.210 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:39 ntpd[27921]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:39.210 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:39 ntpd[27921]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:39.211 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:39 ntpd[27921]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:39.211 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:39 ntpd[27921]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:39.212 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:39 ntpd[28062]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:39.212 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:39 ntpd[28062]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:39.212 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:39 ntpd[28062]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:39.212 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:39 ntpd[28062]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:39.213 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:39 ntpd[28062]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:39.213 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:39 ntpd[28062]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:39.226 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:39 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:39.226 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:39 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:39.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:39 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:39.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:39 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:39.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:39 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:39.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:39 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:39.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:39 ntpd[27989]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:39.228 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:39 ntpd[27989]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:40.206 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:40 ntpd[27888]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:40.206 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:40 ntpd[27888]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:40.207 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:40 ntpd[27888]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:40.207 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:40 ntpd[27888]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:40.207 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:40 ntpd[27888]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:40.207 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:40 ntpd[27888]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:40.207 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:40 ntpd[27888]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:40.208 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:40 ntpd[27888]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:40.208 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:40 ntpd[27888]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:40.208 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:40 ntpd[27888]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:40.208 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:40 ntpd[27888]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:40.208 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:40 ntpd[27888]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:40.211 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:40 ntpd[27921]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:40.212 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:40 ntpd[27921]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:40.212 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:40 ntpd[27921]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:40.212 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:40 ntpd[27921]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:40.212 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:40 ntpd[27921]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:40.212 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:40 ntpd[27921]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:40.212 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:40 ntpd[27921]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:40.213 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:40 ntpd[27921]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:40.213 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:40 ntpd[27921]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:40.213 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:40 ntpd[27921]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:40.213 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:40 ntpd[27921]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:40.213 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:40 ntpd[27921]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:40.213 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:40 ntpd[27921]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:40.214 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:40 ntpd[27921]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:40.214 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:40 ntpd[27901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:40.215 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:40 ntpd[27901]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:40.215 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:40 ntpd[27901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:40.215 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:40 ntpd[27901]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:40.215 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:40 ntpd[27901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:40.216 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:40 ntpd[27901]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:40.216 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:40 ntpd[27901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:40.216 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:40 ntpd[27901]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:40.216 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:40 ntpd[27901]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:40.216 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:40 ntpd[27901]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:40 ntpd[27901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:40 ntpd[27901]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:40 ntpd[27901]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:40 ntpd[27901]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:40 ntpd[27901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:40 ntpd[27901]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:40 ntpd[27901]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:40.218 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:40 ntpd[27901]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:40.219 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:40 ntpd[28062]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:40.219 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:40 ntpd[28062]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:40.220 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:40 ntpd[28062]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:40.220 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:40 ntpd[28062]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:40.220 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:40 ntpd[28062]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:40.220 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:40 ntpd[28062]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:40.220 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:40 ntpd[28062]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:40.220 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:40 ntpd[28062]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:40.221 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:40 ntpd[28062]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:40.221 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:40 ntpd[28062]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:40.221 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:40 ntpd[28062]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:40.221 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:40 ntpd[28062]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:40.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:40 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:40.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:40 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:40.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:40 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:40.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:40 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:40.228 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:40 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:40.228 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:40 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:40.228 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:40 ntpd[27989]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:40.228 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:40 ntpd[27989]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:40.229 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:40 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:40.229 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:40 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:40.230 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:40 ntpd[27989]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:40.230 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:40 ntpd[27989]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:41.205 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:41 ntpd[27888]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:41.206 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:41 ntpd[27888]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:41.206 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:41 ntpd[27888]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:41.206 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:41 ntpd[27888]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:41.207 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:41 ntpd[27888]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:41.207 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:41 ntpd[27888]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:41.209 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:41 ntpd[27921]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:41.209 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:41 ntpd[27921]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:41.209 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:41 ntpd[27921]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:41.210 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:41 ntpd[27921]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:41.210 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:41 ntpd[27921]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:41.210 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:41 ntpd[27921]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:41.211 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:41 ntpd[28062]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:41.211 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:41 ntpd[28062]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:41.211 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:41 ntpd[28062]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:41.212 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:41 ntpd[28062]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:41.212 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:41 ntpd[28062]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:41.212 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:41 ntpd[28062]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:41.226 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:41 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:41.226 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:41 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:41.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:41 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:41.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:41 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:41.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:41 ntpd[27989]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:41.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:41 ntpd[27989]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:42.206 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:42 ntpd[27888]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:42.206 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:42 ntpd[27888]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:42.206 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:42 ntpd[27888]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:42.206 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:42 ntpd[27888]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:42.207 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:42 ntpd[27888]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:42.207 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:42 ntpd[27888]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:42.207 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:42 ntpd[27888]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:42.207 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:42 ntpd[27888]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:42.208 INFO:teuthology.orchestra.run.smithi031.stdout:16 Oct 23:23:42 ntpd[27888]: ntpd: time slew -0.000307 s 2023-10-16T23:23:42.208 INFO:teuthology.orchestra.run.smithi031.stdout:ntpd: time slew -0.000307s 2023-10-16T23:23:42.208 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:42 ntpd[27888]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-16T23:23:42.209 INFO:teuthology.orchestra.run.smithi031.stderr:16 Oct 23:23:42 ntpd[27888]: can't open /var/log/ntpstats/loopstats.20231016: Permission denied 2023-10-16T23:23:42.211 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:42 ntpd[27921]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:42.211 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:42 ntpd[27921]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:42.211 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:42 ntpd[27921]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:42.211 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:42 ntpd[27921]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:42.212 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:42 ntpd[27921]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:42.212 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:42 ntpd[27921]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:42.212 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:42 ntpd[27921]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:42.212 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:42 ntpd[27921]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:42.213 INFO:teuthology.orchestra.run.smithi033.stdout:16 Oct 23:23:42 ntpd[27921]: ntpd: time slew -0.000743 s 2023-10-16T23:23:42.213 INFO:teuthology.orchestra.run.smithi033.stdout:ntpd: time slew -0.000743s 2023-10-16T23:23:42.214 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:42 ntpd[27921]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-16T23:23:42.214 INFO:teuthology.orchestra.run.smithi033.stderr:16 Oct 23:23:42 ntpd[27921]: can't open /var/log/ntpstats/loopstats.20231016: Permission denied 2023-10-16T23:23:42.215 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:42 ntpd[27901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:42.215 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:42 ntpd[27901]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:42.216 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:42 ntpd[27901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:42.216 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:42 ntpd[27901]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:42.216 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:42 ntpd[27901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:42.216 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:42 ntpd[27901]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:42.216 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:42 ntpd[27901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:42.217 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:42 ntpd[27901]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:42.217 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:42 ntpd[27901]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:42.217 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:42 ntpd[27901]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:42.217 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:42 ntpd[27901]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:42.217 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:42 ntpd[27901]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:42.218 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:42 ntpd[27901]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:42.218 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:42 ntpd[27901]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:42.218 INFO:teuthology.orchestra.run.smithi012.stdout:16 Oct 23:23:42 ntpd[27901]: ntpd: time slew -0.000381 s 2023-10-16T23:23:42.219 INFO:teuthology.orchestra.run.smithi012.stdout:ntpd: time slew -0.000381s 2023-10-16T23:23:42.220 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:42 ntpd[27901]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-16T23:23:42.220 INFO:teuthology.orchestra.run.smithi012.stderr:16 Oct 23:23:42 ntpd[27901]: can't open /var/log/ntpstats/loopstats.20231016: Permission denied 2023-10-16T23:23:42.220 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:42 ntpd[28062]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:42.221 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:42 ntpd[28062]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:42.221 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:42 ntpd[28062]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:42.221 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:42 ntpd[28062]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:42.221 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:42 ntpd[28062]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:42.222 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:42 ntpd[28062]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:42.222 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:42 ntpd[28062]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:42.222 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:42 ntpd[28062]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:42.222 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:42 ntpd[28062]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:42.222 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:42 ntpd[28062]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:42.223 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:42 ntpd[28062]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:42.223 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:42 ntpd[28062]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:42.223 INFO:teuthology.orchestra.run.smithi072.stdout:16 Oct 23:23:42 ntpd[28062]: ntpd: time slew -0.002112 s 2023-10-16T23:23:42.224 INFO:teuthology.orchestra.run.smithi072.stdout:ntpd: time slew -0.002112s 2023-10-16T23:23:42.224 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:42 ntpd[28062]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-16T23:23:42.224 INFO:teuthology.orchestra.run.smithi072.stderr:16 Oct 23:23:42 ntpd[28062]: can't open /var/log/ntpstats/loopstats.20231016: Permission denied 2023-10-16T23:23:42.226 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:42 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:42.226 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:42 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:42.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:42 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:42.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:42 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:42.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:42 ntpd[27989]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-16T23:23:42.227 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:42 ntpd[27989]: can't open /var/log/ntpstats/rawstats.20231016: Permission denied 2023-10-16T23:23:42.228 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:42 ntpd[27989]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-16T23:23:42.228 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:42 ntpd[27989]: can't open /var/log/ntpstats/peerstats.20231016: Permission denied 2023-10-16T23:23:42.228 INFO:teuthology.orchestra.run.smithi138.stdout:16 Oct 23:23:42 ntpd[27989]: ntpd: time slew +0.000753 s 2023-10-16T23:23:42.228 INFO:teuthology.orchestra.run.smithi138.stdout:ntpd: time slew +0.000753s 2023-10-16T23:23:42.229 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:42 ntpd[27989]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-16T23:23:42.229 INFO:teuthology.orchestra.run.smithi138.stderr:16 Oct 23:23:42 ntpd[27989]: can't open /var/log/ntpstats/loopstats.20231016: Permission denied 2023-10-16T23:23:42.286 INFO:teuthology.orchestra.run.smithi072.stdout: remote refid st t when poll reach delay offset jitter 2023-10-16T23:23:42.286 INFO:teuthology.orchestra.run.smithi072.stdout:============================================================================== 2023-10-16T23:23:42.286 INFO:teuthology.orchestra.run.smithi072.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-16T23:23:42.287 INFO:teuthology.orchestra.run.smithi072.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-16T23:23:42.287 INFO:teuthology.orchestra.run.smithi072.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-16T23:23:42.287 INFO:teuthology.orchestra.run.smithi072.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-16T23:23:42.296 INFO:teuthology.orchestra.run.smithi012.stdout: remote refid st t when poll reach delay offset jitter 2023-10-16T23:23:42.296 INFO:teuthology.orchestra.run.smithi012.stdout:============================================================================== 2023-10-16T23:23:42.296 INFO:teuthology.orchestra.run.smithi012.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-16T23:23:42.296 INFO:teuthology.orchestra.run.smithi012.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-16T23:23:42.297 INFO:teuthology.orchestra.run.smithi012.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-16T23:23:42.297 INFO:teuthology.orchestra.run.smithi012.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-16T23:23:42.298 INFO:teuthology.orchestra.run.smithi031.stdout: remote refid st t when poll reach delay offset jitter 2023-10-16T23:23:42.299 INFO:teuthology.orchestra.run.smithi031.stdout:============================================================================== 2023-10-16T23:23:42.299 INFO:teuthology.orchestra.run.smithi031.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-16T23:23:42.299 INFO:teuthology.orchestra.run.smithi031.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-16T23:23:42.299 INFO:teuthology.orchestra.run.smithi031.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-16T23:23:42.300 INFO:teuthology.orchestra.run.smithi031.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-16T23:23:42.308 INFO:teuthology.orchestra.run.smithi033.stdout: remote refid st t when poll reach delay offset jitter 2023-10-16T23:23:42.308 INFO:teuthology.orchestra.run.smithi033.stdout:============================================================================== 2023-10-16T23:23:42.309 INFO:teuthology.orchestra.run.smithi033.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-16T23:23:42.309 INFO:teuthology.orchestra.run.smithi033.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-16T23:23:42.309 INFO:teuthology.orchestra.run.smithi033.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-16T23:23:42.309 INFO:teuthology.orchestra.run.smithi033.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-16T23:23:42.328 INFO:teuthology.orchestra.run.smithi138.stdout: remote refid st t when poll reach delay offset jitter 2023-10-16T23:23:42.328 INFO:teuthology.orchestra.run.smithi138.stdout:============================================================================== 2023-10-16T23:23:42.328 INFO:teuthology.orchestra.run.smithi138.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-16T23:23:42.328 INFO:teuthology.orchestra.run.smithi138.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-16T23:23:42.329 INFO:teuthology.orchestra.run.smithi138.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-16T23:23:42.329 INFO:teuthology.orchestra.run.smithi138.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-16T23:23:42.330 INFO:teuthology.run_tasks:Running task install... 2023-10-16T23:23:42.339 DEBUG:teuthology.task.install:project ceph 2023-10-16T23:23:42.340 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ab9fe43522bc41de59746200b95f65d4fbcccffe'}} 2023-10-16T23:23:42.340 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ab9fe43522bc41de59746200b95f65d4fbcccffe'} 2023-10-16T23:23:42.340 INFO:teuthology.task.install:Using flavor: default 2023-10-16T23:23:42.346 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-16T23:23:42.347 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-16T23:23:42.348 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-key list | grep Ceph 2023-10-16T23:23:42.348 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-key list | grep Ceph 2023-10-16T23:23:42.349 DEBUG:teuthology.orchestra.run.smithi033:> sudo apt-key list | grep Ceph 2023-10-16T23:23:42.349 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-key list | grep Ceph 2023-10-16T23:23:42.350 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-key list | grep Ceph 2023-10-16T23:23:42.406 INFO:teuthology.orchestra.run.smithi072.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-10-16T23:23:42.407 INFO:teuthology.orchestra.run.smithi031.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-10-16T23:23:42.411 INFO:teuthology.orchestra.run.smithi033.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-10-16T23:23:42.414 INFO:teuthology.orchestra.run.smithi012.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-10-16T23:23:42.433 INFO:teuthology.orchestra.run.smithi031.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-16T23:23:42.434 INFO:teuthology.orchestra.run.smithi031.stdout:uid [ unknown] Ceph.com (release key) 2023-10-16T23:23:42.434 INFO:teuthology.orchestra.run.smithi138.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-10-16T23:23:42.436 INFO:teuthology.orchestra.run.smithi072.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-16T23:23:42.436 INFO:teuthology.orchestra.run.smithi072.stdout:uid [ unknown] Ceph.com (release key) 2023-10-16T23:23:42.436 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-16T23:23:42.437 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-10-16T23:23:42.437 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ab9fe43522bc41de59746200b95f65d4fbcccffe 2023-10-16T23:23:42.439 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-16T23:23:42.439 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-10-16T23:23:42.440 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ab9fe43522bc41de59746200b95f65d4fbcccffe 2023-10-16T23:23:42.445 INFO:teuthology.orchestra.run.smithi033.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-16T23:23:42.445 INFO:teuthology.orchestra.run.smithi033.stdout:uid [ unknown] Ceph.com (release key) 2023-10-16T23:23:42.446 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-16T23:23:42.446 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-10-16T23:23:42.446 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ab9fe43522bc41de59746200b95f65d4fbcccffe 2023-10-16T23:23:42.450 INFO:teuthology.orchestra.run.smithi012.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-16T23:23:42.451 INFO:teuthology.orchestra.run.smithi012.stdout:uid [ unknown] Ceph.com (release key) 2023-10-16T23:23:42.451 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-16T23:23:42.451 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-10-16T23:23:42.452 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ab9fe43522bc41de59746200b95f65d4fbcccffe 2023-10-16T23:23:42.462 INFO:teuthology.orchestra.run.smithi138.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-16T23:23:42.462 INFO:teuthology.orchestra.run.smithi138.stdout:uid [ unknown] Ceph.com (release key) 2023-10-16T23:23:42.463 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-16T23:23:42.463 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-10-16T23:23:42.464 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ab9fe43522bc41de59746200b95f65d4fbcccffe 2023-10-16T23:23:42.581 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default/ 2023-10-16T23:23:42.581 INFO:teuthology.task.install.deb:Package version is 18.2.0-668-gab9fe435-1jammy 2023-10-16T23:23:42.600 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default/ 2023-10-16T23:23:42.601 INFO:teuthology.task.install.deb:Package version is 18.2.0-668-gab9fe435-1jammy 2023-10-16T23:23:42.602 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default/ 2023-10-16T23:23:42.602 INFO:teuthology.task.install.deb:Package version is 18.2.0-668-gab9fe435-1jammy 2023-10-16T23:23:42.668 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default/ 2023-10-16T23:23:42.668 INFO:teuthology.task.install.deb:Package version is 18.2.0-668-gab9fe435-1jammy 2023-10-16T23:23:42.698 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default/ 2023-10-16T23:23:42.699 INFO:teuthology.task.install.deb:Package version is 18.2.0-668-gab9fe435-1jammy 2023-10-16T23:23:42.703 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-16T23:23:42.704 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-16T23:23:42.706 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-16T23:23:42.706 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-16T23:23:42.715 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-16T23:23:42.716 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-16T23:23:42.731 DEBUG:teuthology.orchestra.run.smithi033:> sudo apt-get update 2023-10-16T23:23:42.761 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-get update 2023-10-16T23:23:42.763 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-get update 2023-10-16T23:23:42.839 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-16T23:23:42.839 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-16T23:23:42.853 DEBUG:teuthology.orchestra.run.smithi072:> sudo apt-get update 2023-10-16T23:23:42.871 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-10-16T23:23:42.871 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-16T23:23:42.885 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2023-10-16T23:23:42.937 INFO:teuthology.orchestra.run.smithi012.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-10-16T23:23:42.955 INFO:teuthology.orchestra.run.smithi033.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy InRelease 2023-10-16T23:23:42.976 INFO:teuthology.orchestra.run.smithi033.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-10-16T23:23:42.988 INFO:teuthology.orchestra.run.smithi012.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy InRelease 2023-10-16T23:23:43.000 INFO:teuthology.orchestra.run.smithi033.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy Release.gpg 2023-10-16T23:23:43.015 INFO:teuthology.orchestra.run.smithi012.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-10-16T23:23:43.021 INFO:teuthology.orchestra.run.smithi033.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2023-10-16T23:23:43.022 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-16T23:23:43.030 INFO:teuthology.orchestra.run.smithi072.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-10-16T23:23:43.037 INFO:teuthology.orchestra.run.smithi012.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy Release.gpg 2023-10-16T23:23:43.052 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-16T23:23:43.058 INFO:teuthology.orchestra.run.smithi033.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-16T23:23:43.059 INFO:teuthology.orchestra.run.smithi033.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-16T23:23:43.059 INFO:teuthology.orchestra.run.smithi033.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-10-16T23:23:43.059 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-16T23:23:43.060 INFO:teuthology.orchestra.run.smithi031.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-10-16T23:23:43.060 INFO:teuthology.orchestra.run.smithi012.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2023-10-16T23:23:43.061 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-16T23:23:43.061 INFO:teuthology.orchestra.run.smithi031.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy InRelease 2023-10-16T23:23:43.088 INFO:teuthology.orchestra.run.smithi012.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-10-16T23:23:43.097 INFO:teuthology.orchestra.run.smithi031.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-10-16T23:23:43.101 INFO:teuthology.orchestra.run.smithi138.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy InRelease 2023-10-16T23:23:43.105 INFO:teuthology.orchestra.run.smithi072.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-16T23:23:43.122 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-10-16T23:23:43.131 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-16T23:23:43.131 INFO:teuthology.orchestra.run.smithi033.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-10-16T23:23:43.134 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-16T23:23:43.134 INFO:teuthology.orchestra.run.smithi031.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy Release.gpg 2023-10-16T23:23:43.142 INFO:teuthology.orchestra.run.smithi072.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy InRelease 2023-10-16T23:23:43.142 INFO:teuthology.orchestra.run.smithi072.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-10-16T23:23:43.144 INFO:teuthology.orchestra.run.smithi138.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy Release.gpg 2023-10-16T23:23:43.165 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2023-10-16T23:23:43.170 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2023-10-16T23:23:43.172 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-16T23:23:43.178 INFO:teuthology.orchestra.run.smithi072.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-10-16T23:23:43.193 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-10-16T23:23:43.212 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-16T23:23:43.215 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-16T23:23:43.220 INFO:teuthology.orchestra.run.smithi031.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-10-16T23:23:43.220 INFO:teuthology.orchestra.run.smithi072.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy Release.gpg 2023-10-16T23:23:43.251 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-10-16T23:23:43.256 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-10-16T23:23:43.298 INFO:teuthology.orchestra.run.smithi072.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2023-10-16T23:23:43.385 INFO:teuthology.orchestra.run.smithi012.stdout:Fetched 139 kB in 0s (319 kB/s) 2023-10-16T23:23:43.477 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 139 kB in 1s (261 kB/s) 2023-10-16T23:23:43.484 INFO:teuthology.orchestra.run.smithi033.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-16T23:23:43.580 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 258 kB in 1s (485 kB/s) 2023-10-16T23:23:43.606 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-16T23:23:43.643 INFO:teuthology.orchestra.run.smithi033.stdout:Fetched 147 kB in 1s (202 kB/s) 2023-10-16T23:23:43.769 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 147 kB in 1s (210 kB/s) 2023-10-16T23:23:44.289 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2023-10-16T23:23:44.305 DEBUG:teuthology.orchestra.run.smithi012:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.0-668-gab9fe435-1jammy cephadm=18.2.0-668-gab9fe435-1jammy ceph-mds=18.2.0-668-gab9fe435-1jammy ceph-mgr=18.2.0-668-gab9fe435-1jammy ceph-common=18.2.0-668-gab9fe435-1jammy ceph-fuse=18.2.0-668-gab9fe435-1jammy ceph-test=18.2.0-668-gab9fe435-1jammy ceph-volume=18.2.0-668-gab9fe435-1jammy radosgw=18.2.0-668-gab9fe435-1jammy python3-rados=18.2.0-668-gab9fe435-1jammy python3-rgw=18.2.0-668-gab9fe435-1jammy python3-cephfs=18.2.0-668-gab9fe435-1jammy python3-rbd=18.2.0-668-gab9fe435-1jammy libcephfs2=18.2.0-668-gab9fe435-1jammy libcephfs-dev=18.2.0-668-gab9fe435-1jammy librados2=18.2.0-668-gab9fe435-1jammy librbd1=18.2.0-668-gab9fe435-1jammy rbd-fuse=18.2.0-668-gab9fe435-1jammy python3-cephfs=18.2.0-668-gab9fe435-1jammy cephfs-shell=18.2.0-668-gab9fe435-1jammy cephfs-top=18.2.0-668-gab9fe435-1jammy cephfs-mirror=18.2.0-668-gab9fe435-1jammy 2023-10-16T23:23:44.358 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2023-10-16T23:23:44.383 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2023-10-16T23:23:44.399 DEBUG:teuthology.orchestra.run.smithi031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.0-668-gab9fe435-1jammy cephadm=18.2.0-668-gab9fe435-1jammy ceph-mds=18.2.0-668-gab9fe435-1jammy ceph-mgr=18.2.0-668-gab9fe435-1jammy ceph-common=18.2.0-668-gab9fe435-1jammy ceph-fuse=18.2.0-668-gab9fe435-1jammy ceph-test=18.2.0-668-gab9fe435-1jammy ceph-volume=18.2.0-668-gab9fe435-1jammy radosgw=18.2.0-668-gab9fe435-1jammy python3-rados=18.2.0-668-gab9fe435-1jammy python3-rgw=18.2.0-668-gab9fe435-1jammy python3-cephfs=18.2.0-668-gab9fe435-1jammy python3-rbd=18.2.0-668-gab9fe435-1jammy libcephfs2=18.2.0-668-gab9fe435-1jammy libcephfs-dev=18.2.0-668-gab9fe435-1jammy librados2=18.2.0-668-gab9fe435-1jammy librbd1=18.2.0-668-gab9fe435-1jammy rbd-fuse=18.2.0-668-gab9fe435-1jammy python3-cephfs=18.2.0-668-gab9fe435-1jammy cephfs-shell=18.2.0-668-gab9fe435-1jammy cephfs-top=18.2.0-668-gab9fe435-1jammy cephfs-mirror=18.2.0-668-gab9fe435-1jammy 2023-10-16T23:23:44.464 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2023-10-16T23:23:44.466 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2023-10-16T23:23:44.482 DEBUG:teuthology.orchestra.run.smithi072:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.0-668-gab9fe435-1jammy cephadm=18.2.0-668-gab9fe435-1jammy ceph-mds=18.2.0-668-gab9fe435-1jammy ceph-mgr=18.2.0-668-gab9fe435-1jammy ceph-common=18.2.0-668-gab9fe435-1jammy ceph-fuse=18.2.0-668-gab9fe435-1jammy ceph-test=18.2.0-668-gab9fe435-1jammy ceph-volume=18.2.0-668-gab9fe435-1jammy radosgw=18.2.0-668-gab9fe435-1jammy python3-rados=18.2.0-668-gab9fe435-1jammy python3-rgw=18.2.0-668-gab9fe435-1jammy python3-cephfs=18.2.0-668-gab9fe435-1jammy python3-rbd=18.2.0-668-gab9fe435-1jammy libcephfs2=18.2.0-668-gab9fe435-1jammy libcephfs-dev=18.2.0-668-gab9fe435-1jammy librados2=18.2.0-668-gab9fe435-1jammy librbd1=18.2.0-668-gab9fe435-1jammy rbd-fuse=18.2.0-668-gab9fe435-1jammy python3-cephfs=18.2.0-668-gab9fe435-1jammy cephfs-shell=18.2.0-668-gab9fe435-1jammy cephfs-top=18.2.0-668-gab9fe435-1jammy cephfs-mirror=18.2.0-668-gab9fe435-1jammy 2023-10-16T23:23:44.522 INFO:teuthology.orchestra.run.smithi033.stdout:Reading package lists... 2023-10-16T23:23:44.526 INFO:teuthology.orchestra.run.smithi012.stdout:Building dependency tree... 2023-10-16T23:23:44.526 INFO:teuthology.orchestra.run.smithi012.stdout:Reading state information... 2023-10-16T23:23:44.537 DEBUG:teuthology.orchestra.run.smithi033:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.0-668-gab9fe435-1jammy cephadm=18.2.0-668-gab9fe435-1jammy ceph-mds=18.2.0-668-gab9fe435-1jammy ceph-mgr=18.2.0-668-gab9fe435-1jammy ceph-common=18.2.0-668-gab9fe435-1jammy ceph-fuse=18.2.0-668-gab9fe435-1jammy ceph-test=18.2.0-668-gab9fe435-1jammy ceph-volume=18.2.0-668-gab9fe435-1jammy radosgw=18.2.0-668-gab9fe435-1jammy python3-rados=18.2.0-668-gab9fe435-1jammy python3-rgw=18.2.0-668-gab9fe435-1jammy python3-cephfs=18.2.0-668-gab9fe435-1jammy python3-rbd=18.2.0-668-gab9fe435-1jammy libcephfs2=18.2.0-668-gab9fe435-1jammy libcephfs-dev=18.2.0-668-gab9fe435-1jammy librados2=18.2.0-668-gab9fe435-1jammy librbd1=18.2.0-668-gab9fe435-1jammy rbd-fuse=18.2.0-668-gab9fe435-1jammy python3-cephfs=18.2.0-668-gab9fe435-1jammy cephfs-shell=18.2.0-668-gab9fe435-1jammy cephfs-top=18.2.0-668-gab9fe435-1jammy cephfs-mirror=18.2.0-668-gab9fe435-1jammy 2023-10-16T23:23:44.546 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2023-10-16T23:23:44.599 INFO:teuthology.orchestra.run.smithi033.stdout:Reading package lists... 2023-10-16T23:23:44.656 INFO:teuthology.orchestra.run.smithi031.stdout:Building dependency tree... 2023-10-16T23:23:44.657 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2023-10-16T23:23:44.657 INFO:teuthology.orchestra.run.smithi031.stdout:Reading state information... 2023-10-16T23:23:44.673 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.0-668-gab9fe435-1jammy cephadm=18.2.0-668-gab9fe435-1jammy ceph-mds=18.2.0-668-gab9fe435-1jammy ceph-mgr=18.2.0-668-gab9fe435-1jammy ceph-common=18.2.0-668-gab9fe435-1jammy ceph-fuse=18.2.0-668-gab9fe435-1jammy ceph-test=18.2.0-668-gab9fe435-1jammy ceph-volume=18.2.0-668-gab9fe435-1jammy radosgw=18.2.0-668-gab9fe435-1jammy python3-rados=18.2.0-668-gab9fe435-1jammy python3-rgw=18.2.0-668-gab9fe435-1jammy python3-cephfs=18.2.0-668-gab9fe435-1jammy python3-rbd=18.2.0-668-gab9fe435-1jammy libcephfs2=18.2.0-668-gab9fe435-1jammy libcephfs-dev=18.2.0-668-gab9fe435-1jammy librados2=18.2.0-668-gab9fe435-1jammy librbd1=18.2.0-668-gab9fe435-1jammy rbd-fuse=18.2.0-668-gab9fe435-1jammy python3-cephfs=18.2.0-668-gab9fe435-1jammy cephfs-shell=18.2.0-668-gab9fe435-1jammy cephfs-top=18.2.0-668-gab9fe435-1jammy cephfs-mirror=18.2.0-668-gab9fe435-1jammy 2023-10-16T23:23:44.679 INFO:teuthology.orchestra.run.smithi012.stdout:The following packages were automatically installed and are no longer required: 2023-10-16T23:23:44.679 INFO:teuthology.orchestra.run.smithi012.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-16T23:23:44.679 INFO:teuthology.orchestra.run.smithi012.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-16T23:23:44.680 INFO:teuthology.orchestra.run.smithi012.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-16T23:23:44.681 INFO:teuthology.orchestra.run.smithi012.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-16T23:23:44.681 INFO:teuthology.orchestra.run.smithi012.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-16T23:23:44.682 INFO:teuthology.orchestra.run.smithi012.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-16T23:23:44.682 INFO:teuthology.orchestra.run.smithi012.stdout:The following additional packages will be installed: 2023-10-16T23:23:44.682 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-16T23:23:44.682 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-10-16T23:23:44.682 INFO:teuthology.orchestra.run.smithi012.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-16T23:23:44.683 INFO:teuthology.orchestra.run.smithi012.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-10-16T23:23:44.683 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-10-16T23:23:44.683 INFO:teuthology.orchestra.run.smithi012.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-10-16T23:23:44.683 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-10-16T23:23:44.683 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-10-16T23:23:44.684 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-10-16T23:23:44.684 INFO:teuthology.orchestra.run.smithi012.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-10-16T23:23:44.684 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-10-16T23:23:44.684 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-10-16T23:23:44.684 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-10-16T23:23:44.685 INFO:teuthology.orchestra.run.smithi012.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-16T23:23:44.685 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-10-16T23:23:44.685 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-10-16T23:23:44.685 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-10-16T23:23:44.685 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-10-16T23:23:44.685 INFO:teuthology.orchestra.run.smithi012.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-10-16T23:23:44.686 INFO:teuthology.orchestra.run.smithi012.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-10-16T23:23:44.686 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-10-16T23:23:44.686 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-10-16T23:23:44.686 INFO:teuthology.orchestra.run.smithi012.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-16T23:23:44.687 INFO:teuthology.orchestra.run.smithi012.stdout:Suggested packages: 2023-10-16T23:23:44.687 INFO:teuthology.orchestra.run.smithi012.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-10-16T23:23:44.687 INFO:teuthology.orchestra.run.smithi012.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-10-16T23:23:44.687 INFO:teuthology.orchestra.run.smithi012.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-10-16T23:23:44.688 INFO:teuthology.orchestra.run.smithi012.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-10-16T23:23:44.688 INFO:teuthology.orchestra.run.smithi012.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-10-16T23:23:44.688 INFO:teuthology.orchestra.run.smithi012.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-10-16T23:23:44.688 INFO:teuthology.orchestra.run.smithi012.stdout: python3-watchdog 2023-10-16T23:23:44.688 INFO:teuthology.orchestra.run.smithi012.stdout:Recommended packages: 2023-10-16T23:23:44.689 INFO:teuthology.orchestra.run.smithi012.stdout: btrfs-tools 2023-10-16T23:23:44.726 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2023-10-16T23:23:44.731 INFO:teuthology.orchestra.run.smithi072.stdout:Building dependency tree... 2023-10-16T23:23:44.731 INFO:teuthology.orchestra.run.smithi072.stdout:Reading state information... 2023-10-16T23:23:44.782 INFO:teuthology.orchestra.run.smithi033.stdout:Building dependency tree... 2023-10-16T23:23:44.783 INFO:teuthology.orchestra.run.smithi033.stdout:Reading state information... 2023-10-16T23:23:44.785 INFO:teuthology.orchestra.run.smithi012.stdout:The following NEW packages will be installed: 2023-10-16T23:23:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-16T23:23:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-16T23:23:44.785 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-16T23:23:44.786 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-10-16T23:23:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-16T23:23:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-10-16T23:23:44.787 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-10-16T23:23:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-10-16T23:23:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-10-16T23:23:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-10-16T23:23:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-10-16T23:23:44.788 INFO:teuthology.orchestra.run.smithi012.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-10-16T23:23:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-10-16T23:23:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-10-16T23:23:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-10-16T23:23:44.789 INFO:teuthology.orchestra.run.smithi012.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-10-16T23:23:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-10-16T23:23:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-10-16T23:23:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-10-16T23:23:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-10-16T23:23:44.790 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-16T23:23:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-10-16T23:23:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-10-16T23:23:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-10-16T23:23:44.791 INFO:teuthology.orchestra.run.smithi012.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-10-16T23:23:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-10-16T23:23:44.792 INFO:teuthology.orchestra.run.smithi012.stdout: socat xmlstarlet 2023-10-16T23:23:44.833 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages were automatically installed and are no longer required: 2023-10-16T23:23:44.833 INFO:teuthology.orchestra.run.smithi031.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-16T23:23:44.833 INFO:teuthology.orchestra.run.smithi031.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-16T23:23:44.834 INFO:teuthology.orchestra.run.smithi031.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-16T23:23:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-16T23:23:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-16T23:23:44.835 INFO:teuthology.orchestra.run.smithi031.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-16T23:23:44.835 INFO:teuthology.orchestra.run.smithi031.stdout:The following additional packages will be installed: 2023-10-16T23:23:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-16T23:23:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-10-16T23:23:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-16T23:23:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-10-16T23:23:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-10-16T23:23:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-10-16T23:23:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-10-16T23:23:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-10-16T23:23:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-10-16T23:23:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-10-16T23:23:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-10-16T23:23:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-10-16T23:23:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-10-16T23:23:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-16T23:23:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-10-16T23:23:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-10-16T23:23:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-10-16T23:23:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-10-16T23:23:44.840 INFO:teuthology.orchestra.run.smithi031.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-10-16T23:23:44.840 INFO:teuthology.orchestra.run.smithi031.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-10-16T23:23:44.840 INFO:teuthology.orchestra.run.smithi031.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-10-16T23:23:44.840 INFO:teuthology.orchestra.run.smithi031.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-10-16T23:23:44.840 INFO:teuthology.orchestra.run.smithi031.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-16T23:23:44.841 INFO:teuthology.orchestra.run.smithi031.stdout:Suggested packages: 2023-10-16T23:23:44.841 INFO:teuthology.orchestra.run.smithi031.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-10-16T23:23:44.841 INFO:teuthology.orchestra.run.smithi031.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-10-16T23:23:44.841 INFO:teuthology.orchestra.run.smithi031.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-10-16T23:23:44.841 INFO:teuthology.orchestra.run.smithi031.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-10-16T23:23:44.842 INFO:teuthology.orchestra.run.smithi031.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-10-16T23:23:44.842 INFO:teuthology.orchestra.run.smithi031.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-10-16T23:23:44.842 INFO:teuthology.orchestra.run.smithi031.stdout: python3-watchdog 2023-10-16T23:23:44.842 INFO:teuthology.orchestra.run.smithi031.stdout:Recommended packages: 2023-10-16T23:23:44.842 INFO:teuthology.orchestra.run.smithi031.stdout: btrfs-tools 2023-10-16T23:23:44.855 INFO:teuthology.orchestra.run.smithi012.stdout:0 upgraded, 115 newly installed, 0 to remove and 256 not upgraded. 2023-10-16T23:23:44.855 INFO:teuthology.orchestra.run.smithi012.stdout:Need to get 180 MB of archives. 2023-10-16T23:23:44.855 INFO:teuthology.orchestra.run.smithi012.stdout:After this operation, 810 MB of additional disk space will be used. 2023-10-16T23:23:44.856 INFO:teuthology.orchestra.run.smithi012.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-10-16T23:23:44.888 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2023-10-16T23:23:44.889 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2023-10-16T23:23:44.891 INFO:teuthology.orchestra.run.smithi012.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-10-16T23:23:44.900 INFO:teuthology.orchestra.run.smithi012.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-10-16T23:23:44.901 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages were automatically installed and are no longer required: 2023-10-16T23:23:44.901 INFO:teuthology.orchestra.run.smithi072.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-16T23:23:44.901 INFO:teuthology.orchestra.run.smithi072.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-16T23:23:44.901 INFO:teuthology.orchestra.run.smithi072.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-16T23:23:44.901 INFO:teuthology.orchestra.run.smithi072.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-16T23:23:44.902 INFO:teuthology.orchestra.run.smithi072.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-16T23:23:44.902 INFO:teuthology.orchestra.run.smithi072.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-16T23:23:44.903 INFO:teuthology.orchestra.run.smithi072.stdout:The following additional packages will be installed: 2023-10-16T23:23:44.904 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-16T23:23:44.904 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-10-16T23:23:44.904 INFO:teuthology.orchestra.run.smithi072.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-16T23:23:44.904 INFO:teuthology.orchestra.run.smithi072.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-10-16T23:23:44.905 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-10-16T23:23:44.905 INFO:teuthology.orchestra.run.smithi072.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-10-16T23:23:44.905 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-10-16T23:23:44.905 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-10-16T23:23:44.906 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-10-16T23:23:44.906 INFO:teuthology.orchestra.run.smithi072.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-10-16T23:23:44.906 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-10-16T23:23:44.906 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-10-16T23:23:44.906 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-10-16T23:23:44.907 INFO:teuthology.orchestra.run.smithi072.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-16T23:23:44.907 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-10-16T23:23:44.907 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-10-16T23:23:44.907 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-10-16T23:23:44.907 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-10-16T23:23:44.908 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-10-16T23:23:44.908 INFO:teuthology.orchestra.run.smithi072.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-10-16T23:23:44.908 INFO:teuthology.orchestra.run.smithi072.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-10-16T23:23:44.908 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-10-16T23:23:44.909 INFO:teuthology.orchestra.run.smithi072.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-16T23:23:44.909 INFO:teuthology.orchestra.run.smithi072.stdout:Suggested packages: 2023-10-16T23:23:44.909 INFO:teuthology.orchestra.run.smithi072.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-10-16T23:23:44.909 INFO:teuthology.orchestra.run.smithi072.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-10-16T23:23:44.910 INFO:teuthology.orchestra.run.smithi072.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-10-16T23:23:44.910 INFO:teuthology.orchestra.run.smithi072.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-10-16T23:23:44.910 INFO:teuthology.orchestra.run.smithi072.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-10-16T23:23:44.910 INFO:teuthology.orchestra.run.smithi072.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-10-16T23:23:44.911 INFO:teuthology.orchestra.run.smithi072.stdout: python3-watchdog 2023-10-16T23:23:44.911 INFO:teuthology.orchestra.run.smithi072.stdout:Recommended packages: 2023-10-16T23:23:44.911 INFO:teuthology.orchestra.run.smithi072.stdout: btrfs-tools 2023-10-16T23:23:44.928 INFO:teuthology.orchestra.run.smithi012.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.0-668-gab9fe435-1jammy [3,404 kB] 2023-10-16T23:23:44.944 INFO:teuthology.orchestra.run.smithi031.stdout:The following NEW packages will be installed: 2023-10-16T23:23:44.944 INFO:teuthology.orchestra.run.smithi031.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-16T23:23:44.944 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-16T23:23:44.944 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-16T23:23:44.946 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-10-16T23:23:44.946 INFO:teuthology.orchestra.run.smithi031.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-16T23:23:44.946 INFO:teuthology.orchestra.run.smithi031.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-10-16T23:23:44.947 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-10-16T23:23:44.947 INFO:teuthology.orchestra.run.smithi031.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-10-16T23:23:44.947 INFO:teuthology.orchestra.run.smithi031.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-10-16T23:23:44.947 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-10-16T23:23:44.947 INFO:teuthology.orchestra.run.smithi031.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-10-16T23:23:44.948 INFO:teuthology.orchestra.run.smithi031.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-10-16T23:23:44.948 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-10-16T23:23:44.948 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-10-16T23:23:44.948 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-10-16T23:23:44.948 INFO:teuthology.orchestra.run.smithi031.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-10-16T23:23:44.949 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-10-16T23:23:44.949 INFO:teuthology.orchestra.run.smithi031.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-10-16T23:23:44.949 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-10-16T23:23:44.949 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-10-16T23:23:44.950 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-16T23:23:44.950 INFO:teuthology.orchestra.run.smithi031.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-10-16T23:23:44.950 INFO:teuthology.orchestra.run.smithi031.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-10-16T23:23:44.950 INFO:teuthology.orchestra.run.smithi031.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-10-16T23:23:44.950 INFO:teuthology.orchestra.run.smithi031.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-10-16T23:23:44.951 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-10-16T23:23:44.951 INFO:teuthology.orchestra.run.smithi031.stdout: socat xmlstarlet 2023-10-16T23:23:44.955 INFO:teuthology.orchestra.run.smithi033.stdout:The following packages were automatically installed and are no longer required: 2023-10-16T23:23:44.956 INFO:teuthology.orchestra.run.smithi033.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-16T23:23:44.956 INFO:teuthology.orchestra.run.smithi033.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-16T23:23:44.956 INFO:teuthology.orchestra.run.smithi033.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-16T23:23:44.957 INFO:teuthology.orchestra.run.smithi033.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-16T23:23:44.957 INFO:teuthology.orchestra.run.smithi033.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-16T23:23:44.958 INFO:teuthology.orchestra.run.smithi033.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-16T23:23:44.958 INFO:teuthology.orchestra.run.smithi033.stdout:The following additional packages will be installed: 2023-10-16T23:23:44.958 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-16T23:23:44.958 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-10-16T23:23:44.958 INFO:teuthology.orchestra.run.smithi033.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-16T23:23:44.959 INFO:teuthology.orchestra.run.smithi033.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-10-16T23:23:44.960 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-10-16T23:23:44.960 INFO:teuthology.orchestra.run.smithi033.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-10-16T23:23:44.960 INFO:teuthology.orchestra.run.smithi033.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-10-16T23:23:44.960 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-10-16T23:23:44.961 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-10-16T23:23:44.961 INFO:teuthology.orchestra.run.smithi033.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-10-16T23:23:44.961 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-10-16T23:23:44.962 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-10-16T23:23:44.962 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-10-16T23:23:44.962 INFO:teuthology.orchestra.run.smithi033.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-16T23:23:44.963 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-10-16T23:23:44.963 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-10-16T23:23:44.963 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-10-16T23:23:44.963 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-10-16T23:23:44.964 INFO:teuthology.orchestra.run.smithi033.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-10-16T23:23:44.964 INFO:teuthology.orchestra.run.smithi033.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-10-16T23:23:44.964 INFO:teuthology.orchestra.run.smithi033.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-10-16T23:23:44.965 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-10-16T23:23:44.965 INFO:teuthology.orchestra.run.smithi033.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-16T23:23:44.965 INFO:teuthology.orchestra.run.smithi033.stdout:Suggested packages: 2023-10-16T23:23:44.965 INFO:teuthology.orchestra.run.smithi033.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-10-16T23:23:44.966 INFO:teuthology.orchestra.run.smithi033.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-10-16T23:23:44.966 INFO:teuthology.orchestra.run.smithi033.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-10-16T23:23:44.966 INFO:teuthology.orchestra.run.smithi033.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-10-16T23:23:44.967 INFO:teuthology.orchestra.run.smithi033.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-10-16T23:23:44.967 INFO:teuthology.orchestra.run.smithi033.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-10-16T23:23:44.967 INFO:teuthology.orchestra.run.smithi033.stdout: python3-watchdog 2023-10-16T23:23:44.968 INFO:teuthology.orchestra.run.smithi033.stdout:Recommended packages: 2023-10-16T23:23:44.968 INFO:teuthology.orchestra.run.smithi033.stdout: btrfs-tools 2023-10-16T23:23:44.969 INFO:teuthology.orchestra.run.smithi012.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-10-16T23:23:44.984 INFO:teuthology.orchestra.run.smithi012.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-10-16T23:23:45.004 INFO:teuthology.orchestra.run.smithi031.stdout:0 upgraded, 115 newly installed, 0 to remove and 256 not upgraded. 2023-10-16T23:23:45.004 INFO:teuthology.orchestra.run.smithi031.stdout:Need to get 180 MB of archives. 2023-10-16T23:23:45.005 INFO:teuthology.orchestra.run.smithi031.stdout:After this operation, 810 MB of additional disk space will be used. 2023-10-16T23:23:45.006 INFO:teuthology.orchestra.run.smithi031.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-10-16T23:23:45.007 INFO:teuthology.orchestra.run.smithi012.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-10-16T23:23:45.009 INFO:teuthology.orchestra.run.smithi072.stdout:The following NEW packages will be installed: 2023-10-16T23:23:45.009 INFO:teuthology.orchestra.run.smithi072.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-16T23:23:45.010 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-16T23:23:45.010 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-16T23:23:45.011 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-10-16T23:23:45.011 INFO:teuthology.orchestra.run.smithi072.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-16T23:23:45.011 INFO:teuthology.orchestra.run.smithi072.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-10-16T23:23:45.012 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-10-16T23:23:45.012 INFO:teuthology.orchestra.run.smithi072.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-10-16T23:23:45.012 INFO:teuthology.orchestra.run.smithi072.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-10-16T23:23:45.012 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-10-16T23:23:45.012 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-10-16T23:23:45.013 INFO:teuthology.orchestra.run.smithi072.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-10-16T23:23:45.013 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-10-16T23:23:45.013 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-10-16T23:23:45.013 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-10-16T23:23:45.013 INFO:teuthology.orchestra.run.smithi072.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-10-16T23:23:45.014 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-10-16T23:23:45.014 INFO:teuthology.orchestra.run.smithi072.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-10-16T23:23:45.014 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-10-16T23:23:45.014 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-10-16T23:23:45.014 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-16T23:23:45.015 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-10-16T23:23:45.015 INFO:teuthology.orchestra.run.smithi072.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-10-16T23:23:45.015 INFO:teuthology.orchestra.run.smithi072.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-10-16T23:23:45.015 INFO:teuthology.orchestra.run.smithi072.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-10-16T23:23:45.015 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-10-16T23:23:45.016 INFO:teuthology.orchestra.run.smithi072.stdout: socat xmlstarlet 2023-10-16T23:23:45.016 INFO:teuthology.orchestra.run.smithi012.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-10-16T23:23:45.022 INFO:teuthology.orchestra.run.smithi031.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-10-16T23:23:45.024 INFO:teuthology.orchestra.run.smithi012.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-10-16T23:23:45.031 INFO:teuthology.orchestra.run.smithi031.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-10-16T23:23:45.035 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2023-10-16T23:23:45.035 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-16T23:23:45.035 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-16T23:23:45.035 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-16T23:23:45.035 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-16T23:23:45.037 INFO:teuthology.orchestra.run.smithi138.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-16T23:23:45.037 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-16T23:23:45.037 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2023-10-16T23:23:45.038 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-16T23:23:45.038 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-10-16T23:23:45.038 INFO:teuthology.orchestra.run.smithi138.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-16T23:23:45.038 INFO:teuthology.orchestra.run.smithi138.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-10-16T23:23:45.039 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-10-16T23:23:45.039 INFO:teuthology.orchestra.run.smithi138.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-10-16T23:23:45.039 INFO:teuthology.orchestra.run.smithi138.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-10-16T23:23:45.040 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-10-16T23:23:45.040 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-10-16T23:23:45.040 INFO:teuthology.orchestra.run.smithi138.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-10-16T23:23:45.041 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-10-16T23:23:45.041 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-10-16T23:23:45.041 INFO:teuthology.orchestra.run.smithi138.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-10-16T23:23:45.042 INFO:teuthology.orchestra.run.smithi138.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-16T23:23:45.042 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-10-16T23:23:45.042 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-10-16T23:23:45.043 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-10-16T23:23:45.043 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-10-16T23:23:45.043 INFO:teuthology.orchestra.run.smithi138.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-10-16T23:23:45.044 INFO:teuthology.orchestra.run.smithi138.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-10-16T23:23:45.044 INFO:teuthology.orchestra.run.smithi138.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-10-16T23:23:45.044 INFO:teuthology.orchestra.run.smithi138.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-10-16T23:23:45.045 INFO:teuthology.orchestra.run.smithi138.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-16T23:23:45.045 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2023-10-16T23:23:45.046 INFO:teuthology.orchestra.run.smithi138.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-10-16T23:23:45.046 INFO:teuthology.orchestra.run.smithi138.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-10-16T23:23:45.047 INFO:teuthology.orchestra.run.smithi138.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-10-16T23:23:45.047 INFO:teuthology.orchestra.run.smithi138.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-10-16T23:23:45.047 INFO:teuthology.orchestra.run.smithi138.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-10-16T23:23:45.048 INFO:teuthology.orchestra.run.smithi138.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-10-16T23:23:45.048 INFO:teuthology.orchestra.run.smithi138.stdout: python3-watchdog 2023-10-16T23:23:45.048 INFO:teuthology.orchestra.run.smithi138.stdout:Recommended packages: 2023-10-16T23:23:45.048 INFO:teuthology.orchestra.run.smithi138.stdout: btrfs-tools 2023-10-16T23:23:45.069 INFO:teuthology.orchestra.run.smithi033.stdout:The following NEW packages will be installed: 2023-10-16T23:23:45.070 INFO:teuthology.orchestra.run.smithi033.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-16T23:23:45.070 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-16T23:23:45.070 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-16T23:23:45.070 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-10-16T23:23:45.072 INFO:teuthology.orchestra.run.smithi033.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-16T23:23:45.072 INFO:teuthology.orchestra.run.smithi033.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-10-16T23:23:45.072 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-10-16T23:23:45.072 INFO:teuthology.orchestra.run.smithi033.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-10-16T23:23:45.073 INFO:teuthology.orchestra.run.smithi033.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-10-16T23:23:45.073 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-10-16T23:23:45.073 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-10-16T23:23:45.073 INFO:teuthology.orchestra.run.smithi033.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-10-16T23:23:45.073 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-10-16T23:23:45.074 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-10-16T23:23:45.074 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-10-16T23:23:45.074 INFO:teuthology.orchestra.run.smithi033.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-10-16T23:23:45.074 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-10-16T23:23:45.074 INFO:teuthology.orchestra.run.smithi033.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-10-16T23:23:45.075 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-10-16T23:23:45.075 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-10-16T23:23:45.075 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-16T23:23:45.075 INFO:teuthology.orchestra.run.smithi033.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-10-16T23:23:45.075 INFO:teuthology.orchestra.run.smithi033.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-10-16T23:23:45.076 INFO:teuthology.orchestra.run.smithi033.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-10-16T23:23:45.076 INFO:teuthology.orchestra.run.smithi033.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-10-16T23:23:45.076 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-10-16T23:23:45.076 INFO:teuthology.orchestra.run.smithi033.stdout: socat xmlstarlet 2023-10-16T23:23:45.077 INFO:teuthology.orchestra.run.smithi072.stdout:0 upgraded, 115 newly installed, 0 to remove and 256 not upgraded. 2023-10-16T23:23:45.077 INFO:teuthology.orchestra.run.smithi072.stdout:Need to get 180 MB of archives. 2023-10-16T23:23:45.077 INFO:teuthology.orchestra.run.smithi072.stdout:After this operation, 810 MB of additional disk space will be used. 2023-10-16T23:23:45.078 INFO:teuthology.orchestra.run.smithi072.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-10-16T23:23:45.078 INFO:teuthology.orchestra.run.smithi031.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-10-16T23:23:45.078 INFO:teuthology.orchestra.run.smithi012.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-10-16T23:23:45.080 INFO:teuthology.orchestra.run.smithi031.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-10-16T23:23:45.082 INFO:teuthology.orchestra.run.smithi012.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-10-16T23:23:45.089 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.0-668-gab9fe435-1jammy [3,404 kB] 2023-10-16T23:23:45.094 INFO:teuthology.orchestra.run.smithi012.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-10-16T23:23:45.098 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-10-16T23:23:45.099 INFO:teuthology.orchestra.run.smithi012.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-10-16T23:23:45.099 INFO:teuthology.orchestra.run.smithi012.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-10-16T23:23:45.099 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-10-16T23:23:45.107 INFO:teuthology.orchestra.run.smithi012.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-10-16T23:23:45.107 INFO:teuthology.orchestra.run.smithi012.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-10-16T23:23:45.108 INFO:teuthology.orchestra.run.smithi012.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-10-16T23:23:45.109 INFO:teuthology.orchestra.run.smithi012.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-10-16T23:23:45.109 INFO:teuthology.orchestra.run.smithi031.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-10-16T23:23:45.114 INFO:teuthology.orchestra.run.smithi072.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-10-16T23:23:45.118 INFO:teuthology.orchestra.run.smithi012.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-10-16T23:23:45.122 INFO:teuthology.orchestra.run.smithi072.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-10-16T23:23:45.129 INFO:teuthology.orchestra.run.smithi012.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-10-16T23:23:45.130 INFO:teuthology.orchestra.run.smithi012.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-10-16T23:23:45.130 INFO:teuthology.orchestra.run.smithi012.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-10-16T23:23:45.131 INFO:teuthology.orchestra.run.smithi012.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-10-16T23:23:45.131 INFO:teuthology.orchestra.run.smithi012.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-10-16T23:23:45.134 INFO:teuthology.orchestra.run.smithi012.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-10-16T23:23:45.134 INFO:teuthology.orchestra.run.smithi012.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-10-16T23:23:45.135 INFO:teuthology.orchestra.run.smithi012.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-10-16T23:23:45.136 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2023-10-16T23:23:45.137 INFO:teuthology.orchestra.run.smithi138.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-16T23:23:45.137 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-16T23:23:45.137 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-16T23:23:45.138 INFO:teuthology.orchestra.run.smithi012.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-10-16T23:23:45.139 INFO:teuthology.orchestra.run.smithi138.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-10-16T23:23:45.139 INFO:teuthology.orchestra.run.smithi138.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-16T23:23:45.139 INFO:teuthology.orchestra.run.smithi138.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-10-16T23:23:45.140 INFO:teuthology.orchestra.run.smithi138.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-10-16T23:23:45.140 INFO:teuthology.orchestra.run.smithi138.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-10-16T23:23:45.140 INFO:teuthology.orchestra.run.smithi138.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-10-16T23:23:45.140 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-10-16T23:23:45.140 INFO:teuthology.orchestra.run.smithi138.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-10-16T23:23:45.141 INFO:teuthology.orchestra.run.smithi138.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-10-16T23:23:45.141 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-10-16T23:23:45.141 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-10-16T23:23:45.141 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-10-16T23:23:45.141 INFO:teuthology.orchestra.run.smithi138.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-10-16T23:23:45.142 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-10-16T23:23:45.142 INFO:teuthology.orchestra.run.smithi138.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-10-16T23:23:45.142 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-10-16T23:23:45.142 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-10-16T23:23:45.142 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-16T23:23:45.143 INFO:teuthology.orchestra.run.smithi138.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-10-16T23:23:45.143 INFO:teuthology.orchestra.run.smithi138.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-10-16T23:23:45.143 INFO:teuthology.orchestra.run.smithi138.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-10-16T23:23:45.143 INFO:teuthology.orchestra.run.smithi138.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-10-16T23:23:45.143 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-10-16T23:23:45.144 INFO:teuthology.orchestra.run.smithi138.stdout: socat xmlstarlet 2023-10-16T23:23:45.147 INFO:teuthology.orchestra.run.smithi033.stdout:0 upgraded, 115 newly installed, 0 to remove and 256 not upgraded. 2023-10-16T23:23:45.147 INFO:teuthology.orchestra.run.smithi033.stdout:Need to get 180 MB of archives. 2023-10-16T23:23:45.148 INFO:teuthology.orchestra.run.smithi033.stdout:After this operation, 810 MB of additional disk space will be used. 2023-10-16T23:23:45.148 INFO:teuthology.orchestra.run.smithi033.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-10-16T23:23:45.148 INFO:teuthology.orchestra.run.smithi072.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.0-668-gab9fe435-1jammy [3,404 kB] 2023-10-16T23:23:45.158 INFO:teuthology.orchestra.run.smithi012.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-16T23:23:45.158 INFO:teuthology.orchestra.run.smithi012.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-10-16T23:23:45.159 INFO:teuthology.orchestra.run.smithi012.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-10-16T23:23:45.159 INFO:teuthology.orchestra.run.smithi012.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-10-16T23:23:45.160 INFO:teuthology.orchestra.run.smithi031.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-10-16T23:23:45.160 INFO:teuthology.orchestra.run.smithi012.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-10-16T23:23:45.160 INFO:teuthology.orchestra.run.smithi012.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-10-16T23:23:45.163 INFO:teuthology.orchestra.run.smithi031.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-10-16T23:23:45.164 INFO:teuthology.orchestra.run.smithi012.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-10-16T23:23:45.165 INFO:teuthology.orchestra.run.smithi012.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-10-16T23:23:45.165 INFO:teuthology.orchestra.run.smithi012.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-10-16T23:23:45.168 INFO:teuthology.orchestra.run.smithi033.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-10-16T23:23:45.174 INFO:teuthology.orchestra.run.smithi031.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-10-16T23:23:45.177 INFO:teuthology.orchestra.run.smithi031.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-10-16T23:23:45.178 INFO:teuthology.orchestra.run.smithi031.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-10-16T23:23:45.179 INFO:teuthology.orchestra.run.smithi012.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-10-16T23:23:45.180 INFO:teuthology.orchestra.run.smithi012.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-10-16T23:23:45.182 INFO:teuthology.orchestra.run.smithi033.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-10-16T23:23:45.183 INFO:teuthology.orchestra.run.smithi012.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-10-16T23:23:45.183 INFO:teuthology.orchestra.run.smithi072.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-10-16T23:23:45.183 INFO:teuthology.orchestra.run.smithi012.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-10-16T23:23:45.186 INFO:teuthology.orchestra.run.smithi031.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-10-16T23:23:45.187 INFO:teuthology.orchestra.run.smithi031.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-10-16T23:23:45.187 INFO:teuthology.orchestra.run.smithi031.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-10-16T23:23:45.188 INFO:teuthology.orchestra.run.smithi031.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-10-16T23:23:45.189 INFO:teuthology.orchestra.run.smithi031.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-10-16T23:23:45.191 INFO:teuthology.orchestra.run.smithi072.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-10-16T23:23:45.196 INFO:teuthology.orchestra.run.smithi031.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-10-16T23:23:45.196 INFO:teuthology.orchestra.run.smithi031.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-10-16T23:23:45.199 INFO:teuthology.orchestra.run.smithi138.stdout:0 upgraded, 115 newly installed, 0 to remove and 256 not upgraded. 2023-10-16T23:23:45.200 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 180 MB of archives. 2023-10-16T23:23:45.200 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 810 MB of additional disk space will be used. 2023-10-16T23:23:45.200 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-10-16T23:23:45.201 INFO:teuthology.orchestra.run.smithi012.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-10-16T23:23:45.202 INFO:teuthology.orchestra.run.smithi012.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-10-16T23:23:45.203 INFO:teuthology.orchestra.run.smithi012.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-10-16T23:23:45.203 INFO:teuthology.orchestra.run.smithi012.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-10-16T23:23:45.205 INFO:teuthology.orchestra.run.smithi012.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-10-16T23:23:45.213 INFO:teuthology.orchestra.run.smithi031.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-10-16T23:23:45.213 INFO:teuthology.orchestra.run.smithi031.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-10-16T23:23:45.214 INFO:teuthology.orchestra.run.smithi031.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-10-16T23:23:45.216 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-10-16T23:23:45.217 INFO:teuthology.orchestra.run.smithi031.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-10-16T23:23:45.217 INFO:teuthology.orchestra.run.smithi031.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-10-16T23:23:45.218 INFO:teuthology.orchestra.run.smithi031.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-10-16T23:23:45.218 INFO:teuthology.orchestra.run.smithi031.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-10-16T23:23:45.219 INFO:teuthology.orchestra.run.smithi031.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-16T23:23:45.227 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-10-16T23:23:45.228 INFO:teuthology.orchestra.run.smithi072.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-10-16T23:23:45.230 INFO:teuthology.orchestra.run.smithi031.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-10-16T23:23:45.230 INFO:teuthology.orchestra.run.smithi031.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-10-16T23:23:45.232 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-10-16T23:23:45.247 INFO:teuthology.orchestra.run.smithi031.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-10-16T23:23:45.248 INFO:teuthology.orchestra.run.smithi031.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-10-16T23:23:45.248 INFO:teuthology.orchestra.run.smithi031.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-10-16T23:23:45.250 INFO:teuthology.orchestra.run.smithi033.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-10-16T23:23:45.254 INFO:teuthology.orchestra.run.smithi031.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-10-16T23:23:45.254 INFO:teuthology.orchestra.run.smithi031.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-10-16T23:23:45.254 INFO:teuthology.orchestra.run.smithi031.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-10-16T23:23:45.255 INFO:teuthology.orchestra.run.smithi031.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-10-16T23:23:45.256 INFO:teuthology.orchestra.run.smithi031.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-10-16T23:23:45.257 INFO:teuthology.orchestra.run.smithi072.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-10-16T23:23:45.263 INFO:teuthology.orchestra.run.smithi031.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-10-16T23:23:45.264 INFO:teuthology.orchestra.run.smithi031.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-10-16T23:23:45.267 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-10-16T23:23:45.275 INFO:teuthology.orchestra.run.smithi031.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-10-16T23:23:45.276 INFO:teuthology.orchestra.run.smithi031.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-10-16T23:23:45.277 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-10-16T23:23:45.278 INFO:teuthology.orchestra.run.smithi012.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-10-16T23:23:45.280 INFO:teuthology.orchestra.run.smithi012.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-10-16T23:23:45.280 INFO:teuthology.orchestra.run.smithi031.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-10-16T23:23:45.281 INFO:teuthology.orchestra.run.smithi031.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-10-16T23:23:45.282 INFO:teuthology.orchestra.run.smithi012.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-10-16T23:23:45.282 INFO:teuthology.orchestra.run.smithi012.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-10-16T23:23:45.283 INFO:teuthology.orchestra.run.smithi012.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-10-16T23:23:45.284 INFO:teuthology.orchestra.run.smithi012.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-10-16T23:23:45.284 INFO:teuthology.orchestra.run.smithi031.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-10-16T23:23:45.285 INFO:teuthology.orchestra.run.smithi012.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-10-16T23:23:45.285 INFO:teuthology.orchestra.run.smithi012.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-10-16T23:23:45.287 INFO:teuthology.orchestra.run.smithi033.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-10-16T23:23:45.287 INFO:teuthology.orchestra.run.smithi012.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-16T23:23:45.293 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-10-16T23:23:45.295 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-10-16T23:23:45.305 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-10-16T23:23:45.323 INFO:teuthology.orchestra.run.smithi012.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-10-16T23:23:45.324 INFO:teuthology.orchestra.run.smithi012.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-10-16T23:23:45.338 INFO:teuthology.orchestra.run.smithi031.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-10-16T23:23:45.339 INFO:teuthology.orchestra.run.smithi031.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-10-16T23:23:45.340 INFO:teuthology.orchestra.run.smithi031.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-10-16T23:23:45.340 INFO:teuthology.orchestra.run.smithi031.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-10-16T23:23:45.341 INFO:teuthology.orchestra.run.smithi031.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-10-16T23:23:45.342 INFO:teuthology.orchestra.run.smithi031.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-10-16T23:23:45.342 INFO:teuthology.orchestra.run.smithi031.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-10-16T23:23:45.342 INFO:teuthology.orchestra.run.smithi031.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-10-16T23:23:45.344 INFO:teuthology.orchestra.run.smithi031.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-16T23:23:45.350 INFO:teuthology.orchestra.run.smithi012.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-10-16T23:23:45.351 INFO:teuthology.orchestra.run.smithi033.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-10-16T23:23:45.351 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-10-16T23:23:45.355 INFO:teuthology.orchestra.run.smithi138.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-10-16T23:23:45.356 INFO:teuthology.orchestra.run.smithi033.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-10-16T23:23:45.356 INFO:teuthology.orchestra.run.smithi031.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-10-16T23:23:45.362 INFO:teuthology.orchestra.run.smithi031.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-10-16T23:23:45.366 INFO:teuthology.orchestra.run.smithi138.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-10-16T23:23:45.369 INFO:teuthology.orchestra.run.smithi138.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-10-16T23:23:45.370 INFO:teuthology.orchestra.run.smithi138.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-10-16T23:23:45.373 INFO:teuthology.orchestra.run.smithi033.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.0-668-gab9fe435-1jammy [3,404 kB] 2023-10-16T23:23:45.374 INFO:teuthology.orchestra.run.smithi012.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-10-16T23:23:45.375 INFO:teuthology.orchestra.run.smithi012.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-10-16T23:23:45.378 INFO:teuthology.orchestra.run.smithi138.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-10-16T23:23:45.379 INFO:teuthology.orchestra.run.smithi138.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-10-16T23:23:45.379 INFO:teuthology.orchestra.run.smithi138.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-10-16T23:23:45.380 INFO:teuthology.orchestra.run.smithi138.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-10-16T23:23:45.380 INFO:teuthology.orchestra.run.smithi138.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-10-16T23:23:45.381 INFO:teuthology.orchestra.run.smithi031.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-10-16T23:23:45.383 INFO:teuthology.orchestra.run.smithi031.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-10-16T23:23:45.383 INFO:teuthology.orchestra.run.smithi031.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-10-16T23:23:45.388 INFO:teuthology.orchestra.run.smithi138.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-10-16T23:23:45.388 INFO:teuthology.orchestra.run.smithi138.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-10-16T23:23:45.399 INFO:teuthology.orchestra.run.smithi031.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-10-16T23:23:45.399 INFO:teuthology.orchestra.run.smithi031.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-10-16T23:23:45.400 INFO:teuthology.orchestra.run.smithi031.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-10-16T23:23:45.400 INFO:teuthology.orchestra.run.smithi031.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-10-16T23:23:45.400 INFO:teuthology.orchestra.run.smithi031.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-10-16T23:23:45.401 INFO:teuthology.orchestra.run.smithi031.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-10-16T23:23:45.405 INFO:teuthology.orchestra.run.smithi138.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-10-16T23:23:45.406 INFO:teuthology.orchestra.run.smithi138.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-10-16T23:23:45.406 INFO:teuthology.orchestra.run.smithi138.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-10-16T23:23:45.407 INFO:teuthology.orchestra.run.smithi031.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-10-16T23:23:45.407 INFO:teuthology.orchestra.run.smithi031.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-10-16T23:23:45.409 INFO:teuthology.orchestra.run.smithi138.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-10-16T23:23:45.409 INFO:teuthology.orchestra.run.smithi138.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-10-16T23:23:45.410 INFO:teuthology.orchestra.run.smithi138.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-10-16T23:23:45.410 INFO:teuthology.orchestra.run.smithi138.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-10-16T23:23:45.411 INFO:teuthology.orchestra.run.smithi031.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-10-16T23:23:45.411 INFO:teuthology.orchestra.run.smithi138.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-16T23:23:45.413 INFO:teuthology.orchestra.run.smithi033.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-10-16T23:23:45.422 INFO:teuthology.orchestra.run.smithi138.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-10-16T23:23:45.422 INFO:teuthology.orchestra.run.smithi138.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-10-16T23:23:45.424 INFO:teuthology.orchestra.run.smithi031.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-10-16T23:23:45.426 INFO:teuthology.orchestra.run.smithi031.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-10-16T23:23:45.427 INFO:teuthology.orchestra.run.smithi031.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-10-16T23:23:45.430 INFO:teuthology.orchestra.run.smithi031.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-10-16T23:23:45.432 INFO:teuthology.orchestra.run.smithi031.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-10-16T23:23:45.432 INFO:teuthology.orchestra.run.smithi031.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-10-16T23:23:45.436 INFO:teuthology.orchestra.run.smithi031.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-10-16T23:23:45.439 INFO:teuthology.orchestra.run.smithi138.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-10-16T23:23:45.440 INFO:teuthology.orchestra.run.smithi138.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-10-16T23:23:45.440 INFO:teuthology.orchestra.run.smithi138.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-10-16T23:23:45.441 INFO:teuthology.orchestra.run.smithi031.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-16T23:23:45.442 INFO:teuthology.orchestra.run.smithi031.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-10-16T23:23:45.443 INFO:teuthology.orchestra.run.smithi031.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-10-16T23:23:45.446 INFO:teuthology.orchestra.run.smithi138.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-10-16T23:23:45.447 INFO:teuthology.orchestra.run.smithi138.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-10-16T23:23:45.447 INFO:teuthology.orchestra.run.smithi138.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-10-16T23:23:45.447 INFO:teuthology.orchestra.run.smithi138.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-10-16T23:23:45.448 INFO:teuthology.orchestra.run.smithi138.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-10-16T23:23:45.455 INFO:teuthology.orchestra.run.smithi012.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-10-16T23:23:45.456 INFO:teuthology.orchestra.run.smithi012.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-10-16T23:23:45.456 INFO:teuthology.orchestra.run.smithi138.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-10-16T23:23:45.457 INFO:teuthology.orchestra.run.smithi012.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-10-16T23:23:45.457 INFO:teuthology.orchestra.run.smithi138.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-10-16T23:23:45.458 INFO:teuthology.orchestra.run.smithi012.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-10-16T23:23:45.459 INFO:teuthology.orchestra.run.smithi138.stdout:Get:41 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.0-668-gab9fe435-1jammy [3,404 kB] 2023-10-16T23:23:45.459 INFO:teuthology.orchestra.run.smithi031.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-10-16T23:23:45.459 INFO:teuthology.orchestra.run.smithi031.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-10-16T23:23:45.460 INFO:teuthology.orchestra.run.smithi031.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-10-16T23:23:45.460 INFO:teuthology.orchestra.run.smithi012.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-10-16T23:23:45.461 INFO:teuthology.orchestra.run.smithi012.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-10-16T23:23:45.461 INFO:teuthology.orchestra.run.smithi012.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-10-16T23:23:45.462 INFO:teuthology.orchestra.run.smithi072.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-10-16T23:23:45.462 INFO:teuthology.orchestra.run.smithi012.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-10-16T23:23:45.466 INFO:teuthology.orchestra.run.smithi072.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-10-16T23:23:45.468 INFO:teuthology.orchestra.run.smithi138.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-10-16T23:23:45.468 INFO:teuthology.orchestra.run.smithi012.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-10-16T23:23:45.469 INFO:teuthology.orchestra.run.smithi138.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-10-16T23:23:45.471 INFO:teuthology.orchestra.run.smithi138.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-10-16T23:23:45.472 INFO:teuthology.orchestra.run.smithi138.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-10-16T23:23:45.475 INFO:teuthology.orchestra.run.smithi138.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-10-16T23:23:45.483 INFO:teuthology.orchestra.run.smithi072.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-10-16T23:23:45.489 INFO:teuthology.orchestra.run.smithi072.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-10-16T23:23:45.490 INFO:teuthology.orchestra.run.smithi072.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-10-16T23:23:45.494 INFO:teuthology.orchestra.run.smithi012.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-10-16T23:23:45.497 INFO:teuthology.orchestra.run.smithi012.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-10-16T23:23:45.498 INFO:teuthology.orchestra.run.smithi012.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-10-16T23:23:45.504 INFO:teuthology.orchestra.run.smithi072.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-10-16T23:23:45.505 INFO:teuthology.orchestra.run.smithi012.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-10-16T23:23:45.505 INFO:teuthology.orchestra.run.smithi072.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-10-16T23:23:45.506 INFO:teuthology.orchestra.run.smithi072.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-10-16T23:23:45.508 INFO:teuthology.orchestra.run.smithi072.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-10-16T23:23:45.508 INFO:teuthology.orchestra.run.smithi072.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-10-16T23:23:45.510 INFO:teuthology.orchestra.run.smithi012.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-10-16T23:23:45.510 INFO:teuthology.orchestra.run.smithi012.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-10-16T23:23:45.518 INFO:teuthology.orchestra.run.smithi012.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-10-16T23:23:45.525 INFO:teuthology.orchestra.run.smithi012.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-16T23:23:45.526 INFO:teuthology.orchestra.run.smithi138.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-10-16T23:23:45.526 INFO:teuthology.orchestra.run.smithi012.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-10-16T23:23:45.527 INFO:teuthology.orchestra.run.smithi138.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-10-16T23:23:45.528 INFO:teuthology.orchestra.run.smithi138.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-10-16T23:23:45.528 INFO:teuthology.orchestra.run.smithi138.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-10-16T23:23:45.529 INFO:teuthology.orchestra.run.smithi138.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-10-16T23:23:45.529 INFO:teuthology.orchestra.run.smithi012.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-10-16T23:23:45.530 INFO:teuthology.orchestra.run.smithi138.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-10-16T23:23:45.530 INFO:teuthology.orchestra.run.smithi138.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-10-16T23:23:45.530 INFO:teuthology.orchestra.run.smithi138.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-10-16T23:23:45.532 INFO:teuthology.orchestra.run.smithi138.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-16T23:23:45.535 INFO:teuthology.orchestra.run.smithi072.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-10-16T23:23:45.536 INFO:teuthology.orchestra.run.smithi072.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-10-16T23:23:45.536 INFO:teuthology.orchestra.run.smithi072.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-10-16T23:23:45.537 INFO:teuthology.orchestra.run.smithi072.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-10-16T23:23:45.545 INFO:teuthology.orchestra.run.smithi012.stdout:Get:80 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.0-668-gab9fe435-1jammy [3,093 kB] 2023-10-16T23:23:45.552 INFO:teuthology.orchestra.run.smithi012.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-10-16T23:23:45.553 INFO:teuthology.orchestra.run.smithi012.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-10-16T23:23:45.554 INFO:teuthology.orchestra.run.smithi012.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-10-16T23:23:45.555 INFO:teuthology.orchestra.run.smithi138.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-10-16T23:23:45.561 INFO:teuthology.orchestra.run.smithi138.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-10-16T23:23:45.579 INFO:teuthology.orchestra.run.smithi138.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-10-16T23:23:45.581 INFO:teuthology.orchestra.run.smithi138.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-10-16T23:23:45.581 INFO:teuthology.orchestra.run.smithi138.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-10-16T23:23:45.584 INFO:teuthology.orchestra.run.smithi072.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-10-16T23:23:45.589 INFO:teuthology.orchestra.run.smithi072.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-10-16T23:23:45.590 INFO:teuthology.orchestra.run.smithi072.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-10-16T23:23:45.591 INFO:teuthology.orchestra.run.smithi072.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-10-16T23:23:45.591 INFO:teuthology.orchestra.run.smithi072.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-10-16T23:23:45.593 INFO:teuthology.orchestra.run.smithi072.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-16T23:23:45.596 INFO:teuthology.orchestra.run.smithi138.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-10-16T23:23:45.597 INFO:teuthology.orchestra.run.smithi138.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-10-16T23:23:45.598 INFO:teuthology.orchestra.run.smithi138.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-10-16T23:23:45.598 INFO:teuthology.orchestra.run.smithi138.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-10-16T23:23:45.599 INFO:teuthology.orchestra.run.smithi138.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-10-16T23:23:45.599 INFO:teuthology.orchestra.run.smithi138.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-10-16T23:23:45.599 INFO:teuthology.orchestra.run.smithi138.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-10-16T23:23:45.603 INFO:teuthology.orchestra.run.smithi033.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-10-16T23:23:45.608 INFO:teuthology.orchestra.run.smithi033.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-10-16T23:23:45.614 INFO:teuthology.orchestra.run.smithi138.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-10-16T23:23:45.618 INFO:teuthology.orchestra.run.smithi138.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-10-16T23:23:45.621 INFO:teuthology.orchestra.run.smithi072.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-10-16T23:23:45.622 INFO:teuthology.orchestra.run.smithi072.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-10-16T23:23:45.624 INFO:teuthology.orchestra.run.smithi072.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-10-16T23:23:45.627 INFO:teuthology.orchestra.run.smithi072.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-10-16T23:23:45.631 INFO:teuthology.orchestra.run.smithi138.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-10-16T23:23:45.633 INFO:teuthology.orchestra.run.smithi138.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-10-16T23:23:45.633 INFO:teuthology.orchestra.run.smithi138.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-10-16T23:23:45.637 INFO:teuthology.orchestra.run.smithi138.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-10-16T23:23:45.639 INFO:teuthology.orchestra.run.smithi033.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-10-16T23:23:45.639 INFO:teuthology.orchestra.run.smithi138.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-10-16T23:23:45.640 INFO:teuthology.orchestra.run.smithi138.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-10-16T23:23:45.643 INFO:teuthology.orchestra.run.smithi138.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-10-16T23:23:45.646 INFO:teuthology.orchestra.run.smithi138.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-16T23:23:45.647 INFO:teuthology.orchestra.run.smithi033.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-10-16T23:23:45.647 INFO:teuthology.orchestra.run.smithi033.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-10-16T23:23:45.648 INFO:teuthology.orchestra.run.smithi138.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-10-16T23:23:45.650 INFO:teuthology.orchestra.run.smithi138.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-10-16T23:23:45.657 INFO:teuthology.orchestra.run.smithi072.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-10-16T23:23:45.662 INFO:teuthology.orchestra.run.smithi033.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-10-16T23:23:45.664 INFO:teuthology.orchestra.run.smithi033.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-10-16T23:23:45.664 INFO:teuthology.orchestra.run.smithi033.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-10-16T23:23:45.665 INFO:teuthology.orchestra.run.smithi138.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-10-16T23:23:45.665 INFO:teuthology.orchestra.run.smithi138.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-10-16T23:23:45.666 INFO:teuthology.orchestra.run.smithi138.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-10-16T23:23:45.667 INFO:teuthology.orchestra.run.smithi033.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-10-16T23:23:45.667 INFO:teuthology.orchestra.run.smithi033.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-10-16T23:23:45.668 INFO:teuthology.orchestra.run.smithi072.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-10-16T23:23:45.668 INFO:teuthology.orchestra.run.smithi072.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-10-16T23:23:45.669 INFO:teuthology.orchestra.run.smithi072.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-10-16T23:23:45.670 INFO:teuthology.orchestra.run.smithi072.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-10-16T23:23:45.673 INFO:teuthology.orchestra.run.smithi072.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-10-16T23:23:45.677 INFO:teuthology.orchestra.run.smithi033.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-10-16T23:23:45.678 INFO:teuthology.orchestra.run.smithi033.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-10-16T23:23:45.683 INFO:teuthology.orchestra.run.smithi072.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-10-16T23:23:45.684 INFO:teuthology.orchestra.run.smithi072.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-10-16T23:23:45.687 INFO:teuthology.orchestra.run.smithi072.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-10-16T23:23:45.688 INFO:teuthology.orchestra.run.smithi072.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-10-16T23:23:45.704 INFO:teuthology.orchestra.run.smithi033.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-10-16T23:23:45.705 INFO:teuthology.orchestra.run.smithi033.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-10-16T23:23:45.705 INFO:teuthology.orchestra.run.smithi033.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-10-16T23:23:45.710 INFO:teuthology.orchestra.run.smithi072.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-10-16T23:23:45.710 INFO:teuthology.orchestra.run.smithi033.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-10-16T23:23:45.711 INFO:teuthology.orchestra.run.smithi033.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-10-16T23:23:45.711 INFO:teuthology.orchestra.run.smithi072.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-10-16T23:23:45.712 INFO:teuthology.orchestra.run.smithi033.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-10-16T23:23:45.712 INFO:teuthology.orchestra.run.smithi033.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-10-16T23:23:45.714 INFO:teuthology.orchestra.run.smithi033.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-16T23:23:45.715 INFO:teuthology.orchestra.run.smithi031.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.0-668-gab9fe435-1jammy [3,093 kB] 2023-10-16T23:23:45.716 INFO:teuthology.orchestra.run.smithi072.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-10-16T23:23:45.730 INFO:teuthology.orchestra.run.smithi033.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-10-16T23:23:45.731 INFO:teuthology.orchestra.run.smithi033.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-10-16T23:23:45.770 INFO:teuthology.orchestra.run.smithi033.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-10-16T23:23:45.773 INFO:teuthology.orchestra.run.smithi033.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-10-16T23:23:45.773 INFO:teuthology.orchestra.run.smithi033.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-10-16T23:23:45.782 INFO:teuthology.orchestra.run.smithi033.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-10-16T23:23:45.782 INFO:teuthology.orchestra.run.smithi033.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-10-16T23:23:45.783 INFO:teuthology.orchestra.run.smithi033.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-10-16T23:23:45.784 INFO:teuthology.orchestra.run.smithi012.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.0-668-gab9fe435-1jammy [653 kB] 2023-10-16T23:23:45.784 INFO:teuthology.orchestra.run.smithi033.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-10-16T23:23:45.786 INFO:teuthology.orchestra.run.smithi033.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-10-16T23:23:45.789 INFO:teuthology.orchestra.run.smithi072.stdout:Get:47 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.0-668-gab9fe435-1jammy [3,093 kB] 2023-10-16T23:23:45.807 INFO:teuthology.orchestra.run.smithi072.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-10-16T23:23:45.815 INFO:teuthology.orchestra.run.smithi072.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-10-16T23:23:45.816 INFO:teuthology.orchestra.run.smithi072.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-10-16T23:23:45.816 INFO:teuthology.orchestra.run.smithi072.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-10-16T23:23:45.816 INFO:teuthology.orchestra.run.smithi072.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-10-16T23:23:45.816 INFO:teuthology.orchestra.run.smithi072.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-10-16T23:23:45.822 INFO:teuthology.orchestra.run.smithi033.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-10-16T23:23:45.823 INFO:teuthology.orchestra.run.smithi033.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-10-16T23:23:45.832 INFO:teuthology.orchestra.run.smithi033.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-10-16T23:23:45.834 INFO:teuthology.orchestra.run.smithi033.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-10-16T23:23:45.839 INFO:teuthology.orchestra.run.smithi012.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.0-668-gab9fe435-1jammy [345 kB] 2023-10-16T23:23:45.840 INFO:teuthology.orchestra.run.smithi033.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-10-16T23:23:45.840 INFO:teuthology.orchestra.run.smithi072.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-10-16T23:23:45.840 INFO:teuthology.orchestra.run.smithi072.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-10-16T23:23:45.841 INFO:teuthology.orchestra.run.smithi033.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-10-16T23:23:45.843 INFO:teuthology.orchestra.run.smithi072.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-16T23:23:45.846 INFO:teuthology.orchestra.run.smithi033.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-10-16T23:23:45.861 INFO:teuthology.orchestra.run.smithi072.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-10-16T23:23:45.870 INFO:teuthology.orchestra.run.smithi012.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.0-668-gab9fe435-1jammy [23.0 kB] 2023-10-16T23:23:45.870 INFO:teuthology.orchestra.run.smithi012.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.0-668-gab9fe435-1jammy [164 kB] 2023-10-16T23:23:45.876 INFO:teuthology.orchestra.run.smithi012.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.0-668-gab9fe435-1jammy [51.6 kB] 2023-10-16T23:23:45.878 INFO:teuthology.orchestra.run.smithi012.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.0-668-gab9fe435-1jammy [318 kB] 2023-10-16T23:23:45.883 INFO:teuthology.orchestra.run.smithi072.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-10-16T23:23:45.909 INFO:teuthology.orchestra.run.smithi012.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.0-668-gab9fe435-1jammy [5,861 kB] 2023-10-16T23:23:45.923 INFO:teuthology.orchestra.run.smithi072.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-10-16T23:23:45.927 INFO:teuthology.orchestra.run.smithi072.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-10-16T23:23:45.927 INFO:teuthology.orchestra.run.smithi072.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-10-16T23:23:45.991 INFO:teuthology.orchestra.run.smithi033.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-10-16T23:23:45.992 INFO:teuthology.orchestra.run.smithi033.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-10-16T23:23:45.993 INFO:teuthology.orchestra.run.smithi072.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-10-16T23:23:45.994 INFO:teuthology.orchestra.run.smithi072.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-10-16T23:23:45.995 INFO:teuthology.orchestra.run.smithi033.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-10-16T23:23:45.995 INFO:teuthology.orchestra.run.smithi072.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-10-16T23:23:45.996 INFO:teuthology.orchestra.run.smithi033.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-10-16T23:23:45.996 INFO:teuthology.orchestra.run.smithi072.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-10-16T23:23:45.997 INFO:teuthology.orchestra.run.smithi033.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-10-16T23:23:45.997 INFO:teuthology.orchestra.run.smithi072.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-10-16T23:23:45.998 INFO:teuthology.orchestra.run.smithi072.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-10-16T23:23:45.998 INFO:teuthology.orchestra.run.smithi033.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-10-16T23:23:45.999 INFO:teuthology.orchestra.run.smithi033.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-10-16T23:23:45.999 INFO:teuthology.orchestra.run.smithi072.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-10-16T23:23:46.000 INFO:teuthology.orchestra.run.smithi033.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-10-16T23:23:46.000 INFO:teuthology.orchestra.run.smithi072.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-10-16T23:23:46.003 INFO:teuthology.orchestra.run.smithi033.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-16T23:23:46.006 INFO:teuthology.orchestra.run.smithi072.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-10-16T23:23:46.015 INFO:teuthology.orchestra.run.smithi072.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-10-16T23:23:46.017 INFO:teuthology.orchestra.run.smithi033.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-10-16T23:23:46.032 INFO:teuthology.orchestra.run.smithi072.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-10-16T23:23:46.033 INFO:teuthology.orchestra.run.smithi072.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-10-16T23:23:46.039 INFO:teuthology.orchestra.run.smithi072.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-10-16T23:23:46.039 INFO:teuthology.orchestra.run.smithi033.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-10-16T23:23:46.043 INFO:teuthology.orchestra.run.smithi072.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-10-16T23:23:46.043 INFO:teuthology.orchestra.run.smithi072.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-10-16T23:23:46.050 INFO:teuthology.orchestra.run.smithi072.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-10-16T23:23:46.056 INFO:teuthology.orchestra.run.smithi072.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-16T23:23:46.057 INFO:teuthology.orchestra.run.smithi072.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-10-16T23:23:46.058 INFO:teuthology.orchestra.run.smithi031.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.0-668-gab9fe435-1jammy [653 kB] 2023-10-16T23:23:46.060 INFO:teuthology.orchestra.run.smithi072.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-10-16T23:23:46.087 INFO:teuthology.orchestra.run.smithi033.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-10-16T23:23:46.091 INFO:teuthology.orchestra.run.smithi033.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-10-16T23:23:46.091 INFO:teuthology.orchestra.run.smithi033.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-10-16T23:23:46.098 INFO:teuthology.orchestra.run.smithi072.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-10-16T23:23:46.099 INFO:teuthology.orchestra.run.smithi072.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-10-16T23:23:46.100 INFO:teuthology.orchestra.run.smithi072.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-10-16T23:23:46.140 INFO:teuthology.orchestra.run.smithi031.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.0-668-gab9fe435-1jammy [345 kB] 2023-10-16T23:23:46.146 INFO:teuthology.orchestra.run.smithi033.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-10-16T23:23:46.146 INFO:teuthology.orchestra.run.smithi033.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-10-16T23:23:46.147 INFO:teuthology.orchestra.run.smithi033.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-10-16T23:23:46.148 INFO:teuthology.orchestra.run.smithi033.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-10-16T23:23:46.148 INFO:teuthology.orchestra.run.smithi033.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-10-16T23:23:46.149 INFO:teuthology.orchestra.run.smithi033.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-10-16T23:23:46.150 INFO:teuthology.orchestra.run.smithi033.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-10-16T23:23:46.154 INFO:teuthology.orchestra.run.smithi033.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-10-16T23:23:46.166 INFO:teuthology.orchestra.run.smithi033.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-10-16T23:23:46.173 INFO:teuthology.orchestra.run.smithi033.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-10-16T23:23:46.176 INFO:teuthology.orchestra.run.smithi033.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-10-16T23:23:46.177 INFO:teuthology.orchestra.run.smithi033.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-10-16T23:23:46.182 INFO:teuthology.orchestra.run.smithi033.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-10-16T23:23:46.186 INFO:teuthology.orchestra.run.smithi031.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.0-668-gab9fe435-1jammy [23.0 kB] 2023-10-16T23:23:46.187 INFO:teuthology.orchestra.run.smithi031.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.0-668-gab9fe435-1jammy [164 kB] 2023-10-16T23:23:46.188 INFO:teuthology.orchestra.run.smithi033.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-10-16T23:23:46.188 INFO:teuthology.orchestra.run.smithi033.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-10-16T23:23:46.192 INFO:teuthology.orchestra.run.smithi031.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.0-668-gab9fe435-1jammy [51.6 kB] 2023-10-16T23:23:46.192 INFO:teuthology.orchestra.run.smithi033.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-10-16T23:23:46.193 INFO:teuthology.orchestra.run.smithi031.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.0-668-gab9fe435-1jammy [318 kB] 2023-10-16T23:23:46.197 INFO:teuthology.orchestra.run.smithi033.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-16T23:23:46.198 INFO:teuthology.orchestra.run.smithi033.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-10-16T23:23:46.200 INFO:teuthology.orchestra.run.smithi033.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-10-16T23:23:46.213 INFO:teuthology.orchestra.run.smithi033.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-10-16T23:23:46.213 INFO:teuthology.orchestra.run.smithi033.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-10-16T23:23:46.214 INFO:teuthology.orchestra.run.smithi033.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-10-16T23:23:46.219 INFO:teuthology.orchestra.run.smithi072.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.0-668-gab9fe435-1jammy [653 kB] 2023-10-16T23:23:46.240 INFO:teuthology.orchestra.run.smithi031.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.0-668-gab9fe435-1jammy [5,861 kB] 2023-10-16T23:23:46.280 INFO:teuthology.orchestra.run.smithi072.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.0-668-gab9fe435-1jammy [345 kB] 2023-10-16T23:23:46.331 INFO:teuthology.orchestra.run.smithi072.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.0-668-gab9fe435-1jammy [23.0 kB] 2023-10-16T23:23:46.332 INFO:teuthology.orchestra.run.smithi072.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.0-668-gab9fe435-1jammy [164 kB] 2023-10-16T23:23:46.369 INFO:teuthology.orchestra.run.smithi012.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.0-668-gab9fe435-1jammy [102 kB] 2023-10-16T23:23:46.372 INFO:teuthology.orchestra.run.smithi012.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.0-668-gab9fe435-1jammy [431 kB] 2023-10-16T23:23:46.380 INFO:teuthology.orchestra.run.smithi072.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.0-668-gab9fe435-1jammy [51.6 kB] 2023-10-16T23:23:46.382 INFO:teuthology.orchestra.run.smithi072.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.0-668-gab9fe435-1jammy [318 kB] 2023-10-16T23:23:46.418 INFO:teuthology.orchestra.run.smithi012.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.0-668-gab9fe435-1jammy [21.9 MB] 2023-10-16T23:23:46.438 INFO:teuthology.orchestra.run.smithi072.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.0-668-gab9fe435-1jammy [5,861 kB] 2023-10-16T23:23:46.981 INFO:teuthology.orchestra.run.smithi031.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.0-668-gab9fe435-1jammy [102 kB] 2023-10-16T23:23:46.993 INFO:teuthology.orchestra.run.smithi031.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.0-668-gab9fe435-1jammy [431 kB] 2023-10-16T23:23:47.040 INFO:teuthology.orchestra.run.smithi031.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.0-668-gab9fe435-1jammy [21.9 MB] 2023-10-16T23:23:47.199 INFO:teuthology.orchestra.run.smithi072.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.0-668-gab9fe435-1jammy [102 kB] 2023-10-16T23:23:47.202 INFO:teuthology.orchestra.run.smithi072.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.0-668-gab9fe435-1jammy [431 kB] 2023-10-16T23:23:47.261 INFO:teuthology.orchestra.run.smithi072.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.0-668-gab9fe435-1jammy [21.9 MB] 2023-10-16T23:23:48.255 INFO:teuthology.orchestra.run.smithi012.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.0-668-gab9fe435-1jammy [6,825 kB] 2023-10-16T23:23:48.745 INFO:teuthology.orchestra.run.smithi012.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.0-668-gab9fe435-1jammy [227 kB] 2023-10-16T23:23:48.751 INFO:teuthology.orchestra.run.smithi012.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.0-668-gab9fe435-1jammy [119 kB] 2023-10-16T23:23:48.755 INFO:teuthology.orchestra.run.smithi012.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.0-668-gab9fe435-1jammy [1,470 kB] 2023-10-16T23:23:48.890 INFO:teuthology.orchestra.run.smithi012.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.0-668-gab9fe435-1jammy [9,870 kB] 2023-10-16T23:23:49.152 INFO:teuthology.orchestra.run.smithi033.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.0-668-gab9fe435-1jammy [3,093 kB] 2023-10-16T23:23:49.245 INFO:teuthology.orchestra.run.smithi138.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.0-668-gab9fe435-1jammy [3,093 kB] 2023-10-16T23:23:49.615 INFO:teuthology.orchestra.run.smithi031.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.0-668-gab9fe435-1jammy [6,825 kB] 2023-10-16T23:23:49.721 INFO:teuthology.orchestra.run.smithi012.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.0-668-gab9fe435-1jammy [31.5 MB] 2023-10-16T23:23:50.156 INFO:teuthology.orchestra.run.smithi072.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.0-668-gab9fe435-1jammy [6,825 kB] 2023-10-16T23:23:50.438 INFO:teuthology.orchestra.run.smithi031.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.0-668-gab9fe435-1jammy [227 kB] 2023-10-16T23:23:50.444 INFO:teuthology.orchestra.run.smithi031.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.0-668-gab9fe435-1jammy [119 kB] 2023-10-16T23:23:50.471 INFO:teuthology.orchestra.run.smithi031.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.0-668-gab9fe435-1jammy [1,470 kB] 2023-10-16T23:23:50.697 INFO:teuthology.orchestra.run.smithi031.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.0-668-gab9fe435-1jammy [9,870 kB] 2023-10-16T23:23:50.927 INFO:teuthology.orchestra.run.smithi072.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.0-668-gab9fe435-1jammy [227 kB] 2023-10-16T23:23:50.931 INFO:teuthology.orchestra.run.smithi072.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.0-668-gab9fe435-1jammy [119 kB] 2023-10-16T23:23:50.934 INFO:teuthology.orchestra.run.smithi072.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.0-668-gab9fe435-1jammy [1,470 kB] 2023-10-16T23:23:51.080 INFO:teuthology.orchestra.run.smithi072.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.0-668-gab9fe435-1jammy [9,870 kB] 2023-10-16T23:23:52.130 INFO:teuthology.orchestra.run.smithi031.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.0-668-gab9fe435-1jammy [31.5 MB] 2023-10-16T23:23:52.157 INFO:teuthology.orchestra.run.smithi138.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.0-668-gab9fe435-1jammy [653 kB] 2023-10-16T23:23:52.222 INFO:teuthology.orchestra.run.smithi012.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.0-668-gab9fe435-1jammy [3,654 B] 2023-10-16T23:23:52.222 INFO:teuthology.orchestra.run.smithi012.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.0-668-gab9fe435-1jammy [808 kB] 2023-10-16T23:23:52.238 INFO:teuthology.orchestra.run.smithi012.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.0-668-gab9fe435-1jammy [2,152 kB] 2023-10-16T23:23:52.256 INFO:teuthology.orchestra.run.smithi033.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.0-668-gab9fe435-1jammy [653 kB] 2023-10-16T23:23:52.304 INFO:teuthology.orchestra.run.smithi072.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.0-668-gab9fe435-1jammy [31.5 MB] 2023-10-16T23:23:52.393 INFO:teuthology.orchestra.run.smithi012.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.0-668-gab9fe435-1jammy [222 kB] 2023-10-16T23:23:52.406 INFO:teuthology.orchestra.run.smithi012.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.0-668-gab9fe435-1jammy [128 kB] 2023-10-16T23:23:52.411 INFO:teuthology.orchestra.run.smithi012.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.0-668-gab9fe435-1jammy [1,897 kB] 2023-10-16T23:23:52.602 INFO:teuthology.orchestra.run.smithi012.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.0-668-gab9fe435-1jammy [8,615 kB] 2023-10-16T23:23:52.718 INFO:teuthology.orchestra.run.smithi138.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.0-668-gab9fe435-1jammy [345 kB] 2023-10-16T23:23:52.859 INFO:teuthology.orchestra.run.smithi033.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.0-668-gab9fe435-1jammy [345 kB] 2023-10-16T23:23:53.040 INFO:teuthology.orchestra.run.smithi138.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.0-668-gab9fe435-1jammy [23.0 kB] 2023-10-16T23:23:53.045 INFO:teuthology.orchestra.run.smithi138.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.0-668-gab9fe435-1jammy [164 kB] 2023-10-16T23:23:53.272 INFO:teuthology.orchestra.run.smithi138.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.0-668-gab9fe435-1jammy [51.6 kB] 2023-10-16T23:23:53.279 INFO:teuthology.orchestra.run.smithi138.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.0-668-gab9fe435-1jammy [318 kB] 2023-10-16T23:23:53.280 INFO:teuthology.orchestra.run.smithi033.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.0-668-gab9fe435-1jammy [23.0 kB] 2023-10-16T23:23:53.290 INFO:teuthology.orchestra.run.smithi033.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.0-668-gab9fe435-1jammy [164 kB] 2023-10-16T23:23:53.379 INFO:teuthology.orchestra.run.smithi012.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.0-668-gab9fe435-1jammy [3,780 B] 2023-10-16T23:23:53.380 INFO:teuthology.orchestra.run.smithi012.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.0-668-gab9fe435-1jammy [46.3 MB] 2023-10-16T23:23:53.446 INFO:teuthology.orchestra.run.smithi033.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.0-668-gab9fe435-1jammy [51.6 kB] 2023-10-16T23:23:53.623 INFO:teuthology.orchestra.run.smithi138.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.0-668-gab9fe435-1jammy [5,861 kB] 2023-10-16T23:23:53.636 INFO:teuthology.orchestra.run.smithi033.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.0-668-gab9fe435-1jammy [318 kB] 2023-10-16T23:23:53.918 INFO:teuthology.orchestra.run.smithi033.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.0-668-gab9fe435-1jammy [5,861 kB] 2023-10-16T23:23:56.068 INFO:teuthology.orchestra.run.smithi072.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.0-668-gab9fe435-1jammy [3,654 B] 2023-10-16T23:23:56.069 INFO:teuthology.orchestra.run.smithi072.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.0-668-gab9fe435-1jammy [808 kB] 2023-10-16T23:23:56.085 INFO:teuthology.orchestra.run.smithi072.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.0-668-gab9fe435-1jammy [2,152 kB] 2023-10-16T23:23:56.150 INFO:teuthology.orchestra.run.smithi031.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.0-668-gab9fe435-1jammy [3,654 B] 2023-10-16T23:23:56.190 INFO:teuthology.orchestra.run.smithi072.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.0-668-gab9fe435-1jammy [222 kB] 2023-10-16T23:23:56.197 INFO:teuthology.orchestra.run.smithi072.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.0-668-gab9fe435-1jammy [128 kB] 2023-10-16T23:23:56.212 INFO:teuthology.orchestra.run.smithi072.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.0-668-gab9fe435-1jammy [1,897 kB] 2023-10-16T23:23:56.225 INFO:teuthology.orchestra.run.smithi031.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.0-668-gab9fe435-1jammy [808 kB] 2023-10-16T23:23:56.241 INFO:teuthology.orchestra.run.smithi031.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.0-668-gab9fe435-1jammy [2,152 kB] 2023-10-16T23:23:56.436 INFO:teuthology.orchestra.run.smithi072.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.0-668-gab9fe435-1jammy [8,615 kB] 2023-10-16T23:23:56.482 INFO:teuthology.orchestra.run.smithi031.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.0-668-gab9fe435-1jammy [222 kB] 2023-10-16T23:23:56.514 INFO:teuthology.orchestra.run.smithi031.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.0-668-gab9fe435-1jammy [128 kB] 2023-10-16T23:23:56.518 INFO:teuthology.orchestra.run.smithi031.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.0-668-gab9fe435-1jammy [1,897 kB] 2023-10-16T23:23:56.731 INFO:teuthology.orchestra.run.smithi031.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.0-668-gab9fe435-1jammy [8,615 kB] 2023-10-16T23:23:56.877 INFO:teuthology.orchestra.run.smithi138.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.0-668-gab9fe435-1jammy [102 kB] 2023-10-16T23:23:56.938 INFO:teuthology.orchestra.run.smithi138.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.0-668-gab9fe435-1jammy [431 kB] 2023-10-16T23:23:57.128 INFO:teuthology.orchestra.run.smithi138.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.0-668-gab9fe435-1jammy [21.9 MB] 2023-10-16T23:23:57.343 INFO:teuthology.orchestra.run.smithi072.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.0-668-gab9fe435-1jammy [3,780 B] 2023-10-16T23:23:57.344 INFO:teuthology.orchestra.run.smithi072.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.0-668-gab9fe435-1jammy [46.3 MB] 2023-10-16T23:23:57.785 INFO:teuthology.orchestra.run.smithi031.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.0-668-gab9fe435-1jammy [3,780 B] 2023-10-16T23:23:57.786 INFO:teuthology.orchestra.run.smithi031.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.0-668-gab9fe435-1jammy [46.3 MB] 2023-10-16T23:23:57.821 INFO:teuthology.orchestra.run.smithi012.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.0-668-gab9fe435-1jammy [234 kB] 2023-10-16T23:23:57.826 INFO:teuthology.orchestra.run.smithi012.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.0-668-gab9fe435-1jammy [216 kB] 2023-10-16T23:23:57.830 INFO:teuthology.orchestra.run.smithi012.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.0-668-gab9fe435-1jammy [23.9 kB] 2023-10-16T23:23:57.889 INFO:teuthology.orchestra.run.smithi012.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.0-668-gab9fe435-1jammy [13.2 kB] 2023-10-16T23:23:57.889 INFO:teuthology.orchestra.run.smithi012.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.0-668-gab9fe435-1jammy [27.8 kB] 2023-10-16T23:23:57.890 INFO:teuthology.orchestra.run.smithi012.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.0-668-gab9fe435-1jammy [11.6 MB] 2023-10-16T23:23:58.920 INFO:teuthology.orchestra.run.smithi033.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.0-668-gab9fe435-1jammy [102 kB] 2023-10-16T23:23:58.991 INFO:teuthology.orchestra.run.smithi012.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.0-668-gab9fe435-1jammy [82.1 kB] 2023-10-16T23:23:58.998 INFO:teuthology.orchestra.run.smithi033.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.0-668-gab9fe435-1jammy [431 kB] 2023-10-16T23:23:59.209 INFO:teuthology.orchestra.run.smithi033.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.0-668-gab9fe435-1jammy [21.9 MB] 2023-10-16T23:23:59.581 INFO:teuthology.orchestra.run.smithi012.stdout:Fetched 180 MB in 14s (12.7 MB/s) 2023-10-16T23:23:59.696 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-16T23:23:59.794 INFO:teuthology.orchestra.run.smithi012.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2023-10-16T23:23:59.799 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-10-16T23:23:59.836 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-10-16T23:24:00.139 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-16T23:24:00.165 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-10-16T23:24:00.205 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-16T23:24:00.550 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-cmd2. 2023-10-16T23:24:00.576 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-10-16T23:24:00.616 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-10-16T23:24:00.928 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libfmt8:amd64. 2023-10-16T23:24:00.954 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-10-16T23:24:01.036 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-16T23:24:01.314 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-10-16T23:24:01.330 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-10-16T23:24:01.372 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-16T23:24:01.650 INFO:teuthology.orchestra.run.smithi072.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.0-668-gab9fe435-1jammy [234 kB] 2023-10-16T23:24:01.655 INFO:teuthology.orchestra.run.smithi072.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.0-668-gab9fe435-1jammy [216 kB] 2023-10-16T23:24:01.659 INFO:teuthology.orchestra.run.smithi072.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.0-668-gab9fe435-1jammy [23.9 kB] 2023-10-16T23:24:01.660 INFO:teuthology.orchestra.run.smithi072.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.0-668-gab9fe435-1jammy [13.2 kB] 2023-10-16T23:24:01.661 INFO:teuthology.orchestra.run.smithi072.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.0-668-gab9fe435-1jammy [27.8 kB] 2023-10-16T23:24:01.662 INFO:teuthology.orchestra.run.smithi072.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.0-668-gab9fe435-1jammy [11.6 MB] 2023-10-16T23:24:01.718 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-16T23:24:01.744 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-10-16T23:24:01.784 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-16T23:24:02.121 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-16T23:24:02.149 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-10-16T23:24:02.179 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-16T23:24:02.197 INFO:teuthology.orchestra.run.smithi031.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.0-668-gab9fe435-1jammy [234 kB] 2023-10-16T23:24:02.201 INFO:teuthology.orchestra.run.smithi031.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.0-668-gab9fe435-1jammy [216 kB] 2023-10-16T23:24:02.206 INFO:teuthology.orchestra.run.smithi031.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.0-668-gab9fe435-1jammy [23.9 kB] 2023-10-16T23:24:02.207 INFO:teuthology.orchestra.run.smithi031.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.0-668-gab9fe435-1jammy [13.2 kB] 2023-10-16T23:24:02.221 INFO:teuthology.orchestra.run.smithi072.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.0-668-gab9fe435-1jammy [82.1 kB] 2023-10-16T23:24:02.255 INFO:teuthology.orchestra.run.smithi031.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.0-668-gab9fe435-1jammy [27.8 kB] 2023-10-16T23:24:02.256 INFO:teuthology.orchestra.run.smithi031.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.0-668-gab9fe435-1jammy [11.6 MB] 2023-10-16T23:24:02.608 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-16T23:24:02.635 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-16T23:24:02.683 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:24:02.691 INFO:teuthology.orchestra.run.smithi031.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.0-668-gab9fe435-1jammy [82.1 kB] 2023-10-16T23:24:02.780 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 180 MB in 17s (10.5 MB/s) 2023-10-16T23:24:02.905 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-16T23:24:03.000 INFO:teuthology.orchestra.run.smithi072.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2023-10-16T23:24:03.005 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-10-16T23:24:03.045 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-10-16T23:24:03.094 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-16T23:24:03.121 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-16T23:24:03.161 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:24:03.259 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 180 MB in 18s (10.2 MB/s) 2023-10-16T23:24:03.343 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-16T23:24:03.370 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-10-16T23:24:03.396 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-16T23:24:03.410 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-16T23:24:03.430 INFO:teuthology.orchestra.run.smithi138.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.0-668-gab9fe435-1jammy [6,825 kB] 2023-10-16T23:24:03.497 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2023-10-16T23:24:03.502 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-10-16T23:24:03.544 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-10-16T23:24:03.714 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-16T23:24:03.741 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-16T23:24:03.781 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:24:03.822 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-16T23:24:03.848 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-10-16T23:24:03.888 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-16T23:24:03.915 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cmd2. 2023-10-16T23:24:03.942 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-10-16T23:24:03.982 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-10-16T23:24:04.117 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-10-16T23:24:04.144 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-10-16T23:24:04.184 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-16T23:24:04.224 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cmd2. 2023-10-16T23:24:04.251 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-10-16T23:24:04.291 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-10-16T23:24:04.306 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libfmt8:amd64. 2023-10-16T23:24:04.332 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-10-16T23:24:04.379 INFO:teuthology.orchestra.run.smithi138.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.0-668-gab9fe435-1jammy [227 kB] 2023-10-16T23:24:04.412 INFO:teuthology.orchestra.run.smithi138.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.0-668-gab9fe435-1jammy [119 kB] 2023-10-16T23:24:04.415 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-16T23:24:04.420 INFO:teuthology.orchestra.run.smithi138.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.0-668-gab9fe435-1jammy [1,470 kB] 2023-10-16T23:24:04.503 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package librados2. 2023-10-16T23:24:04.530 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../011-librados2_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:04.570 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking librados2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:04.602 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libfmt8:amd64. 2023-10-16T23:24:04.617 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-10-16T23:24:04.629 INFO:teuthology.orchestra.run.smithi138.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.0-668-gab9fe435-1jammy [9,870 kB] 2023-10-16T23:24:04.721 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-16T23:24:04.755 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-10-16T23:24:04.782 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-10-16T23:24:04.822 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-16T23:24:04.912 INFO:teuthology.orchestra.run.smithi033.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.0-668-gab9fe435-1jammy [6,825 kB] 2023-10-16T23:24:05.023 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package librbd1. 2023-10-16T23:24:05.049 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../012-librbd1_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:05.098 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking librbd1 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:05.170 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-16T23:24:05.182 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-10-16T23:24:05.196 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-10-16T23:24:05.209 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-10-16T23:24:05.238 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-16T23:24:05.248 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-16T23:24:05.492 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libcephfs2. 2023-10-16T23:24:05.519 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../013-libcephfs2_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:05.559 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libcephfs2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:05.577 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-16T23:24:05.593 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-16T23:24:05.603 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-10-16T23:24:05.620 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-10-16T23:24:05.643 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-16T23:24:05.659 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-16T23:24:05.777 INFO:teuthology.orchestra.run.smithi033.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.0-668-gab9fe435-1jammy [227 kB] 2023-10-16T23:24:05.805 INFO:teuthology.orchestra.run.smithi033.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.0-668-gab9fe435-1jammy [119 kB] 2023-10-16T23:24:05.831 INFO:teuthology.orchestra.run.smithi033.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.0-668-gab9fe435-1jammy [1,470 kB] 2023-10-16T23:24:05.836 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-rados. 2023-10-16T23:24:05.863 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../014-python3-rados_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:05.903 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-rados (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:05.954 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-16T23:24:05.981 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-10-16T23:24:06.013 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-16T23:24:06.013 INFO:teuthology.orchestra.run.smithi033.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.0-668-gab9fe435-1jammy [9,870 kB] 2023-10-16T23:24:06.101 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-16T23:24:06.128 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-16T23:24:06.134 INFO:teuthology.orchestra.run.smithi138.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.0-668-gab9fe435-1jammy [31.5 MB] 2023-10-16T23:24:06.177 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:24:06.231 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-16T23:24:06.257 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:06.297 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-ceph-argparse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:06.458 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-16T23:24:06.485 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-16T23:24:06.533 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:24:06.534 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-cephfs. 2023-10-16T23:24:06.560 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../016-python3-cephfs_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:06.600 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-cephfs (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:06.626 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-16T23:24:06.652 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-16T23:24:06.692 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:24:06.886 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-16T23:24:06.913 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:06.935 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-16T23:24:06.952 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-ceph-common (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:06.962 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-16T23:24:07.002 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:24:07.065 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-16T23:24:07.091 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-16T23:24:07.131 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:24:07.281 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-prettytable. 2023-10-16T23:24:07.307 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-10-16T23:24:07.313 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-16T23:24:07.333 INFO:teuthology.orchestra.run.smithi033.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.0-668-gab9fe435-1jammy [31.5 MB] 2023-10-16T23:24:07.340 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-16T23:24:07.347 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-10-16T23:24:07.372 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:24:07.505 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-10-16T23:24:07.533 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-10-16T23:24:07.572 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-16T23:24:07.608 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-rbd. 2023-10-16T23:24:07.624 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../019-python3-rbd_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:07.667 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-rbd (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:07.912 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package librados2. 2023-10-16T23:24:07.916 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-10-16T23:24:07.939 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../011-librados2_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:07.943 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-10-16T23:24:07.979 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking librados2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:07.982 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-16T23:24:07.986 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-16T23:24:08.002 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-10-16T23:24:08.036 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-16T23:24:08.310 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librados2. 2023-10-16T23:24:08.331 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package librgw2. 2023-10-16T23:24:08.337 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../011-librados2_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:08.357 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../021-librgw2_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:08.377 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librados2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:08.397 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking librgw2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:08.475 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package librbd1. 2023-10-16T23:24:08.501 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../012-librbd1_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:08.542 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking librbd1 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:08.813 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librbd1. 2023-10-16T23:24:08.840 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../012-librbd1_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:08.879 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librbd1 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:08.908 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-rgw. 2023-10-16T23:24:08.935 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../022-python3-rgw_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:08.975 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-rgw (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:09.190 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libcephfs2. 2023-10-16T23:24:09.217 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../013-libcephfs2_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:09.257 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libcephfs2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:09.265 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libcephfs2. 2023-10-16T23:24:09.281 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../013-libcephfs2_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:09.286 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package liboath0:amd64. 2023-10-16T23:24:09.313 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-10-16T23:24:09.323 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libcephfs2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:09.353 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-10-16T23:24:09.536 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-rados. 2023-10-16T23:24:09.552 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../014-python3-rados_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:09.554 INFO:teuthology.orchestra.run.smithi138.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.0-668-gab9fe435-1jammy [3,654 B] 2023-10-16T23:24:09.587 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-rados (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:09.609 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rados. 2023-10-16T23:24:09.625 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../014-python3-rados_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:09.635 INFO:teuthology.orchestra.run.smithi138.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.0-668-gab9fe435-1jammy [808 kB] 2023-10-16T23:24:09.639 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libradosstriper1. 2023-10-16T23:24:09.650 INFO:teuthology.orchestra.run.smithi138.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.0-668-gab9fe435-1jammy [2,152 kB] 2023-10-16T23:24:09.666 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../024-libradosstriper1_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:09.667 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rados (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:09.705 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libradosstriper1 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:09.746 INFO:teuthology.orchestra.run.smithi138.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.0-668-gab9fe435-1jammy [222 kB] 2023-10-16T23:24:09.751 INFO:teuthology.orchestra.run.smithi138.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.0-668-gab9fe435-1jammy [128 kB] 2023-10-16T23:24:09.754 INFO:teuthology.orchestra.run.smithi138.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.0-668-gab9fe435-1jammy [1,897 kB] 2023-10-16T23:24:09.918 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-16T23:24:09.922 INFO:teuthology.orchestra.run.smithi138.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.0-668-gab9fe435-1jammy [8,615 kB] 2023-10-16T23:24:09.944 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:09.985 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-ceph-argparse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:09.995 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-16T23:24:10.022 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:10.061 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-ceph-argparse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:10.134 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-common. 2023-10-16T23:24:10.161 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../025-ceph-common_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:10.201 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-common (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:10.241 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cephfs. 2023-10-16T23:24:10.267 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../016-python3-cephfs_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:10.308 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cephfs (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:10.322 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cephfs. 2023-10-16T23:24:10.350 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../016-python3-cephfs_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:10.389 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cephfs (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:10.629 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-16T23:24:10.656 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:10.675 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-16T23:24:10.694 INFO:teuthology.orchestra.run.smithi138.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.0-668-gab9fe435-1jammy [3,780 B] 2023-10-16T23:24:10.695 INFO:teuthology.orchestra.run.smithi138.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.0-668-gab9fe435-1jammy [46.3 MB] 2023-10-16T23:24:10.696 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-ceph-common (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:10.702 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:10.741 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-ceph-common (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:11.053 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-prettytable. 2023-10-16T23:24:11.069 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-prettytable. 2023-10-16T23:24:11.080 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-10-16T23:24:11.096 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-10-16T23:24:11.120 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-10-16T23:24:11.135 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-10-16T23:24:11.203 INFO:teuthology.orchestra.run.smithi033.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.0-668-gab9fe435-1jammy [3,654 B] 2023-10-16T23:24:11.204 INFO:teuthology.orchestra.run.smithi033.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.0-668-gab9fe435-1jammy [808 kB] 2023-10-16T23:24:11.245 INFO:teuthology.orchestra.run.smithi033.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.0-668-gab9fe435-1jammy [2,152 kB] 2023-10-16T23:24:11.383 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-rbd. 2023-10-16T23:24:11.405 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rbd. 2023-10-16T23:24:11.409 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../019-python3-rbd_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:11.421 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../019-python3-rbd_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:11.451 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-rbd (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:11.463 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rbd (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:11.498 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-base. 2023-10-16T23:24:11.525 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../026-ceph-base_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:11.531 INFO:teuthology.orchestra.run.smithi033.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.0-668-gab9fe435-1jammy [222 kB] 2023-10-16T23:24:11.564 INFO:teuthology.orchestra.run.smithi033.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.0-668-gab9fe435-1jammy [128 kB] 2023-10-16T23:24:11.569 INFO:teuthology.orchestra.run.smithi033.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.0-668-gab9fe435-1jammy [1,897 kB] 2023-10-16T23:24:11.575 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-base (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:11.792 INFO:teuthology.orchestra.run.smithi033.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.0-668-gab9fe435-1jammy [8,615 kB] 2023-10-16T23:24:11.807 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-16T23:24:11.824 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-16T23:24:11.833 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-10-16T23:24:11.851 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-10-16T23:24:11.873 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-16T23:24:11.891 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-16T23:24:12.160 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librgw2. 2023-10-16T23:24:12.187 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../021-librgw2_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:12.214 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package librgw2. 2023-10-16T23:24:12.227 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librgw2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:12.240 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../021-librgw2_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:12.280 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking librgw2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:12.319 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-10-16T23:24:12.346 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-10-16T23:24:12.386 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-10-16T23:24:12.705 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-cheroot. 2023-10-16T23:24:12.721 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rgw. 2023-10-16T23:24:12.732 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-10-16T23:24:12.737 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../022-python3-rgw_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:12.769 INFO:teuthology.orchestra.run.smithi033.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.0-668-gab9fe435-1jammy [3,780 B] 2023-10-16T23:24:12.772 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-16T23:24:12.779 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rgw (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:12.780 INFO:teuthology.orchestra.run.smithi033.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.0-668-gab9fe435-1jammy [46.3 MB] 2023-10-16T23:24:12.918 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-rgw. 2023-10-16T23:24:12.934 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../022-python3-rgw_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:12.976 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-rgw (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:13.209 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-10-16T23:24:13.235 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-10-16T23:24:13.290 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liboath0:amd64. 2023-10-16T23:24:13.291 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-10-16T23:24:13.317 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-10-16T23:24:13.325 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package liboath0:amd64. 2023-10-16T23:24:13.352 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-10-16T23:24:13.357 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-10-16T23:24:13.392 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-10-16T23:24:13.595 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-jaraco.text. 2023-10-16T23:24:13.622 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-10-16T23:24:13.651 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libradosstriper1. 2023-10-16T23:24:13.661 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-10-16T23:24:13.678 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../024-libradosstriper1_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:13.707 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libradosstriper1. 2023-10-16T23:24:13.709 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libradosstriper1 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:13.733 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../024-libradosstriper1_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:13.774 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libradosstriper1 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:13.914 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-10-16T23:24:13.930 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-10-16T23:24:13.938 INFO:teuthology.orchestra.run.smithi138.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.0-668-gab9fe435-1jammy [234 kB] 2023-10-16T23:24:13.942 INFO:teuthology.orchestra.run.smithi138.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.0-668-gab9fe435-1jammy [216 kB] 2023-10-16T23:24:13.947 INFO:teuthology.orchestra.run.smithi138.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.0-668-gab9fe435-1jammy [23.9 kB] 2023-10-16T23:24:14.006 INFO:teuthology.orchestra.run.smithi138.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.0-668-gab9fe435-1jammy [13.2 kB] 2023-10-16T23:24:14.007 INFO:teuthology.orchestra.run.smithi138.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.0-668-gab9fe435-1jammy [27.8 kB] 2023-10-16T23:24:14.008 INFO:teuthology.orchestra.run.smithi138.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.0-668-gab9fe435-1jammy [11.6 MB] 2023-10-16T23:24:14.089 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-10-16T23:24:14.121 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-common. 2023-10-16T23:24:14.148 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../025-ceph-common_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:14.187 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-common (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:14.321 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-common. 2023-10-16T23:24:14.348 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../025-ceph-common_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:14.388 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-common (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:14.400 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-tempora. 2023-10-16T23:24:14.427 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-10-16T23:24:14.467 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-10-16T23:24:14.770 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-portend. 2023-10-16T23:24:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-10-16T23:24:14.836 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-10-16T23:24:14.883 INFO:teuthology.orchestra.run.smithi138.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.0-668-gab9fe435-1jammy [82.1 kB] 2023-10-16T23:24:15.097 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-10-16T23:24:15.124 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-10-16T23:24:15.158 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-10-16T23:24:15.401 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-base. 2023-10-16T23:24:15.428 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../026-ceph-base_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:15.431 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 180 MB in 30s (6,066 kB/s) 2023-10-16T23:24:15.461 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-16T23:24:15.469 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-base (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:15.487 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-10-16T23:24:15.527 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-10-16T23:24:15.565 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-16T23:24:15.658 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2023-10-16T23:24:15.663 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-10-16T23:24:15.705 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-10-16T23:24:15.831 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-natsort. 2023-10-16T23:24:15.857 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-10-16T23:24:15.897 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-10-16T23:24:16.016 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-16T23:24:16.043 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-10-16T23:24:16.060 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-base. 2023-10-16T23:24:16.083 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-16T23:24:16.086 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../026-ceph-base_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:16.145 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-base (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:16.192 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-logutils. 2023-10-16T23:24:16.219 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-10-16T23:24:16.259 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-10-16T23:24:16.305 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-10-16T23:24:16.332 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-10-16T23:24:16.372 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-10-16T23:24:16.402 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cmd2. 2023-10-16T23:24:16.429 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-10-16T23:24:16.469 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-10-16T23:24:16.570 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-16T23:24:16.596 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-10-16T23:24:16.624 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cheroot. 2023-10-16T23:24:16.651 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-10-16T23:24:16.661 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-10-16T23:24:16.682 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-16T23:24:16.797 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libfmt8:amd64. 2023-10-16T23:24:16.823 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-10-16T23:24:16.905 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-16T23:24:16.939 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-mako. 2023-10-16T23:24:16.966 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-10-16T23:24:16.993 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-10-16T23:24:17.006 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-16T23:24:17.009 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-10-16T23:24:17.043 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-10-16T23:24:17.078 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-10-16T23:24:17.105 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-10-16T23:24:17.153 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-10-16T23:24:17.242 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-10-16T23:24:17.268 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-10-16T23:24:17.284 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-16T23:24:17.308 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-16T23:24:17.311 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-16T23:24:17.313 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jaraco.text. 2023-10-16T23:24:17.339 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-10-16T23:24:17.342 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-16T23:24:17.379 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-10-16T23:24:17.517 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cheroot. 2023-10-16T23:24:17.543 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-10-16T23:24:17.583 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-16T23:24:17.662 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-16T23:24:17.662 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-16T23:24:17.665 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-10-16T23:24:17.688 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-10-16T23:24:17.688 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-10-16T23:24:17.692 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-10-16T23:24:17.728 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-10-16T23:24:17.729 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-16T23:24:17.732 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-10-16T23:24:17.949 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-10-16T23:24:17.975 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-10-16T23:24:18.031 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-webob. 2023-10-16T23:24:18.032 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-16T23:24:18.034 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-tempora. 2023-10-16T23:24:18.058 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-10-16T23:24:18.058 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-10-16T23:24:18.061 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-10-16T23:24:18.090 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-16T23:24:18.097 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-10-16T23:24:18.101 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-10-16T23:24:18.214 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-10-16T23:24:18.945 INFO:teuthology.orchestra.run.smithi033.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.0-668-gab9fe435-1jammy [234 kB] 2023-10-16T23:24:18.988 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-portend. 2023-10-16T23:24:19.003 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-10-16T23:24:19.046 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-10-16T23:24:19.053 INFO:teuthology.orchestra.run.smithi033.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.0-668-gab9fe435-1jammy [216 kB] 2023-10-16T23:24:19.058 INFO:teuthology.orchestra.run.smithi033.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.0-668-gab9fe435-1jammy [23.9 kB] 2023-10-16T23:24:19.058 INFO:teuthology.orchestra.run.smithi033.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.0-668-gab9fe435-1jammy [13.2 kB] 2023-10-16T23:24:19.059 INFO:teuthology.orchestra.run.smithi033.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.0-668-gab9fe435-1jammy [27.8 kB] 2023-10-16T23:24:19.060 INFO:teuthology.orchestra.run.smithi033.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.0-668-gab9fe435-1jammy [11.6 MB] 2023-10-16T23:24:19.159 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-waitress. 2023-10-16T23:24:19.186 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-10-16T23:24:19.229 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-16T23:24:19.349 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-10-16T23:24:19.369 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-16T23:24:19.375 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-10-16T23:24:19.396 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-16T23:24:19.415 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-10-16T23:24:19.443 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:24:19.520 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-tempita. 2023-10-16T23:24:19.547 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-10-16T23:24:19.578 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-10-16T23:24:19.718 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-16T23:24:19.744 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-10-16T23:24:19.784 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-10-16T23:24:19.805 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-16T23:24:19.831 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-16T23:24:19.863 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:24:19.864 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-paste. 2023-10-16T23:24:19.892 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-10-16T23:24:19.931 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-10-16T23:24:19.982 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jaraco.text. 2023-10-16T23:24:20.008 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-10-16T23:24:20.048 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-10-16T23:24:20.121 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-natsort. 2023-10-16T23:24:20.148 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-10-16T23:24:20.196 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-10-16T23:24:20.234 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-16T23:24:20.251 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-16T23:24:20.260 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-16T23:24:20.267 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-10-16T23:24:20.300 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:24:20.301 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-10-16T23:24:20.337 INFO:teuthology.orchestra.run.smithi033.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-10-11-0735-reef/ab9fe43522bc41de59746200b95f65d4fbcccffe/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.0-668-gab9fe435-1jammy [82.1 kB] 2023-10-16T23:24:20.386 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-10-16T23:24:20.413 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-10-16T23:24:20.453 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-10-16T23:24:20.507 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-logutils. 2023-10-16T23:24:20.534 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-10-16T23:24:20.570 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-16T23:24:20.573 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-10-16T23:24:20.597 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-10-16T23:24:20.637 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-10-16T23:24:20.655 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-10-16T23:24:20.679 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-10-16T23:24:20.720 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-16T23:24:20.760 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-tempora. 2023-10-16T23:24:20.786 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-10-16T23:24:20.827 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-10-16T23:24:20.876 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-16T23:24:20.903 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-10-16T23:24:20.924 INFO:teuthology.orchestra.run.smithi033.stdout:Fetched 180 MB in 35s (5,117 kB/s) 2023-10-16T23:24:20.940 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-webtest. 2023-10-16T23:24:20.942 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-10-16T23:24:20.967 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-10-16T23:24:21.006 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librados2. 2023-10-16T23:24:21.006 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-10-16T23:24:21.021 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../011-librados2_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:21.048 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-16T23:24:21.055 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librados2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:21.142 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-portend. 2023-10-16T23:24:21.144 INFO:teuthology.orchestra.run.smithi033.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2023-10-16T23:24:21.150 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-10-16T23:24:21.168 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-10-16T23:24:21.188 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-10-16T23:24:21.209 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-10-16T23:24:21.220 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-mako. 2023-10-16T23:24:21.247 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-10-16T23:24:21.278 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-16T23:24:21.318 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pecan. 2023-10-16T23:24:21.344 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-10-16T23:24:21.384 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-10-16T23:24:21.491 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-16T23:24:21.500 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librbd1. 2023-10-16T23:24:21.505 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-10-16T23:24:21.517 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-10-16T23:24:21.527 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../012-librbd1_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:21.531 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-10-16T23:24:21.548 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-16T23:24:21.557 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-16T23:24:21.567 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librbd1 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:21.572 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-10-16T23:24:21.572 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-16T23:24:21.606 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-16T23:24:21.739 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-certifi. 2023-10-16T23:24:21.766 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-10-16T23:24:21.805 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-10-16T23:24:21.854 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-16T23:24:21.877 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-cmd2. 2023-10-16T23:24:21.880 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-10-16T23:24:21.904 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-10-16T23:24:21.909 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-16T23:24:21.920 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-10-16T23:24:21.936 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-10-16T23:24:21.943 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-10-16T23:24:21.976 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-10-16T23:24:22.003 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcephfs2. 2023-10-16T23:24:22.029 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../013-libcephfs2_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:22.069 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcephfs2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:22.083 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-idna. 2023-10-16T23:24:22.100 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-10-16T23:24:22.134 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-idna (3.3-1) ... 2023-10-16T23:24:22.261 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-webob. 2023-10-16T23:24:22.271 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libfmt8:amd64. 2023-10-16T23:24:22.287 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-natsort. 2023-10-16T23:24:22.288 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-10-16T23:24:22.298 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-10-16T23:24:22.313 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-10-16T23:24:22.328 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-10-16T23:24:22.347 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rados. 2023-10-16T23:24:22.362 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-10-16T23:24:22.362 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../014-python3-rados_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:22.371 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-16T23:24:22.397 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rados (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:22.420 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-urllib3. 2023-10-16T23:24:22.447 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-10-16T23:24:22.486 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-10-16T23:24:22.683 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-10-16T23:24:22.689 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-waitress. 2023-10-16T23:24:22.692 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-logutils. 2023-10-16T23:24:22.710 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-10-16T23:24:22.716 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-10-16T23:24:22.719 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-10-16T23:24:22.725 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-16T23:24:22.750 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-16T23:24:22.751 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:22.759 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-16T23:24:22.767 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-10-16T23:24:22.791 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-ceph-argparse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:22.814 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-requests. 2023-10-16T23:24:22.842 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-10-16T23:24:22.881 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-16T23:24:23.121 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-16T23:24:23.141 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-16T23:24:23.146 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-10-16T23:24:23.168 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-10-16T23:24:23.168 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-16T23:24:23.183 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-tempita. 2023-10-16T23:24:23.186 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-16T23:24:23.195 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-10-16T23:24:23.210 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-10-16T23:24:23.216 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-10-16T23:24:23.234 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-16T23:24:23.285 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cephfs. 2023-10-16T23:24:23.301 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../016-python3-cephfs_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:23.333 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-10-16T23:24:23.352 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cephfs (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:23.512 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-16T23:24:23.531 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-16T23:24:23.539 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:23.558 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-10-16T23:24:23.573 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-mako. 2023-10-16T23:24:23.578 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-paste. 2023-10-16T23:24:23.578 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr-modules-core (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:23.594 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-10-16T23:24:23.600 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-10-16T23:24:23.606 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-16T23:24:23.627 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-10-16T23:24:23.648 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-16T23:24:23.713 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-16T23:24:23.739 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:23.788 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-ceph-common (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:23.939 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-16T23:24:23.955 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-10-16T23:24:23.958 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-16T23:24:23.974 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:23.979 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-16T23:24:23.997 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-10-16T23:24:24.001 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-16T23:24:24.005 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-16T23:24:24.016 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libsqlite3-mod-ceph (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:24.028 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-16T23:24:24.045 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-16T23:24:24.076 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:24:24.166 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-prettytable. 2023-10-16T23:24:24.193 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-10-16T23:24:24.233 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-10-16T23:24:24.250 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-16T23:24:24.266 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-10-16T23:24:24.277 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-openssl. 2023-10-16T23:24:24.294 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-10-16T23:24:24.299 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-10-16T23:24:24.336 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-10-16T23:24:24.344 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-16T23:24:24.371 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-10-16T23:24:24.411 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-10-16T23:24:24.471 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-16T23:24:24.477 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rbd. 2023-10-16T23:24:24.492 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../019-python3-rbd_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:24.498 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-16T23:24:24.535 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rbd (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:24.538 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:24:24.586 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-webtest. 2023-10-16T23:24:24.613 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-10-16T23:24:24.652 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-10-16T23:24:24.672 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr. 2023-10-16T23:24:24.700 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../058-ceph-mgr_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:24.738 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:24.875 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-16T23:24:24.888 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-webob. 2023-10-16T23:24:24.901 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-16T23:24:24.915 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-10-16T23:24:24.938 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-16T23:24:24.941 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:24:24.959 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-10-16T23:24:24.963 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pecan. 2023-10-16T23:24:24.965 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-10-16T23:24:24.990 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-10-16T23:24:25.013 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-16T23:24:25.030 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-10-16T23:24:25.184 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mon. 2023-10-16T23:24:25.211 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../059-ceph-mon_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:25.250 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mon (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:25.269 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-10-16T23:24:25.296 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-10-16T23:24:25.306 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-waitress. 2023-10-16T23:24:25.333 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-10-16T23:24:25.336 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-16T23:24:25.376 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-16T23:24:25.393 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-certifi. 2023-10-16T23:24:25.416 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librgw2. 2023-10-16T23:24:25.420 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-10-16T23:24:25.443 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../021-librgw2_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:25.459 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-10-16T23:24:25.491 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librgw2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:25.614 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package librados2. 2023-10-16T23:24:25.640 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../011-librados2_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:25.663 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-tempita. 2023-10-16T23:24:25.680 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking librados2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:25.690 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-10-16T23:24:25.730 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-10-16T23:24:25.788 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-idna. 2023-10-16T23:24:25.814 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-10-16T23:24:25.853 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-idna (3.3-1) ... 2023-10-16T23:24:25.994 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rgw. 2023-10-16T23:24:26.020 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../022-python3-rgw_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:26.028 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-paste. 2023-10-16T23:24:26.055 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-10-16T23:24:26.060 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rgw (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:26.092 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package librbd1. 2023-10-16T23:24:26.095 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-10-16T23:24:26.112 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-osd. 2023-10-16T23:24:26.118 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../012-librbd1_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:26.131 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-urllib3. 2023-10-16T23:24:26.140 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../060-ceph-osd_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:26.148 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-10-16T23:24:26.158 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking librbd1 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:26.178 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-osd (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:26.181 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-10-16T23:24:26.405 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liboath0:amd64. 2023-10-16T23:24:26.409 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-16T23:24:26.431 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-10-16T23:24:26.436 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-10-16T23:24:26.471 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-10-16T23:24:26.484 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-10-16T23:24:26.501 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-requests. 2023-10-16T23:24:26.528 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-10-16T23:24:26.567 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-16T23:24:26.595 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libcephfs2. 2023-10-16T23:24:26.621 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../013-libcephfs2_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:26.661 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libcephfs2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:26.741 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libradosstriper1. 2023-10-16T23:24:26.767 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../024-libradosstriper1_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:26.782 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-16T23:24:26.807 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libradosstriper1 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:26.808 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-10-16T23:24:26.849 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-10-16T23:24:26.862 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-16T23:24:26.889 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-10-16T23:24:26.928 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-16T23:24:26.930 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-rados. 2023-10-16T23:24:26.946 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../014-python3-rados_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:26.980 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-rados (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:27.148 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-webtest. 2023-10-16T23:24:27.175 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-10-16T23:24:27.215 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-10-16T23:24:27.223 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-16T23:24:27.244 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-common. 2023-10-16T23:24:27.249 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:27.250 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-16T23:24:27.266 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:27.270 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../025-ceph-common_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:27.289 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-modules-core (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:27.300 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-ceph-argparse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:27.327 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-common (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:27.511 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pecan. 2023-10-16T23:24:27.538 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-10-16T23:24:27.578 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-10-16T23:24:27.661 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-16T23:24:27.669 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-cephfs. 2023-10-16T23:24:27.685 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../016-python3-cephfs_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:27.687 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:27.727 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libsqlite3-mod-ceph (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:27.728 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-cephfs (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:27.930 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-certifi. 2023-10-16T23:24:27.956 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-10-16T23:24:27.996 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-10-16T23:24:28.038 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-openssl. 2023-10-16T23:24:28.047 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-16T23:24:28.065 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-10-16T23:24:28.073 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:28.113 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-10-16T23:24:28.114 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-ceph-common (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:28.190 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph. 2023-10-16T23:24:28.217 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../061-ceph_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:28.256 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:28.312 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-idna. 2023-10-16T23:24:28.339 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-10-16T23:24:28.378 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-idna (3.3-1) ... 2023-10-16T23:24:28.442 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-prettytable. 2023-10-16T23:24:28.458 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr. 2023-10-16T23:24:28.468 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-10-16T23:24:28.485 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../058-ceph-mgr_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:28.508 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-10-16T23:24:28.524 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:28.584 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-fuse. 2023-10-16T23:24:28.600 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-base. 2023-10-16T23:24:28.612 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../062-ceph-fuse_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:28.626 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../026-ceph-base_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:28.650 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-fuse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:28.676 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-base (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:28.700 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-urllib3. 2023-10-16T23:24:28.727 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-10-16T23:24:28.769 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-10-16T23:24:28.786 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-rbd. 2023-10-16T23:24:28.806 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../019-python3-rbd_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:28.844 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-rbd (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:28.869 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mon. 2023-10-16T23:24:28.885 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../059-ceph-mon_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:28.918 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mon (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:29.091 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-requests. 2023-10-16T23:24:29.118 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-10-16T23:24:29.166 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-16T23:24:29.205 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-16T23:24:29.221 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mds. 2023-10-16T23:24:29.232 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-10-16T23:24:29.248 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../063-ceph-mds_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:29.272 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-16T23:24:29.287 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mds (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:29.379 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-10-16T23:24:29.405 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-10-16T23:24:29.445 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-10-16T23:24:29.498 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-16T23:24:29.525 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-10-16T23:24:29.533 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package librgw2. 2023-10-16T23:24:29.549 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../021-librgw2_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:29.564 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-16T23:24:29.592 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking librgw2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:29.665 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package cephadm. 2023-10-16T23:24:29.692 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../064-cephadm_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:29.706 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cheroot. 2023-10-16T23:24:29.730 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-10-16T23:24:29.731 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking cephadm (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:29.764 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-16T23:24:29.822 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-osd. 2023-10-16T23:24:29.849 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../060-ceph-osd_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:29.853 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-16T23:24:29.869 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:29.888 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-osd (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:29.913 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-modules-core (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:30.035 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-asyncssh. 2023-10-16T23:24:30.062 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-10-16T23:24:30.101 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-10-16T23:24:30.102 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-rgw. 2023-10-16T23:24:30.118 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-10-16T23:24:30.129 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../022-python3-rgw_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:30.144 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-10-16T23:24:30.169 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-rgw (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:30.192 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-10-16T23:24:30.429 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python-babel-localedata. 2023-10-16T23:24:30.445 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-10-16T23:24:30.466 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-16T23:24:30.487 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-16T23:24:30.492 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:30.505 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package liboath0:amd64. 2023-10-16T23:24:30.529 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.text. 2023-10-16T23:24:30.532 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-10-16T23:24:30.540 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libsqlite3-mod-ceph (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:30.555 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-10-16T23:24:30.572 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-10-16T23:24:30.595 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-10-16T23:24:30.833 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libradosstriper1. 2023-10-16T23:24:30.860 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../024-libradosstriper1_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:30.892 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libradosstriper1 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:30.895 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-openssl. 2023-10-16T23:24:30.898 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-10-16T23:24:30.922 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-10-16T23:24:30.924 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-10-16T23:24:30.965 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-10-16T23:24:30.971 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-10-16T23:24:31.295 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-common. 2023-10-16T23:24:31.319 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr. 2023-10-16T23:24:31.322 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../025-ceph-common_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:31.335 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-tempora. 2023-10-16T23:24:31.346 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../058-ceph-mgr_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:31.361 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-10-16T23:24:31.361 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-common (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:31.386 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:31.410 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-10-16T23:24:31.534 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-babel. 2023-10-16T23:24:31.562 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-10-16T23:24:31.592 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-10-16T23:24:31.779 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-portend. 2023-10-16T23:24:31.805 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-10-16T23:24:31.810 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mon. 2023-10-16T23:24:31.837 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../059-ceph-mon_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:31.854 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-10-16T23:24:31.862 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-jinja2. 2023-10-16T23:24:31.877 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mon (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:31.878 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-10-16T23:24:31.912 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-10-16T23:24:32.066 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph. 2023-10-16T23:24:32.082 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../061-ceph_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:32.124 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:32.157 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-10-16T23:24:32.183 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-10-16T23:24:32.198 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-16T23:24:32.223 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-10-16T23:24:32.225 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:32.256 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr-cephadm (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:32.410 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-fuse. 2023-10-16T23:24:32.437 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../062-ceph-fuse_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:32.477 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-fuse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:32.568 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-16T23:24:32.569 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-16T23:24:32.594 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-10-16T23:24:32.596 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-10-16T23:24:32.635 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-10-16T23:24:32.643 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-10-16T23:24:32.776 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-base. 2023-10-16T23:24:32.803 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../026-ceph-base_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:32.814 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mds. 2023-10-16T23:24:32.840 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../063-ceph-mds_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:32.860 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-base (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:32.880 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mds (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:32.938 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pluggy. 2023-10-16T23:24:32.965 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2023-10-16T23:24:33.013 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-natsort. 2023-10-16T23:24:33.025 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-osd. 2023-10-16T23:24:33.025 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-10-16T23:24:33.040 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-10-16T23:24:33.051 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../060-ceph-osd_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:33.079 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-10-16T23:24:33.091 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-osd (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:33.250 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephadm. 2023-10-16T23:24:33.276 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../064-cephadm_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:33.316 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephadm (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:33.341 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-py. 2023-10-16T23:24:33.368 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2023-10-16T23:24:33.416 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-py (1.10.0-1) ... 2023-10-16T23:24:33.424 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-logutils. 2023-10-16T23:24:33.451 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-10-16T23:24:33.491 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-10-16T23:24:33.564 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-10-16T23:24:33.590 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-10-16T23:24:33.622 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-10-16T23:24:33.719 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-iniconfig. 2023-10-16T23:24:33.744 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-16T23:24:33.747 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2023-10-16T23:24:33.769 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-asyncssh. 2023-10-16T23:24:33.770 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-10-16T23:24:33.777 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-10-16T23:24:33.796 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-10-16T23:24:33.802 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-10-16T23:24:33.835 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-10-16T23:24:33.925 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-cheroot. 2023-10-16T23:24:33.952 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-10-16T23:24:34.008 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-16T23:24:34.080 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-toml. 2023-10-16T23:24:34.088 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-mako. 2023-10-16T23:24:34.108 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2023-10-16T23:24:34.115 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-10-16T23:24:34.147 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-10-16T23:24:34.155 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-16T23:24:34.163 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python-babel-localedata. 2023-10-16T23:24:34.179 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-10-16T23:24:34.221 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-16T23:24:34.328 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-10-16T23:24:34.355 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-10-16T23:24:34.394 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-10-16T23:24:34.467 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pytest. 2023-10-16T23:24:34.494 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-10-16T23:24:34.500 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-16T23:24:34.526 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-16T23:24:34.533 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-10-16T23:24:34.566 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-16T23:24:34.681 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-jaraco.text. 2023-10-16T23:24:34.708 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-10-16T23:24:34.747 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-10-16T23:24:34.869 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-16T23:24:34.878 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-16T23:24:34.895 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-10-16T23:24:34.906 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2023-10-16T23:24:34.936 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-10-16T23:24:34.945 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-16T23:24:35.017 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-10-16T23:24:35.044 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-10-16T23:24:35.084 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-10-16T23:24:35.230 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-webob. 2023-10-16T23:24:35.248 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-routes. 2023-10-16T23:24:35.251 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-babel. 2023-10-16T23:24:35.257 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-10-16T23:24:35.275 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-10-16T23:24:35.279 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-10-16T23:24:35.288 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-10-16T23:24:35.314 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-10-16T23:24:35.317 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-10-16T23:24:35.428 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-tempora. 2023-10-16T23:24:35.441 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph. 2023-10-16T23:24:35.455 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-10-16T23:24:35.456 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../061-ceph_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:35.495 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-10-16T23:24:35.499 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:35.600 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-waitress. 2023-10-16T23:24:35.616 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-10-16T23:24:35.645 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jinja2. 2023-10-16T23:24:35.651 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-16T23:24:35.653 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-16T23:24:35.673 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-10-16T23:24:35.678 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:35.712 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-10-16T23:24:35.717 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr-dashboard (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:35.789 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-fuse. 2023-10-16T23:24:35.798 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-portend. 2023-10-16T23:24:35.816 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../062-ceph-fuse_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:35.825 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-10-16T23:24:35.856 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-fuse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:35.864 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-10-16T23:24:36.030 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-tempita. 2023-10-16T23:24:36.040 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-16T23:24:36.054 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-10-16T23:24:36.067 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:36.079 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-10-16T23:24:36.095 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-10-16T23:24:36.098 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-cephadm (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:36.111 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-10-16T23:24:36.129 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-16T23:24:36.142 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-10-16T23:24:36.170 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-10-16T23:24:36.201 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-10-16T23:24:36.238 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mds. 2023-10-16T23:24:36.264 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../063-ceph-mds_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:36.305 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mds (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:36.393 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-16T23:24:36.418 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-10-16T23:24:36.451 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-10-16T23:24:36.481 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-paste. 2023-10-16T23:24:36.487 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-16T23:24:36.507 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-10-16T23:24:36.514 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-10-16T23:24:36.554 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-10-16T23:24:36.555 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-10-16T23:24:36.608 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-joblib. 2023-10-16T23:24:36.635 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-10-16T23:24:36.674 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-10-16T23:24:36.727 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package cephadm. 2023-10-16T23:24:36.729 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pluggy. 2023-10-16T23:24:36.754 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../064-cephadm_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:36.756 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2023-10-16T23:24:36.794 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking cephadm (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:36.795 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-10-16T23:24:36.891 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-natsort. 2023-10-16T23:24:36.918 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-10-16T23:24:36.926 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-16T23:24:36.952 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-10-16T23:24:36.957 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-10-16T23:24:37.017 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-10-16T23:24:37.028 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-10-16T23:24:37.055 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-10-16T23:24:37.076 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-asyncssh. 2023-10-16T23:24:37.094 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-10-16T23:24:37.103 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-10-16T23:24:37.107 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-py. 2023-10-16T23:24:37.134 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2023-10-16T23:24:37.142 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-10-16T23:24:37.174 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-py (1.10.0-1) ... 2023-10-16T23:24:37.269 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-logutils. 2023-10-16T23:24:37.296 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-10-16T23:24:37.335 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-10-16T23:24:37.370 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-16T23:24:37.396 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-10-16T23:24:37.422 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-sklearn. 2023-10-16T23:24:37.436 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-10-16T23:24:37.439 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python-babel-localedata. 2023-10-16T23:24:37.449 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-10-16T23:24:37.466 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-10-16T23:24:37.488 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-16T23:24:37.502 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-iniconfig. 2023-10-16T23:24:37.506 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-16T23:24:37.529 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2023-10-16T23:24:37.568 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-10-16T23:24:37.588 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-16T23:24:37.604 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-10-16T23:24:37.638 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-10-16T23:24:37.748 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-webtest. 2023-10-16T23:24:37.774 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-10-16T23:24:37.814 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-10-16T23:24:37.871 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-toml. 2023-10-16T23:24:37.898 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2023-10-16T23:24:37.937 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-10-16T23:24:37.950 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-mako. 2023-10-16T23:24:37.977 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-10-16T23:24:38.016 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-16T23:24:38.101 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pecan. 2023-10-16T23:24:38.127 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-10-16T23:24:38.167 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-10-16T23:24:38.190 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pytest. 2023-10-16T23:24:38.217 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-10-16T23:24:38.248 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-10-16T23:24:38.274 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-16T23:24:38.302 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:38.340 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:38.353 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-16T23:24:38.380 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-16T23:24:38.419 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-16T23:24:38.477 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-babel. 2023-10-16T23:24:38.504 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-10-16T23:24:38.530 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-certifi. 2023-10-16T23:24:38.557 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-10-16T23:24:38.560 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-10-16T23:24:38.585 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-16T23:24:38.597 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-10-16T23:24:38.613 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2023-10-16T23:24:38.651 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-16T23:24:38.722 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-16T23:24:38.749 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-10-16T23:24:38.789 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-10-16T23:24:38.883 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-jinja2. 2023-10-16T23:24:38.905 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-routes. 2023-10-16T23:24:38.910 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-10-16T23:24:38.931 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-10-16T23:24:38.933 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-idna. 2023-10-16T23:24:38.949 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-10-16T23:24:38.959 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-10-16T23:24:38.962 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-10-16T23:24:39.020 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-idna (3.3-1) ... 2023-10-16T23:24:39.108 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-webob. 2023-10-16T23:24:39.124 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-10-16T23:24:39.167 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-10-16T23:24:39.257 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-16T23:24:39.274 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:39.286 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-urllib3. 2023-10-16T23:24:39.313 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-10-16T23:24:39.317 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-dashboard (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:39.344 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-10-16T23:24:39.410 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-cachetools. 2023-10-16T23:24:39.438 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2023-10-16T23:24:39.468 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-10-16T23:24:39.495 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-waitress. 2023-10-16T23:24:39.522 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-10-16T23:24:39.524 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-16T23:24:39.550 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:39.565 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-16T23:24:39.590 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-cephadm (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:39.631 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-requests. 2023-10-16T23:24:39.646 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-10-16T23:24:39.681 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-16T23:24:39.743 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-10-16T23:24:39.754 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-16T23:24:39.760 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-10-16T23:24:39.782 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2023-10-16T23:24:39.802 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-16T23:24:39.846 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-10-16T23:24:39.873 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-tempita. 2023-10-16T23:24:39.900 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-10-16T23:24:39.923 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-16T23:24:39.939 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-10-16T23:24:39.950 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-10-16T23:24:39.976 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-16T23:24:39.990 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-10-16T23:24:40.002 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-10-16T23:24:40.042 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-16T23:24:40.183 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-16T23:24:40.209 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-paste. 2023-10-16T23:24:40.210 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-10-16T23:24:40.225 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-10-16T23:24:40.249 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-10-16T23:24:40.259 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-10-16T23:24:40.287 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pluggy. 2023-10-16T23:24:40.289 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-joblib. 2023-10-16T23:24:40.315 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2023-10-16T23:24:40.316 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-10-16T23:24:40.336 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-16T23:24:40.347 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-10-16T23:24:40.352 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:40.386 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-modules-core (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:40.554 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-10-16T23:24:40.561 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-rsa. 2023-10-16T23:24:40.588 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2023-10-16T23:24:40.604 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-16T23:24:40.627 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-rsa (4.8-1) ... 2023-10-16T23:24:40.631 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-10-16T23:24:40.670 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-10-16T23:24:40.717 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-10-16T23:24:40.744 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-10-16T23:24:40.783 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-10-16T23:24:40.784 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-16T23:24:40.809 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:40.849 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libsqlite3-mod-ceph (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:40.861 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-py. 2023-10-16T23:24:40.888 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2023-10-16T23:24:40.922 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-google-auth. 2023-10-16T23:24:40.927 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-py (1.10.0-1) ... 2023-10-16T23:24:40.950 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2023-10-16T23:24:40.974 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-16T23:24:40.989 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-10-16T23:24:41.000 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-10-16T23:24:41.049 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-10-16T23:24:41.069 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-sklearn. 2023-10-16T23:24:41.097 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-10-16T23:24:41.135 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-16T23:24:41.169 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-openssl. 2023-10-16T23:24:41.196 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-10-16T23:24:41.235 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-10-16T23:24:41.243 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-iniconfig. 2023-10-16T23:24:41.271 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2023-10-16T23:24:41.302 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-webtest. 2023-10-16T23:24:41.310 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-10-16T23:24:41.326 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-16T23:24:41.328 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-10-16T23:24:41.353 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-10-16T23:24:41.368 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-10-16T23:24:41.392 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-16T23:24:41.555 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr. 2023-10-16T23:24:41.582 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../058-ceph-mgr_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:41.582 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-toml. 2023-10-16T23:24:41.609 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2023-10-16T23:24:41.613 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:41.650 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-10-16T23:24:41.692 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pecan. 2023-10-16T23:24:41.703 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-websocket. 2023-10-16T23:24:41.719 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-10-16T23:24:41.731 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2023-10-16T23:24:41.770 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-10-16T23:24:41.895 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-16T23:24:41.923 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:41.947 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pytest. 2023-10-16T23:24:41.954 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-10-16T23:24:41.961 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:41.974 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-10-16T23:24:42.009 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mon. 2023-10-16T23:24:42.022 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-10-16T23:24:42.035 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../059-ceph-mon_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:42.083 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mon (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:42.090 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-16T23:24:42.117 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-10-16T23:24:42.156 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-16T23:24:42.318 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-certifi. 2023-10-16T23:24:42.345 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-10-16T23:24:42.364 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-16T23:24:42.384 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-10-16T23:24:42.391 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2023-10-16T23:24:42.439 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-16T23:24:42.712 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-idna. 2023-10-16T23:24:42.737 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-routes. 2023-10-16T23:24:42.739 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-10-16T23:24:42.764 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-10-16T23:24:42.779 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-idna (3.3-1) ... 2023-10-16T23:24:42.804 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-10-16T23:24:42.812 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-16T23:24:42.823 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cachetools. 2023-10-16T23:24:42.828 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:42.850 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2023-10-16T23:24:42.870 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr-k8sevents (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:42.889 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-10-16T23:24:43.029 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-osd. 2023-10-16T23:24:43.055 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../060-ceph-osd_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:43.095 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-osd (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:43.152 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-16T23:24:43.156 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-16T23:24:43.173 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-urllib3. 2023-10-16T23:24:43.179 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:43.184 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-10-16T23:24:43.192 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-16T23:24:43.201 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-10-16T23:24:43.218 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-dashboard (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:43.220 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2023-10-16T23:24:43.222 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-16T23:24:43.248 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-10-16T23:24:43.258 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-10-16T23:24:43.542 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-16T23:24:43.570 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-10-16T23:24:43.609 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-16T23:24:43.620 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-16T23:24:43.644 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-requests. 2023-10-16T23:24:43.648 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-10-16T23:24:43.659 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-10-16T23:24:43.670 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-10-16T23:24:43.686 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-10-16T23:24:43.687 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-10-16T23:24:43.719 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-16T23:24:43.726 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-16T23:24:43.878 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package jq. 2023-10-16T23:24:43.895 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-10-16T23:24:43.936 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-10-16T23:24:44.000 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rsa. 2023-10-16T23:24:44.028 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2023-10-16T23:24:44.080 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-16T23:24:44.107 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rsa (4.8-1) ... 2023-10-16T23:24:44.107 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-10-16T23:24:44.146 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-16T23:24:44.181 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package socat. 2023-10-16T23:24:44.192 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-joblib. 2023-10-16T23:24:44.198 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-10-16T23:24:44.219 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-10-16T23:24:44.239 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-10-16T23:24:44.259 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-10-16T23:24:44.469 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-16T23:24:44.470 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-google-auth. 2023-10-16T23:24:44.496 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:44.497 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2023-10-16T23:24:44.534 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package xmlstarlet. 2023-10-16T23:24:44.535 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-mgr-modules-core (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:44.536 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-10-16T23:24:44.558 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-10-16T23:24:44.592 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-10-16T23:24:44.617 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-10-16T23:24:44.644 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-10-16T23:24:44.683 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-10-16T23:24:44.832 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-16T23:24:44.848 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-10-16T23:24:44.890 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-16T23:24:44.940 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-16T23:24:44.954 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-test. 2023-10-16T23:24:44.967 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:44.971 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../098-ceph-test_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:44.980 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-sklearn. 2023-10-16T23:24:44.990 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph. 2023-10-16T23:24:45.005 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../061-ceph_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:45.006 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libsqlite3-mod-ceph (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:45.007 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-10-16T23:24:45.013 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-test (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:45.040 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:45.046 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-16T23:24:45.201 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-websocket. 2023-10-16T23:24:45.229 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2023-10-16T23:24:45.268 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-10-16T23:24:45.326 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-openssl. 2023-10-16T23:24:45.326 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-fuse. 2023-10-16T23:24:45.353 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../062-ceph-fuse_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:45.353 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-10-16T23:24:45.392 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-10-16T23:24:45.393 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-fuse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:45.596 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-16T23:24:45.624 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-10-16T23:24:45.665 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-16T23:24:45.729 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-mgr. 2023-10-16T23:24:45.756 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../058-ceph-mgr_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:45.771 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mds. 2023-10-16T23:24:45.795 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-mgr (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:45.797 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../063-ceph-mds_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:45.837 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mds (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:45.943 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-16T23:24:45.971 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:46.010 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:46.148 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-mon. 2023-10-16T23:24:46.174 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package cephadm. 2023-10-16T23:24:46.175 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../059-ceph-mon_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:46.189 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../064-cephadm_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:46.206 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-mon (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:46.223 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking cephadm (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:46.335 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-16T23:24:46.352 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:46.385 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-k8sevents (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:46.535 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-asyncssh. 2023-10-16T23:24:46.561 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-10-16T23:24:46.601 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-10-16T23:24:46.705 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-16T23:24:46.733 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-10-16T23:24:46.771 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-16T23:24:46.904 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-babel-localedata. 2023-10-16T23:24:46.920 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-10-16T23:24:46.954 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-16T23:24:47.116 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-16T23:24:47.144 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-10-16T23:24:47.152 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-osd. 2023-10-16T23:24:47.179 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../060-ceph-osd_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:47.191 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-16T23:24:47.218 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-osd (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:47.343 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-cachetools. 2023-10-16T23:24:47.369 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2023-10-16T23:24:47.383 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-volume. 2023-10-16T23:24:47.409 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-10-16T23:24:47.411 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../099-ceph-volume_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:47.427 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package jq. 2023-10-16T23:24:47.443 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-10-16T23:24:47.450 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-volume (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:47.477 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-10-16T23:24:47.688 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package socat. 2023-10-16T23:24:47.691 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-16T23:24:47.715 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-10-16T23:24:47.718 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2023-10-16T23:24:47.754 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-10-16T23:24:47.774 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-10-16T23:24:47.905 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-16T23:24:47.933 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:47.979 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking cephfs-mirror (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:48.003 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-babel. 2023-10-16T23:24:48.030 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-10-16T23:24:48.070 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-10-16T23:24:48.074 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package xmlstarlet. 2023-10-16T23:24:48.089 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-16T23:24:48.102 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-10-16T23:24:48.116 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-10-16T23:24:48.141 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-10-16T23:24:48.157 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-10-16T23:24:48.333 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-colorama. 2023-10-16T23:24:48.361 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2023-10-16T23:24:48.365 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jinja2. 2023-10-16T23:24:48.392 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-10-16T23:24:48.399 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-10-16T23:24:48.432 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-10-16T23:24:48.454 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-rsa. 2023-10-16T23:24:48.481 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2023-10-16T23:24:48.487 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-test. 2023-10-16T23:24:48.515 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../098-ceph-test_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:48.521 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-rsa (4.8-1) ... 2023-10-16T23:24:48.553 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-test (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:48.660 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package cephfs-shell. 2023-10-16T23:24:48.689 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../102-cephfs-shell_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:48.727 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking cephfs-shell (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:48.769 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-16T23:24:48.796 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:48.821 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-google-auth. 2023-10-16T23:24:48.836 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-cephadm (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:48.848 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2023-10-16T23:24:48.887 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-10-16T23:24:48.988 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package cephfs-top. 2023-10-16T23:24:49.016 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../103-cephfs-top_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:49.063 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking cephfs-top (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:49.173 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-16T23:24:49.195 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-16T23:24:49.200 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-10-16T23:24:49.222 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-10-16T23:24:49.240 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-10-16T23:24:49.270 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-16T23:24:49.288 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph. 2023-10-16T23:24:49.315 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../061-ceph_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:49.354 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:49.418 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-16T23:24:49.446 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:49.499 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libcephfs-dev (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:49.543 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pluggy. 2023-10-16T23:24:49.567 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-websocket. 2023-10-16T23:24:49.570 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2023-10-16T23:24:49.594 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2023-10-16T23:24:49.609 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-10-16T23:24:49.633 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-10-16T23:24:49.674 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-fuse. 2023-10-16T23:24:49.701 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../062-ceph-fuse_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:49.740 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-fuse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:49.894 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package nvme-cli. 2023-10-16T23:24:49.922 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-10-16T23:24:49.930 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-py. 2023-10-16T23:24:49.958 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-16T23:24:49.959 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2023-10-16T23:24:49.960 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-10-16T23:24:49.985 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-10-16T23:24:49.988 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-py (1.10.0-1) ... 2023-10-16T23:24:50.024 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-16T23:24:50.069 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-mds. 2023-10-16T23:24:50.085 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../063-ceph-mds_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:50.118 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-mds (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:50.307 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-10-16T23:24:50.317 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-iniconfig. 2023-10-16T23:24:50.335 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-10-16T23:24:50.344 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2023-10-16T23:24:50.373 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-10-16T23:24:50.384 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-10-16T23:24:50.455 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package cephadm. 2023-10-16T23:24:50.470 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../064-cephadm_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:50.505 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking cephadm (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:50.644 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-16T23:24:50.660 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:50.688 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-toml. 2023-10-16T23:24:50.694 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-mgr-k8sevents (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:50.715 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2023-10-16T23:24:50.754 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-10-16T23:24:50.777 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pastescript. 2023-10-16T23:24:50.790 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-volume. 2023-10-16T23:24:50.805 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2023-10-16T23:24:50.818 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../099-ceph-volume_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:50.824 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-asyncssh. 2023-10-16T23:24:50.843 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-16T23:24:50.848 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-volume (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:50.851 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-10-16T23:24:50.891 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-10-16T23:24:51.009 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-16T23:24:51.016 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pytest. 2023-10-16T23:24:51.032 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-10-16T23:24:51.036 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-10-16T23:24:51.066 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-10-16T23:24:51.101 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-16T23:24:51.163 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-psutil. 2023-10-16T23:24:51.180 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-10-16T23:24:51.193 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python-babel-localedata. 2023-10-16T23:24:51.210 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-10-16T23:24:51.221 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-10-16T23:24:51.252 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-16T23:24:51.304 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-16T23:24:51.332 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:51.370 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephfs-mirror (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:51.420 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-16T23:24:51.441 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-16T23:24:51.447 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2023-10-16T23:24:51.468 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-10-16T23:24:51.487 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-16T23:24:51.508 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-16T23:24:51.558 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pygments. 2023-10-16T23:24:51.586 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-10-16T23:24:51.624 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-10-16T23:24:51.674 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-colorama. 2023-10-16T23:24:51.702 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2023-10-16T23:24:51.740 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-10-16T23:24:51.771 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package jq. 2023-10-16T23:24:51.786 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-10-16T23:24:51.799 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-routes. 2023-10-16T23:24:51.821 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-10-16T23:24:51.826 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-10-16T23:24:51.865 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-10-16T23:24:51.993 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephfs-shell. 2023-10-16T23:24:52.009 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../102-cephfs-shell_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:52.043 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephfs-shell (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:52.061 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package socat. 2023-10-16T23:24:52.077 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-10-16T23:24:52.104 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-16T23:24:52.119 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-10-16T23:24:52.131 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-10-16T23:24:52.169 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-10-16T23:24:52.186 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-16T23:24:52.212 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:52.253 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-dashboard (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:52.279 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephfs-top. 2023-10-16T23:24:52.307 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../103-cephfs-top_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:52.340 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-babel. 2023-10-16T23:24:52.345 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephfs-top (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:52.368 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-10-16T23:24:52.407 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-10-16T23:24:52.475 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package xmlstarlet. 2023-10-16T23:24:52.481 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-simplejson. 2023-10-16T23:24:52.490 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-10-16T23:24:52.509 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-10-16T23:24:52.533 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-10-16T23:24:52.548 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-10-16T23:24:52.598 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-16T23:24:52.626 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:52.665 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libcephfs-dev (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:52.690 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-10-16T23:24:52.705 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-10-16T23:24:52.744 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-jinja2. 2023-10-16T23:24:52.748 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-16T23:24:52.771 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-10-16T23:24:52.808 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-16T23:24:52.810 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-10-16T23:24:52.825 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-10-16T23:24:52.866 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-10-16T23:24:52.909 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-test. 2023-10-16T23:24:52.925 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../098-ceph-test_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:52.976 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-test (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:53.043 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package nvme-cli. 2023-10-16T23:24:53.071 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-10-16T23:24:53.109 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-10-16T23:24:53.138 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-16T23:24:53.165 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:53.205 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-mgr-cephadm (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:53.244 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-joblib. 2023-10-16T23:24:53.271 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-10-16T23:24:53.302 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-10-16T23:24:53.464 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-10-16T23:24:53.492 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-10-16T23:24:53.531 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-10-16T23:24:53.545 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package radosgw. 2023-10-16T23:24:53.550 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-16T23:24:53.574 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../113-radosgw_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:53.577 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-10-16T23:24:53.612 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking radosgw (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:53.616 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-10-16T23:24:53.673 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-10-16T23:24:53.700 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-10-16T23:24:53.739 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-10-16T23:24:53.919 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pluggy. 2023-10-16T23:24:53.946 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2023-10-16T23:24:53.959 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pastescript. 2023-10-16T23:24:53.986 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-10-16T23:24:53.987 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2023-10-16T23:24:54.026 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-16T23:24:54.051 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-sklearn. 2023-10-16T23:24:54.078 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-10-16T23:24:54.117 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-16T23:24:54.297 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-py. 2023-10-16T23:24:54.312 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-psutil. 2023-10-16T23:24:54.324 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2023-10-16T23:24:54.328 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-10-16T23:24:54.362 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-10-16T23:24:54.363 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-py (1.10.0-1) ... 2023-10-16T23:24:54.415 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package rbd-fuse. 2023-10-16T23:24:54.431 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../114-rbd-fuse_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:54.473 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking rbd-fuse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:54.700 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-iniconfig. 2023-10-16T23:24:54.723 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pygments. 2023-10-16T23:24:54.727 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2023-10-16T23:24:54.751 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-10-16T23:24:54.760 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-10-16T23:24:54.767 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-10-16T23:24:54.790 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-10-16T23:24:55.027 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-16T23:24:55.036 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-toml. 2023-10-16T23:24:55.052 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2023-10-16T23:24:55.086 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-10-16T23:24:55.098 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-16T23:24:55.125 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:55.153 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-10-16T23:24:55.189 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:55.269 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-16T23:24:55.286 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-10-16T23:24:55.319 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-10-16T23:24:55.389 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pytest. 2023-10-16T23:24:55.416 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-10-16T23:24:55.417 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-10-16T23:24:55.455 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-10-16T23:24:55.605 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-simplejson. 2023-10-16T23:24:55.633 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-10-16T23:24:55.671 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-10-16T23:24:55.768 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-16T23:24:55.770 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-10-16T23:24:55.795 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2023-10-16T23:24:55.825 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-16T23:24:55.941 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-16T23:24:55.958 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-10-16T23:24:55.993 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ceph-volume. 2023-10-16T23:24:56.007 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-10-16T23:24:56.021 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../099-ceph-volume_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:56.068 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ceph-volume (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:56.120 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-routes. 2023-10-16T23:24:56.144 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cachetools. 2023-10-16T23:24:56.147 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-10-16T23:24:56.170 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2023-10-16T23:24:56.187 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-10-16T23:24:56.209 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-10-16T23:24:56.257 INFO:teuthology.orchestra.run.smithi012.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-10-16T23:24:56.355 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up cephadm (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:56.480 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-16T23:24:56.507 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2023-10-16T23:24:56.532 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-16T23:24:56.538 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-10-16T23:24:56.559 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:56.598 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-mgr-dashboard (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:56.770 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package radosgw. 2023-10-16T23:24:56.798 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../113-radosgw_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:56.821 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-16T23:24:56.833 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-16T23:24:56.836 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking radosgw (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:56.848 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:56.860 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-10-16T23:24:56.892 INFO:teuthology.orchestra.run.smithi012.stdout:Adding system user cephadm....done 2023-10-16T23:24:56.896 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking cephfs-mirror (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:56.900 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-10-16T23:24:57.022 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-16T23:24:57.052 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-10-16T23:24:57.079 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-10-16T23:24:57.118 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-16T23:24:57.187 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rsa. 2023-10-16T23:24:57.214 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2023-10-16T23:24:57.254 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rsa (4.8-1) ... 2023-10-16T23:24:57.298 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-10-16T23:24:57.311 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-colorama. 2023-10-16T23:24:57.339 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2023-10-16T23:24:57.386 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-10-16T23:24:57.549 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-10-16T23:24:57.564 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package rbd-fuse. 2023-10-16T23:24:57.575 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-google-auth. 2023-10-16T23:24:57.580 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../114-rbd-fuse_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:57.596 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-joblib. 2023-10-16T23:24:57.602 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2023-10-16T23:24:57.622 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking rbd-fuse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:57.624 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-10-16T23:24:57.641 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-10-16T23:24:57.663 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-10-16T23:24:57.676 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package cephfs-shell. 2023-10-16T23:24:57.684 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-10-16T23:24:57.692 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../102-cephfs-shell_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:57.751 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking cephfs-shell (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:57.910 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-10-16T23:24:57.952 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-16T23:24:57.970 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-16T23:24:57.997 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-10-16T23:24:58.031 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package cephfs-top. 2023-10-16T23:24:58.037 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-16T23:24:58.041 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-10-16T23:24:58.059 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../103-cephfs-top_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:58.069 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-10-16T23:24:58.106 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking cephfs-top (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:58.108 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-10-16T23:24:58.203 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-10-16T23:24:58.244 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-16T23:24:58.282 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-websocket. 2023-10-16T23:24:58.297 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2023-10-16T23:24:58.329 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-py (1.10.0-1) ... 2023-10-16T23:24:58.332 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-10-16T23:24:58.345 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-10-16T23:24:58.405 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-16T23:24:58.411 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-sklearn. 2023-10-16T23:24:58.432 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:24:58.438 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-10-16T23:24:58.477 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-16T23:24:58.479 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libcephfs-dev (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:58.616 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-10-16T23:24:58.639 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-10-16T23:24:58.644 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-16T23:24:58.671 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-10-16T23:24:58.736 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-16T23:24:58.903 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package nvme-cli. 2023-10-16T23:24:58.931 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-10-16T23:24:58.978 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-10-16T23:24:58.993 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-10-16T23:24:59.057 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-10-16T23:24:59.213 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-16T23:24:59.240 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:59.279 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:59.313 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-10-16T23:24:59.330 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-10-16T23:24:59.350 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-10-16T23:24:59.363 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-10-16T23:24:59.426 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-16T23:24:59.454 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:24:59.477 INFO:teuthology.orchestra.run.smithi031.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-10-16T23:24:59.492 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-k8sevents (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:59.547 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephadm (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:24:59.693 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-10-16T23:24:59.795 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-16T23:24:59.803 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pastescript. 2023-10-16T23:24:59.822 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-10-16T23:24:59.830 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2023-10-16T23:24:59.862 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-16T23:24:59.877 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-16T23:25:00.090 INFO:teuthology.orchestra.run.smithi031.stdout:Adding system user cephadm....done 2023-10-16T23:25:00.160 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-psutil. 2023-10-16T23:25:00.174 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-16T23:25:00.188 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-10-16T23:25:00.194 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-10-16T23:25:00.202 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-10-16T23:25:00.227 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-10-16T23:25:00.228 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-16T23:25:00.240 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-16T23:25:00.241 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-cachetools. 2023-10-16T23:25:00.268 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2023-10-16T23:25:00.307 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-10-16T23:25:00.445 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-10-16T23:25:00.505 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-10-16T23:25:00.510 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package jq. 2023-10-16T23:25:00.538 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-10-16T23:25:00.550 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pygments. 2023-10-16T23:25:00.577 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-10-16T23:25:00.578 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-10-16T23:25:00.610 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-16T23:25:00.625 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-10-16T23:25:00.638 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2023-10-16T23:25:00.676 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-10-16T23:25:00.705 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-10-16T23:25:00.739 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-10-16T23:25:00.830 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package socat. 2023-10-16T23:25:00.857 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-10-16T23:25:00.865 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-10-16T23:25:00.888 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-10-16T23:25:00.964 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-ceph-argparse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:01.005 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-16T23:25:01.034 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-10-16T23:25:01.071 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-10-16T23:25:01.084 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-16T23:25:01.112 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-10-16T23:25:01.133 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-16T23:25:01.151 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-10-16T23:25:01.226 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package xmlstarlet. 2023-10-16T23:25:01.232 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-16T23:25:01.253 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-10-16T23:25:01.300 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-10-16T23:25:01.383 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-rsa. 2023-10-16T23:25:01.401 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-10-16T23:25:01.410 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2023-10-16T23:25:01.439 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package python3-simplejson. 2023-10-16T23:25:01.449 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-rsa (4.8-1) ... 2023-10-16T23:25:01.458 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-10-16T23:25:01.467 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-10-16T23:25:01.506 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-10-16T23:25:01.619 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-py (1.10.0-1) ... 2023-10-16T23:25:01.706 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-test. 2023-10-16T23:25:01.726 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-10-16T23:25:01.733 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../098-ceph-test_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:25:01.780 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-test (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:01.838 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-16T23:25:01.855 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-google-auth. 2023-10-16T23:25:01.866 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-10-16T23:25:01.873 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2023-10-16T23:25:01.904 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-10-16T23:25:01.911 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-10-16T23:25:01.920 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-10-16T23:25:01.985 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-16T23:25:02.111 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-10-16T23:25:02.256 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-16T23:25:02.284 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-10-16T23:25:02.297 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-10-16T23:25:02.323 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-16T23:25:02.470 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-16T23:25:02.548 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-10-16T23:25:02.588 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-10-16T23:25:02.605 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package radosgw. 2023-10-16T23:25:02.633 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../113-radosgw_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:25:02.642 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-websocket. 2023-10-16T23:25:02.670 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2023-10-16T23:25:02.671 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking radosgw (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:02.709 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-10-16T23:25:02.825 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-10-16T23:25:02.856 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-10-16T23:25:03.020 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-16T23:25:03.048 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-10-16T23:25:03.087 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-16T23:25:03.101 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-10-16T23:25:03.132 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-10-16T23:25:03.360 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-10-16T23:25:03.425 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-10-16T23:25:03.543 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package rbd-fuse. 2023-10-16T23:25:03.570 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../114-rbd-fuse_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:25:03.618 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking rbd-fuse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:03.619 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-10-16T23:25:03.742 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-16T23:25:03.759 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:25:03.800 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-mgr-k8sevents (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:03.871 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-ceph-argparse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:03.926 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-10-16T23:25:04.069 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-volume. 2023-10-16T23:25:04.084 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../099-ceph-volume_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:25:04.095 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-16T23:25:04.114 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-16T23:25:04.122 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-10-16T23:25:04.127 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-10-16T23:25:04.127 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-volume (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:04.161 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-16T23:25:04.170 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-16T23:25:04.240 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-10-16T23:25:04.291 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-10-16T23:25:04.378 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-10-16T23:25:04.510 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-10-16T23:25:04.533 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-16T23:25:04.537 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-10-16T23:25:04.549 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-10-16T23:25:04.556 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-16T23:25:04.561 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:25:04.584 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-10-16T23:25:04.623 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-16T23:25:04.640 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking cephfs-mirror (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:04.663 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-16T23:25:04.783 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-16T23:25:04.880 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-10-16T23:25:04.900 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package jq. 2023-10-16T23:25:04.910 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-10-16T23:25:04.916 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-10-16T23:25:04.958 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-10-16T23:25:04.973 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-10-16T23:25:04.995 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-colorama. 2023-10-16T23:25:05.023 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2023-10-16T23:25:05.062 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-10-16T23:25:05.219 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package socat. 2023-10-16T23:25:05.236 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-10-16T23:25:05.269 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-16T23:25:05.278 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-10-16T23:25:05.315 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package cephfs-shell. 2023-10-16T23:25:05.342 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../102-cephfs-shell_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:25:05.361 INFO:teuthology.orchestra.run.smithi072.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-10-16T23:25:05.382 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking cephfs-shell (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:05.383 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-10-16T23:25:05.404 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-10-16T23:25:05.486 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up cephadm (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:05.581 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package xmlstarlet. 2023-10-16T23:25:05.593 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package cephfs-top. 2023-10-16T23:25:05.597 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-10-16T23:25:05.609 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../103-cephfs-top_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:25:05.639 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-10-16T23:25:05.651 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking cephfs-top (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:05.663 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-10-16T23:25:05.742 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-10-16T23:25:05.922 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-16T23:25:05.922 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-10-16T23:25:05.949 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:25:05.988 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcephfs-dev (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:06.001 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-test. 2023-10-16T23:25:06.018 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../098-ceph-test_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:25:06.059 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-test (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:06.086 INFO:teuthology.orchestra.run.smithi072.stdout:Adding system user cephadm....done 2023-10-16T23:25:06.160 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-16T23:25:06.241 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-10-16T23:25:06.303 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-16T23:25:06.375 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package nvme-cli. 2023-10-16T23:25:06.402 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-10-16T23:25:06.442 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-10-16T23:25:06.469 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-10-16T23:25:06.764 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-10-16T23:25:06.780 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-10-16T23:25:06.814 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-10-16T23:25:06.896 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-16T23:25:06.934 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-10-16T23:25:07.185 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-10-16T23:25:07.247 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-10-16T23:25:07.259 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pastescript. 2023-10-16T23:25:07.287 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2023-10-16T23:25:07.311 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-10-16T23:25:07.326 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-16T23:25:07.423 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-10-16T23:25:07.437 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-16T23:25:07.507 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-10-16T23:25:07.607 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-ceph-common (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:07.621 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-psutil. 2023-10-16T23:25:07.649 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-10-16T23:25:07.669 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-10-16T23:25:07.680 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-10-16T23:25:07.738 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-10-16T23:25:07.796 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-10-16T23:25:07.892 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-idna (3.3-1) ... 2023-10-16T23:25:08.017 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pygments. 2023-10-16T23:25:08.044 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-10-16T23:25:08.083 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-10-16T23:25:08.123 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-16T23:25:08.131 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-10-16T23:25:08.210 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-16T23:25:08.313 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-volume. 2023-10-16T23:25:08.326 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../099-ceph-volume_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:25:08.363 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-volume (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:08.374 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-10-16T23:25:08.400 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-10-16T23:25:08.512 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-py (1.10.0-1) ... 2023-10-16T23:25:08.555 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-16T23:25:08.582 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-10-16T23:25:08.621 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-10-16T23:25:08.759 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-16T23:25:08.760 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-16T23:25:08.788 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:25:08.835 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking cephfs-mirror (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:08.840 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-10-16T23:25:08.916 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-simplejson. 2023-10-16T23:25:08.932 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-10-16T23:25:08.974 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-10-16T23:25:09.060 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-10-16T23:25:09.146 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-colorama. 2023-10-16T23:25:09.174 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2023-10-16T23:25:09.211 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-10-16T23:25:09.213 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-10-16T23:25:09.219 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-16T23:25:09.246 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-10-16T23:25:09.277 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-10-16T23:25:09.399 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:25:09.411 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-16T23:25:09.464 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-10-16T23:25:09.465 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package cephfs-shell. 2023-10-16T23:25:09.493 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../102-cephfs-shell_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:25:09.532 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking cephfs-shell (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:09.541 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-toml (0.10.2-1) ... 2023-10-16T23:25:09.717 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-10-16T23:25:09.762 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-10-16T23:25:09.768 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package cephfs-top. 2023-10-16T23:25:09.784 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../103-cephfs-top_18.2.0-668-gab9fe435-1jammy_all.deb ... 2023-10-16T23:25:09.801 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-16T23:25:09.826 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking cephfs-top (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:09.985 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-10-16T23:25:10.013 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-10-16T23:25:10.041 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package radosgw. 2023-10-16T23:25:10.054 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-16T23:25:10.060 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-10-16T23:25:10.068 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../113-radosgw_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:25:10.082 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:25:10.098 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking radosgw (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:10.112 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libcephfs-dev (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:10.114 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-ceph-common (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:10.186 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-10-16T23:25:10.239 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-10-16T23:25:10.457 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package nvme-cli. 2023-10-16T23:25:10.458 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-idna (3.3-1) ... 2023-10-16T23:25:10.483 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-10-16T23:25:10.485 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-10-16T23:25:10.487 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-10-16T23:25:10.523 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-10-16T23:25:10.735 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-ceph-argparse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:10.784 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-16T23:25:10.797 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-10-16T23:25:10.835 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package rbd-fuse. 2023-10-16T23:25:10.851 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../114-rbd-fuse_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:25:10.893 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking rbd-fuse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:10.894 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-10-16T23:25:10.911 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-10-16T23:25:10.953 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-10-16T23:25:11.029 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-16T23:25:11.056 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:25:11.156 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-10-16T23:25:11.191 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-16T23:25:11.198 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-10-16T23:25:11.317 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-10-16T23:25:11.373 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pastescript. 2023-10-16T23:25:11.400 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2023-10-16T23:25:11.409 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-10-16T23:25:11.439 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-16T23:25:11.458 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-16T23:25:11.601 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-10-16T23:25:11.618 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-10-16T23:25:11.653 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-16T23:25:11.759 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-psutil. 2023-10-16T23:25:11.780 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-10-16T23:25:11.787 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-10-16T23:25:11.825 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-10-16T23:25:11.869 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-10-16T23:25:11.894 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-10-16T23:25:11.956 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:25:12.099 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-toml (0.10.2-1) ... 2023-10-16T23:25:12.112 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-10-16T23:25:12.149 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-16T23:25:12.170 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pygments. 2023-10-16T23:25:12.198 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-10-16T23:25:12.237 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-10-16T23:25:12.251 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-10-16T23:25:12.277 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-10-16T23:25:12.358 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-16T23:25:12.371 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-16T23:25:12.484 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-10-16T23:25:12.563 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-10-16T23:25:12.610 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-10-16T23:25:12.647 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-10-16T23:25:12.745 INFO:teuthology.orchestra.run.smithi138.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-10-16T23:25:12.828 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up cephadm (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:12.831 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-10-16T23:25:12.906 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-16T23:25:12.912 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-10-16T23:25:13.008 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-10-16T23:25:13.032 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-16T23:25:13.060 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-10-16T23:25:13.099 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-10-16T23:25:13.119 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-10-16T23:25:13.171 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-10-16T23:25:13.283 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-16T23:25:13.376 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-simplejson. 2023-10-16T23:25:13.385 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-16T23:25:13.404 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-10-16T23:25:13.406 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:25:13.434 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-10-16T23:25:13.480 INFO:teuthology.orchestra.run.smithi138.stdout:Adding system user cephadm....done 2023-10-16T23:25:13.531 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-16T23:25:13.627 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-16T23:25:13.658 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-10-16T23:25:13.662 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-16T23:25:13.669 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-10-16T23:25:13.690 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-10-16T23:25:13.720 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-10-16T23:25:13.772 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-10-16T23:25:13.937 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-10-16T23:25:13.967 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-10-16T23:25:13.995 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-10-16T23:25:14.033 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-10-16T23:25:14.160 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-10-16T23:25:14.213 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-10-16T23:25:14.227 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-10-16T23:25:14.255 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-10-16T23:25:14.288 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-16T23:25:14.340 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-10-16T23:25:14.458 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package radosgw. 2023-10-16T23:25:14.478 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-10-16T23:25:14.486 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../113-radosgw_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:25:14.524 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking radosgw (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:14.590 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-10-16T23:25:14.599 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-16T23:25:14.634 INFO:teuthology.orchestra.run.smithi012.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-10-16T23:25:14.746 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-16T23:25:14.850 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-10-16T23:25:14.883 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-16T23:25:14.977 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-10-16T23:25:14.997 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-10-16T23:25:15.000 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-10-16T23:25:15.002 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-py (1.10.0-1) ... 2023-10-16T23:25:15.219 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-10-16T23:25:15.248 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-16T23:25:15.285 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package rbd-fuse. 2023-10-16T23:25:15.307 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../114-rbd-fuse_18.2.0-668-gab9fe435-1jammy_amd64.deb ... 2023-10-16T23:25:15.360 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking rbd-fuse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:15.362 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-10-16T23:25:15.374 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-10-16T23:25:15.385 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-10-16T23:25:15.624 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-16T23:25:15.644 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-portend (3.0.0-1) ... 2023-10-16T23:25:15.658 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-16T23:25:15.681 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-10-16T23:25:15.759 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-16T23:25:15.904 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:25:15.910 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-10-16T23:25:15.923 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-16T23:25:15.948 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-10-16T23:25:16.030 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-10-16T23:25:16.035 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-10-16T23:25:16.049 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-10-16T23:25:16.203 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-16T23:25:16.216 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-10-16T23:25:16.323 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-10-16T23:25:16.339 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-10-16T23:25:16.362 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-10-16T23:25:16.476 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-10-16T23:25:16.541 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-10-16T23:25:16.621 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-10-16T23:25:16.649 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-16T23:25:16.713 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-10-16T23:25:16.761 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-10-16T23:25:16.785 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-10-16T23:25:16.912 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-ceph-common (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:16.916 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-10-16T23:25:16.998 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-10-16T23:25:17.017 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-rsa (4.8-1) ... 2023-10-16T23:25:17.020 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-10-16T23:25:17.204 INFO:teuthology.orchestra.run.smithi033.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-10-16T23:25:17.205 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-idna (3.3-1) ... 2023-10-16T23:25:17.241 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-16T23:25:17.275 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up cephadm (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:17.277 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-10-16T23:25:17.322 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-10-16T23:25:17.367 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-10-16T23:25:17.526 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-16T23:25:17.561 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-16T23:25:17.573 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-ceph-argparse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:17.743 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-10-16T23:25:17.802 INFO:teuthology.orchestra.run.smithi033.stdout:Adding system user cephadm....done 2023-10-16T23:25:17.833 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-16T23:25:17.837 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-10-16T23:25:17.915 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-16T23:25:17.959 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-10-16T23:25:18.003 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-portend (3.0.0-1) ... 2023-10-16T23:25:18.174 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-10-16T23:25:18.202 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-10-16T23:25:18.230 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-16T23:25:18.254 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:25:18.380 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-10-16T23:25:18.426 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-10-16T23:25:18.470 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-16T23:25:18.532 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-10-16T23:25:18.560 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-10-16T23:25:18.622 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-10-16T23:25:18.622 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:25:18.723 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-10-16T23:25:18.757 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-toml (0.10.2-1) ... 2023-10-16T23:25:18.828 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-16T23:25:18.901 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-16T23:25:18.981 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-16T23:25:19.009 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-16T23:25:19.027 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up librados2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:19.032 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-16T23:25:19.079 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-10-16T23:25:19.107 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-10-16T23:25:19.137 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-10-16T23:25:19.152 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up librgw2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:19.180 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-py (1.10.0-1) ... 2023-10-16T23:25:19.264 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-10-16T23:25:19.325 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-10-16T23:25:19.347 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libsqlite3-mod-ceph (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:19.367 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-10-16T23:25:19.451 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rsa (4.8-1) ... 2023-10-16T23:25:19.457 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libcephfs2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:19.465 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-10-16T23:25:19.558 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-10-16T23:25:19.574 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libradosstriper1 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:19.644 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-10-16T23:25:19.700 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-10-16T23:25:19.719 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-10-16T23:25:19.812 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-10-16T23:25:19.833 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-10-16T23:25:19.962 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-10-16T23:25:19.985 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up librbd1 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:19.995 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-16T23:25:20.072 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:25:20.110 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-10-16T23:25:20.111 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr-modules-core (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:20.199 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-16T23:25:20.237 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-fuse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:20.254 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-10-16T23:25:20.309 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-10-16T23:25:20.378 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-10-16T23:25:20.456 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-16T23:25:20.456 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-16T23:25:20.598 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-10-16T23:25:20.605 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-10-16T23:25:20.622 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-16T23:25:20.662 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-10-16T23:25:20.857 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-10-16T23:25:20.858 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-10-16T23:25:20.905 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-10-16T23:25:20.975 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-10-16T23:25:21.006 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libcephfs-dev (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:21.101 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-10-16T23:25:21.107 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-rados (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:21.109 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-16T23:25:21.148 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-10-16T23:25:21.199 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-10-16T23:25:21.233 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up cephfs-top (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:21.334 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-16T23:25:21.344 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-16T23:25:21.436 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-10-16T23:25:21.457 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-ceph-argparse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:21.543 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-16T23:25:21.590 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-10-16T23:25:21.644 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librados2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:21.786 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librgw2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:21.833 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-16T23:25:21.838 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-10-16T23:25:21.842 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-16T23:25:21.959 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-10-16T23:25:21.969 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-10-16T23:25:21.998 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libsqlite3-mod-ceph (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:22.089 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-10-16T23:25:22.124 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libcephfs2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:22.227 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-10-16T23:25:22.246 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-16T23:25:22.250 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libradosstriper1 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:22.351 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-10-16T23:25:22.373 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-16T23:25:22.449 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-16T23:25:22.503 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-16T23:25:22.612 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-10-16T23:25:22.619 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librbd1 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:22.638 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-rbd (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:22.652 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-10-16T23:25:22.725 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-10-16T23:25:22.729 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-modules-core (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:22.739 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up rbd-fuse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:22.830 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-fuse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:22.840 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-rgw (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:22.945 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-10-16T23:25:22.955 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-16T23:25:22.966 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-cephfs (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:23.033 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-16T23:25:23.033 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-16T23:25:23.043 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-16T23:25:23.064 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-10-16T23:25:23.092 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up cephfs-shell (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:23.198 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-10-16T23:25:23.218 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-common (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:23.332 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-10-16T23:25:23.395 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-10-16T23:25:23.565 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libcephfs-dev (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:23.596 INFO:teuthology.orchestra.run.smithi072.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-10-16T23:25:23.600 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-10-16T23:25:23.680 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-10-16T23:25:23.691 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rados (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:23.761 INFO:teuthology.orchestra.run.smithi012.stdout:Adding group ceph....done 2023-10-16T23:25:23.817 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephfs-top (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:23.831 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-ceph-common (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:23.854 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-16T23:25:23.943 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-10-16T23:25:23.951 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-16T23:25:23.981 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-10-16T23:25:24.139 INFO:teuthology.orchestra.run.smithi012.stdout:Adding system user ceph....done 2023-10-16T23:25:24.141 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-idna (3.3-1) ... 2023-10-16T23:25:24.273 INFO:teuthology.orchestra.run.smithi012.stdout:Setting system user ceph properties....done 2023-10-16T23:25:24.291 INFO:teuthology.orchestra.run.smithi012.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-16T23:25:24.368 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-10-16T23:25:24.430 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-16T23:25:24.442 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-16T23:25:24.638 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-portend (3.0.0-1) ... 2023-10-16T23:25:24.678 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-10-16T23:25:24.780 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-16T23:25:24.890 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:25:24.929 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-10-16T23:25:25.017 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-10-16T23:25:25.030 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-10-16T23:25:25.131 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-16T23:25:25.197 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rbd (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:25.295 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up cephfs-mirror (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:25.323 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up rbd-fuse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:25.335 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-10-16T23:25:25.423 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-10-16T23:25:25.449 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rgw (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:25.510 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-16T23:25:25.511 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-16T23:25:25.584 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cephfs (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:25.647 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-16T23:25:25.658 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:25:25.685 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephfs-shell (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:25.786 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-common (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:25.816 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-10-16T23:25:25.817 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-toml (0.10.2-1) ... 2023-10-16T23:25:25.916 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-10-16T23:25:26.018 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-rsa (4.8-1) ... 2023-10-16T23:25:26.055 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-test (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:26.076 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-10-16T23:25:26.110 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-16T23:25:26.181 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up radosgw (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:26.236 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-10-16T23:25:26.287 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-10-16T23:25:26.354 INFO:teuthology.orchestra.run.smithi031.stdout:Adding group ceph....done 2023-10-16T23:25:26.363 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-10-16T23:25:26.469 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-16T23:25:26.516 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-16T23:25:26.517 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-16T23:25:26.557 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-16T23:25:26.664 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-10-16T23:25:26.731 INFO:teuthology.orchestra.run.smithi031.stdout:Adding system user ceph....done 2023-10-16T23:25:26.762 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-10-16T23:25:26.818 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-10-16T23:25:26.857 INFO:teuthology.orchestra.run.smithi031.stdout:Setting system user ceph properties....done 2023-10-16T23:25:26.870 INFO:teuthology.orchestra.run.smithi031.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-16T23:25:26.924 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-10-16T23:25:27.008 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-16T23:25:27.046 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-16T23:25:27.184 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:25:27.187 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-16T23:25:27.293 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-16T23:25:27.355 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-base (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:27.372 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-10-16T23:25:27.389 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-16T23:25:27.444 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-10-16T23:25:27.474 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-10-16T23:25:27.624 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-10-16T23:25:27.748 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-10-16T23:25:27.750 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-ceph-common (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:27.865 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-16T23:25:27.913 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephfs-mirror (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:27.962 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-16T23:25:28.024 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-10-16T23:25:28.059 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-idna (3.3-1) ... 2023-10-16T23:25:28.089 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up librados2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:28.120 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-16T23:25:28.120 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-16T23:25:28.217 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up librgw2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:28.276 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-10-16T23:25:28.393 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mds (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:28.402 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-16T23:25:28.431 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libsqlite3-mod-ceph (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:28.544 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-16T23:25:28.558 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libcephfs2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:28.621 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-16T23:25:28.621 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-16T23:25:28.686 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libradosstriper1 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:28.689 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-test (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:28.803 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-10-16T23:25:28.813 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-10-16T23:25:28.824 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up radosgw (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:29.063 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-16T23:25:29.083 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up librbd1 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:29.091 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-16T23:25:29.091 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-16T23:25:29.161 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:29.198 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-10-16T23:25:29.245 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-modules-core (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:29.372 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-fuse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:29.387 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-16T23:25:29.387 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-16T23:25:29.482 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-16T23:25:29.584 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-16T23:25:29.587 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-16T23:25:29.587 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-16T23:25:29.632 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:25:29.761 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-toml (0.10.2-1) ... 2023-10-16T23:25:29.834 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-base (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:29.877 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-10-16T23:25:29.896 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-osd (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:30.028 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-16T23:25:30.110 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libcephfs-dev (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:30.138 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-10-16T23:25:30.162 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-16T23:25:30.215 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-16T23:25:30.215 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-16T23:25:30.220 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-10-16T23:25:30.238 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-rados (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:30.239 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-10-16T23:25:30.365 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up cephfs-top (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:30.471 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-10-16T23:25:30.492 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-16T23:25:30.523 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-10-16T23:25:30.722 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mds (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:30.765 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr-k8sevents (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:30.782 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-10-16T23:25:30.866 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr-diskprediction-local (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:30.886 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-10-16T23:25:30.946 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-16T23:25:30.946 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-16T23:25:31.008 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mon (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:31.033 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:25:31.133 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-16T23:25:31.159 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-16T23:25:31.228 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-16T23:25:31.228 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-16T23:25:31.259 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-10-16T23:25:31.285 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-10-16T23:25:31.491 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:31.587 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-10-16T23:25:31.669 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-10-16T23:25:31.718 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-16T23:25:31.718 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-16T23:25:31.774 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-rbd (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:31.793 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr-cephadm (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:31.838 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-10-16T23:25:31.895 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up rbd-fuse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:31.944 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:31.945 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-portend (3.0.0-1) ... 2023-10-16T23:25:32.022 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-rgw (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:32.070 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr-dashboard (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:32.106 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-10-16T23:25:32.149 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up python3-cephfs (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:32.197 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:25:32.204 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-volume (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:32.301 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-osd (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:32.306 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-16T23:25:32.331 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-10-16T23:25:32.348 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-16T23:25:32.371 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up cephfs-shell (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:32.521 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-common (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:32.599 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-10-16T23:25:32.634 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-16T23:25:32.634 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-16T23:25:32.658 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-10-16T23:25:32.908 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-16T23:25:32.968 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-16T23:25:32.990 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-16T23:25:33.035 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-10-16T23:25:33.061 INFO:teuthology.orchestra.run.smithi072.stdout:Adding group ceph....done 2023-10-16T23:25:33.194 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-k8sevents (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:33.253 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-10-16T23:25:33.353 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-diskprediction-local (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:33.394 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-16T23:25:33.403 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rsa (4.8-1) ... 2023-10-16T23:25:33.448 INFO:teuthology.orchestra.run.smithi072.stdout:Adding system user ceph....done 2023-10-16T23:25:33.460 INFO:teuthology.orchestra.run.smithi012.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-16T23:25:33.463 DEBUG:teuthology.orchestra.run.smithi012:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-10-16T23:25:33.504 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-16T23:25:33.504 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mon (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:33.560 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2023-10-16T23:25:33.645 INFO:teuthology.orchestra.run.smithi072.stdout:Setting system user ceph properties....done 2023-10-16T23:25:33.660 INFO:teuthology.orchestra.run.smithi072.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-16T23:25:33.696 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-10-16T23:25:33.721 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-16T23:25:33.722 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-16T23:25:33.750 INFO:teuthology.orchestra.run.smithi012.stdout:Building dependency tree... 2023-10-16T23:25:33.751 INFO:teuthology.orchestra.run.smithi012.stdout:Reading state information... 2023-10-16T23:25:33.788 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-10-16T23:25:33.792 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-16T23:25:33.923 INFO:teuthology.orchestra.run.smithi012.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-10-16T23:25:33.923 INFO:teuthology.orchestra.run.smithi012.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-10-16T23:25:33.923 INFO:teuthology.orchestra.run.smithi012.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-10-16T23:25:33.923 INFO:teuthology.orchestra.run.smithi012.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-10-16T23:25:33.924 INFO:teuthology.orchestra.run.smithi012.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-10-16T23:25:33.924 INFO:teuthology.orchestra.run.smithi012.stdout:The following packages were automatically installed and are no longer required: 2023-10-16T23:25:33.924 INFO:teuthology.orchestra.run.smithi012.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-16T23:25:33.924 INFO:teuthology.orchestra.run.smithi012.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-16T23:25:33.925 INFO:teuthology.orchestra.run.smithi012.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-16T23:25:33.925 INFO:teuthology.orchestra.run.smithi012.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-16T23:25:33.926 INFO:teuthology.orchestra.run.smithi012.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-16T23:25:33.926 INFO:teuthology.orchestra.run.smithi012.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-16T23:25:33.926 INFO:teuthology.orchestra.run.smithi012.stdout:The following additional packages will be installed: 2023-10-16T23:25:33.927 INFO:teuthology.orchestra.run.smithi012.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-10-16T23:25:33.927 INFO:teuthology.orchestra.run.smithi012.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-10-16T23:25:33.927 INFO:teuthology.orchestra.run.smithi012.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-10-16T23:25:33.927 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-10-16T23:25:33.927 INFO:teuthology.orchestra.run.smithi012.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-16T23:25:33.928 INFO:teuthology.orchestra.run.smithi012.stdout:Suggested packages: 2023-10-16T23:25:33.928 INFO:teuthology.orchestra.run.smithi012.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-10-16T23:25:33.928 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-10-16T23:25:33.928 INFO:teuthology.orchestra.run.smithi012.stdout: libengine-pkcs11-openssl 2023-10-16T23:25:33.965 INFO:teuthology.orchestra.run.smithi012.stdout:The following NEW packages will be installed: 2023-10-16T23:25:33.966 INFO:teuthology.orchestra.run.smithi012.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-10-16T23:25:33.966 INFO:teuthology.orchestra.run.smithi012.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-10-16T23:25:33.966 INFO:teuthology.orchestra.run.smithi012.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-10-16T23:25:33.966 INFO:teuthology.orchestra.run.smithi012.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-10-16T23:25:33.966 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-10-16T23:25:33.967 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-10-16T23:25:33.967 INFO:teuthology.orchestra.run.smithi012.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-16T23:25:33.968 INFO:teuthology.orchestra.run.smithi012.stdout:The following packages will be upgraded: 2023-10-16T23:25:33.968 INFO:teuthology.orchestra.run.smithi012.stdout: libssl3 2023-10-16T23:25:33.973 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-16T23:25:34.018 INFO:teuthology.orchestra.run.smithi012.stdout:1 upgraded, 39 newly installed, 0 to remove and 255 not upgraded. 2023-10-16T23:25:34.019 INFO:teuthology.orchestra.run.smithi012.stdout:Need to get 54.6 MB of archives. 2023-10-16T23:25:34.019 INFO:teuthology.orchestra.run.smithi012.stdout:After this operation, 202 MB of additional disk space will be used. 2023-10-16T23:25:34.019 INFO:teuthology.orchestra.run.smithi012.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-10-16T23:25:34.089 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-10-16T23:25:34.120 INFO:teuthology.orchestra.run.smithi012.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-10-16T23:25:34.134 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-16T23:25:34.182 INFO:teuthology.orchestra.run.smithi012.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-10-16T23:25:34.197 INFO:teuthology.orchestra.run.smithi012.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-10-16T23:25:34.198 INFO:teuthology.orchestra.run.smithi012.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-10-16T23:25:34.201 INFO:teuthology.orchestra.run.smithi012.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-10-16T23:25:34.203 INFO:teuthology.orchestra.run.smithi012.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-10-16T23:25:34.203 INFO:teuthology.orchestra.run.smithi012.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-10-16T23:25:34.205 INFO:teuthology.orchestra.run.smithi012.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-10-16T23:25:34.206 INFO:teuthology.orchestra.run.smithi012.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-10-16T23:25:34.207 INFO:teuthology.orchestra.run.smithi012.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-10-16T23:25:34.207 INFO:teuthology.orchestra.run.smithi012.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-10-16T23:25:34.222 INFO:teuthology.orchestra.run.smithi012.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-10-16T23:25:34.241 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-10-16T23:25:34.264 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-cephadm (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:34.332 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-10-16T23:25:34.407 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:34.522 INFO:teuthology.orchestra.run.smithi012.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-10-16T23:25:34.524 INFO:teuthology.orchestra.run.smithi012.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-10-16T23:25:34.524 INFO:teuthology.orchestra.run.smithi012.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-10-16T23:25:34.526 INFO:teuthology.orchestra.run.smithi012.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-10-16T23:25:34.527 INFO:teuthology.orchestra.run.smithi012.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-10-16T23:25:34.530 INFO:teuthology.orchestra.run.smithi012.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-10-16T23:25:34.532 INFO:teuthology.orchestra.run.smithi012.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-10-16T23:25:34.533 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-dashboard (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:34.538 INFO:teuthology.orchestra.run.smithi012.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-10-16T23:25:34.539 INFO:teuthology.orchestra.run.smithi012.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-10-16T23:25:34.558 INFO:teuthology.orchestra.run.smithi012.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-10-16T23:25:34.558 INFO:teuthology.orchestra.run.smithi012.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-10-16T23:25:34.567 INFO:teuthology.orchestra.run.smithi012.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-10-16T23:25:34.588 INFO:teuthology.orchestra.run.smithi012.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-10-16T23:25:34.592 INFO:teuthology.orchestra.run.smithi012.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-10-16T23:25:34.592 INFO:teuthology.orchestra.run.smithi012.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-10-16T23:25:34.593 INFO:teuthology.orchestra.run.smithi012.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-10-16T23:25:34.594 INFO:teuthology.orchestra.run.smithi012.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-10-16T23:25:34.604 INFO:teuthology.orchestra.run.smithi012.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-10-16T23:25:34.605 INFO:teuthology.orchestra.run.smithi012.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-10-16T23:25:34.608 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up cephfs-mirror (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:34.634 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-16T23:25:34.684 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-volume (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:34.722 INFO:teuthology.orchestra.run.smithi033.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-10-16T23:25:34.811 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-16T23:25:34.814 INFO:teuthology.orchestra.run.smithi012.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-10-16T23:25:34.815 INFO:teuthology.orchestra.run.smithi012.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-10-16T23:25:34.815 INFO:teuthology.orchestra.run.smithi012.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-10-16T23:25:34.815 INFO:teuthology.orchestra.run.smithi012.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-10-16T23:25:34.815 INFO:teuthology.orchestra.run.smithi012.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-10-16T23:25:34.815 INFO:teuthology.orchestra.run.smithi012.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-10-16T23:25:34.816 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-16T23:25:34.816 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-16T23:25:34.826 INFO:teuthology.orchestra.run.smithi012.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-10-16T23:25:34.826 INFO:teuthology.orchestra.run.smithi012.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-10-16T23:25:34.936 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-10-16T23:25:34.984 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-16T23:25:35.110 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-10-16T23:25:35.248 INFO:teuthology.orchestra.run.smithi012.stdout:Preconfiguring packages ... 2023-10-16T23:25:35.305 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-16T23:25:35.336 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-test (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:35.409 INFO:teuthology.orchestra.run.smithi012.stdout:Fetched 54.6 MB in 1s (64.1 MB/s) 2023-10-16T23:25:35.432 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librados2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:35.446 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up radosgw (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:35.545 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package flex. 2023-10-16T23:25:35.570 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-10-16T23:25:35.575 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librgw2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:35.610 INFO:teuthology.orchestra.run.smithi012.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172963 files and directories currently installed.) 2023-10-16T23:25:35.615 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-10-16T23:25:35.661 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking flex (2.6.4-8build2) ... 2023-10-16T23:25:35.710 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-16T23:25:35.710 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-16T23:25:35.812 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libsqlite3-mod-ceph (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:35.813 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-portend (3.0.0-1) ... 2023-10-16T23:25:35.947 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcephfs2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:35.954 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-16T23:25:36.048 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-16T23:25:36.072 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libradosstriper1 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:36.174 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-10-16T23:25:36.199 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-10-16T23:25:36.400 INFO:teuthology.orchestra.run.smithi031.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-16T23:25:36.403 DEBUG:teuthology.orchestra.run.smithi031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-10-16T23:25:36.430 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-16T23:25:36.435 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-base (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:36.457 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2023-10-16T23:25:36.484 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librbd1 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:36.499 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-10-16T23:25:36.602 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-10-16T23:25:36.611 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-modules-core (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:36.646 INFO:teuthology.orchestra.run.smithi031.stdout:Building dependency tree... 2023-10-16T23:25:36.647 INFO:teuthology.orchestra.run.smithi031.stdout:Reading state information... 2023-10-16T23:25:36.737 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-fuse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:36.767 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-16T23:25:36.809 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-16T23:25:36.819 INFO:teuthology.orchestra.run.smithi031.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-10-16T23:25:36.819 INFO:teuthology.orchestra.run.smithi031.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-10-16T23:25:36.820 INFO:teuthology.orchestra.run.smithi031.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-10-16T23:25:36.820 INFO:teuthology.orchestra.run.smithi031.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-10-16T23:25:36.820 INFO:teuthology.orchestra.run.smithi031.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-10-16T23:25:36.821 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages were automatically installed and are no longer required: 2023-10-16T23:25:36.821 INFO:teuthology.orchestra.run.smithi031.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-16T23:25:36.821 INFO:teuthology.orchestra.run.smithi031.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-16T23:25:36.822 INFO:teuthology.orchestra.run.smithi031.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-16T23:25:36.822 INFO:teuthology.orchestra.run.smithi031.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-16T23:25:36.822 INFO:teuthology.orchestra.run.smithi031.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-16T23:25:36.823 INFO:teuthology.orchestra.run.smithi031.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-16T23:25:36.825 INFO:teuthology.orchestra.run.smithi031.stdout:The following additional packages will be installed: 2023-10-16T23:25:36.825 INFO:teuthology.orchestra.run.smithi031.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-10-16T23:25:36.825 INFO:teuthology.orchestra.run.smithi031.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-10-16T23:25:36.825 INFO:teuthology.orchestra.run.smithi031.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-10-16T23:25:36.825 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-10-16T23:25:36.826 INFO:teuthology.orchestra.run.smithi031.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-16T23:25:36.826 INFO:teuthology.orchestra.run.smithi031.stdout:Suggested packages: 2023-10-16T23:25:36.826 INFO:teuthology.orchestra.run.smithi031.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-10-16T23:25:36.826 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-10-16T23:25:36.827 INFO:teuthology.orchestra.run.smithi031.stdout: libengine-pkcs11-openssl 2023-10-16T23:25:36.860 INFO:teuthology.orchestra.run.smithi031.stdout:The following NEW packages will be installed: 2023-10-16T23:25:36.861 INFO:teuthology.orchestra.run.smithi031.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-10-16T23:25:36.861 INFO:teuthology.orchestra.run.smithi031.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-10-16T23:25:36.861 INFO:teuthology.orchestra.run.smithi031.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-10-16T23:25:36.861 INFO:teuthology.orchestra.run.smithi031.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-10-16T23:25:36.862 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-10-16T23:25:36.862 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-10-16T23:25:36.863 INFO:teuthology.orchestra.run.smithi031.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-16T23:25:36.863 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages will be upgraded: 2023-10-16T23:25:36.863 INFO:teuthology.orchestra.run.smithi031.stdout: libssl3 2023-10-16T23:25:36.923 INFO:teuthology.orchestra.run.smithi031.stdout:1 upgraded, 39 newly installed, 0 to remove and 255 not upgraded. 2023-10-16T23:25:36.923 INFO:teuthology.orchestra.run.smithi031.stdout:Need to get 54.6 MB of archives. 2023-10-16T23:25:36.924 INFO:teuthology.orchestra.run.smithi031.stdout:After this operation, 202 MB of additional disk space will be used. 2023-10-16T23:25:36.924 INFO:teuthology.orchestra.run.smithi031.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-10-16T23:25:36.956 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-16T23:25:36.956 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-16T23:25:37.012 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-16T23:25:37.068 INFO:teuthology.orchestra.run.smithi031.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-10-16T23:25:37.110 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-10-16T23:25:37.156 INFO:teuthology.orchestra.run.smithi031.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-10-16T23:25:37.176 INFO:teuthology.orchestra.run.smithi031.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-10-16T23:25:37.177 INFO:teuthology.orchestra.run.smithi031.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-10-16T23:25:37.181 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-10-16T23:25:37.184 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-10-16T23:25:37.184 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-10-16T23:25:37.187 INFO:teuthology.orchestra.run.smithi031.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-10-16T23:25:37.188 INFO:teuthology.orchestra.run.smithi031.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-10-16T23:25:37.190 INFO:teuthology.orchestra.run.smithi031.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-10-16T23:25:37.190 INFO:teuthology.orchestra.run.smithi031.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-10-16T23:25:37.210 INFO:teuthology.orchestra.run.smithi031.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-10-16T23:25:37.228 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-rsa (4.8-1) ... 2023-10-16T23:25:37.238 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mds (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:37.453 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-16T23:25:37.454 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-16T23:25:37.479 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-10-16T23:25:37.522 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcephfs-dev (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:37.536 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package bison. 2023-10-16T23:25:37.638 INFO:teuthology.orchestra.run.smithi031.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-10-16T23:25:37.641 INFO:teuthology.orchestra.run.smithi012.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173036 files and directories currently installed.) 2023-10-16T23:25:37.642 INFO:teuthology.orchestra.run.smithi031.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-10-16T23:25:37.642 INFO:teuthology.orchestra.run.smithi031.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-10-16T23:25:37.647 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-10-16T23:25:37.648 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rados (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:37.649 INFO:teuthology.orchestra.run.smithi031.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-10-16T23:25:37.650 INFO:teuthology.orchestra.run.smithi031.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-10-16T23:25:37.661 INFO:teuthology.orchestra.run.smithi031.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-10-16T23:25:37.664 INFO:teuthology.orchestra.run.smithi031.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-10-16T23:25:37.680 INFO:teuthology.orchestra.run.smithi031.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-10-16T23:25:37.681 INFO:teuthology.orchestra.run.smithi031.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-10-16T23:25:37.697 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-10-16T23:25:37.715 INFO:teuthology.orchestra.run.smithi031.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-10-16T23:25:37.715 INFO:teuthology.orchestra.run.smithi031.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-10-16T23:25:37.727 INFO:teuthology.orchestra.run.smithi031.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-10-16T23:25:37.730 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-16T23:25:37.749 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up cephfs-top (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:37.753 INFO:teuthology.orchestra.run.smithi031.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-10-16T23:25:37.762 INFO:teuthology.orchestra.run.smithi031.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-10-16T23:25:37.762 INFO:teuthology.orchestra.run.smithi031.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-10-16T23:25:37.763 INFO:teuthology.orchestra.run.smithi031.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-10-16T23:25:37.763 INFO:teuthology.orchestra.run.smithi031.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-10-16T23:25:37.791 INFO:teuthology.orchestra.run.smithi031.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-10-16T23:25:37.793 INFO:teuthology.orchestra.run.smithi031.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-10-16T23:25:37.851 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-16T23:25:37.935 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:38.006 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-10-16T23:25:38.106 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-16T23:25:38.134 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-10-16T23:25:38.141 INFO:teuthology.orchestra.run.smithi031.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-10-16T23:25:38.141 INFO:teuthology.orchestra.run.smithi031.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-10-16T23:25:38.141 INFO:teuthology.orchestra.run.smithi031.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-10-16T23:25:38.142 INFO:teuthology.orchestra.run.smithi031.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-10-16T23:25:38.142 INFO:teuthology.orchestra.run.smithi031.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-10-16T23:25:38.142 INFO:teuthology.orchestra.run.smithi031.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-10-16T23:25:38.151 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-16T23:25:38.152 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-16T23:25:38.159 INFO:teuthology.orchestra.run.smithi031.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-10-16T23:25:38.159 INFO:teuthology.orchestra.run.smithi031.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-10-16T23:25:38.181 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-10-16T23:25:38.399 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-16T23:25:38.500 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package dump. 2023-10-16T23:25:38.528 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-10-16T23:25:38.579 INFO:teuthology.orchestra.run.smithi031.stdout:Preconfiguring packages ... 2023-10-16T23:25:38.583 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking dump (0.4b47-3) ... 2023-10-16T23:25:38.646 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-osd (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:38.708 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-10-16T23:25:38.734 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 54.6 MB in 1s (42.3 MB/s) 2023-10-16T23:25:38.870 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package indent. 2023-10-16T23:25:38.871 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package flex. 2023-10-16T23:25:38.895 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:25:38.928 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-16T23:25:38.929 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-16T23:25:38.929 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-16T23:25:38.966 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172963 files and directories currently installed.) 2023-10-16T23:25:38.972 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-10-16T23:25:39.011 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking flex (2.6.4-8build2) ... 2023-10-16T23:25:39.069 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-16T23:25:39.080 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rbd (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:39.139 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-16T23:25:39.153 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-10-16T23:25:39.181 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-16T23:25:39.195 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up librados2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:39.207 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up rbd-fuse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:39.296 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up librgw2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:39.358 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rgw (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:39.433 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-k8sevents (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:39.499 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libsqlite3-mod-ceph (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:39.509 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cephfs (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:39.510 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-16T23:25:39.538 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-10-16T23:25:39.561 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-diskprediction-local (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:39.576 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-16T23:25:39.586 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-16T23:25:39.625 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libcephfs2 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:39.661 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up cephfs-shell (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:39.696 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mon (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:39.751 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libradosstriper1 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:39.767 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-10-16T23:25:39.812 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-common (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:39.877 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-10-16T23:25:39.887 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-16T23:25:39.907 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-16T23:25:39.907 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-16T23:25:39.915 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-10-16T23:25:39.954 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-10-16T23:25:40.171 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up librbd1 (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:40.185 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-16T23:25:40.280 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-mgr-modules-core (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:40.299 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libfl2:amd64. 2023-10-16T23:25:40.327 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-10-16T23:25:40.365 INFO:teuthology.orchestra.run.smithi138.stdout:Adding group ceph....done 2023-10-16T23:25:40.366 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-10-16T23:25:40.406 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-fuse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:40.432 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-cephadm (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:40.584 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:40.618 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-10-16T23:25:40.624 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-16T23:25:40.624 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-16T23:25:40.646 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-10-16T23:25:40.684 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-16T23:25:40.702 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package bison. 2023-10-16T23:25:40.712 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-mgr-dashboard (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:40.750 INFO:teuthology.orchestra.run.smithi138.stdout:Adding system user ceph....done 2023-10-16T23:25:40.808 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173036 files and directories currently installed.) 2023-10-16T23:25:40.814 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-10-16T23:25:40.839 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ceph-volume (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:40.862 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-10-16T23:25:40.919 INFO:teuthology.orchestra.run.smithi138.stdout:Setting system user ceph properties....done 2023-10-16T23:25:40.934 INFO:teuthology.orchestra.run.smithi138.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-16T23:25:40.937 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libjson-perl. 2023-10-16T23:25:40.965 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-10-16T23:25:40.967 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-16T23:25:41.003 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-10-16T23:25:41.065 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-16T23:25:41.149 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libcephfs-dev (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:41.284 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-rados (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:41.296 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-16T23:25:41.324 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-10-16T23:25:41.362 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-10-16T23:25:41.398 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-16T23:25:41.433 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libllvm14:amd64. 2023-10-16T23:25:41.461 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-10-16T23:25:41.499 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-16T23:25:41.744 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up cephfs-top (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:41.802 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-16T23:25:41.895 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-16T23:25:42.040 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package dump. 2023-10-16T23:25:42.059 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up cephfs-mirror (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:42.068 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-10-16T23:25:42.107 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking dump (0.4b47-3) ... 2023-10-16T23:25:42.288 INFO:teuthology.orchestra.run.smithi072.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-16T23:25:42.290 DEBUG:teuthology.orchestra.run.smithi072:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-10-16T23:25:42.348 INFO:teuthology.orchestra.run.smithi072.stdout:Reading package lists... 2023-10-16T23:25:42.370 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-16T23:25:42.370 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-16T23:25:42.402 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package indent. 2023-10-16T23:25:42.419 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:25:42.460 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-16T23:25:42.535 INFO:teuthology.orchestra.run.smithi072.stdout:Building dependency tree... 2023-10-16T23:25:42.535 INFO:teuthology.orchestra.run.smithi072.stdout:Reading state information... 2023-10-16T23:25:42.683 INFO:teuthology.orchestra.run.smithi072.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-10-16T23:25:42.683 INFO:teuthology.orchestra.run.smithi072.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-10-16T23:25:42.684 INFO:teuthology.orchestra.run.smithi072.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-10-16T23:25:42.684 INFO:teuthology.orchestra.run.smithi072.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-10-16T23:25:42.684 INFO:teuthology.orchestra.run.smithi072.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-10-16T23:25:42.684 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages were automatically installed and are no longer required: 2023-10-16T23:25:42.684 INFO:teuthology.orchestra.run.smithi072.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-16T23:25:42.685 INFO:teuthology.orchestra.run.smithi072.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-16T23:25:42.685 INFO:teuthology.orchestra.run.smithi072.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-16T23:25:42.685 INFO:teuthology.orchestra.run.smithi072.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-16T23:25:42.685 INFO:teuthology.orchestra.run.smithi072.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-16T23:25:42.685 INFO:teuthology.orchestra.run.smithi072.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-16T23:25:42.686 INFO:teuthology.orchestra.run.smithi072.stdout:The following additional packages will be installed: 2023-10-16T23:25:42.687 INFO:teuthology.orchestra.run.smithi072.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-10-16T23:25:42.687 INFO:teuthology.orchestra.run.smithi072.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-10-16T23:25:42.687 INFO:teuthology.orchestra.run.smithi072.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-10-16T23:25:42.687 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-10-16T23:25:42.688 INFO:teuthology.orchestra.run.smithi072.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-16T23:25:42.688 INFO:teuthology.orchestra.run.smithi072.stdout:Suggested packages: 2023-10-16T23:25:42.688 INFO:teuthology.orchestra.run.smithi072.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-10-16T23:25:42.688 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-10-16T23:25:42.688 INFO:teuthology.orchestra.run.smithi072.stdout: libengine-pkcs11-openssl 2023-10-16T23:25:42.704 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-16T23:25:42.721 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-10-16T23:25:42.722 INFO:teuthology.orchestra.run.smithi072.stdout:The following NEW packages will be installed: 2023-10-16T23:25:42.722 INFO:teuthology.orchestra.run.smithi072.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-10-16T23:25:42.722 INFO:teuthology.orchestra.run.smithi072.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-10-16T23:25:42.723 INFO:teuthology.orchestra.run.smithi072.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-10-16T23:25:42.723 INFO:teuthology.orchestra.run.smithi072.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-10-16T23:25:42.723 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-10-16T23:25:42.724 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-10-16T23:25:42.724 INFO:teuthology.orchestra.run.smithi072.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-16T23:25:42.724 INFO:teuthology.orchestra.run.smithi072.stdout:The following packages will be upgraded: 2023-10-16T23:25:42.725 INFO:teuthology.orchestra.run.smithi072.stdout: libssl3 2023-10-16T23:25:42.754 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-16T23:25:42.904 INFO:teuthology.orchestra.run.smithi072.stdout:1 upgraded, 39 newly installed, 0 to remove and 255 not upgraded. 2023-10-16T23:25:42.904 INFO:teuthology.orchestra.run.smithi072.stdout:Need to get 54.6 MB of archives. 2023-10-16T23:25:42.905 INFO:teuthology.orchestra.run.smithi072.stdout:After this operation, 202 MB of additional disk space will be used. 2023-10-16T23:25:42.905 INFO:teuthology.orchestra.run.smithi072.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-10-16T23:25:42.934 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-test (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:43.066 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-16T23:25:43.086 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up radosgw (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:43.094 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-10-16T23:25:43.149 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-rbd (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:43.157 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-16T23:25:43.201 INFO:teuthology.orchestra.run.smithi072.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-10-16T23:25:43.236 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-16T23:25:43.264 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-16T23:25:43.275 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up rbd-fuse (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:43.302 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-16T23:25:43.363 INFO:teuthology.orchestra.run.smithi072.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-10-16T23:25:43.395 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-16T23:25:43.396 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-16T23:25:43.410 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-16T23:25:43.427 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-10-16T23:25:43.455 INFO:teuthology.orchestra.run.smithi072.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-10-16T23:25:43.459 INFO:teuthology.orchestra.run.smithi072.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-10-16T23:25:43.464 INFO:teuthology.orchestra.run.smithi072.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-10-16T23:25:43.466 INFO:teuthology.orchestra.run.smithi072.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-10-16T23:25:43.467 INFO:teuthology.orchestra.run.smithi072.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-10-16T23:25:43.468 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-10-16T23:25:43.470 INFO:teuthology.orchestra.run.smithi072.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-10-16T23:25:43.471 INFO:teuthology.orchestra.run.smithi072.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-10-16T23:25:43.472 INFO:teuthology.orchestra.run.smithi072.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-10-16T23:25:43.473 INFO:teuthology.orchestra.run.smithi072.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-10-16T23:25:43.501 INFO:teuthology.orchestra.run.smithi072.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-10-16T23:25:43.537 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-16T23:25:43.555 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-16T23:25:43.587 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-16T23:25:43.593 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-rgw (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:43.752 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-cephfs (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:43.805 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libfl2:amd64. 2023-10-16T23:25:43.833 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-10-16T23:25:43.871 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-10-16T23:25:43.887 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up cephfs-shell (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:43.907 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-16T23:25:43.935 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-16T23:25:43.974 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-16T23:25:43.996 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-common (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:44.073 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-10-16T23:25:44.090 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-10-16T23:25:44.123 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-16T23:25:44.185 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-base (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:44.318 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-16T23:25:44.346 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-10-16T23:25:44.360 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libjson-perl. 2023-10-16T23:25:44.376 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-10-16T23:25:44.384 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-16T23:25:44.417 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-10-16T23:25:44.489 INFO:teuthology.orchestra.run.smithi033.stdout:Adding group ceph....done 2023-10-16T23:25:44.679 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-16T23:25:44.707 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-10-16T23:25:44.725 INFO:teuthology.orchestra.run.smithi072.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-10-16T23:25:44.729 INFO:teuthology.orchestra.run.smithi072.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-10-16T23:25:44.730 INFO:teuthology.orchestra.run.smithi072.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-10-16T23:25:44.735 INFO:teuthology.orchestra.run.smithi072.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-10-16T23:25:44.736 INFO:teuthology.orchestra.run.smithi072.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-10-16T23:25:44.745 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-16T23:25:44.746 INFO:teuthology.orchestra.run.smithi072.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-10-16T23:25:44.747 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-16T23:25:44.749 INFO:teuthology.orchestra.run.smithi072.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-10-16T23:25:44.754 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libllvm14:amd64. 2023-10-16T23:25:44.765 INFO:teuthology.orchestra.run.smithi072.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-10-16T23:25:44.766 INFO:teuthology.orchestra.run.smithi072.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-10-16T23:25:44.782 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-10-16T23:25:44.802 INFO:teuthology.orchestra.run.smithi072.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-10-16T23:25:44.803 INFO:teuthology.orchestra.run.smithi072.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-10-16T23:25:44.814 INFO:teuthology.orchestra.run.smithi072.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-10-16T23:25:44.820 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-16T23:25:44.840 INFO:teuthology.orchestra.run.smithi072.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-10-16T23:25:44.848 INFO:teuthology.orchestra.run.smithi072.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-10-16T23:25:44.848 INFO:teuthology.orchestra.run.smithi072.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-10-16T23:25:44.849 INFO:teuthology.orchestra.run.smithi072.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-10-16T23:25:44.849 INFO:teuthology.orchestra.run.smithi072.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-10-16T23:25:44.869 INFO:teuthology.orchestra.run.smithi072.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-10-16T23:25:44.872 INFO:teuthology.orchestra.run.smithi072.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-10-16T23:25:44.874 INFO:teuthology.orchestra.run.smithi033.stdout:Adding system user ceph....done 2023-10-16T23:25:45.048 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libpq5:amd64. 2023-10-16T23:25:45.050 INFO:teuthology.orchestra.run.smithi033.stdout:Setting system user ceph properties....done 2023-10-16T23:25:45.066 INFO:teuthology.orchestra.run.smithi033.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-16T23:25:45.076 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:25:45.115 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:25:45.204 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-16T23:25:45.268 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mds (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:45.295 INFO:teuthology.orchestra.run.smithi072.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-10-16T23:25:45.295 INFO:teuthology.orchestra.run.smithi072.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-10-16T23:25:45.295 INFO:teuthology.orchestra.run.smithi072.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-10-16T23:25:45.295 INFO:teuthology.orchestra.run.smithi072.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-10-16T23:25:45.296 INFO:teuthology.orchestra.run.smithi072.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-10-16T23:25:45.296 INFO:teuthology.orchestra.run.smithi072.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-10-16T23:25:45.314 INFO:teuthology.orchestra.run.smithi072.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-10-16T23:25:45.314 INFO:teuthology.orchestra.run.smithi072.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-10-16T23:25:45.468 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-16T23:25:45.496 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:25:45.534 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-16T23:25:45.550 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-16T23:25:45.550 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-16T23:25:45.613 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-16T23:25:45.708 INFO:teuthology.orchestra.run.smithi072.stdout:Preconfiguring packages ... 2023-10-16T23:25:45.836 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-16T23:25:45.853 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:25:45.877 INFO:teuthology.orchestra.run.smithi072.stdout:Fetched 54.6 MB in 3s (21.1 MB/s) 2023-10-16T23:25:45.895 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-16T23:25:46.018 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package flex. 2023-10-16T23:25:46.113 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-16T23:25:46.114 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up cephfs-mirror (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:46.117 INFO:teuthology.orchestra.run.smithi072.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172963 files and directories currently installed.) 2023-10-16T23:25:46.123 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-10-16T23:25:46.130 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-16T23:25:46.164 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-16T23:25:46.168 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking flex (2.6.4-8build2) ... 2023-10-16T23:25:46.256 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:46.312 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-16T23:25:46.313 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-16T23:25:46.464 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-16T23:25:46.493 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-16T23:25:46.531 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-16T23:25:46.617 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-16T23:25:46.617 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-16T23:25:46.684 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-16T23:25:46.712 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-10-16T23:25:46.740 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-16T23:25:46.784 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-10-16T23:25:46.825 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-16T23:25:46.840 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-test (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:46.842 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-16T23:25:46.892 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-16T23:25:46.905 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-10-16T23:25:46.991 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up radosgw (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:47.125 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-osd (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:47.128 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package modemmanager. 2023-10-16T23:25:47.157 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-16T23:25:47.195 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-16T23:25:47.219 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-16T23:25:47.248 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-16T23:25:47.271 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-16T23:25:47.272 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-16T23:25:47.286 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-16T23:25:47.378 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-16T23:25:47.410 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-16T23:25:47.411 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-16T23:25:47.572 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-16T23:25:47.589 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-10-16T23:25:47.622 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-16T23:25:47.776 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package network-manager. 2023-10-16T23:25:47.805 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-10-16T23:25:47.843 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-10-16T23:25:47.918 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-k8sevents (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:47.933 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-16T23:25:47.950 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package bison. 2023-10-16T23:25:47.961 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-10-16T23:25:47.999 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-16T23:25:48.044 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-diskprediction-local (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:48.051 INFO:teuthology.orchestra.run.smithi072.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173036 files and directories currently installed.) 2023-10-16T23:25:48.057 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-10-16T23:25:48.059 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-base (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:48.102 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-10-16T23:25:48.196 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mon (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:48.360 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libpq5:amd64. 2023-10-16T23:25:48.389 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:25:48.411 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-16T23:25:48.411 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-16T23:25:48.427 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:25:48.445 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-16T23:25:48.466 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ppp. 2023-10-16T23:25:48.495 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-10-16T23:25:48.728 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-16T23:25:48.756 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-10-16T23:25:48.780 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-10-16T23:25:48.794 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-10-16T23:25:48.796 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-16T23:25:48.825 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:25:48.863 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-16T23:25:48.947 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-cephadm (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:48.953 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-mds (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:49.096 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package pptp-linux. 2023-10-16T23:25:49.107 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:49.124 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-10-16T23:25:49.132 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-16T23:25:49.143 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package dump. 2023-10-16T23:25:49.148 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:25:49.162 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-10-16T23:25:49.163 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-16T23:25:49.163 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-16T23:25:49.170 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-10-16T23:25:49.182 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-16T23:25:49.210 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking dump (0.4b47-3) ... 2023-10-16T23:25:49.216 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-dashboard (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:49.343 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-volume (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:49.408 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-16T23:25:49.425 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-10-16T23:25:49.434 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-16T23:25:49.445 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-16T23:25:49.462 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-16T23:25:49.467 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-10-16T23:25:49.500 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package indent. 2023-10-16T23:25:49.501 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-16T23:25:49.527 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:25:49.575 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-16T23:25:49.672 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-mgr (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:49.728 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package postgresql-client-common. 2023-10-16T23:25:49.757 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-10-16T23:25:49.795 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking postgresql-client-common (238) ... 2023-10-16T23:25:49.840 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-16T23:25:49.855 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-10-16T23:25:49.897 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-16T23:25:49.902 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-16T23:25:49.902 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-16T23:25:50.013 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-16T23:25:50.041 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-10-16T23:25:50.079 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-10-16T23:25:50.099 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package postgresql-client-14. 2023-10-16T23:25:50.127 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:25:50.165 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:25:50.231 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-16T23:25:50.258 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-10-16T23:25:50.298 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-16T23:25:50.314 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-16T23:25:50.365 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package modemmanager. 2023-10-16T23:25:50.393 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-16T23:25:50.415 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-osd (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:50.423 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-16T23:25:50.560 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-16T23:25:50.576 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-10-16T23:25:50.619 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-10-16T23:25:50.725 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-16T23:25:50.726 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-16T23:25:50.745 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package postgresql-common. 2023-10-16T23:25:50.774 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-10-16T23:25:50.789 INFO:teuthology.orchestra.run.smithi138.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-16T23:25:50.792 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-10-16T23:25:50.831 INFO:teuthology.orchestra.run.smithi012.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-10-16T23:25:50.868 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking postgresql-common (238) ... 2023-10-16T23:25:50.892 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2023-10-16T23:25:50.993 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libfl2:amd64. 2023-10-16T23:25:51.020 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-10-16T23:25:51.054 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package network-manager. 2023-10-16T23:25:51.059 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-10-16T23:25:51.074 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2023-10-16T23:25:51.074 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2023-10-16T23:25:51.082 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-10-16T23:25:51.129 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-10-16T23:25:51.219 INFO:teuthology.orchestra.run.smithi138.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-10-16T23:25:51.220 INFO:teuthology.orchestra.run.smithi138.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-10-16T23:25:51.220 INFO:teuthology.orchestra.run.smithi138.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-10-16T23:25:51.220 INFO:teuthology.orchestra.run.smithi138.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-10-16T23:25:51.220 INFO:teuthology.orchestra.run.smithi138.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-10-16T23:25:51.221 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2023-10-16T23:25:51.221 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-16T23:25:51.221 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-16T23:25:51.221 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-16T23:25:51.221 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-16T23:25:51.222 INFO:teuthology.orchestra.run.smithi138.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-16T23:25:51.222 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-16T23:25:51.223 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2023-10-16T23:25:51.223 INFO:teuthology.orchestra.run.smithi138.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-10-16T23:25:51.224 INFO:teuthology.orchestra.run.smithi138.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-10-16T23:25:51.224 INFO:teuthology.orchestra.run.smithi138.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-10-16T23:25:51.224 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-10-16T23:25:51.224 INFO:teuthology.orchestra.run.smithi138.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-16T23:25:51.224 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2023-10-16T23:25:51.225 INFO:teuthology.orchestra.run.smithi138.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-10-16T23:25:51.225 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-10-16T23:25:51.225 INFO:teuthology.orchestra.run.smithi138.stdout: libengine-pkcs11-openssl 2023-10-16T23:25:51.233 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-mgr-k8sevents (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:51.258 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2023-10-16T23:25:51.260 INFO:teuthology.orchestra.run.smithi138.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-10-16T23:25:51.260 INFO:teuthology.orchestra.run.smithi138.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-10-16T23:25:51.260 INFO:teuthology.orchestra.run.smithi138.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-10-16T23:25:51.260 INFO:teuthology.orchestra.run.smithi138.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-10-16T23:25:51.261 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-10-16T23:25:51.261 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-10-16T23:25:51.261 INFO:teuthology.orchestra.run.smithi138.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-16T23:25:51.262 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages will be upgraded: 2023-10-16T23:25:51.262 INFO:teuthology.orchestra.run.smithi138.stdout: libssl3 2023-10-16T23:25:51.299 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-10-16T23:25:51.326 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-10-16T23:25:51.365 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-16T23:25:51.400 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-mgr-diskprediction-local (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:51.440 INFO:teuthology.orchestra.run.smithi138.stdout:1 upgraded, 39 newly installed, 0 to remove and 255 not upgraded. 2023-10-16T23:25:51.440 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 54.6 MB of archives. 2023-10-16T23:25:51.441 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 202 MB of additional disk space will be used. 2023-10-16T23:25:51.441 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-10-16T23:25:51.501 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package postgresql-14. 2023-10-16T23:25:51.529 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:25:51.568 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-mon (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:51.611 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libjson-perl. 2023-10-16T23:25:51.627 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-10-16T23:25:51.670 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-10-16T23:25:51.685 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ppp. 2023-10-16T23:25:51.702 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-10-16T23:25:51.795 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-16T23:25:51.795 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-16T23:25:51.840 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:25:51.917 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-10-16T23:25:51.960 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libllvm14:amd64. 2023-10-16T23:25:51.976 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-10-16T23:25:52.009 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-10-16T23:25:52.010 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-16T23:25:52.173 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-10-16T23:25:52.208 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-10-16T23:25:52.209 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-10-16T23:25:52.215 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-10-16T23:25:52.218 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-10-16T23:25:52.219 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-10-16T23:25:52.222 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-10-16T23:25:52.224 INFO:teuthology.orchestra.run.smithi138.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-10-16T23:25:52.311 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-mgr-cephadm (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:52.365 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package pptp-linux. 2023-10-16T23:25:52.382 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-10-16T23:25:52.389 INFO:teuthology.orchestra.run.smithi138.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-10-16T23:25:52.390 INFO:teuthology.orchestra.run.smithi138.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-10-16T23:25:52.446 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:52.448 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-10-16T23:25:52.572 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-mgr-dashboard (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:52.634 INFO:teuthology.orchestra.run.smithi138.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-10-16T23:25:52.700 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-16T23:25:52.717 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-10-16T23:25:52.723 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-volume (18.2.0-668-gab9fe435-1jammy) ... 2023-10-16T23:25:52.759 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-10-16T23:25:52.849 INFO:teuthology.orchestra.run.smithi033.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-16T23:25:53.062 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-client-common. 2023-10-16T23:25:53.090 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-10-16T23:25:53.115 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package postgresql. 2023-10-16T23:25:53.128 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-client-common (238) ... 2023-10-16T23:25:53.133 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-10-16T23:25:53.173 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking postgresql (14+238) ... 2023-10-16T23:25:53.407 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-client-14. 2023-10-16T23:25:53.434 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package postgresql-client. 2023-10-16T23:25:53.435 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:25:53.451 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-10-16T23:25:53.473 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:25:53.492 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking postgresql-client (14+238) ... 2023-10-16T23:25:53.728 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package postgresql-contrib. 2023-10-16T23:25:53.756 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-10-16T23:25:53.765 INFO:teuthology.orchestra.run.smithi138.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-10-16T23:25:53.770 INFO:teuthology.orchestra.run.smithi138.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-10-16T23:25:53.770 INFO:teuthology.orchestra.run.smithi138.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-10-16T23:25:53.777 INFO:teuthology.orchestra.run.smithi138.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-10-16T23:25:53.777 INFO:teuthology.orchestra.run.smithi138.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-10-16T23:25:53.788 INFO:teuthology.orchestra.run.smithi138.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-10-16T23:25:53.792 INFO:teuthology.orchestra.run.smithi138.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-10-16T23:25:53.794 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking postgresql-contrib (14+238) ... 2023-10-16T23:25:53.808 INFO:teuthology.orchestra.run.smithi138.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-10-16T23:25:53.973 INFO:teuthology.orchestra.run.smithi138.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-10-16T23:25:53.992 INFO:teuthology.orchestra.run.smithi033.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-16T23:25:54.086 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-common. 2023-10-16T23:25:54.114 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package tcl8.6. 2023-10-16T23:25:54.115 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-10-16T23:25:54.143 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-10-16T23:25:54.172 INFO:teuthology.orchestra.run.smithi031.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-10-16T23:25:54.180 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-16T23:25:54.201 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-common (238) ... 2023-10-16T23:25:54.458 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package tcl. 2023-10-16T23:25:54.487 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-10-16T23:25:54.498 INFO:teuthology.orchestra.run.smithi033.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-16T23:25:54.500 DEBUG:teuthology.orchestra.run.smithi033:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-10-16T23:25:54.530 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-10-16T23:25:54.554 INFO:teuthology.orchestra.run.smithi033.stdout:Reading package lists... 2023-10-16T23:25:54.593 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-16T23:25:54.620 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-16T23:25:54.652 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-14. 2023-10-16T23:25:54.659 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-16T23:25:54.680 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:25:54.696 INFO:teuthology.orchestra.run.smithi138.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-10-16T23:25:54.696 INFO:teuthology.orchestra.run.smithi138.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-10-16T23:25:54.722 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:25:54.722 INFO:teuthology.orchestra.run.smithi138.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-10-16T23:25:54.743 INFO:teuthology.orchestra.run.smithi033.stdout:Building dependency tree... 2023-10-16T23:25:54.744 INFO:teuthology.orchestra.run.smithi033.stdout:Reading state information... 2023-10-16T23:25:54.800 INFO:teuthology.orchestra.run.smithi138.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-10-16T23:25:54.808 INFO:teuthology.orchestra.run.smithi138.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-10-16T23:25:54.810 INFO:teuthology.orchestra.run.smithi138.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-10-16T23:25:54.814 INFO:teuthology.orchestra.run.smithi138.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-10-16T23:25:54.814 INFO:teuthology.orchestra.run.smithi138.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-10-16T23:25:54.819 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package wpasupplicant. 2023-10-16T23:25:54.838 INFO:teuthology.orchestra.run.smithi138.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-10-16T23:25:54.841 INFO:teuthology.orchestra.run.smithi138.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-10-16T23:25:54.848 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-10-16T23:25:54.877 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-16T23:25:54.916 INFO:teuthology.orchestra.run.smithi033.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-10-16T23:25:54.917 INFO:teuthology.orchestra.run.smithi033.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-10-16T23:25:54.917 INFO:teuthology.orchestra.run.smithi033.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-10-16T23:25:54.917 INFO:teuthology.orchestra.run.smithi033.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-10-16T23:25:54.917 INFO:teuthology.orchestra.run.smithi033.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-10-16T23:25:54.918 INFO:teuthology.orchestra.run.smithi033.stdout:The following packages were automatically installed and are no longer required: 2023-10-16T23:25:54.918 INFO:teuthology.orchestra.run.smithi033.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-16T23:25:54.918 INFO:teuthology.orchestra.run.smithi033.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-16T23:25:54.918 INFO:teuthology.orchestra.run.smithi033.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-16T23:25:54.919 INFO:teuthology.orchestra.run.smithi033.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-16T23:25:54.920 INFO:teuthology.orchestra.run.smithi033.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-16T23:25:54.920 INFO:teuthology.orchestra.run.smithi033.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-16T23:25:54.920 INFO:teuthology.orchestra.run.smithi033.stdout:The following additional packages will be installed: 2023-10-16T23:25:54.920 INFO:teuthology.orchestra.run.smithi033.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-10-16T23:25:54.921 INFO:teuthology.orchestra.run.smithi033.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-10-16T23:25:54.921 INFO:teuthology.orchestra.run.smithi033.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-10-16T23:25:54.921 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-10-16T23:25:54.921 INFO:teuthology.orchestra.run.smithi033.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-16T23:25:54.922 INFO:teuthology.orchestra.run.smithi033.stdout:Suggested packages: 2023-10-16T23:25:54.922 INFO:teuthology.orchestra.run.smithi033.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-10-16T23:25:54.922 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-10-16T23:25:54.922 INFO:teuthology.orchestra.run.smithi033.stdout: libengine-pkcs11-openssl 2023-10-16T23:25:54.923 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-16T23:25:54.938 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-16T23:25:54.958 INFO:teuthology.orchestra.run.smithi033.stdout:The following NEW packages will be installed: 2023-10-16T23:25:54.983 INFO:teuthology.orchestra.run.smithi033.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-10-16T23:25:54.984 INFO:teuthology.orchestra.run.smithi033.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-10-16T23:25:54.985 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-16T23:25:54.987 INFO:teuthology.orchestra.run.smithi033.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-10-16T23:25:55.002 INFO:teuthology.orchestra.run.smithi033.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-10-16T23:25:55.003 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-10-16T23:25:55.003 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-10-16T23:25:55.003 INFO:teuthology.orchestra.run.smithi033.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-16T23:25:55.004 INFO:teuthology.orchestra.run.smithi033.stdout:The following packages will be upgraded: 2023-10-16T23:25:55.004 INFO:teuthology.orchestra.run.smithi033.stdout: libssl3 2023-10-16T23:25:55.011 INFO:teuthology.orchestra.run.smithi033.stdout:1 upgraded, 39 newly installed, 0 to remove and 255 not upgraded. 2023-10-16T23:25:55.012 INFO:teuthology.orchestra.run.smithi033.stdout:Need to get 54.6 MB of archives. 2023-10-16T23:25:55.012 INFO:teuthology.orchestra.run.smithi033.stdout:After this operation, 202 MB of additional disk space will be used. 2023-10-16T23:25:55.012 INFO:teuthology.orchestra.run.smithi033.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-10-16T23:25:55.111 INFO:teuthology.orchestra.run.smithi033.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-10-16T23:25:55.171 INFO:teuthology.orchestra.run.smithi033.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-10-16T23:25:55.186 INFO:teuthology.orchestra.run.smithi033.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-10-16T23:25:55.187 INFO:teuthology.orchestra.run.smithi033.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-10-16T23:25:55.190 INFO:teuthology.orchestra.run.smithi033.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-10-16T23:25:55.191 INFO:teuthology.orchestra.run.smithi033.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-10-16T23:25:55.192 INFO:teuthology.orchestra.run.smithi033.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-10-16T23:25:55.194 INFO:teuthology.orchestra.run.smithi033.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-10-16T23:25:55.195 INFO:teuthology.orchestra.run.smithi033.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-10-16T23:25:55.196 INFO:teuthology.orchestra.run.smithi033.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-10-16T23:25:55.196 INFO:teuthology.orchestra.run.smithi033.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-10-16T23:25:55.210 INFO:teuthology.orchestra.run.smithi033.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-10-16T23:25:55.248 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-16T23:25:55.265 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-10-16T23:25:55.307 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-10-16T23:25:55.321 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-16T23:25:55.348 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-16T23:25:55.387 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-16T23:25:55.521 INFO:teuthology.orchestra.run.smithi033.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-10-16T23:25:55.522 INFO:teuthology.orchestra.run.smithi033.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-10-16T23:25:55.523 INFO:teuthology.orchestra.run.smithi033.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-10-16T23:25:55.525 INFO:teuthology.orchestra.run.smithi033.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-10-16T23:25:55.526 INFO:teuthology.orchestra.run.smithi033.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-10-16T23:25:55.529 INFO:teuthology.orchestra.run.smithi033.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-10-16T23:25:55.531 INFO:teuthology.orchestra.run.smithi033.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-10-16T23:25:55.537 INFO:teuthology.orchestra.run.smithi033.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-10-16T23:25:55.538 INFO:teuthology.orchestra.run.smithi033.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-10-16T23:25:55.545 INFO:teuthology.orchestra.run.smithi138.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-10-16T23:25:55.558 INFO:teuthology.orchestra.run.smithi033.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-10-16T23:25:55.558 INFO:teuthology.orchestra.run.smithi033.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-10-16T23:25:55.567 INFO:teuthology.orchestra.run.smithi033.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-10-16T23:25:55.587 INFO:teuthology.orchestra.run.smithi033.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-10-16T23:25:55.590 INFO:teuthology.orchestra.run.smithi033.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-10-16T23:25:55.591 INFO:teuthology.orchestra.run.smithi033.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-10-16T23:25:55.591 INFO:teuthology.orchestra.run.smithi033.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-10-16T23:25:55.592 INFO:teuthology.orchestra.run.smithi033.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-10-16T23:25:55.602 INFO:teuthology.orchestra.run.smithi033.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-10-16T23:25:55.603 INFO:teuthology.orchestra.run.smithi033.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-10-16T23:25:55.629 INFO:teuthology.orchestra.run.smithi138.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-10-16T23:25:55.629 INFO:teuthology.orchestra.run.smithi138.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-10-16T23:25:55.630 INFO:teuthology.orchestra.run.smithi138.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-10-16T23:25:55.685 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-16T23:25:55.714 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-10-16T23:25:55.719 INFO:teuthology.orchestra.run.smithi138.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-10-16T23:25:55.725 INFO:teuthology.orchestra.run.smithi138.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-10-16T23:25:55.751 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-16T23:25:55.760 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-16T23:25:55.778 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-10-16T23:25:55.798 INFO:teuthology.orchestra.run.smithi033.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-10-16T23:25:55.799 INFO:teuthology.orchestra.run.smithi033.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-10-16T23:25:55.799 INFO:teuthology.orchestra.run.smithi033.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-10-16T23:25:55.799 INFO:teuthology.orchestra.run.smithi033.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-10-16T23:25:55.799 INFO:teuthology.orchestra.run.smithi033.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-10-16T23:25:55.800 INFO:teuthology.orchestra.run.smithi033.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-10-16T23:25:55.810 INFO:teuthology.orchestra.run.smithi033.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-10-16T23:25:55.811 INFO:teuthology.orchestra.run.smithi033.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-10-16T23:25:55.826 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-16T23:25:56.029 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql. 2023-10-16T23:25:56.050 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up postgresql-client-common (238) ... 2023-10-16T23:25:56.059 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-10-16T23:25:56.096 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql (14+238) ... 2023-10-16T23:25:56.149 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-16T23:25:56.176 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-10-16T23:25:56.182 INFO:teuthology.orchestra.run.smithi138.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-10-16T23:25:56.184 INFO:teuthology.orchestra.run.smithi138.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-10-16T23:25:56.215 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-16T23:25:56.229 INFO:teuthology.orchestra.run.smithi033.stdout:Preconfiguring packages ... 2023-10-16T23:25:56.283 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up flex (2.6.4-8build2) ... 2023-10-16T23:25:56.364 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-client. 2023-10-16T23:25:56.381 INFO:teuthology.orchestra.run.smithi033.stdout:Fetched 54.6 MB in 1s (64.7 MB/s) 2023-10-16T23:25:56.381 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-10-16T23:25:56.423 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-client (14+238) ... 2023-10-16T23:25:56.434 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-16T23:25:56.491 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package flex. 2023-10-16T23:25:56.585 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:25:56.589 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libpq5:amd64. 2023-10-16T23:25:56.589 INFO:teuthology.orchestra.run.smithi138.stdout:Preconfiguring packages ... 2023-10-16T23:25:56.590 INFO:teuthology.orchestra.run.smithi033.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172963 files and directories currently installed.) 2023-10-16T23:25:56.595 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-10-16T23:25:56.616 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:25:56.617 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-contrib. 2023-10-16T23:25:56.631 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking flex (2.6.4-8build2) ... 2023-10-16T23:25:56.645 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-10-16T23:25:56.655 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:25:56.675 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-contrib (14+238) ... 2023-10-16T23:25:56.711 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-10-16T23:25:56.745 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 54.6 MB in 5s (11.1 MB/s) 2023-10-16T23:25:56.901 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package flex. 2023-10-16T23:25:56.947 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-16T23:25:56.986 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package tcl8.6. 2023-10-16T23:25:57.004 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172963 files and directories currently installed.) 2023-10-16T23:25:57.010 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-10-16T23:25:57.014 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-10-16T23:25:57.036 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-16T23:25:57.049 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking flex (2.6.4-8build2) ... 2023-10-16T23:25:57.052 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-16T23:25:57.063 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:25:57.073 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:25:57.102 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-16T23:25:57.189 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-16T23:25:57.338 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package tcl. 2023-10-16T23:25:57.367 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-10-16T23:25:57.370 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-10-16T23:25:57.410 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-10-16T23:25:57.425 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-16T23:25:57.441 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:25:57.483 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-16T23:25:57.614 INFO:teuthology.orchestra.run.smithi012.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-10-16T23:25:57.691 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-16T23:25:57.713 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-16T23:25:57.729 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-16T23:25:57.732 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package wpasupplicant. 2023-10-16T23:25:57.745 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-16T23:25:57.761 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-10-16T23:25:57.780 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-16T23:25:57.787 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-16T23:25:57.799 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-16T23:25:57.906 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-10-16T23:25:58.100 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-16T23:25:58.102 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-16T23:25:58.145 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-16T23:25:58.173 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-10-16T23:25:58.211 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-10-16T23:25:58.330 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package bison. 2023-10-16T23:25:58.349 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-16T23:25:58.362 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-16T23:25:58.390 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-10-16T23:25:58.437 INFO:teuthology.orchestra.run.smithi033.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173036 files and directories currently installed.) 2023-10-16T23:25:58.437 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-10-16T23:25:58.443 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-10-16T23:25:58.499 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-10-16T23:25:58.589 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-16T23:25:58.618 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-10-16T23:25:58.658 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-10-16T23:25:58.664 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-16T23:25:58.785 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package modemmanager. 2023-10-16T23:25:58.809 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-16T23:25:58.813 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-16T23:25:58.852 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-16T23:25:58.884 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package bison. 2023-10-16T23:25:58.932 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-16T23:25:58.952 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-client-common (238) ... 2023-10-16T23:25:58.960 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-10-16T23:25:58.960 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-10-16T23:25:58.988 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173036 files and directories currently installed.) 2023-10-16T23:25:58.993 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-10-16T23:25:59.036 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-10-16T23:25:59.119 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-10-16T23:25:59.136 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-10-16T23:25:59.145 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up flex (2.6.4-8build2) ... 2023-10-16T23:25:59.254 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-16T23:25:59.262 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-10-16T23:25:59.380 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:25:59.388 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-16T23:25:59.438 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-16T23:25:59.465 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-10-16T23:25:59.504 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-10-16T23:25:59.506 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-10-16T23:25:59.514 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-10-16T23:25:59.554 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package dump. 2023-10-16T23:25:59.582 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-10-16T23:25:59.621 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking dump (0.4b47-3) ... 2023-10-16T23:25:59.632 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-16T23:25:59.758 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:25:59.816 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package dump. 2023-10-16T23:25:59.832 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-10-16T23:25:59.866 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking dump (0.4b47-3) ... 2023-10-16T23:25:59.908 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package indent. 2023-10-16T23:25:59.924 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:25:59.966 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-16T23:26:00.129 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package indent. 2023-10-16T23:26:00.144 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:26:00.166 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package network-manager. 2023-10-16T23:26:00.188 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-16T23:26:00.194 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-10-16T23:26:00.226 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-16T23:26:00.243 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-10-16T23:26:00.245 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-16T23:26:00.249 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-10-16T23:26:00.285 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-16T23:26:00.320 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-10-16T23:26:00.371 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up dump (0.4b47-3) ... 2023-10-16T23:26:00.413 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-16T23:26:00.448 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-16T23:26:00.464 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-10-16T23:26:00.465 INFO:teuthology.orchestra.run.smithi012.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-16T23:26:00.507 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-16T23:26:00.523 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-16T23:26:00.649 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-16T23:26:00.689 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-16T23:26:00.716 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-10-16T23:26:00.763 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-16T23:26:00.778 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-16T23:26:00.792 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up tcl (8.6.11+1build2) ... 2023-10-16T23:26:00.799 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-16T23:26:00.799 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-16T23:26:00.805 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-10-16T23:26:00.844 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-16T23:26:00.907 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package ppp. 2023-10-16T23:26:00.935 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-10-16T23:26:00.942 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libjson-perl (4.04000-1) ... 2023-10-16T23:26:01.016 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-16T23:26:01.033 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-10-16T23:26:01.074 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-10-16T23:26:01.094 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-10-16T23:26:01.114 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-16T23:26:01.130 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-10-16T23:26:01.172 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-10-16T23:26:01.200 INFO:teuthology.orchestra.run.smithi012.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-10-16T23:26:01.261 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-10-16T23:26:01.278 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-16T23:26:01.383 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-10-16T23:26:01.405 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-16T23:26:01.509 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-16T23:26:01.519 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libfl2:amd64. 2023-10-16T23:26:01.535 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libfl2:amd64. 2023-10-16T23:26:01.547 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-10-16T23:26:01.562 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-10-16T23:26:01.581 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-16T23:26:01.585 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-10-16T23:26:01.601 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-10-16T23:26:01.618 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package pptp-linux. 2023-10-16T23:26:01.635 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-10-16T23:26:01.646 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-10-16T23:26:01.684 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-10-16T23:26:01.707 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-16T23:26:01.752 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-10-16T23:26:01.795 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-10-16T23:26:01.811 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-10-16T23:26:01.833 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-10-16T23:26:01.854 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-16T23:26:01.861 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-10-16T23:26:01.863 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-10-16T23:26:01.891 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-10-16T23:26:01.938 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-16T23:26:01.939 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-16T23:26:01.962 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-16T23:26:01.966 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-10-16T23:26:02.014 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-10-16T23:26:02.035 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up postgresql-client (14+238) ... 2023-10-16T23:26:02.088 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-10-16T23:26:02.107 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libjson-perl. 2023-10-16T23:26:02.134 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-10-16T23:26:02.174 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-10-16T23:26:02.186 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-10-16T23:26:02.241 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libjson-perl. 2023-10-16T23:26:02.268 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-10-16T23:26:02.304 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package postgresql-client-common. 2023-10-16T23:26:02.307 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-10-16T23:26:02.332 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-10-16T23:26:02.371 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking postgresql-client-common (238) ... 2023-10-16T23:26:02.485 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libllvm14:amd64. 2023-10-16T23:26:02.513 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-10-16T23:26:02.552 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-16T23:26:02.618 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libllvm14:amd64. 2023-10-16T23:26:02.646 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-10-16T23:26:02.654 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package postgresql-client-14. 2023-10-16T23:26:02.682 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:26:02.685 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-16T23:26:02.707 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:02.707 INFO:teuthology.orchestra.run.smithi012.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-16T23:26:02.708 INFO:teuthology.orchestra.run.smithi012.stdout:which means they are currently configured by ifupdown: 2023-10-16T23:26:02.708 INFO:teuthology.orchestra.run.smithi012.stdout:- ens1f0 2023-10-16T23:26:02.708 INFO:teuthology.orchestra.run.smithi012.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-16T23:26:02.708 INFO:teuthology.orchestra.run.smithi012.stdout:remove their configuration from /etc/network/interfaces. 2023-10-16T23:26:02.709 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:02.721 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:26:02.743 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-16T23:26:02.829 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-16T23:26:02.861 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up dump (0.4b47-3) ... 2023-10-16T23:26:03.055 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-16T23:26:03.113 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-16T23:26:03.176 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-16T23:26:03.239 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-16T23:26:03.306 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package postgresql-common. 2023-10-16T23:26:03.334 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-10-16T23:26:03.365 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up tcl (8.6.11+1build2) ... 2023-10-16T23:26:03.399 INFO:teuthology.orchestra.run.smithi072.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-10-16T23:26:03.429 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking postgresql-common (238) ... 2023-10-16T23:26:03.490 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libjson-perl (4.04000-1) ... 2023-10-16T23:26:03.523 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-16T23:26:03.616 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-10-16T23:26:03.706 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-10-16T23:26:03.785 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-16T23:26:03.896 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package postgresql-14. 2023-10-16T23:26:03.911 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-16T23:26:03.923 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:26:03.966 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:26:04.088 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-16T23:26:04.120 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-16T23:26:04.213 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-16T23:26:04.223 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-16T23:26:04.229 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-16T23:26:04.246 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-16T23:26:04.272 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-16T23:26:04.358 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-10-16T23:26:04.372 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-10-16T23:26:04.455 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-16T23:26:04.483 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-16T23:26:04.484 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up postgresql-common (238) ... 2023-10-16T23:26:04.515 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-client (14+238) ... 2023-10-16T23:26:04.522 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-16T23:26:04.541 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-16T23:26:04.557 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-16T23:26:04.600 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-16T23:26:04.616 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-10-16T23:26:04.782 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-16T23:26:04.810 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-16T23:26:04.849 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-16T23:26:04.919 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-16T23:26:04.947 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-16T23:26:04.986 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-16T23:26:05.099 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:05.099 INFO:teuthology.orchestra.run.smithi031.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-16T23:26:05.100 INFO:teuthology.orchestra.run.smithi031.stdout:which means they are currently configured by ifupdown: 2023-10-16T23:26:05.100 INFO:teuthology.orchestra.run.smithi031.stdout:- ens1f0 2023-10-16T23:26:05.100 INFO:teuthology.orchestra.run.smithi031.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-16T23:26:05.100 INFO:teuthology.orchestra.run.smithi031.stdout:remove their configuration from /etc/network/interfaces. 2023-10-16T23:26:05.100 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:05.185 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-16T23:26:05.213 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-16T23:26:05.230 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-16T23:26:05.251 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-16T23:26:05.289 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-16T23:26:05.317 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-10-16T23:26:05.356 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-16T23:26:05.379 INFO:teuthology.orchestra.run.smithi012.stdout:Adding user postgres to group ssl-cert 2023-10-16T23:26:05.399 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package postgresql. 2023-10-16T23:26:05.417 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-10-16T23:26:05.458 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking postgresql (14+238) ... 2023-10-16T23:26:05.550 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-16T23:26:05.605 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-16T23:26:05.619 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:05.619 INFO:teuthology.orchestra.run.smithi012.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-10-16T23:26:05.633 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-10-16T23:26:05.671 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-16T23:26:05.685 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-16T23:26:05.712 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-10-16T23:26:05.713 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package postgresql-client. 2023-10-16T23:26:05.730 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-10-16T23:26:05.751 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-16T23:26:05.772 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking postgresql-client (14+238) ... 2023-10-16T23:26:05.820 INFO:teuthology.orchestra.run.smithi012.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-10-16T23:26:05.821 INFO:teuthology.orchestra.run.smithi012.stdout:Removing obsolete dictionary files: 2023-10-16T23:26:05.932 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-16T23:26:05.949 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-16T23:26:05.960 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-10-16T23:26:05.990 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-16T23:26:06.017 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package postgresql-contrib. 2023-10-16T23:26:06.034 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-10-16T23:26:06.079 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libpq5:amd64. 2023-10-16T23:26:06.107 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:26:06.109 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking postgresql-contrib (14+238) ... 2023-10-16T23:26:06.146 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:26:06.343 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libpq5:amd64. 2023-10-16T23:26:06.371 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:26:06.418 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:26:06.432 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package tcl8.6. 2023-10-16T23:26:06.435 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-10-16T23:26:06.460 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-10-16T23:26:06.466 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-16T23:26:06.493 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:26:06.507 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-16T23:26:06.532 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-16T23:26:06.535 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-16T23:26:06.662 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-16T23:26:06.763 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-10-16T23:26:06.779 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-16T23:26:06.795 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package tcl. 2023-10-16T23:26:06.808 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:26:06.823 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-10-16T23:26:06.827 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:26:06.845 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-16T23:26:06.868 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-10-16T23:26:06.869 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-16T23:26:06.889 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-common (238) ... 2023-10-16T23:26:06.896 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:26:06.935 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-16T23:26:07.140 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-16T23:26:07.144 INFO:teuthology.orchestra.run.smithi012.stdout:Creating new PostgreSQL cluster 14/main ... 2023-10-16T23:26:07.166 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-10-16T23:26:07.168 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:26:07.179 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-16T23:26:07.206 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-16T23:26:07.207 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-16T23:26:07.208 INFO:teuthology.orchestra.run.smithi012.stdout:The files belonging to this database system will be owned by user "postgres". 2023-10-16T23:26:07.208 INFO:teuthology.orchestra.run.smithi012.stdout:This user must also own the server process. 2023-10-16T23:26:07.209 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:07.209 INFO:teuthology.orchestra.run.smithi012.stdout:The database cluster will be initialized with locale "en_US". 2023-10-16T23:26:07.209 INFO:teuthology.orchestra.run.smithi012.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-10-16T23:26:07.209 INFO:teuthology.orchestra.run.smithi012.stdout:The default text search configuration will be set to "english". 2023-10-16T23:26:07.209 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:07.210 INFO:teuthology.orchestra.run.smithi012.stdout:Data page checksums are disabled. 2023-10-16T23:26:07.210 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:07.210 INFO:teuthology.orchestra.run.smithi012.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-10-16T23:26:07.211 INFO:teuthology.orchestra.run.smithi012.stdout:creating subdirectories ... ok 2023-10-16T23:26:07.211 INFO:teuthology.orchestra.run.smithi012.stdout:selecting dynamic shared memory implementation ... posix 2023-10-16T23:26:07.219 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package wpasupplicant. 2023-10-16T23:26:07.226 INFO:teuthology.orchestra.run.smithi012.stdout:selecting default max_connections ... 100 2023-10-16T23:26:07.246 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-16T23:26:07.247 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-10-16T23:26:07.248 INFO:teuthology.orchestra.run.smithi012.stdout:selecting default shared_buffers ... 128MB 2023-10-16T23:26:07.258 INFO:teuthology.orchestra.run.smithi012.stdout:selecting default time zone ... Etc/UTC 2023-10-16T23:26:07.259 INFO:teuthology.orchestra.run.smithi012.stdout:creating configuration files ... ok 2023-10-16T23:26:07.285 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-16T23:26:07.378 INFO:teuthology.orchestra.run.smithi012.stdout:running bootstrap script ... ok 2023-10-16T23:26:07.484 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-16T23:26:07.512 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-16T23:26:07.558 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-16T23:26:07.645 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-16T23:26:07.673 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-10-16T23:26:07.720 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-10-16T23:26:07.759 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-16T23:26:07.786 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-10-16T23:26:07.825 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-10-16T23:26:08.022 INFO:teuthology.orchestra.run.smithi012.stdout:performing post-bootstrap initialization ... ok 2023-10-16T23:26:08.094 INFO:teuthology.orchestra.run.smithi072.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-16T23:26:08.104 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-16T23:26:08.114 INFO:teuthology.orchestra.run.smithi031.stdout:Adding user postgres to group ssl-cert 2023-10-16T23:26:08.121 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-10-16T23:26:08.132 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-10-16T23:26:08.168 INFO:teuthology.orchestra.run.smithi072.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-16T23:26:08.170 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-10-16T23:26:08.179 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package modemmanager. 2023-10-16T23:26:08.206 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-16T23:26:08.245 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-16T23:26:08.355 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:08.355 INFO:teuthology.orchestra.run.smithi031.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-10-16T23:26:08.477 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up postgresql-client-common (238) ... 2023-10-16T23:26:08.506 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package modemmanager. 2023-10-16T23:26:08.530 INFO:teuthology.orchestra.run.smithi031.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-10-16T23:26:08.531 INFO:teuthology.orchestra.run.smithi031.stdout:Removing obsolete dictionary files: 2023-10-16T23:26:08.535 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-16T23:26:08.573 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-16T23:26:08.645 INFO:teuthology.orchestra.run.smithi012.stdout:syncing data to disk ... ok 2023-10-16T23:26:08.698 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up flex (2.6.4-8build2) ... 2023-10-16T23:26:08.825 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-16T23:26:08.877 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package network-manager. 2023-10-16T23:26:08.905 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-10-16T23:26:08.952 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-10-16T23:26:08.954 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:26:09.035 INFO:teuthology.orchestra.run.smithi012.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-10-16T23:26:09.080 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-10-16T23:26:09.145 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-10-16T23:26:09.204 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package network-manager. 2023-10-16T23:26:09.207 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-16T23:26:09.233 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-10-16T23:26:09.313 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-10-16T23:26:09.317 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:26:09.519 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ppp. 2023-10-16T23:26:09.547 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-10-16T23:26:09.556 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:26:09.821 INFO:teuthology.orchestra.run.smithi072.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-10-16T23:26:09.837 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-10-16T23:26:09.878 INFO:teuthology.orchestra.run.smithi031.stdout:Creating new PostgreSQL cluster 14/main ... 2023-10-16T23:26:09.900 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-10-16T23:26:09.915 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-16T23:26:09.947 INFO:teuthology.orchestra.run.smithi031.stdout:The files belonging to this database system will be owned by user "postgres". 2023-10-16T23:26:09.947 INFO:teuthology.orchestra.run.smithi031.stdout:This user must also own the server process. 2023-10-16T23:26:09.947 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:09.948 INFO:teuthology.orchestra.run.smithi031.stdout:The database cluster will be initialized with locale "en_US". 2023-10-16T23:26:09.948 INFO:teuthology.orchestra.run.smithi031.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-10-16T23:26:09.948 INFO:teuthology.orchestra.run.smithi031.stdout:The default text search configuration will be set to "english". 2023-10-16T23:26:09.948 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:09.948 INFO:teuthology.orchestra.run.smithi031.stdout:Data page checksums are disabled. 2023-10-16T23:26:09.949 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:09.949 INFO:teuthology.orchestra.run.smithi031.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-10-16T23:26:09.949 INFO:teuthology.orchestra.run.smithi031.stdout:creating subdirectories ... ok 2023-10-16T23:26:09.950 INFO:teuthology.orchestra.run.smithi031.stdout:selecting dynamic shared memory implementation ... posix 2023-10-16T23:26:09.964 INFO:teuthology.orchestra.run.smithi031.stdout:selecting default max_connections ... 100 2023-10-16T23:26:09.982 INFO:teuthology.orchestra.run.smithi031.stdout:selecting default shared_buffers ... 128MB 2023-10-16T23:26:09.993 INFO:teuthology.orchestra.run.smithi031.stdout:selecting default time zone ... Etc/UTC 2023-10-16T23:26:09.994 INFO:teuthology.orchestra.run.smithi031.stdout:creating configuration files ... ok 2023-10-16T23:26:09.995 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ppp. 2023-10-16T23:26:10.018 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-10-16T23:26:10.115 INFO:teuthology.orchestra.run.smithi031.stdout:running bootstrap script ... ok 2023-10-16T23:26:10.142 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package pptp-linux. 2023-10-16T23:26:10.169 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-10-16T23:26:10.208 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-10-16T23:26:10.279 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-16T23:26:10.279 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-16T23:26:10.311 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-10-16T23:26:10.478 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-16T23:26:10.505 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-10-16T23:26:10.544 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-10-16T23:26:10.633 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package pptp-linux. 2023-10-16T23:26:10.661 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-10-16T23:26:10.699 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-10-16T23:26:10.742 INFO:teuthology.orchestra.run.smithi031.stdout:performing post-bootstrap initialization ... ok 2023-10-16T23:26:10.837 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-10-16T23:26:10.848 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql-client-common. 2023-10-16T23:26:10.875 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-10-16T23:26:10.914 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql-client-common (238) ... 2023-10-16T23:26:10.952 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-16T23:26:10.964 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-16T23:26:10.968 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-10-16T23:26:11.010 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-10-16T23:26:11.092 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-10-16T23:26:11.194 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql-client-14. 2023-10-16T23:26:11.219 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-10-16T23:26:11.221 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:26:11.260 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:26:11.288 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package postgresql-client-common. 2023-10-16T23:26:11.305 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-10-16T23:26:11.346 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-10-16T23:26:11.347 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking postgresql-client-common (238) ... 2023-10-16T23:26:11.351 INFO:teuthology.orchestra.run.smithi031.stdout:syncing data to disk ... ok 2023-10-16T23:26:11.473 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-16T23:26:11.593 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-10-16T23:26:11.617 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package postgresql-client-14. 2023-10-16T23:26:11.645 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:26:11.683 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:26:11.784 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-10-16T23:26:11.851 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-16T23:26:11.857 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql-common. 2023-10-16T23:26:11.885 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-10-16T23:26:11.952 INFO:teuthology.orchestra.run.smithi138.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-10-16T23:26:11.976 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up postgresql-contrib (14+238) ... 2023-10-16T23:26:11.989 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql-common (238) ... 2023-10-16T23:26:12.094 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up postgresql (14+238) ... 2023-10-16T23:26:12.204 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-16T23:26:12.239 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-16T23:26:12.305 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package postgresql-common. 2023-10-16T23:26:12.305 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-16T23:26:12.333 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-10-16T23:26:12.366 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up dump (0.4b47-3) ... 2023-10-16T23:26:12.389 INFO:teuthology.orchestra.run.smithi033.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-10-16T23:26:12.411 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking postgresql-common (238) ... 2023-10-16T23:26:12.450 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql-14. 2023-10-16T23:26:12.451 INFO:teuthology.orchestra.run.smithi072.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-16T23:26:12.478 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:26:12.520 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:26:12.528 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-16T23:26:12.556 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-16T23:26:12.557 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-16T23:26:12.655 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-16T23:26:12.783 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up tcl (8.6.11+1build2) ... 2023-10-16T23:26:12.887 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package postgresql-14. 2023-10-16T23:26:12.901 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libjson-perl (4.04000-1) ... 2023-10-16T23:26:12.915 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-16T23:26:12.957 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:26:13.028 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-10-16T23:26:13.120 INFO:teuthology.orchestra.run.smithi072.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-10-16T23:26:13.174 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-16T23:26:13.191 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-16T23:26:13.309 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-16T23:26:13.468 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-16T23:26:13.487 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-16T23:26:13.616 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-16T23:26:13.619 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-16T23:26:13.743 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-10-16T23:26:13.831 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql. 2023-10-16T23:26:13.848 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-10-16T23:26:13.881 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql (14+238) ... 2023-10-16T23:26:13.904 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up postgresql-client (14+238) ... 2023-10-16T23:26:14.030 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-10-16T23:26:14.141 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql-client. 2023-10-16T23:26:14.157 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-10-16T23:26:14.200 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql-client (14+238) ... 2023-10-16T23:26:14.239 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package postgresql. 2023-10-16T23:26:14.257 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-10-16T23:26:14.297 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking postgresql (14+238) ... 2023-10-16T23:26:14.444 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql-contrib. 2023-10-16T23:26:14.460 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-10-16T23:26:14.502 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql-contrib (14+238) ... 2023-10-16T23:26:14.507 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:14.508 INFO:teuthology.orchestra.run.smithi072.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-16T23:26:14.508 INFO:teuthology.orchestra.run.smithi072.stdout:which means they are currently configured by ifupdown: 2023-10-16T23:26:14.508 INFO:teuthology.orchestra.run.smithi072.stdout:- enp3s0f1 2023-10-16T23:26:14.508 INFO:teuthology.orchestra.run.smithi072.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-16T23:26:14.508 INFO:teuthology.orchestra.run.smithi072.stdout:remove their configuration from /etc/network/interfaces. 2023-10-16T23:26:14.509 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:14.596 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-16T23:26:14.628 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-16T23:26:14.722 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-contrib (14+238) ... 2023-10-16T23:26:14.821 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package tcl8.6. 2023-10-16T23:26:14.823 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql (14+238) ... 2023-10-16T23:26:14.849 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-10-16T23:26:14.888 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-16T23:26:14.924 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-16T23:26:14.989 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-16T23:26:15.033 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-16T23:26:15.077 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package postgresql-client. 2023-10-16T23:26:15.094 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-10-16T23:26:15.098 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-10-16T23:26:15.123 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package tcl. 2023-10-16T23:26:15.127 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking postgresql-client (14+238) ... 2023-10-16T23:26:15.139 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-10-16T23:26:15.178 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-10-16T23:26:15.198 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-10-16T23:26:15.292 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-16T23:26:15.293 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-16T23:26:15.380 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package postgresql-contrib. 2023-10-16T23:26:15.408 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-10-16T23:26:15.446 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking postgresql-contrib (14+238) ... 2023-10-16T23:26:15.464 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-16T23:26:15.510 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package wpasupplicant. 2023-10-16T23:26:15.538 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-10-16T23:26:15.576 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-16T23:26:15.724 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package tcl8.6. 2023-10-16T23:26:15.752 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-10-16T23:26:15.782 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-16T23:26:15.868 INFO:teuthology.orchestra.run.smithi012.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-16T23:26:15.871 DEBUG:teuthology.parallel:result is None 2023-10-16T23:26:15.939 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-16T23:26:15.944 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-16T23:26:15.955 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-10-16T23:26:15.979 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-16T23:26:15.997 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-10-16T23:26:16.043 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package tcl. 2023-10-16T23:26:16.071 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-10-16T23:26:16.115 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-10-16T23:26:16.124 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-16T23:26:16.221 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-16T23:26:16.244 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-10-16T23:26:16.317 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-16T23:26:16.345 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-10-16T23:26:16.371 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up postgresql-common (238) ... 2023-10-16T23:26:16.372 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-16T23:26:16.384 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-16T23:26:16.504 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package wpasupplicant. 2023-10-16T23:26:16.532 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-10-16T23:26:16.570 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-16T23:26:16.661 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql-client-common (238) ... 2023-10-16T23:26:16.856 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up flex (2.6.4-8build2) ... 2023-10-16T23:26:16.916 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-16T23:26:16.933 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-10-16T23:26:16.965 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-16T23:26:16.974 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-10-16T23:26:17.091 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:26:17.217 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-10-16T23:26:17.252 INFO:teuthology.orchestra.run.smithi072.stdout:Adding user postgres to group ssl-cert 2023-10-16T23:26:17.277 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-16T23:26:17.306 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-10-16T23:26:17.352 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-16T23:26:17.490 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:17.491 INFO:teuthology.orchestra.run.smithi072.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-10-16T23:26:17.566 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-16T23:26:17.624 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up postgresql-client-common (238) ... 2023-10-16T23:26:17.709 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-10-16T23:26:17.740 INFO:teuthology.orchestra.run.smithi072.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-10-16T23:26:17.740 INFO:teuthology.orchestra.run.smithi072.stdout:Removing obsolete dictionary files: 2023-10-16T23:26:17.800 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-10-16T23:26:17.842 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up flex (2.6.4-8build2) ... 2023-10-16T23:26:17.928 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:26:17.968 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-16T23:26:18.094 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:26:18.220 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-10-16T23:26:18.331 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-16T23:26:18.367 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-10-16T23:26:18.401 INFO:teuthology.orchestra.run.smithi031.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-16T23:26:18.403 DEBUG:teuthology.parallel:result is None 2023-10-16T23:26:18.418 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-10-16T23:26:18.432 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:26:18.500 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-16T23:26:18.793 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:26:18.883 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-16T23:26:18.884 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-16T23:26:18.930 INFO:teuthology.orchestra.run.smithi033.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-10-16T23:26:19.030 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-16T23:26:19.112 INFO:teuthology.orchestra.run.smithi072.stdout:Creating new PostgreSQL cluster 14/main ... 2023-10-16T23:26:19.124 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-10-16T23:26:19.186 INFO:teuthology.orchestra.run.smithi072.stdout:The files belonging to this database system will be owned by user "postgres". 2023-10-16T23:26:19.186 INFO:teuthology.orchestra.run.smithi072.stdout:This user must also own the server process. 2023-10-16T23:26:19.187 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:19.187 INFO:teuthology.orchestra.run.smithi072.stdout:The database cluster will be initialized with locale "en_US". 2023-10-16T23:26:19.187 INFO:teuthology.orchestra.run.smithi072.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-10-16T23:26:19.187 INFO:teuthology.orchestra.run.smithi072.stdout:The default text search configuration will be set to "english". 2023-10-16T23:26:19.187 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:19.188 INFO:teuthology.orchestra.run.smithi072.stdout:Data page checksums are disabled. 2023-10-16T23:26:19.188 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:19.188 INFO:teuthology.orchestra.run.smithi072.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-10-16T23:26:19.188 INFO:teuthology.orchestra.run.smithi072.stdout:creating subdirectories ... ok 2023-10-16T23:26:19.188 INFO:teuthology.orchestra.run.smithi072.stdout:selecting dynamic shared memory implementation ... posix 2023-10-16T23:26:19.198 INFO:teuthology.orchestra.run.smithi072.stdout:selecting default max_connections ... 100 2023-10-16T23:26:19.219 INFO:teuthology.orchestra.run.smithi072.stdout:selecting default shared_buffers ... 128MB 2023-10-16T23:26:19.230 INFO:teuthology.orchestra.run.smithi072.stdout:selecting default time zone ... Etc/UTC 2023-10-16T23:26:19.233 INFO:teuthology.orchestra.run.smithi072.stdout:creating configuration files ... ok 2023-10-16T23:26:19.342 INFO:teuthology.orchestra.run.smithi072.stdout:running bootstrap script ... ok 2023-10-16T23:26:19.416 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-16T23:26:19.416 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-16T23:26:19.419 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-10-16T23:26:19.546 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-16T23:26:19.663 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-10-16T23:26:19.764 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-10-16T23:26:19.873 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-10-16T23:26:19.983 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-16T23:26:20.000 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-10-16T23:26:20.008 INFO:teuthology.orchestra.run.smithi072.stdout:performing post-bootstrap initialization ... ok 2023-10-16T23:26:20.126 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-10-16T23:26:20.126 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-16T23:26:20.269 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-10-16T23:26:20.395 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-10-16T23:26:20.546 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-10-16T23:26:20.672 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-16T23:26:20.789 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-16T23:26:20.790 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-10-16T23:26:20.890 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up dump (0.4b47-3) ... 2023-10-16T23:26:20.909 INFO:teuthology.orchestra.run.smithi072.stdout:syncing data to disk ... ok 2023-10-16T23:26:20.967 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-16T23:26:21.033 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-16T23:26:21.159 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-16T23:26:21.294 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up tcl (8.6.11+1build2) ... 2023-10-16T23:26:21.351 INFO:teuthology.orchestra.run.smithi072.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-10-16T23:26:21.395 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-16T23:26:21.436 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libjson-perl (4.04000-1) ... 2023-10-16T23:26:21.521 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up dump (0.4b47-3) ... 2023-10-16T23:26:21.562 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-10-16T23:26:21.615 INFO:teuthology.orchestra.run.smithi033.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-16T23:26:21.653 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-10-16T23:26:21.681 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-16T23:26:21.730 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-16T23:26:21.840 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-16T23:26:21.840 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-16T23:26:21.958 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up tcl (8.6.11+1build2) ... 2023-10-16T23:26:21.983 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-16T23:26:22.076 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libjson-perl (4.04000-1) ... 2023-10-16T23:26:22.100 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-16T23:26:22.202 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-10-16T23:26:22.226 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-10-16T23:26:22.292 INFO:teuthology.orchestra.run.smithi033.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-10-16T23:26:22.362 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-16T23:26:22.403 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql-client (14+238) ... 2023-10-16T23:26:22.488 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-16T23:26:22.537 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-10-16T23:26:22.672 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-16T23:26:22.782 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-16T23:26:22.883 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-10-16T23:26:23.034 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up postgresql-client (14+238) ... 2023-10-16T23:26:23.161 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-10-16T23:26:23.295 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:23.296 INFO:teuthology.orchestra.run.smithi138.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-16T23:26:23.296 INFO:teuthology.orchestra.run.smithi138.stdout:which means they are currently configured by ifupdown: 2023-10-16T23:26:23.296 INFO:teuthology.orchestra.run.smithi138.stdout:- enp3s0f1 2023-10-16T23:26:23.296 INFO:teuthology.orchestra.run.smithi138.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-16T23:26:23.296 INFO:teuthology.orchestra.run.smithi138.stdout:remove their configuration from /etc/network/interfaces. 2023-10-16T23:26:23.297 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:23.430 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-16T23:26:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:23.655 INFO:teuthology.orchestra.run.smithi033.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-16T23:26:23.655 INFO:teuthology.orchestra.run.smithi033.stdout:which means they are currently configured by ifupdown: 2023-10-16T23:26:23.655 INFO:teuthology.orchestra.run.smithi033.stdout:- ens1f0 2023-10-16T23:26:23.655 INFO:teuthology.orchestra.run.smithi033.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-16T23:26:23.656 INFO:teuthology.orchestra.run.smithi033.stdout:remove their configuration from /etc/network/interfaces. 2023-10-16T23:26:23.656 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:23.774 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-16T23:26:23.837 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-16T23:26:24.106 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-16T23:26:24.142 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-16T23:26:24.189 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-16T23:26:24.261 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up postgresql-contrib (14+238) ... 2023-10-16T23:26:24.388 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up postgresql (14+238) ... 2023-10-16T23:26:24.448 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-16T23:26:24.550 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-16T23:26:24.677 INFO:teuthology.orchestra.run.smithi072.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-16T23:26:24.706 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-16T23:26:24.824 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-16T23:26:24.927 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-16T23:26:24.927 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-16T23:26:24.934 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-10-16T23:26:24.996 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-16T23:26:25.085 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql-common (238) ... 2023-10-16T23:26:25.448 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-16T23:26:25.481 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-16T23:26:25.583 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-10-16T23:26:25.684 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up postgresql-common (238) ... 2023-10-16T23:26:25.853 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-16T23:26:25.969 INFO:teuthology.orchestra.run.smithi138.stdout:Adding user postgres to group ssl-cert 2023-10-16T23:26:26.006 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-16T23:26:26.196 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:26.196 INFO:teuthology.orchestra.run.smithi138.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-10-16T23:26:26.378 INFO:teuthology.orchestra.run.smithi138.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-10-16T23:26:26.379 INFO:teuthology.orchestra.run.smithi138.stdout:Removing obsolete dictionary files: 2023-10-16T23:26:26.489 INFO:teuthology.orchestra.run.smithi033.stdout:Adding user postgres to group ssl-cert 2023-10-16T23:26:26.740 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:26.740 INFO:teuthology.orchestra.run.smithi033.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-10-16T23:26:26.923 INFO:teuthology.orchestra.run.smithi033.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-10-16T23:26:26.923 INFO:teuthology.orchestra.run.smithi033.stdout:Removing obsolete dictionary files: 2023-10-16T23:26:26.982 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-10-16T23:26:27.363 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-10-16T23:26:27.378 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:26:27.465 INFO:teuthology.orchestra.run.smithi072.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-10-16T23:26:27.523 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-10-16T23:26:27.705 INFO:teuthology.orchestra.run.smithi138.stdout:Creating new PostgreSQL cluster 14/main ... 2023-10-16T23:26:27.724 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-10-16T23:26:27.777 INFO:teuthology.orchestra.run.smithi138.stdout:The files belonging to this database system will be owned by user "postgres". 2023-10-16T23:26:27.777 INFO:teuthology.orchestra.run.smithi138.stdout:This user must also own the server process. 2023-10-16T23:26:27.778 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:27.778 INFO:teuthology.orchestra.run.smithi138.stdout:The database cluster will be initialized with locale "en_US". 2023-10-16T23:26:27.778 INFO:teuthology.orchestra.run.smithi138.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-10-16T23:26:27.778 INFO:teuthology.orchestra.run.smithi138.stdout:The default text search configuration will be set to "english". 2023-10-16T23:26:27.778 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:27.779 INFO:teuthology.orchestra.run.smithi138.stdout:Data page checksums are disabled. 2023-10-16T23:26:27.779 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:27.779 INFO:teuthology.orchestra.run.smithi138.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-10-16T23:26:27.779 INFO:teuthology.orchestra.run.smithi138.stdout:creating subdirectories ... ok 2023-10-16T23:26:27.779 INFO:teuthology.orchestra.run.smithi138.stdout:selecting dynamic shared memory implementation ... posix 2023-10-16T23:26:27.793 INFO:teuthology.orchestra.run.smithi138.stdout:selecting default max_connections ... 100 2023-10-16T23:26:27.814 INFO:teuthology.orchestra.run.smithi138.stdout:selecting default shared_buffers ... 128MB 2023-10-16T23:26:27.824 INFO:teuthology.orchestra.run.smithi138.stdout:selecting default time zone ... Etc/UTC 2023-10-16T23:26:27.824 INFO:teuthology.orchestra.run.smithi138.stdout:creating configuration files ... ok 2023-10-16T23:26:27.927 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-16T23:26:27.939 INFO:teuthology.orchestra.run.smithi138.stdout:running bootstrap script ... ok 2023-10-16T23:26:28.236 INFO:teuthology.orchestra.run.smithi072.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-16T23:26:28.239 DEBUG:teuthology.parallel:result is None 2023-10-16T23:26:28.258 INFO:teuthology.orchestra.run.smithi033.stdout:Creating new PostgreSQL cluster 14/main ... 2023-10-16T23:26:28.275 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-10-16T23:26:28.323 INFO:teuthology.orchestra.run.smithi033.stdout:The files belonging to this database system will be owned by user "postgres". 2023-10-16T23:26:28.323 INFO:teuthology.orchestra.run.smithi033.stdout:This user must also own the server process. 2023-10-16T23:26:28.323 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:28.323 INFO:teuthology.orchestra.run.smithi033.stdout:The database cluster will be initialized with locale "en_US". 2023-10-16T23:26:28.323 INFO:teuthology.orchestra.run.smithi033.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-10-16T23:26:28.324 INFO:teuthology.orchestra.run.smithi033.stdout:The default text search configuration will be set to "english". 2023-10-16T23:26:28.324 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:28.324 INFO:teuthology.orchestra.run.smithi033.stdout:Data page checksums are disabled. 2023-10-16T23:26:28.324 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:28.324 INFO:teuthology.orchestra.run.smithi033.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-10-16T23:26:28.325 INFO:teuthology.orchestra.run.smithi033.stdout:creating subdirectories ... ok 2023-10-16T23:26:28.325 INFO:teuthology.orchestra.run.smithi033.stdout:selecting dynamic shared memory implementation ... posix 2023-10-16T23:26:28.336 INFO:teuthology.orchestra.run.smithi033.stdout:selecting default max_connections ... 100 2023-10-16T23:26:28.359 INFO:teuthology.orchestra.run.smithi033.stdout:selecting default shared_buffers ... 128MB 2023-10-16T23:26:28.369 INFO:teuthology.orchestra.run.smithi033.stdout:selecting default time zone ... Etc/UTC 2023-10-16T23:26:28.370 INFO:teuthology.orchestra.run.smithi033.stdout:creating configuration files ... ok 2023-10-16T23:26:28.490 INFO:teuthology.orchestra.run.smithi033.stdout:running bootstrap script ... ok 2023-10-16T23:26:28.598 INFO:teuthology.orchestra.run.smithi138.stdout:performing post-bootstrap initialization ... ok 2023-10-16T23:26:29.102 INFO:teuthology.orchestra.run.smithi033.stdout:performing post-bootstrap initialization ... ok 2023-10-16T23:26:29.309 INFO:teuthology.orchestra.run.smithi138.stdout:syncing data to disk ... ok 2023-10-16T23:26:29.693 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-10-16T23:26:29.730 INFO:teuthology.orchestra.run.smithi033.stdout:syncing data to disk ... ok 2023-10-16T23:26:30.123 INFO:teuthology.orchestra.run.smithi033.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-10-16T23:26:32.602 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-16T23:26:32.752 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql-contrib (14+238) ... 2023-10-16T23:26:32.895 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql (14+238) ... 2023-10-16T23:26:32.951 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-16T23:26:33.004 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-16T23:26:33.077 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up postgresql-contrib (14+238) ... 2023-10-16T23:26:33.105 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-16T23:26:33.203 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up postgresql (14+238) ... 2023-10-16T23:26:33.329 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-16T23:26:33.342 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-16T23:26:33.343 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-16T23:26:33.455 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-16T23:26:33.731 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-16T23:26:33.732 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-16T23:26:33.925 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-16T23:26:34.243 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-16T23:26:34.358 INFO:teuthology.orchestra.run.smithi033.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-16T23:26:34.412 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-16T23:26:34.660 INFO:teuthology.orchestra.run.smithi033.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-16T23:26:34.820 INFO:teuthology.orchestra.run.smithi033.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-16T23:26:35.760 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-10-16T23:26:35.873 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-10-16T23:26:36.207 INFO:teuthology.orchestra.run.smithi033.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-10-16T23:26:36.299 INFO:teuthology.orchestra.run.smithi033.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-10-16T23:26:36.550 INFO:teuthology.orchestra.run.smithi138.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-16T23:26:36.553 DEBUG:teuthology.parallel:result is None 2023-10-16T23:26:36.931 INFO:teuthology.orchestra.run.smithi033.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-16T23:26:36.934 DEBUG:teuthology.parallel:result is None 2023-10-16T23:26:36.935 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ab9fe43522bc41de59746200b95f65d4fbcccffe 2023-10-16T23:26:37.238 DEBUG:teuthology.orchestra.run.smithi012:> dpkg-query -W -f '${Version}' ceph 2023-10-16T23:26:37.259 INFO:teuthology.orchestra.run.smithi012.stdout:18.2.0-668-gab9fe435-1jammy 2023-10-16T23:26:37.260 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-668-gab9fe435-1jammy 2023-10-16T23:26:37.260 INFO:teuthology.task.install:The correct ceph version 18.2.0-668-gab9fe435-1jammy is installed. 2023-10-16T23:26:37.261 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ab9fe43522bc41de59746200b95f65d4fbcccffe 2023-10-16T23:26:37.490 DEBUG:teuthology.orchestra.run.smithi031:> dpkg-query -W -f '${Version}' ceph 2023-10-16T23:26:37.511 INFO:teuthology.orchestra.run.smithi031.stdout:18.2.0-668-gab9fe435-1jammy 2023-10-16T23:26:37.511 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-668-gab9fe435-1jammy 2023-10-16T23:26:37.512 INFO:teuthology.task.install:The correct ceph version 18.2.0-668-gab9fe435-1jammy is installed. 2023-10-16T23:26:37.512 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ab9fe43522bc41de59746200b95f65d4fbcccffe 2023-10-16T23:26:37.732 DEBUG:teuthology.orchestra.run.smithi033:> dpkg-query -W -f '${Version}' ceph 2023-10-16T23:26:37.752 INFO:teuthology.orchestra.run.smithi033.stdout:18.2.0-668-gab9fe435-1jammy 2023-10-16T23:26:37.753 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-668-gab9fe435-1jammy 2023-10-16T23:26:37.753 INFO:teuthology.task.install:The correct ceph version 18.2.0-668-gab9fe435-1jammy is installed. 2023-10-16T23:26:37.753 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ab9fe43522bc41de59746200b95f65d4fbcccffe 2023-10-16T23:26:37.894 DEBUG:teuthology.orchestra.run.smithi072:> dpkg-query -W -f '${Version}' ceph 2023-10-16T23:26:37.915 INFO:teuthology.orchestra.run.smithi072.stdout:18.2.0-668-gab9fe435-1jammy 2023-10-16T23:26:37.915 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-668-gab9fe435-1jammy 2023-10-16T23:26:37.916 INFO:teuthology.task.install:The correct ceph version 18.2.0-668-gab9fe435-1jammy is installed. 2023-10-16T23:26:37.916 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ab9fe43522bc41de59746200b95f65d4fbcccffe 2023-10-16T23:26:38.133 DEBUG:teuthology.orchestra.run.smithi138:> dpkg-query -W -f '${Version}' ceph 2023-10-16T23:26:38.156 INFO:teuthology.orchestra.run.smithi138.stdout:18.2.0-668-gab9fe435-1jammy 2023-10-16T23:26:38.156 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-668-gab9fe435-1jammy 2023-10-16T23:26:38.156 INFO:teuthology.task.install:The correct ceph version 18.2.0-668-gab9fe435-1jammy is installed. 2023-10-16T23:26:38.157 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-16T23:26:38.157 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-16T23:26:38.158 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-16T23:26:38.173 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-16T23:26:38.174 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-16T23:26:38.188 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-16T23:26:38.188 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-16T23:26:38.203 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-16T23:26:38.204 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-16T23:26:38.218 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-10-16T23:26:38.218 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-16T23:26:38.232 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-16T23:26:38.233 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-16T23:26:38.233 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/daemon-helper 2023-10-16T23:26:38.247 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-16T23:26:38.301 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-16T23:26:38.302 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/daemon-helper 2023-10-16T23:26:38.316 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-16T23:26:38.371 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-16T23:26:38.371 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/daemon-helper 2023-10-16T23:26:38.386 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-16T23:26:38.439 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-16T23:26:38.440 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/daemon-helper 2023-10-16T23:26:38.454 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-16T23:26:38.508 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-10-16T23:26:38.508 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/daemon-helper 2023-10-16T23:26:38.522 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-16T23:26:38.575 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-16T23:26:38.576 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-16T23:26:38.576 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-16T23:26:38.590 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-16T23:26:38.646 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-16T23:26:38.646 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-16T23:26:38.660 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-16T23:26:38.715 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-16T23:26:38.716 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-16T23:26:38.729 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-16T23:26:38.784 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-16T23:26:38.784 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-16T23:26:38.798 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-16T23:26:38.852 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-10-16T23:26:38.852 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-16T23:26:38.867 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-16T23:26:38.920 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-16T23:26:38.920 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-16T23:26:38.921 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/stdin-killer 2023-10-16T23:26:38.935 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-16T23:26:38.990 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-16T23:26:38.991 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/stdin-killer 2023-10-16T23:26:39.005 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-16T23:26:39.058 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-16T23:26:39.059 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/stdin-killer 2023-10-16T23:26:39.073 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-16T23:26:39.128 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-16T23:26:39.128 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/stdin-killer 2023-10-16T23:26:39.142 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-16T23:26:39.196 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-10-16T23:26:39.197 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/stdin-killer 2023-10-16T23:26:39.211 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-16T23:26:39.263 INFO:teuthology.run_tasks:Running task ceph... 2023-10-16T23:26:39.334 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-16T23:26:39.334 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 777 /var/log/ceph 2023-10-16T23:26:39.337 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 777 /var/log/ceph 2023-10-16T23:26:39.340 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 777 /var/log/ceph 2023-10-16T23:26:39.342 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 777 /var/log/ceph 2023-10-16T23:26:39.347 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 777 /var/log/ceph 2023-10-16T23:26:39.359 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-16T23:26:39.360 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-16T23:26:39.391 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-16T23:26:39.396 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-16T23:26:39.402 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-16T23:26:39.406 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-16T23:26:39.419 INFO:tasks.ceph:Creating extra log directories... 2023-10-16T23:26:39.420 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-16T23:26:39.448 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-16T23:26:39.452 DEBUG:teuthology.orchestra.run.smithi033:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-16T23:26:39.458 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-16T23:26:39.461 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-16T23:26:39.483 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-16T23:26:39.484 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-16T23:26:39.484 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-16T23:26:39.484 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-16T23:26:39.484 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-16T23:26:39.506 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-16T23:26:39.584 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-16T23:26:39.584 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-16T23:26:39.590 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-16T23:26:39.668 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-16T23:26:39.668 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-16T23:26:39.674 DEBUG:teuthology.orchestra.run.smithi033:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-16T23:26:39.750 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-16T23:26:39.751 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-16T23:26:39.757 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-16T23:26:39.832 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-10-16T23:26:39.832 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-16T23:26:39.838 DEBUG:teuthology.orchestra.run.smithi138:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-16T23:26:39.916 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-16T23:26:39.917 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-16T23:26:39.917 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526', 'branch': 'wip-yuri4-testing-2023-10-11-0735-reef', 'description': 'fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7429526', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri4-testing-2023-10-11-0735-reef'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'ab9fe43522bc41de59746200b95f65d4fbcccffe'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ab9fe43522bc41de59746200b95f65d4fbcccffe'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri4-testing-2023-10-11-0735-reef', 'sha1': 'ab9fe43522bc41de59746200b95f65d4fbcccffe'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0'], ['client.1'], ['client.2']], 'seed': 3743, 'sha1': 'ab9fe43522bc41de59746200b95f65d4fbcccffe', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri4-testing-2023-10-11-0735-reef', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_ab9fe43522bc41de59746200b95f65d4fbcccffe/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'ab9fe43522bc41de59746200b95f65d4fbcccffe', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi012.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMxAWQppE48F403WDGJsdsQyiDaEu4+p1ofBC4gxaVoFttdj0/M9w7TEZVP76fWdOhqx8/MLnefW1JJv9yEC1gw=', 'smithi031.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDm1x/fmXG3KROxUPCqJXA4e96W7HQNf5+6CI0iJowdpSxfKt9lfTsuLZug7Pi8QIlDzFfVAPPWqfQ+fv/mZl3k=', 'smithi033.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK/nAGApqx0VNNkrmqQAz+LU9/R0Q3vIETJvMXf92q/w3MTqUlnVwultvLaCdOzrS/WT/OvHo+APpB0R0JfPOQ4=', 'smithi072.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCuL74Xu58QHvckEI31wgy0qjUJB2IzOwO1byfnLnRDXZdKbmDlS0mpWOBHJ0DeQsnhDw6n/Lj2cS8qSxuZx2xo=', 'smithi138.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGktYTOmphqzUFGOpOfDH/SIj8g9vzxqkQ52gDiN44/QGExzrXBgT5LGiQZ+QxKKiIDT29dOQTX/rhaXDXq/iQc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ab9fe43522bc41de59746200b95f65d4fbcccffe'}}, {'ceph': None}, {'ceph-fuse': None}, {'pexec': {'clients': ['cd $TESTDIR', 'wget http://download.ceph.com/qa/ior.tbz2', 'tar xvfj ior.tbz2', 'cd ior', './configure', 'make', 'make install DESTDIR=$TESTDIR/binary/', 'cd $TESTDIR/', 'rm ior.tbz2', 'rm -r ior', 'ln -s $TESTDIR/mnt.* $TESTDIR/gmnt']}}, {'ssh_keys': None}, {'mpi': {'exec': '$TESTDIR/binary/usr/local/bin/ior -e -w -r -W -b 10m -a POSIX -o $TESTDIR/gmnt/ior.testfile'}}, {'pexec': {'clients': ['rm -f $TESTDIR/gmnt/ior.testfile', 'rm -f $TESTDIR/gmnt', 'rm -rf $TESTDIR/binary']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '8cdab074dcca9a68965bc5a50e9c30b691949723', 'timestamp': '2023-10-16_14:43:00', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-16T23:26:39.918 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-16T23:26:39.921 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-16T23:26:39.924 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-16T23:26:39.927 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-16T23:26:39.930 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-16T23:26:39.957 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/run/ceph 2023-10-16T23:26:39.971 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/run/ceph 2023-10-16T23:26:39.974 DEBUG:teuthology.orchestra.run.smithi033:> sudo install -d -m0777 -- /var/run/ceph 2023-10-16T23:26:39.978 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/run/ceph 2023-10-16T23:26:39.981 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/run/ceph 2023-10-16T23:26:40.012 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-16T23:26:40.012 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/scratch_devs of=/dev/stdout 2023-10-16T23:26:40.030 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-16T23:26:40.030 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_1 2023-10-16T23:26:40.078 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-16T23:26:40.078 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T23:26:40.078 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 866 Links: 1 2023-10-16T23:26:40.079 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T23:26:40.079 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-10-16 23:20:09.230518689 +0000 2023-10-16T23:26:40.079 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-10-16 23:20:09.226518725 +0000 2023-10-16T23:26:40.079 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-10-16 23:20:09.226518725 +0000 2023-10-16T23:26:40.080 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2023-10-16T23:26:40.080 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-16T23:26:40.132 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-10-16T23:26:40.132 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-10-16T23:26:40.132 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000415646 s, 1.2 MB/s 2023-10-16T23:26:40.133 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-16T23:26:40.184 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_2 2023-10-16T23:26:40.230 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-16T23:26:40.230 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T23:26:40.230 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 884 Links: 1 2023-10-16T23:26:40.230 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T23:26:40.231 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-10-16 23:20:10.146510552 +0000 2023-10-16T23:26:40.231 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-10-16 23:20:09.794513678 +0000 2023-10-16T23:26:40.231 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-10-16 23:20:09.794513678 +0000 2023-10-16T23:26:40.231 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2023-10-16T23:26:40.232 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-16T23:26:40.284 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-10-16T23:26:40.284 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-10-16T23:26:40.284 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000423855 s, 1.2 MB/s 2023-10-16T23:26:40.285 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-16T23:26:40.335 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_3 2023-10-16T23:26:40.382 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-16T23:26:40.383 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T23:26:40.383 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 902 Links: 1 2023-10-16T23:26:40.383 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T23:26:40.383 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-10-16 23:20:10.706505577 +0000 2023-10-16T23:26:40.383 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-10-16 23:20:10.354508705 +0000 2023-10-16T23:26:40.384 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-10-16 23:20:10.354508705 +0000 2023-10-16T23:26:40.384 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2023-10-16T23:26:40.384 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-16T23:26:40.436 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-10-16T23:26:40.437 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-10-16T23:26:40.437 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000321938 s, 1.6 MB/s 2023-10-16T23:26:40.438 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-16T23:26:40.487 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_4 2023-10-16T23:26:40.534 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-16T23:26:40.534 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T23:26:40.535 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 923 Links: 1 2023-10-16T23:26:40.535 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T23:26:40.535 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-10-16 23:20:11.318500141 +0000 2023-10-16T23:26:40.535 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-10-16 23:20:10.958503339 +0000 2023-10-16T23:26:40.535 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-10-16 23:20:10.958503339 +0000 2023-10-16T23:26:40.536 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2023-10-16T23:26:40.536 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-16T23:26:40.588 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-10-16T23:26:40.588 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-10-16T23:26:40.589 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000372566 s, 1.4 MB/s 2023-10-16T23:26:40.590 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-16T23:26:40.639 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T23:26:40.640 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-16T23:26:40.640 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/scratch_devs of=/dev/stdout 2023-10-16T23:26:40.646 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-16T23:26:40.646 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_1 2023-10-16T23:26:40.695 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-16T23:26:40.695 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T23:26:40.696 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 881 Links: 1 2023-10-16T23:26:40.696 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T23:26:40.696 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-10-16 23:20:11.080352132 +0000 2023-10-16T23:26:40.696 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-10-16 23:20:10.716355380 +0000 2023-10-16T23:26:40.697 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-10-16 23:20:10.716355380 +0000 2023-10-16T23:26:40.697 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2023-10-16T23:26:40.697 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-16T23:26:40.750 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-10-16T23:26:40.750 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-10-16T23:26:40.750 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000412934 s, 1.2 MB/s 2023-10-16T23:26:40.751 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-16T23:26:40.800 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_2 2023-10-16T23:26:40.847 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-16T23:26:40.847 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T23:26:40.848 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 901 Links: 1 2023-10-16T23:26:40.848 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T23:26:40.848 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-10-16 23:20:11.696346637 +0000 2023-10-16T23:26:40.848 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-10-16 23:20:11.340349813 +0000 2023-10-16T23:26:40.848 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-10-16 23:20:11.340349813 +0000 2023-10-16T23:26:40.849 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2023-10-16T23:26:40.849 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-16T23:26:40.902 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-10-16T23:26:40.902 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-10-16T23:26:40.903 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000405097 s, 1.3 MB/s 2023-10-16T23:26:40.904 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-16T23:26:40.952 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_3 2023-10-16T23:26:40.999 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-16T23:26:40.999 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T23:26:40.999 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 917 Links: 1 2023-10-16T23:26:40.999 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T23:26:41.000 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-10-16 23:20:12.276341463 +0000 2023-10-16T23:26:41.000 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-10-16 23:20:11.924344604 +0000 2023-10-16T23:26:41.000 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-10-16 23:20:11.924344604 +0000 2023-10-16T23:26:41.000 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2023-10-16T23:26:41.000 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-16T23:26:41.053 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-10-16T23:26:41.054 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-10-16T23:26:41.054 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000384764 s, 1.3 MB/s 2023-10-16T23:26:41.055 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-16T23:26:41.104 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_4 2023-10-16T23:26:41.151 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-16T23:26:41.151 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T23:26:41.151 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 935 Links: 1 2023-10-16T23:26:41.151 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T23:26:41.152 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-10-16 23:20:12.860336252 +0000 2023-10-16T23:26:41.152 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-10-16 23:20:12.524339251 +0000 2023-10-16T23:26:41.152 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-10-16 23:20:12.524339251 +0000 2023-10-16T23:26:41.152 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2023-10-16T23:26:41.153 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-16T23:26:41.206 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-10-16T23:26:41.206 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-10-16T23:26:41.206 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000388981 s, 1.3 MB/s 2023-10-16T23:26:41.207 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-16T23:26:41.256 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T23:26:41.257 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-16T23:26:41.257 INFO:tasks.ceph:Generating config... 2023-10-16T23:26:41.258 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-16T23:26:41.259 INFO:tasks.ceph:[client] debug client = 20 2023-10-16T23:26:41.259 INFO:tasks.ceph:[client] debug ms = 1 2023-10-16T23:26:41.259 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-16T23:26:41.259 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-16T23:26:41.260 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-16T23:26:41.260 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-16T23:26:41.260 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-16T23:26:41.260 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-16T23:26:41.261 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-16T23:26:41.261 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-16T23:26:41.261 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-16T23:26:41.261 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-16T23:26:41.262 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-16T23:26:41.262 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-16T23:26:41.263 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-16T23:26:41.263 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-16T23:26:41.263 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-16T23:26:41.263 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-16T23:26:41.264 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-16T23:26:41.264 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-16T23:26:41.264 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-16T23:26:41.264 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-16T23:26:41.265 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-16T23:26:41.265 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-16T23:26:41.265 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-16T23:26:41.265 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-16T23:26:41.266 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-16T23:26:41.266 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-16T23:26:41.266 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-16T23:26:41.266 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-16T23:26:41.267 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-16T23:26:41.267 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-16T23:26:41.267 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-16T23:26:41.267 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-16T23:26:41.268 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-16T23:26:41.268 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-16T23:26:41.268 INFO:tasks.ceph:Setting up mon.a... 2023-10-16T23:26:41.268 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-16T23:26:41.303 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.keyring 2023-10-16T23:26:41.315 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-16T23:26:41.393 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T23:26:41.450 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.12'), ('mon.b', '172.21.15.31'), ('mon.c', '[v2:172.21.15.31:3301,v1:172.21.15.31:6790]')] 2023-10-16T23:26:41.451 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.12,172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-16T23:26:41.452 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-16T23:26:41.452 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-16T23:26:41.498 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.12 --add b 172.21.15.31 --addv c '[v2:172.21.15.31:3301,v1:172.21.15.31:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-16T23:26:41.584 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-16T23:26:41.585 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: generated fsid 0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51 2023-10-16T23:26:41.585 INFO:teuthology.orchestra.run.smithi012.stdout:setting min_mon_release = pacific 2023-10-16T23:26:41.585 INFO:teuthology.orchestra.run.smithi012.stdout:epoch 0 2023-10-16T23:26:41.585 INFO:teuthology.orchestra.run.smithi012.stdout:fsid 0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51 2023-10-16T23:26:41.586 INFO:teuthology.orchestra.run.smithi012.stdout:last_changed 2023-10-16T23:26:41.584966+0000 2023-10-16T23:26:41.586 INFO:teuthology.orchestra.run.smithi012.stdout:created 2023-10-16T23:26:41.584966+0000 2023-10-16T23:26:41.586 INFO:teuthology.orchestra.run.smithi012.stdout:min_mon_release 16 (pacific) 2023-10-16T23:26:41.586 INFO:teuthology.orchestra.run.smithi012.stdout:election_strategy: 1 2023-10-16T23:26:41.587 INFO:teuthology.orchestra.run.smithi012.stdout:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-16T23:26:41.587 INFO:teuthology.orchestra.run.smithi012.stdout:1: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.b 2023-10-16T23:26:41.587 INFO:teuthology.orchestra.run.smithi012.stdout:2: [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] mon.c 2023-10-16T23:26:41.587 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-16T23:26:41.588 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-16T23:26:41.634 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51... 2023-10-16T23:26:41.635 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-16T23:26:41.679 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-16T23:26:41.681 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-16T23:26:41.684 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-16T23:26:41.687 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-16T23:26:41.707 INFO:teuthology.orchestra.run.smithi012.stdout:[global] 2023-10-16T23:26:41.708 INFO:teuthology.orchestra.run.smithi012.stdout: chdir = "" 2023-10-16T23:26:41.708 INFO:teuthology.orchestra.run.smithi012.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-16T23:26:41.708 INFO:teuthology.orchestra.run.smithi012.stdout: auth supported = cephx 2023-10-16T23:26:41.708 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.709 INFO:teuthology.orchestra.run.smithi012.stdout: filestore xattr use omap = true 2023-10-16T23:26:41.709 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.709 INFO:teuthology.orchestra.run.smithi012.stdout: mon clock drift allowed = 1.000 2023-10-16T23:26:41.709 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.709 INFO:teuthology.orchestra.run.smithi012.stdout: osd crush chooseleaf type = 0 2023-10-16T23:26:41.709 INFO:teuthology.orchestra.run.smithi012.stdout: auth debug = true 2023-10-16T23:26:41.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.710 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on old message = true 2023-10-16T23:26:41.710 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on bug = true 2023-10-16T23:26:41.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.711 INFO:teuthology.orchestra.run.smithi012.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-16T23:26:41.711 INFO:teuthology.orchestra.run.smithi012.stdout: mon pg warn max object skew = 0 2023-10-16T23:26:41.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.711 INFO:teuthology.orchestra.run.smithi012.stdout: # disable pg_autoscaler by default for new pools 2023-10-16T23:26:41.711 INFO:teuthology.orchestra.run.smithi012.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-16T23:26:41.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.712 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default size = 2 2023-10-16T23:26:41.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.712 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow primary affinity = true 2023-10-16T23:26:41.712 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow pg remap = true 2023-10-16T23:26:41.712 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on legacy crush tunables = false 2023-10-16T23:26:41.713 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on crush straw calc version zero = false 2023-10-16T23:26:41.713 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on no sortbitwise = false 2023-10-16T23:26:41.713 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on osd down out interval zero = false 2023-10-16T23:26:41.713 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on too few osds = false 2023-10-16T23:26:41.713 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-16T23:26:41.714 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-16T23:26:41.714 INFO:teuthology.orchestra.run.smithi012.stdout: mon_allow_pool_size_one = true 2023-10-16T23:26:41.714 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.714 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-16T23:26:41.714 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.715 INFO:teuthology.orchestra.run.smithi012.stdout: osd default data pool replay window = 5 2023-10-16T23:26:41.715 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.715 INFO:teuthology.orchestra.run.smithi012.stdout: mon allow pool delete = true 2023-10-16T23:26:41.715 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.715 INFO:teuthology.orchestra.run.smithi012.stdout: mon cluster log file level = debug 2023-10-16T23:26:41.716 INFO:teuthology.orchestra.run.smithi012.stdout: debug asserts on shutdown = true 2023-10-16T23:26:41.716 INFO:teuthology.orchestra.run.smithi012.stdout: mon health detail to clog = false 2023-10-16T23:26:41.716 INFO:teuthology.orchestra.run.smithi012.stdout: mon host = "172.21.15.12,172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790]" 2023-10-16T23:26:41.716 INFO:teuthology.orchestra.run.smithi012.stdout: fsid = 0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51 2023-10-16T23:26:41.716 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.716 INFO:teuthology.orchestra.run.smithi012.stdout:[osd] 2023-10-16T23:26:41.717 INFO:teuthology.orchestra.run.smithi012.stdout: osd journal size = 100 2023-10-16T23:26:41.717 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.717 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub load threshold = 5.0 2023-10-16T23:26:41.717 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub max interval = 600 2023-10-16T23:26:41.717 INFO:teuthology.orchestra.run.smithi012.stdout: osd mclock profile = high_recovery_ops 2023-10-16T23:26:41.718 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.718 INFO:teuthology.orchestra.run.smithi012.stdout: osd recover clone overlap = true 2023-10-16T23:26:41.718 INFO:teuthology.orchestra.run.smithi012.stdout: osd recovery max chunk = 1048576 2023-10-16T23:26:41.718 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.718 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug shutdown = true 2023-10-16T23:26:41.719 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug op order = true 2023-10-16T23:26:41.719 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug verify stray on activate = true 2023-10-16T23:26:41.719 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.719 INFO:teuthology.orchestra.run.smithi012.stdout: osd open classes on start = true 2023-10-16T23:26:41.719 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug pg log writeout = true 2023-10-16T23:26:41.719 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.720 INFO:teuthology.orchestra.run.smithi012.stdout: osd deep scrub update digest min age = 30 2023-10-16T23:26:41.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.720 INFO:teuthology.orchestra.run.smithi012.stdout: osd map max advance = 10 2023-10-16T23:26:41.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.721 INFO:teuthology.orchestra.run.smithi012.stdout: journal zero on create = true 2023-10-16T23:26:41.721 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.721 INFO:teuthology.orchestra.run.smithi012.stdout: filestore ondisk finisher threads = 3 2023-10-16T23:26:41.721 INFO:teuthology.orchestra.run.smithi012.stdout: filestore apply finisher threads = 3 2023-10-16T23:26:41.721 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.722 INFO:teuthology.orchestra.run.smithi012.stdout: bdev debug aio = true 2023-10-16T23:26:41.722 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug misdirected ops = true 2023-10-16T23:26:41.722 INFO:teuthology.orchestra.run.smithi012.stdout: bdev async discard = True 2023-10-16T23:26:41.722 INFO:teuthology.orchestra.run.smithi012.stdout: bdev enable discard = True 2023-10-16T23:26:41.722 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore allocator = bitmap 2023-10-16T23:26:41.722 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore block size = 96636764160 2023-10-16T23:26:41.723 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore fsck on mount = True 2023-10-16T23:26:41.723 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluefs = 1/20 2023-10-16T23:26:41.723 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluestore = 1/20 2023-10-16T23:26:41.723 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2023-10-16T23:26:41.723 INFO:teuthology.orchestra.run.smithi012.stdout: debug osd = 20 2023-10-16T23:26:41.724 INFO:teuthology.orchestra.run.smithi012.stdout: debug rocksdb = 4/10 2023-10-16T23:26:41.724 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd backfillfull_ratio = 0.85 2023-10-16T23:26:41.724 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd full ratio = 0.9 2023-10-16T23:26:41.724 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd nearfull ratio = 0.8 2023-10-16T23:26:41.724 INFO:teuthology.orchestra.run.smithi012.stdout: osd failsafe full ratio = 0.95 2023-10-16T23:26:41.725 INFO:teuthology.orchestra.run.smithi012.stdout: osd objectstore = bluestore 2023-10-16T23:26:41.725 INFO:teuthology.orchestra.run.smithi012.stdout: osd op complaint time = 180 2023-10-16T23:26:41.725 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.725 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr] 2023-10-16T23:26:41.725 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2023-10-16T23:26:41.725 INFO:teuthology.orchestra.run.smithi012.stdout: debug mgr = 20 2023-10-16T23:26:41.726 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2023-10-16T23:26:41.726 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2023-10-16T23:26:41.726 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2023-10-16T23:26:41.726 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2023-10-16T23:26:41.726 INFO:teuthology.orchestra.run.smithi012.stdout: mgr/telemetry/nag = false 2023-10-16T23:26:41.727 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.727 INFO:teuthology.orchestra.run.smithi012.stdout:[mon] 2023-10-16T23:26:41.727 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2023-10-16T23:26:41.727 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2023-10-16T23:26:41.727 INFO:teuthology.orchestra.run.smithi012.stdout: debug paxos = 20 2023-10-16T23:26:41.728 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2023-10-16T23:26:41.728 INFO:teuthology.orchestra.run.smithi012.stdout: mon data avail warn = 5 2023-10-16T23:26:41.728 INFO:teuthology.orchestra.run.smithi012.stdout: mon mgr mkfs grace = 240 2023-10-16T23:26:41.728 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2023-10-16T23:26:41.728 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd reporter subtree level = osd 2023-10-16T23:26:41.728 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd prime pg temp = true 2023-10-16T23:26:41.729 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2023-10-16T23:26:41.729 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.729 INFO:teuthology.orchestra.run.smithi012.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-16T23:26:41.729 INFO:teuthology.orchestra.run.smithi012.stdout: auth mon ticket ttl = 660 # 11m 2023-10-16T23:26:41.729 INFO:teuthology.orchestra.run.smithi012.stdout: auth service ticket ttl = 240 # 4m 2023-10-16T23:26:41.730 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.730 INFO:teuthology.orchestra.run.smithi012.stdout: # don't complain about insecure global_id in the test suite 2023-10-16T23:26:41.730 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-16T23:26:41.730 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-16T23:26:41.730 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.731 INFO:teuthology.orchestra.run.smithi012.stdout: # 1m isn't quite enough 2023-10-16T23:26:41.731 INFO:teuthology.orchestra.run.smithi012.stdout: mon_down_mkfs_grace = 2m 2023-10-16T23:26:41.731 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.731 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_filestore_osds = false 2023-10-16T23:26:41.731 INFO:teuthology.orchestra.run.smithi012.stdout: mon op complaint time = 120 2023-10-16T23:26:41.732 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:26:41.732 INFO:teuthology.orchestra.run.smithi012.stdout:[client] 2023-10-16T23:26:41.732 INFO:teuthology.orchestra.run.smithi012.stdout: rgw cache enabled = true 2023-10-16T23:26:41.732 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable ops log = true 2023-10-16T23:26:41.732 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable usage log = true 2023-10-16T23:26:41.732 INFO:teuthology.orchestra.run.smithi012.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-16T23:26:41.733 INFO:teuthology.orchestra.run.smithi012.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-16T23:26:41.733 INFO:teuthology.orchestra.run.smithi012.stdout: client mount timeout = 600 2023-10-16T23:26:41.733 INFO:teuthology.orchestra.run.smithi012.stdout: debug client = 20 2023-10-16T23:26:41.733 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2023-10-16T23:26:41.733 INFO:teuthology.orchestra.run.smithi012.stdout: rados mon op timeout = 900 2023-10-16T23:26:41.734 INFO:teuthology.orchestra.run.smithi012.stdout: rados osd op timeout = 900 2023-10-16T23:26:41.734 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.a] 2023-10-16T23:26:41.734 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.b] 2023-10-16T23:26:41.734 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.c] 2023-10-16T23:26:41.734 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a] 2023-10-16T23:26:41.735 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b] 2023-10-16T23:26:41.735 INFO:teuthology.orchestra.run.smithi012.stdout:[mds] 2023-10-16T23:26:41.735 INFO:teuthology.orchestra.run.smithi012.stdout: debug mds = 20 2023-10-16T23:26:41.735 INFO:teuthology.orchestra.run.smithi012.stdout: debug mds balancer = 20 2023-10-16T23:26:41.735 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2023-10-16T23:26:41.736 INFO:teuthology.orchestra.run.smithi012.stdout: mds debug frag = True 2023-10-16T23:26:41.736 INFO:teuthology.orchestra.run.smithi012.stdout: mds debug scatterstat = True 2023-10-16T23:26:41.736 INFO:teuthology.orchestra.run.smithi012.stdout: mds op complaint time = 180 2023-10-16T23:26:41.736 INFO:teuthology.orchestra.run.smithi012.stdout: mds verify scatter = True 2023-10-16T23:26:41.736 INFO:teuthology.orchestra.run.smithi012.stdout: osd op complaint time = 180 2023-10-16T23:26:41.736 INFO:teuthology.orchestra.run.smithi012.stdout: rados mon op timeout = 900 2023-10-16T23:26:41.737 INFO:teuthology.orchestra.run.smithi012.stdout: rados osd op timeout = 900 2023-10-16T23:26:41.740 INFO:teuthology.orchestra.run.smithi138.stdout:[global] 2023-10-16T23:26:41.740 INFO:teuthology.orchestra.run.smithi138.stdout: chdir = "" 2023-10-16T23:26:41.740 INFO:teuthology.orchestra.run.smithi138.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-16T23:26:41.741 INFO:teuthology.orchestra.run.smithi138.stdout: auth supported = cephx 2023-10-16T23:26:41.741 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.741 INFO:teuthology.orchestra.run.smithi138.stdout: filestore xattr use omap = true 2023-10-16T23:26:41.741 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.741 INFO:teuthology.orchestra.run.smithi138.stdout: mon clock drift allowed = 1.000 2023-10-16T23:26:41.742 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.742 INFO:teuthology.orchestra.run.smithi138.stdout: osd crush chooseleaf type = 0 2023-10-16T23:26:41.742 INFO:teuthology.orchestra.run.smithi138.stdout: auth debug = true 2023-10-16T23:26:41.743 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.743 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on old message = true 2023-10-16T23:26:41.743 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on bug = true 2023-10-16T23:26:41.743 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.743 INFO:teuthology.orchestra.run.smithi138.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-16T23:26:41.743 INFO:teuthology.orchestra.run.smithi138.stdout: mon pg warn max object skew = 0 2023-10-16T23:26:41.744 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.744 INFO:teuthology.orchestra.run.smithi138.stdout: # disable pg_autoscaler by default for new pools 2023-10-16T23:26:41.744 INFO:teuthology.orchestra.run.smithi138.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-16T23:26:41.744 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.744 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default size = 2 2023-10-16T23:26:41.745 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.745 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow primary affinity = true 2023-10-16T23:26:41.745 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow pg remap = true 2023-10-16T23:26:41.745 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on legacy crush tunables = false 2023-10-16T23:26:41.745 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on crush straw calc version zero = false 2023-10-16T23:26:41.746 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on no sortbitwise = false 2023-10-16T23:26:41.746 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on osd down out interval zero = false 2023-10-16T23:26:41.746 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on too few osds = false 2023-10-16T23:26:41.746 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-16T23:26:41.746 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-16T23:26:41.747 INFO:teuthology.orchestra.run.smithi138.stdout: mon_allow_pool_size_one = true 2023-10-16T23:26:41.747 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.747 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-16T23:26:41.747 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.747 INFO:teuthology.orchestra.run.smithi138.stdout: osd default data pool replay window = 5 2023-10-16T23:26:41.747 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.748 INFO:teuthology.orchestra.run.smithi138.stdout: mon allow pool delete = true 2023-10-16T23:26:41.748 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.748 INFO:teuthology.orchestra.run.smithi138.stdout: mon cluster log file level = debug 2023-10-16T23:26:41.748 INFO:teuthology.orchestra.run.smithi138.stdout: debug asserts on shutdown = true 2023-10-16T23:26:41.748 INFO:teuthology.orchestra.run.smithi138.stdout: mon health detail to clog = false 2023-10-16T23:26:41.749 INFO:teuthology.orchestra.run.smithi138.stdout: mon host = "172.21.15.12,172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790]" 2023-10-16T23:26:41.749 INFO:teuthology.orchestra.run.smithi138.stdout: fsid = 0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51 2023-10-16T23:26:41.749 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.749 INFO:teuthology.orchestra.run.smithi138.stdout:[osd] 2023-10-16T23:26:41.749 INFO:teuthology.orchestra.run.smithi138.stdout: osd journal size = 100 2023-10-16T23:26:41.750 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.750 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub load threshold = 5.0 2023-10-16T23:26:41.750 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub max interval = 600 2023-10-16T23:26:41.750 INFO:teuthology.orchestra.run.smithi138.stdout: osd mclock profile = high_recovery_ops 2023-10-16T23:26:41.750 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.751 INFO:teuthology.orchestra.run.smithi138.stdout: osd recover clone overlap = true 2023-10-16T23:26:41.751 INFO:teuthology.orchestra.run.smithi138.stdout: osd recovery max chunk = 1048576 2023-10-16T23:26:41.751 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.751 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug shutdown = true 2023-10-16T23:26:41.751 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug op order = true 2023-10-16T23:26:41.752 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug verify stray on activate = true 2023-10-16T23:26:41.752 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.752 INFO:teuthology.orchestra.run.smithi138.stdout: osd open classes on start = true 2023-10-16T23:26:41.752 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug pg log writeout = true 2023-10-16T23:26:41.752 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.752 INFO:teuthology.orchestra.run.smithi138.stdout: osd deep scrub update digest min age = 30 2023-10-16T23:26:41.753 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.753 INFO:teuthology.orchestra.run.smithi138.stdout: osd map max advance = 10 2023-10-16T23:26:41.753 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.753 INFO:teuthology.orchestra.run.smithi138.stdout: journal zero on create = true 2023-10-16T23:26:41.753 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.754 INFO:teuthology.orchestra.run.smithi138.stdout: filestore ondisk finisher threads = 3 2023-10-16T23:26:41.754 INFO:teuthology.orchestra.run.smithi138.stdout: filestore apply finisher threads = 3 2023-10-16T23:26:41.754 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.754 INFO:teuthology.orchestra.run.smithi138.stdout: bdev debug aio = true 2023-10-16T23:26:41.754 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug misdirected ops = true 2023-10-16T23:26:41.754 INFO:teuthology.orchestra.run.smithi138.stdout: bdev async discard = True 2023-10-16T23:26:41.755 INFO:teuthology.orchestra.run.smithi138.stdout: bdev enable discard = True 2023-10-16T23:26:41.755 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore allocator = bitmap 2023-10-16T23:26:41.755 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore block size = 96636764160 2023-10-16T23:26:41.755 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore fsck on mount = True 2023-10-16T23:26:41.755 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluefs = 1/20 2023-10-16T23:26:41.756 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluestore = 1/20 2023-10-16T23:26:41.756 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2023-10-16T23:26:41.756 INFO:teuthology.orchestra.run.smithi138.stdout: debug osd = 20 2023-10-16T23:26:41.756 INFO:teuthology.orchestra.run.smithi138.stdout: debug rocksdb = 4/10 2023-10-16T23:26:41.756 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd backfillfull_ratio = 0.85 2023-10-16T23:26:41.756 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd full ratio = 0.9 2023-10-16T23:26:41.757 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd nearfull ratio = 0.8 2023-10-16T23:26:41.757 INFO:teuthology.orchestra.run.smithi138.stdout: osd failsafe full ratio = 0.95 2023-10-16T23:26:41.757 INFO:teuthology.orchestra.run.smithi138.stdout: osd objectstore = bluestore 2023-10-16T23:26:41.757 INFO:teuthology.orchestra.run.smithi138.stdout: osd op complaint time = 180 2023-10-16T23:26:41.757 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.758 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr] 2023-10-16T23:26:41.758 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2023-10-16T23:26:41.758 INFO:teuthology.orchestra.run.smithi138.stdout: debug mgr = 20 2023-10-16T23:26:41.758 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2023-10-16T23:26:41.758 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2023-10-16T23:26:41.759 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2023-10-16T23:26:41.759 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2023-10-16T23:26:41.759 INFO:teuthology.orchestra.run.smithi138.stdout: mgr/telemetry/nag = false 2023-10-16T23:26:41.759 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.759 INFO:teuthology.orchestra.run.smithi138.stdout:[mon] 2023-10-16T23:26:41.760 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2023-10-16T23:26:41.760 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2023-10-16T23:26:41.760 INFO:teuthology.orchestra.run.smithi138.stdout: debug paxos = 20 2023-10-16T23:26:41.760 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2023-10-16T23:26:41.760 INFO:teuthology.orchestra.run.smithi138.stdout: mon data avail warn = 5 2023-10-16T23:26:41.761 INFO:teuthology.orchestra.run.smithi138.stdout: mon mgr mkfs grace = 240 2023-10-16T23:26:41.761 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2023-10-16T23:26:41.761 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd reporter subtree level = osd 2023-10-16T23:26:41.761 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd prime pg temp = true 2023-10-16T23:26:41.761 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2023-10-16T23:26:41.762 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.762 INFO:teuthology.orchestra.run.smithi138.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-16T23:26:41.762 INFO:teuthology.orchestra.run.smithi138.stdout: auth mon ticket ttl = 660 # 11m 2023-10-16T23:26:41.762 INFO:teuthology.orchestra.run.smithi138.stdout: auth service ticket ttl = 240 # 4m 2023-10-16T23:26:41.762 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.763 INFO:teuthology.orchestra.run.smithi138.stdout: # don't complain about insecure global_id in the test suite 2023-10-16T23:26:41.763 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-16T23:26:41.763 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-16T23:26:41.763 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.763 INFO:teuthology.orchestra.run.smithi138.stdout: # 1m isn't quite enough 2023-10-16T23:26:41.763 INFO:teuthology.orchestra.run.smithi138.stdout: mon_down_mkfs_grace = 2m 2023-10-16T23:26:41.764 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.764 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_filestore_osds = false 2023-10-16T23:26:41.764 INFO:teuthology.orchestra.run.smithi138.stdout: mon op complaint time = 120 2023-10-16T23:26:41.764 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-10-16T23:26:41.764 INFO:teuthology.orchestra.run.smithi138.stdout:[client] 2023-10-16T23:26:41.765 INFO:teuthology.orchestra.run.smithi138.stdout: rgw cache enabled = true 2023-10-16T23:26:41.765 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable ops log = true 2023-10-16T23:26:41.765 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable usage log = true 2023-10-16T23:26:41.765 INFO:teuthology.orchestra.run.smithi138.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-16T23:26:41.765 INFO:teuthology.orchestra.run.smithi138.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-16T23:26:41.766 INFO:teuthology.orchestra.run.smithi138.stdout: client mount timeout = 600 2023-10-16T23:26:41.766 INFO:teuthology.orchestra.run.smithi138.stdout: debug client = 20 2023-10-16T23:26:41.766 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2023-10-16T23:26:41.766 INFO:teuthology.orchestra.run.smithi138.stdout: rados mon op timeout = 900 2023-10-16T23:26:41.766 INFO:teuthology.orchestra.run.smithi138.stdout: rados osd op timeout = 900 2023-10-16T23:26:41.767 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.a] 2023-10-16T23:26:41.767 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.b] 2023-10-16T23:26:41.767 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.c] 2023-10-16T23:26:41.767 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.a] 2023-10-16T23:26:41.767 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.b] 2023-10-16T23:26:41.767 INFO:teuthology.orchestra.run.smithi138.stdout:[mds] 2023-10-16T23:26:41.768 INFO:teuthology.orchestra.run.smithi138.stdout: debug mds = 20 2023-10-16T23:26:41.768 INFO:teuthology.orchestra.run.smithi138.stdout: debug mds balancer = 20 2023-10-16T23:26:41.768 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2023-10-16T23:26:41.768 INFO:teuthology.orchestra.run.smithi138.stdout: mds debug frag = True 2023-10-16T23:26:41.768 INFO:teuthology.orchestra.run.smithi138.stdout: mds debug scatterstat = True 2023-10-16T23:26:41.768 INFO:teuthology.orchestra.run.smithi138.stdout: mds op complaint time = 180 2023-10-16T23:26:41.769 INFO:teuthology.orchestra.run.smithi138.stdout: mds verify scatter = True 2023-10-16T23:26:41.769 INFO:teuthology.orchestra.run.smithi138.stdout: osd op complaint time = 180 2023-10-16T23:26:41.769 INFO:teuthology.orchestra.run.smithi138.stdout: rados mon op timeout = 900 2023-10-16T23:26:41.769 INFO:teuthology.orchestra.run.smithi138.stdout: rados osd op timeout = 900 2023-10-16T23:26:41.769 INFO:teuthology.orchestra.run.smithi072.stdout:[global] 2023-10-16T23:26:41.770 INFO:teuthology.orchestra.run.smithi072.stdout: chdir = "" 2023-10-16T23:26:41.770 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-16T23:26:41.770 INFO:teuthology.orchestra.run.smithi072.stdout: auth supported = cephx 2023-10-16T23:26:41.770 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: filestore xattr use omap = true 2023-10-16T23:26:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: mon clock drift allowed = 1.000 2023-10-16T23:26:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: osd crush chooseleaf type = 0 2023-10-16T23:26:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: auth debug = true 2023-10-16T23:26:41.772 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.772 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on old message = true 2023-10-16T23:26:41.772 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on bug = true 2023-10-16T23:26:41.772 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.772 INFO:teuthology.orchestra.run.smithi072.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-16T23:26:41.773 INFO:teuthology.orchestra.run.smithi072.stdout: mon pg warn max object skew = 0 2023-10-16T23:26:41.773 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.773 INFO:teuthology.orchestra.run.smithi072.stdout: # disable pg_autoscaler by default for new pools 2023-10-16T23:26:41.773 INFO:teuthology.orchestra.run.smithi072.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-16T23:26:41.773 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.773 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default size = 2 2023-10-16T23:26:41.774 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.774 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow primary affinity = true 2023-10-16T23:26:41.774 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow pg remap = true 2023-10-16T23:26:41.774 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on legacy crush tunables = false 2023-10-16T23:26:41.774 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on crush straw calc version zero = false 2023-10-16T23:26:41.775 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on no sortbitwise = false 2023-10-16T23:26:41.775 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on osd down out interval zero = false 2023-10-16T23:26:41.775 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on too few osds = false 2023-10-16T23:26:41.775 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-16T23:26:41.775 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-16T23:26:41.776 INFO:teuthology.orchestra.run.smithi072.stdout: mon_allow_pool_size_one = true 2023-10-16T23:26:41.776 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.776 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-16T23:26:41.776 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.776 INFO:teuthology.orchestra.run.smithi072.stdout: osd default data pool replay window = 5 2023-10-16T23:26:41.777 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.777 INFO:teuthology.orchestra.run.smithi072.stdout: mon allow pool delete = true 2023-10-16T23:26:41.777 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.777 INFO:teuthology.orchestra.run.smithi072.stdout: mon cluster log file level = debug 2023-10-16T23:26:41.777 INFO:teuthology.orchestra.run.smithi072.stdout: debug asserts on shutdown = true 2023-10-16T23:26:41.778 INFO:teuthology.orchestra.run.smithi072.stdout: mon health detail to clog = false 2023-10-16T23:26:41.778 INFO:teuthology.orchestra.run.smithi072.stdout: mon host = "172.21.15.12,172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790]" 2023-10-16T23:26:41.778 INFO:teuthology.orchestra.run.smithi072.stdout: fsid = 0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51 2023-10-16T23:26:41.778 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.778 INFO:teuthology.orchestra.run.smithi072.stdout:[osd] 2023-10-16T23:26:41.779 INFO:teuthology.orchestra.run.smithi072.stdout: osd journal size = 100 2023-10-16T23:26:41.779 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.779 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub load threshold = 5.0 2023-10-16T23:26:41.779 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub max interval = 600 2023-10-16T23:26:41.779 INFO:teuthology.orchestra.run.smithi072.stdout: osd mclock profile = high_recovery_ops 2023-10-16T23:26:41.780 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.780 INFO:teuthology.orchestra.run.smithi072.stdout: osd recover clone overlap = true 2023-10-16T23:26:41.780 INFO:teuthology.orchestra.run.smithi072.stdout: osd recovery max chunk = 1048576 2023-10-16T23:26:41.780 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.780 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug shutdown = true 2023-10-16T23:26:41.780 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug op order = true 2023-10-16T23:26:41.781 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug verify stray on activate = true 2023-10-16T23:26:41.781 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.781 INFO:teuthology.orchestra.run.smithi072.stdout: osd open classes on start = true 2023-10-16T23:26:41.781 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug pg log writeout = true 2023-10-16T23:26:41.781 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.782 INFO:teuthology.orchestra.run.smithi072.stdout: osd deep scrub update digest min age = 30 2023-10-16T23:26:41.782 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.782 INFO:teuthology.orchestra.run.smithi072.stdout: osd map max advance = 10 2023-10-16T23:26:41.782 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.782 INFO:teuthology.orchestra.run.smithi072.stdout: journal zero on create = true 2023-10-16T23:26:41.783 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.783 INFO:teuthology.orchestra.run.smithi072.stdout: filestore ondisk finisher threads = 3 2023-10-16T23:26:41.783 INFO:teuthology.orchestra.run.smithi072.stdout: filestore apply finisher threads = 3 2023-10-16T23:26:41.783 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.783 INFO:teuthology.orchestra.run.smithi072.stdout: bdev debug aio = true 2023-10-16T23:26:41.783 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug misdirected ops = true 2023-10-16T23:26:41.784 INFO:teuthology.orchestra.run.smithi072.stdout: bdev async discard = True 2023-10-16T23:26:41.784 INFO:teuthology.orchestra.run.smithi072.stdout: bdev enable discard = True 2023-10-16T23:26:41.784 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore allocator = bitmap 2023-10-16T23:26:41.784 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore block size = 96636764160 2023-10-16T23:26:41.784 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore fsck on mount = True 2023-10-16T23:26:41.785 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluefs = 1/20 2023-10-16T23:26:41.785 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluestore = 1/20 2023-10-16T23:26:41.785 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-10-16T23:26:41.785 INFO:teuthology.orchestra.run.smithi072.stdout: debug osd = 20 2023-10-16T23:26:41.785 INFO:teuthology.orchestra.run.smithi072.stdout: debug rocksdb = 4/10 2023-10-16T23:26:41.786 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd backfillfull_ratio = 0.85 2023-10-16T23:26:41.786 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd full ratio = 0.9 2023-10-16T23:26:41.786 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd nearfull ratio = 0.8 2023-10-16T23:26:41.786 INFO:teuthology.orchestra.run.smithi072.stdout: osd failsafe full ratio = 0.95 2023-10-16T23:26:41.786 INFO:teuthology.orchestra.run.smithi072.stdout: osd objectstore = bluestore 2023-10-16T23:26:41.787 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2023-10-16T23:26:41.787 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.787 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr] 2023-10-16T23:26:41.787 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-10-16T23:26:41.787 INFO:teuthology.orchestra.run.smithi072.stdout: debug mgr = 20 2023-10-16T23:26:41.787 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2023-10-16T23:26:41.788 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2023-10-16T23:26:41.788 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2023-10-16T23:26:41.788 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2023-10-16T23:26:41.788 INFO:teuthology.orchestra.run.smithi072.stdout: mgr/telemetry/nag = false 2023-10-16T23:26:41.788 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.789 INFO:teuthology.orchestra.run.smithi072.stdout:[mon] 2023-10-16T23:26:41.789 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-10-16T23:26:41.789 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2023-10-16T23:26:41.789 INFO:teuthology.orchestra.run.smithi072.stdout: debug paxos = 20 2023-10-16T23:26:41.789 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2023-10-16T23:26:41.790 INFO:teuthology.orchestra.run.smithi072.stdout: mon data avail warn = 5 2023-10-16T23:26:41.790 INFO:teuthology.orchestra.run.smithi072.stdout: mon mgr mkfs grace = 240 2023-10-16T23:26:41.790 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2023-10-16T23:26:41.790 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd reporter subtree level = osd 2023-10-16T23:26:41.790 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd prime pg temp = true 2023-10-16T23:26:41.790 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2023-10-16T23:26:41.791 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.791 INFO:teuthology.orchestra.run.smithi072.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-16T23:26:41.791 INFO:teuthology.orchestra.run.smithi072.stdout: auth mon ticket ttl = 660 # 11m 2023-10-16T23:26:41.791 INFO:teuthology.orchestra.run.smithi072.stdout: auth service ticket ttl = 240 # 4m 2023-10-16T23:26:41.791 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.792 INFO:teuthology.orchestra.run.smithi072.stdout: # don't complain about insecure global_id in the test suite 2023-10-16T23:26:41.792 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-16T23:26:41.792 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-16T23:26:41.792 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.792 INFO:teuthology.orchestra.run.smithi072.stdout: # 1m isn't quite enough 2023-10-16T23:26:41.793 INFO:teuthology.orchestra.run.smithi072.stdout: mon_down_mkfs_grace = 2m 2023-10-16T23:26:41.793 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.793 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_filestore_osds = false 2023-10-16T23:26:41.793 INFO:teuthology.orchestra.run.smithi072.stdout: mon op complaint time = 120 2023-10-16T23:26:41.793 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-16T23:26:41.793 INFO:teuthology.orchestra.run.smithi072.stdout:[client] 2023-10-16T23:26:41.794 INFO:teuthology.orchestra.run.smithi072.stdout: rgw cache enabled = true 2023-10-16T23:26:41.794 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable ops log = true 2023-10-16T23:26:41.794 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable usage log = true 2023-10-16T23:26:41.794 INFO:teuthology.orchestra.run.smithi072.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-16T23:26:41.794 INFO:teuthology.orchestra.run.smithi072.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-16T23:26:41.795 INFO:teuthology.orchestra.run.smithi072.stdout: client mount timeout = 600 2023-10-16T23:26:41.795 INFO:teuthology.orchestra.run.smithi072.stdout: debug client = 20 2023-10-16T23:26:41.795 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-10-16T23:26:41.795 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2023-10-16T23:26:41.795 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2023-10-16T23:26:41.796 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.a] 2023-10-16T23:26:41.796 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.b] 2023-10-16T23:26:41.796 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.c] 2023-10-16T23:26:41.796 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2023-10-16T23:26:41.796 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2023-10-16T23:26:41.796 INFO:teuthology.orchestra.run.smithi072.stdout:[mds] 2023-10-16T23:26:41.797 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds = 20 2023-10-16T23:26:41.797 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds balancer = 20 2023-10-16T23:26:41.797 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-10-16T23:26:41.797 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug frag = True 2023-10-16T23:26:41.797 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug scatterstat = True 2023-10-16T23:26:41.798 INFO:teuthology.orchestra.run.smithi072.stdout: mds op complaint time = 180 2023-10-16T23:26:41.798 INFO:teuthology.orchestra.run.smithi072.stdout: mds verify scatter = True 2023-10-16T23:26:41.798 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2023-10-16T23:26:41.798 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2023-10-16T23:26:41.798 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2023-10-16T23:26:41.799 INFO:teuthology.orchestra.run.smithi033.stdout:[global] 2023-10-16T23:26:41.799 INFO:teuthology.orchestra.run.smithi033.stdout: chdir = "" 2023-10-16T23:26:41.799 INFO:teuthology.orchestra.run.smithi033.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-16T23:26:41.799 INFO:teuthology.orchestra.run.smithi033.stdout: auth supported = cephx 2023-10-16T23:26:41.799 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.800 INFO:teuthology.orchestra.run.smithi033.stdout: filestore xattr use omap = true 2023-10-16T23:26:41.800 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.800 INFO:teuthology.orchestra.run.smithi033.stdout: mon clock drift allowed = 1.000 2023-10-16T23:26:41.800 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.800 INFO:teuthology.orchestra.run.smithi033.stdout: osd crush chooseleaf type = 0 2023-10-16T23:26:41.800 INFO:teuthology.orchestra.run.smithi033.stdout: auth debug = true 2023-10-16T23:26:41.801 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.801 INFO:teuthology.orchestra.run.smithi033.stdout: ms die on old message = true 2023-10-16T23:26:41.801 INFO:teuthology.orchestra.run.smithi033.stdout: ms die on bug = true 2023-10-16T23:26:41.801 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.801 INFO:teuthology.orchestra.run.smithi033.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-16T23:26:41.802 INFO:teuthology.orchestra.run.smithi033.stdout: mon pg warn max object skew = 0 2023-10-16T23:26:41.802 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.802 INFO:teuthology.orchestra.run.smithi033.stdout: # disable pg_autoscaler by default for new pools 2023-10-16T23:26:41.802 INFO:teuthology.orchestra.run.smithi033.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-16T23:26:41.802 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.803 INFO:teuthology.orchestra.run.smithi033.stdout: osd pool default size = 2 2023-10-16T23:26:41.803 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.803 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd allow primary affinity = true 2023-10-16T23:26:41.803 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd allow pg remap = true 2023-10-16T23:26:41.803 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on legacy crush tunables = false 2023-10-16T23:26:41.803 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on crush straw calc version zero = false 2023-10-16T23:26:41.804 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on no sortbitwise = false 2023-10-16T23:26:41.804 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on osd down out interval zero = false 2023-10-16T23:26:41.804 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on too few osds = false 2023-10-16T23:26:41.804 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-16T23:26:41.804 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-16T23:26:41.805 INFO:teuthology.orchestra.run.smithi033.stdout: mon_allow_pool_size_one = true 2023-10-16T23:26:41.805 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.805 INFO:teuthology.orchestra.run.smithi033.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-16T23:26:41.805 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.805 INFO:teuthology.orchestra.run.smithi033.stdout: osd default data pool replay window = 5 2023-10-16T23:26:41.806 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.806 INFO:teuthology.orchestra.run.smithi033.stdout: mon allow pool delete = true 2023-10-16T23:26:41.806 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.806 INFO:teuthology.orchestra.run.smithi033.stdout: mon cluster log file level = debug 2023-10-16T23:26:41.806 INFO:teuthology.orchestra.run.smithi033.stdout: debug asserts on shutdown = true 2023-10-16T23:26:41.806 INFO:teuthology.orchestra.run.smithi033.stdout: mon health detail to clog = false 2023-10-16T23:26:41.807 INFO:teuthology.orchestra.run.smithi033.stdout: mon host = "172.21.15.12,172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790]" 2023-10-16T23:26:41.807 INFO:teuthology.orchestra.run.smithi033.stdout: fsid = 0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51 2023-10-16T23:26:41.807 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.807 INFO:teuthology.orchestra.run.smithi033.stdout:[osd] 2023-10-16T23:26:41.807 INFO:teuthology.orchestra.run.smithi033.stdout: osd journal size = 100 2023-10-16T23:26:41.808 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.808 INFO:teuthology.orchestra.run.smithi033.stdout: osd scrub load threshold = 5.0 2023-10-16T23:26:41.808 INFO:teuthology.orchestra.run.smithi033.stdout: osd scrub max interval = 600 2023-10-16T23:26:41.808 INFO:teuthology.orchestra.run.smithi033.stdout: osd mclock profile = high_recovery_ops 2023-10-16T23:26:41.808 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.809 INFO:teuthology.orchestra.run.smithi033.stdout: osd recover clone overlap = true 2023-10-16T23:26:41.809 INFO:teuthology.orchestra.run.smithi033.stdout: osd recovery max chunk = 1048576 2023-10-16T23:26:41.809 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.809 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug shutdown = true 2023-10-16T23:26:41.809 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug op order = true 2023-10-16T23:26:41.809 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug verify stray on activate = true 2023-10-16T23:26:41.810 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.810 INFO:teuthology.orchestra.run.smithi033.stdout: osd open classes on start = true 2023-10-16T23:26:41.810 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug pg log writeout = true 2023-10-16T23:26:41.810 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.810 INFO:teuthology.orchestra.run.smithi033.stdout: osd deep scrub update digest min age = 30 2023-10-16T23:26:41.811 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.811 INFO:teuthology.orchestra.run.smithi033.stdout: osd map max advance = 10 2023-10-16T23:26:41.811 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.811 INFO:teuthology.orchestra.run.smithi033.stdout: journal zero on create = true 2023-10-16T23:26:41.811 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.812 INFO:teuthology.orchestra.run.smithi033.stdout: filestore ondisk finisher threads = 3 2023-10-16T23:26:41.812 INFO:teuthology.orchestra.run.smithi033.stdout: filestore apply finisher threads = 3 2023-10-16T23:26:41.812 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.812 INFO:teuthology.orchestra.run.smithi033.stdout: bdev debug aio = true 2023-10-16T23:26:41.812 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug misdirected ops = true 2023-10-16T23:26:41.812 INFO:teuthology.orchestra.run.smithi033.stdout: bdev async discard = True 2023-10-16T23:26:41.813 INFO:teuthology.orchestra.run.smithi033.stdout: bdev enable discard = True 2023-10-16T23:26:41.813 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore allocator = bitmap 2023-10-16T23:26:41.813 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore block size = 96636764160 2023-10-16T23:26:41.813 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore fsck on mount = True 2023-10-16T23:26:41.813 INFO:teuthology.orchestra.run.smithi033.stdout: debug bluefs = 1/20 2023-10-16T23:26:41.813 INFO:teuthology.orchestra.run.smithi033.stdout: debug bluestore = 1/20 2023-10-16T23:26:41.814 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2023-10-16T23:26:41.814 INFO:teuthology.orchestra.run.smithi033.stdout: debug osd = 20 2023-10-16T23:26:41.814 INFO:teuthology.orchestra.run.smithi033.stdout: debug rocksdb = 4/10 2023-10-16T23:26:41.814 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd backfillfull_ratio = 0.85 2023-10-16T23:26:41.814 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd full ratio = 0.9 2023-10-16T23:26:41.815 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd nearfull ratio = 0.8 2023-10-16T23:26:41.815 INFO:teuthology.orchestra.run.smithi033.stdout: osd failsafe full ratio = 0.95 2023-10-16T23:26:41.815 INFO:teuthology.orchestra.run.smithi033.stdout: osd objectstore = bluestore 2023-10-16T23:26:41.815 INFO:teuthology.orchestra.run.smithi033.stdout: osd op complaint time = 180 2023-10-16T23:26:41.815 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.815 INFO:teuthology.orchestra.run.smithi033.stdout:[mgr] 2023-10-16T23:26:41.816 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2023-10-16T23:26:41.816 INFO:teuthology.orchestra.run.smithi033.stdout: debug mgr = 20 2023-10-16T23:26:41.816 INFO:teuthology.orchestra.run.smithi033.stdout: debug mon = 20 2023-10-16T23:26:41.816 INFO:teuthology.orchestra.run.smithi033.stdout: debug auth = 20 2023-10-16T23:26:41.816 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min pgs per osd = 4 2023-10-16T23:26:41.817 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min bytes per osd = 10 2023-10-16T23:26:41.817 INFO:teuthology.orchestra.run.smithi033.stdout: mgr/telemetry/nag = false 2023-10-16T23:26:41.817 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.817 INFO:teuthology.orchestra.run.smithi033.stdout:[mon] 2023-10-16T23:26:41.817 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2023-10-16T23:26:41.817 INFO:teuthology.orchestra.run.smithi033.stdout: debug mon = 20 2023-10-16T23:26:41.818 INFO:teuthology.orchestra.run.smithi033.stdout: debug paxos = 20 2023-10-16T23:26:41.818 INFO:teuthology.orchestra.run.smithi033.stdout: debug auth = 20 2023-10-16T23:26:41.818 INFO:teuthology.orchestra.run.smithi033.stdout: mon data avail warn = 5 2023-10-16T23:26:41.818 INFO:teuthology.orchestra.run.smithi033.stdout: mon mgr mkfs grace = 240 2023-10-16T23:26:41.821 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min pgs per osd = 4 2023-10-16T23:26:41.821 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd reporter subtree level = osd 2023-10-16T23:26:41.822 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd prime pg temp = true 2023-10-16T23:26:41.822 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min bytes per osd = 10 2023-10-16T23:26:41.822 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.822 INFO:teuthology.orchestra.run.smithi033.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-16T23:26:41.822 INFO:teuthology.orchestra.run.smithi033.stdout: auth mon ticket ttl = 660 # 11m 2023-10-16T23:26:41.823 INFO:teuthology.orchestra.run.smithi033.stdout: auth service ticket ttl = 240 # 4m 2023-10-16T23:26:41.823 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.823 INFO:teuthology.orchestra.run.smithi033.stdout: # don't complain about insecure global_id in the test suite 2023-10-16T23:26:41.823 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-16T23:26:41.823 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-16T23:26:41.824 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.824 INFO:teuthology.orchestra.run.smithi033.stdout: # 1m isn't quite enough 2023-10-16T23:26:41.824 INFO:teuthology.orchestra.run.smithi033.stdout: mon_down_mkfs_grace = 2m 2023-10-16T23:26:41.824 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.824 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_filestore_osds = false 2023-10-16T23:26:41.824 INFO:teuthology.orchestra.run.smithi033.stdout: mon op complaint time = 120 2023-10-16T23:26:41.825 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-16T23:26:41.825 INFO:teuthology.orchestra.run.smithi033.stdout:[client] 2023-10-16T23:26:41.825 INFO:teuthology.orchestra.run.smithi033.stdout: rgw cache enabled = true 2023-10-16T23:26:41.825 INFO:teuthology.orchestra.run.smithi033.stdout: rgw enable ops log = true 2023-10-16T23:26:41.825 INFO:teuthology.orchestra.run.smithi033.stdout: rgw enable usage log = true 2023-10-16T23:26:41.826 INFO:teuthology.orchestra.run.smithi033.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-16T23:26:41.826 INFO:teuthology.orchestra.run.smithi033.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-16T23:26:41.826 INFO:teuthology.orchestra.run.smithi033.stdout: client mount timeout = 600 2023-10-16T23:26:41.826 INFO:teuthology.orchestra.run.smithi033.stdout: debug client = 20 2023-10-16T23:26:41.826 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2023-10-16T23:26:41.827 INFO:teuthology.orchestra.run.smithi033.stdout: rados mon op timeout = 900 2023-10-16T23:26:41.827 INFO:teuthology.orchestra.run.smithi033.stdout: rados osd op timeout = 900 2023-10-16T23:26:41.827 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.a] 2023-10-16T23:26:41.827 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.b] 2023-10-16T23:26:41.827 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.c] 2023-10-16T23:26:41.828 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.a] 2023-10-16T23:26:41.828 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.b] 2023-10-16T23:26:41.828 INFO:teuthology.orchestra.run.smithi033.stdout:[mds] 2023-10-16T23:26:41.828 INFO:teuthology.orchestra.run.smithi033.stdout: debug mds = 20 2023-10-16T23:26:41.828 INFO:teuthology.orchestra.run.smithi033.stdout: debug mds balancer = 20 2023-10-16T23:26:41.828 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2023-10-16T23:26:41.829 INFO:teuthology.orchestra.run.smithi033.stdout: mds debug frag = True 2023-10-16T23:26:41.829 INFO:teuthology.orchestra.run.smithi033.stdout: mds debug scatterstat = True 2023-10-16T23:26:41.829 INFO:teuthology.orchestra.run.smithi033.stdout: mds op complaint time = 180 2023-10-16T23:26:41.829 INFO:teuthology.orchestra.run.smithi033.stdout: mds verify scatter = True 2023-10-16T23:26:41.829 INFO:teuthology.orchestra.run.smithi033.stdout: osd op complaint time = 180 2023-10-16T23:26:41.830 INFO:teuthology.orchestra.run.smithi033.stdout: rados mon op timeout = 900 2023-10-16T23:26:41.830 INFO:teuthology.orchestra.run.smithi033.stdout: rados osd op timeout = 900 2023-10-16T23:26:41.830 INFO:teuthology.orchestra.run.smithi031.stdout:[global] 2023-10-16T23:26:41.830 INFO:teuthology.orchestra.run.smithi031.stdout: chdir = "" 2023-10-16T23:26:41.830 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-16T23:26:41.831 INFO:teuthology.orchestra.run.smithi031.stdout: auth supported = cephx 2023-10-16T23:26:41.831 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.831 INFO:teuthology.orchestra.run.smithi031.stdout: filestore xattr use omap = true 2023-10-16T23:26:41.831 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.831 INFO:teuthology.orchestra.run.smithi031.stdout: mon clock drift allowed = 1.000 2023-10-16T23:26:41.832 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.832 INFO:teuthology.orchestra.run.smithi031.stdout: osd crush chooseleaf type = 0 2023-10-16T23:26:41.832 INFO:teuthology.orchestra.run.smithi031.stdout: auth debug = true 2023-10-16T23:26:41.832 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.832 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on old message = true 2023-10-16T23:26:41.832 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on bug = true 2023-10-16T23:26:41.833 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.833 INFO:teuthology.orchestra.run.smithi031.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-16T23:26:41.833 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn max object skew = 0 2023-10-16T23:26:41.833 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.833 INFO:teuthology.orchestra.run.smithi031.stdout: # disable pg_autoscaler by default for new pools 2023-10-16T23:26:41.834 INFO:teuthology.orchestra.run.smithi031.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-16T23:26:41.834 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.834 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default size = 2 2023-10-16T23:26:41.834 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.834 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow primary affinity = true 2023-10-16T23:26:41.835 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow pg remap = true 2023-10-16T23:26:41.835 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on legacy crush tunables = false 2023-10-16T23:26:41.835 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on crush straw calc version zero = false 2023-10-16T23:26:41.835 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on no sortbitwise = false 2023-10-16T23:26:41.835 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on osd down out interval zero = false 2023-10-16T23:26:41.835 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on too few osds = false 2023-10-16T23:26:41.836 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-16T23:26:41.836 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-16T23:26:41.836 INFO:teuthology.orchestra.run.smithi031.stdout: mon_allow_pool_size_one = true 2023-10-16T23:26:41.836 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.836 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-16T23:26:41.837 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.837 INFO:teuthology.orchestra.run.smithi031.stdout: osd default data pool replay window = 5 2023-10-16T23:26:41.837 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.837 INFO:teuthology.orchestra.run.smithi031.stdout: mon allow pool delete = true 2023-10-16T23:26:41.837 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.837 INFO:teuthology.orchestra.run.smithi031.stdout: mon cluster log file level = debug 2023-10-16T23:26:41.838 INFO:teuthology.orchestra.run.smithi031.stdout: debug asserts on shutdown = true 2023-10-16T23:26:41.838 INFO:teuthology.orchestra.run.smithi031.stdout: mon health detail to clog = false 2023-10-16T23:26:41.838 INFO:teuthology.orchestra.run.smithi031.stdout: mon host = "172.21.15.12,172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790]" 2023-10-16T23:26:41.838 INFO:teuthology.orchestra.run.smithi031.stdout: fsid = 0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51 2023-10-16T23:26:41.838 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.839 INFO:teuthology.orchestra.run.smithi031.stdout:[osd] 2023-10-16T23:26:41.839 INFO:teuthology.orchestra.run.smithi031.stdout: osd journal size = 100 2023-10-16T23:26:41.839 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.839 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub load threshold = 5.0 2023-10-16T23:26:41.839 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub max interval = 600 2023-10-16T23:26:41.839 INFO:teuthology.orchestra.run.smithi031.stdout: osd mclock profile = high_recovery_ops 2023-10-16T23:26:41.840 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.840 INFO:teuthology.orchestra.run.smithi031.stdout: osd recover clone overlap = true 2023-10-16T23:26:41.840 INFO:teuthology.orchestra.run.smithi031.stdout: osd recovery max chunk = 1048576 2023-10-16T23:26:41.840 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.840 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug shutdown = true 2023-10-16T23:26:41.841 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug op order = true 2023-10-16T23:26:41.841 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug verify stray on activate = true 2023-10-16T23:26:41.841 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.841 INFO:teuthology.orchestra.run.smithi031.stdout: osd open classes on start = true 2023-10-16T23:26:41.841 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug pg log writeout = true 2023-10-16T23:26:41.842 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.842 INFO:teuthology.orchestra.run.smithi031.stdout: osd deep scrub update digest min age = 30 2023-10-16T23:26:41.842 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.842 INFO:teuthology.orchestra.run.smithi031.stdout: osd map max advance = 10 2023-10-16T23:26:41.842 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.843 INFO:teuthology.orchestra.run.smithi031.stdout: journal zero on create = true 2023-10-16T23:26:41.843 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.843 INFO:teuthology.orchestra.run.smithi031.stdout: filestore ondisk finisher threads = 3 2023-10-16T23:26:41.843 INFO:teuthology.orchestra.run.smithi031.stdout: filestore apply finisher threads = 3 2023-10-16T23:26:41.843 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.843 INFO:teuthology.orchestra.run.smithi031.stdout: bdev debug aio = true 2023-10-16T23:26:41.844 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug misdirected ops = true 2023-10-16T23:26:41.844 INFO:teuthology.orchestra.run.smithi031.stdout: bdev async discard = True 2023-10-16T23:26:41.844 INFO:teuthology.orchestra.run.smithi031.stdout: bdev enable discard = True 2023-10-16T23:26:41.844 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore allocator = bitmap 2023-10-16T23:26:41.844 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore block size = 96636764160 2023-10-16T23:26:41.845 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore fsck on mount = True 2023-10-16T23:26:41.845 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluefs = 1/20 2023-10-16T23:26:41.845 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluestore = 1/20 2023-10-16T23:26:41.845 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-10-16T23:26:41.845 INFO:teuthology.orchestra.run.smithi031.stdout: debug osd = 20 2023-10-16T23:26:41.846 INFO:teuthology.orchestra.run.smithi031.stdout: debug rocksdb = 4/10 2023-10-16T23:26:41.846 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd backfillfull_ratio = 0.85 2023-10-16T23:26:41.846 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd full ratio = 0.9 2023-10-16T23:26:41.846 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd nearfull ratio = 0.8 2023-10-16T23:26:41.846 INFO:teuthology.orchestra.run.smithi031.stdout: osd failsafe full ratio = 0.95 2023-10-16T23:26:41.847 INFO:teuthology.orchestra.run.smithi031.stdout: osd objectstore = bluestore 2023-10-16T23:26:41.847 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2023-10-16T23:26:41.847 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.847 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr] 2023-10-16T23:26:41.847 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-10-16T23:26:41.847 INFO:teuthology.orchestra.run.smithi031.stdout: debug mgr = 20 2023-10-16T23:26:41.848 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2023-10-16T23:26:41.848 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2023-10-16T23:26:41.848 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2023-10-16T23:26:41.848 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2023-10-16T23:26:41.848 INFO:teuthology.orchestra.run.smithi031.stdout: mgr/telemetry/nag = false 2023-10-16T23:26:41.849 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.849 INFO:teuthology.orchestra.run.smithi031.stdout:[mon] 2023-10-16T23:26:41.849 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-10-16T23:26:41.849 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2023-10-16T23:26:41.849 INFO:teuthology.orchestra.run.smithi031.stdout: debug paxos = 20 2023-10-16T23:26:41.850 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2023-10-16T23:26:41.850 INFO:teuthology.orchestra.run.smithi031.stdout: mon data avail warn = 5 2023-10-16T23:26:41.850 INFO:teuthology.orchestra.run.smithi031.stdout: mon mgr mkfs grace = 240 2023-10-16T23:26:41.850 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2023-10-16T23:26:41.850 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd reporter subtree level = osd 2023-10-16T23:26:41.850 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd prime pg temp = true 2023-10-16T23:26:41.851 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2023-10-16T23:26:41.851 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.851 INFO:teuthology.orchestra.run.smithi031.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-16T23:26:41.851 INFO:teuthology.orchestra.run.smithi031.stdout: auth mon ticket ttl = 660 # 11m 2023-10-16T23:26:41.851 INFO:teuthology.orchestra.run.smithi031.stdout: auth service ticket ttl = 240 # 4m 2023-10-16T23:26:41.852 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.852 INFO:teuthology.orchestra.run.smithi031.stdout: # don't complain about insecure global_id in the test suite 2023-10-16T23:26:41.852 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-16T23:26:41.852 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-16T23:26:41.852 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.852 INFO:teuthology.orchestra.run.smithi031.stdout: # 1m isn't quite enough 2023-10-16T23:26:41.853 INFO:teuthology.orchestra.run.smithi031.stdout: mon_down_mkfs_grace = 2m 2023-10-16T23:26:41.853 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.853 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_filestore_osds = false 2023-10-16T23:26:41.853 INFO:teuthology.orchestra.run.smithi031.stdout: mon op complaint time = 120 2023-10-16T23:26:41.853 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-16T23:26:41.854 INFO:teuthology.orchestra.run.smithi031.stdout:[client] 2023-10-16T23:26:41.854 INFO:teuthology.orchestra.run.smithi031.stdout: rgw cache enabled = true 2023-10-16T23:26:41.854 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable ops log = true 2023-10-16T23:26:41.854 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable usage log = true 2023-10-16T23:26:41.854 INFO:teuthology.orchestra.run.smithi031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-16T23:26:41.855 INFO:teuthology.orchestra.run.smithi031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-16T23:26:41.855 INFO:teuthology.orchestra.run.smithi031.stdout: client mount timeout = 600 2023-10-16T23:26:41.855 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2023-10-16T23:26:41.855 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-10-16T23:26:41.855 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2023-10-16T23:26:41.855 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2023-10-16T23:26:41.856 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.a] 2023-10-16T23:26:41.856 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.b] 2023-10-16T23:26:41.856 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.c] 2023-10-16T23:26:41.856 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2023-10-16T23:26:41.856 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2023-10-16T23:26:41.857 INFO:teuthology.orchestra.run.smithi031.stdout:[mds] 2023-10-16T23:26:41.857 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds = 20 2023-10-16T23:26:41.857 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds balancer = 20 2023-10-16T23:26:41.857 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-10-16T23:26:41.857 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug frag = True 2023-10-16T23:26:41.857 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug scatterstat = True 2023-10-16T23:26:41.858 INFO:teuthology.orchestra.run.smithi031.stdout: mds op complaint time = 180 2023-10-16T23:26:41.858 INFO:teuthology.orchestra.run.smithi031.stdout: mds verify scatter = True 2023-10-16T23:26:41.858 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2023-10-16T23:26:41.858 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2023-10-16T23:26:41.858 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2023-10-16T23:26:41.859 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-16T23:26:41.859 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-16T23:26:41.912 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-16T23:26:41.912 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-16T23:26:41.913 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-16T23:26:41.918 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-16T23:26:41.919 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-16T23:26:41.966 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi012.front.sepia.ceph.com 2023-10-16T23:26:41.967 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-16T23:26:41.967 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-16T23:26:41.967 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T23:26:42.031 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-16T23:26:42.032 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-16T23:26:42.078 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi031.front.sepia.ceph.com 2023-10-16T23:26:42.078 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-16T23:26:42.079 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-16T23:26:42.079 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T23:26:42.100 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-16T23:26:42.101 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-16T23:26:42.147 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi033.front.sepia.ceph.com 2023-10-16T23:26:42.148 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-16T23:26:42.148 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-16T23:26:42.148 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T23:26:42.173 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-16T23:26:42.174 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-16T23:26:42.221 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi072.front.sepia.ceph.com 2023-10-16T23:26:42.221 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-16T23:26:42.222 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-16T23:26:42.222 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T23:26:42.245 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-16T23:26:42.245 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-16T23:26:42.294 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi138.front.sepia.ceph.com 2023-10-16T23:26:42.294 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-10-16T23:26:42.295 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-16T23:26:42.295 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T23:26:42.319 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-10-16T23:26:42.319 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-16T23:26:42.364 INFO:tasks.ceph:Setting up mon nodes... 2023-10-16T23:26:42.365 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-16T23:26:42.365 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-16T23:26:42.411 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-16T23:26:42.415 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-16T23:26:42.461 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-16T23:26:42.481 INFO:tasks.ceph:Setting up mds nodes... 2023-10-16T23:26:42.481 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-16T23:26:42.526 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-16T23:26:42.529 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-16T23:26:42.580 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-16T23:26:42.625 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-16T23:26:42.627 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-16T23:26:42.681 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-16T23:26:42.681 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-16T23:26:42.720 INFO:teuthology.orchestra.run.smithi033.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-16T23:26:42.740 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-16T23:26:42.778 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-16T23:26:42.802 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-16T23:26:42.838 INFO:teuthology.orchestra.run.smithi138.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-16T23:26:42.870 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-16T23:26:42.871 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-16T23:26:42.871 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-16T23:26:42.886 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T23:26:42.886 INFO:tasks.ceph:role: osd.0 2023-10-16T23:26:42.887 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-16T23:26:42.887 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-16T23:26:42.954 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T23:26:42.954 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T23:26:42.955 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T23:26:42.955 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T23:26:42.955 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T23:26:42.955 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2023-10-16T23:26:42.956 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T23:26:42.956 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T23:26:42.956 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T23:26:42.956 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T23:26:43.409 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2023-10-16T23:26:43.411 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2023-10-16T23:26:43.411 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-16T23:26:43.517 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-16T23:26:43.528 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T23:26:43.529 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: /sbin/restorecon: command not found 2023-10-16T23:26:43.529 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-16T23:26:43.586 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T23:26:43.587 INFO:tasks.ceph:role: osd.1 2023-10-16T23:26:43.587 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-16T23:26:43.588 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-16T23:26:43.654 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T23:26:43.654 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T23:26:43.655 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T23:26:43.655 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T23:26:43.655 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T23:26:43.655 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2023-10-16T23:26:43.656 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T23:26:43.656 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T23:26:43.656 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T23:26:43.656 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T23:26:44.119 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2023-10-16T23:26:44.121 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2023-10-16T23:26:44.121 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-16T23:26:44.268 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-16T23:26:44.280 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: /sbin/restorecon: command not found 2023-10-16T23:26:44.281 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T23:26:44.281 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-16T23:26:44.338 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T23:26:44.338 INFO:tasks.ceph:role: osd.2 2023-10-16T23:26:44.338 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-16T23:26:44.339 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-16T23:26:44.401 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T23:26:44.402 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T23:26:44.402 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T23:26:44.402 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T23:26:44.403 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T23:26:44.403 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2023-10-16T23:26:44.403 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T23:26:44.403 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T23:26:44.403 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T23:26:44.404 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T23:26:44.885 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2023-10-16T23:26:44.887 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2023-10-16T23:26:44.888 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-16T23:26:45.031 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-16T23:26:45.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T23:26:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: /sbin/restorecon: command not found 2023-10-16T23:26:45.044 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-16T23:26:45.101 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T23:26:45.101 INFO:tasks.ceph:role: osd.3 2023-10-16T23:26:45.102 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-16T23:26:45.102 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-16T23:26:45.165 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T23:26:45.165 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T23:26:45.165 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T23:26:45.165 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T23:26:45.166 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T23:26:45.166 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2023-10-16T23:26:45.166 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T23:26:45.166 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T23:26:45.166 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T23:26:45.167 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T23:26:45.590 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2023-10-16T23:26:45.591 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2023-10-16T23:26:45.592 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-16T23:26:45.685 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-16T23:26:45.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T23:26:45.695 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: /sbin/restorecon: command not found 2023-10-16T23:26:45.695 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T23:26:45.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:26:45.797+0000 7fcd1fc98640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-16T23:26:45.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:26:45.805+0000 7fcd1fc98640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-16T23:26:45.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:26:45.805+0000 7fcd1fc98640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-16T23:26:45.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:26:45.805+0000 7fcd1fc98640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-16T23:26:45.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:26:45.805+0000 7fcd1fc98640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-16T23:26:45.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:26:45.805+0000 7fcd1fc98640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-16T23:26:48.827 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-16T23:26:48.841 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T23:26:48.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:26:48.925+0000 7f9413f15640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-16T23:26:48.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:26:48.925+0000 7f9413f15640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-16T23:26:48.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:26:48.925+0000 7f9413f15640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-16T23:26:48.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:26:48.925+0000 7f9413f15640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-16T23:26:48.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:26:48.925+0000 7f9413f15640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-16T23:26:48.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:26:48.925+0000 7f9413f15640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-16T23:26:51.934 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-16T23:26:51.991 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T23:26:52.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:26:52.073+0000 7f67a7fbf640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-16T23:26:52.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:26:52.073+0000 7f67a7fbf640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-16T23:26:52.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:26:52.073+0000 7f67a7fbf640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-16T23:26:52.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:26:52.073+0000 7f67a7fbf640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-16T23:26:52.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:26:52.073+0000 7f67a7fbf640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-16T23:26:52.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:26:52.073+0000 7f67a7fbf640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-16T23:26:55.077 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-16T23:26:55.135 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T23:26:55.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:26:55.217+0000 7fba2f760640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-16T23:26:55.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:26:55.217+0000 7fba2f760640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-16T23:26:55.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:26:55.217+0000 7fba2f760640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-16T23:26:55.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:26:55.217+0000 7fba2f760640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-16T23:26:55.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:26:55.217+0000 7fba2f760640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-16T23:26:55.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:26:55.217+0000 7fba2f760640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-16T23:26:58.214 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-16T23:26:58.271 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-16T23:26:58.286 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T23:26:58.287 INFO:tasks.ceph:role: osd.4 2023-10-16T23:26:58.287 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com 2023-10-16T23:26:58.287 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-16T23:26:58.355 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T23:26:58.355 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T23:26:58.356 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T23:26:58.356 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T23:26:58.356 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T23:26:58.357 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2023-10-16T23:26:58.357 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T23:26:58.358 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T23:26:58.358 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T23:26:58.358 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T23:26:58.809 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2023-10-16T23:26:58.811 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2023-10-16T23:26:58.812 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-16T23:26:58.905 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-16T23:26:58.915 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T23:26:58.916 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2023-10-16T23:26:58.916 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-16T23:26:58.968 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T23:26:58.968 INFO:tasks.ceph:role: osd.5 2023-10-16T23:26:58.969 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com 2023-10-16T23:26:58.969 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-16T23:26:59.030 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T23:26:59.030 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T23:26:59.030 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T23:26:59.031 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T23:26:59.031 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T23:26:59.031 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2023-10-16T23:26:59.031 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T23:26:59.032 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T23:26:59.032 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T23:26:59.032 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T23:26:59.499 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2023-10-16T23:26:59.501 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2023-10-16T23:26:59.501 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-16T23:26:59.631 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-16T23:26:59.641 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2023-10-16T23:26:59.642 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T23:26:59.642 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-16T23:26:59.696 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T23:26:59.697 INFO:tasks.ceph:role: osd.6 2023-10-16T23:26:59.697 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com 2023-10-16T23:26:59.697 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-16T23:26:59.758 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T23:26:59.758 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T23:26:59.758 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T23:26:59.759 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T23:26:59.759 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T23:26:59.759 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2023-10-16T23:26:59.759 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T23:26:59.760 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T23:26:59.760 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T23:26:59.760 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T23:27:00.239 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2023-10-16T23:27:00.241 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2023-10-16T23:27:00.241 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-16T23:27:00.394 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-16T23:27:00.406 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T23:27:00.407 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2023-10-16T23:27:00.408 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-16T23:27:00.463 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T23:27:00.463 INFO:tasks.ceph:role: osd.7 2023-10-16T23:27:00.464 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com 2023-10-16T23:27:00.464 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-16T23:27:00.526 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T23:27:00.527 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T23:27:00.527 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T23:27:00.527 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-16T23:27:00.527 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T23:27:00.527 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2023-10-16T23:27:00.528 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T23:27:00.528 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-16T23:27:00.528 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T23:27:00.528 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T23:27:00.961 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2023-10-16T23:27:00.963 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2023-10-16T23:27:00.964 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-16T23:27:01.054 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-16T23:27:01.109 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2023-10-16T23:27:01.110 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T23:27:01.110 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T23:27:01.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:01.310+0000 7f5552463640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-16T23:27:01.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:01.314+0000 7f5552463640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-16T23:27:01.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:01.314+0000 7f5552463640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-16T23:27:01.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:01.314+0000 7f5552463640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-16T23:27:01.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:01.314+0000 7f5552463640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-16T23:27:01.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:01.314+0000 7f5552463640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-16T23:27:04.333 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-16T23:27:04.347 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T23:27:04.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:04.434+0000 7f22e7301640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-16T23:27:04.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:04.434+0000 7f22e7301640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-16T23:27:04.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:04.434+0000 7f22e7301640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-16T23:27:04.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:04.434+0000 7f22e7301640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-16T23:27:04.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:04.434+0000 7f22e7301640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-16T23:27:04.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:04.434+0000 7f22e7301640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-16T23:27:07.435 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-16T23:27:07.492 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T23:27:07.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:07.569+0000 7f982f7fc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-16T23:27:07.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:07.569+0000 7f982f7fc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-16T23:27:07.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:07.569+0000 7f982f7fc640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-16T23:27:07.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:07.569+0000 7f982f7fc640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-16T23:27:07.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:07.569+0000 7f982f7fc640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-16T23:27:07.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:07.573+0000 7f982f7fc640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-16T23:27:09.920 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:27:09.923 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:27:09.925 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:27:09.929 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:27:09.932 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:27:10.604 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-16T23:27:10.619 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T23:27:10.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:10.697+0000 7fc6b4eb5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-16T23:27:10.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:10.697+0000 7fc6b4eb5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-16T23:27:10.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:10.697+0000 7fc6b4eb5640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-16T23:27:10.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:10.697+0000 7fc6b4eb5640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-16T23:27:10.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:10.697+0000 7fc6b4eb5640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-16T23:27:10.703 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:10.701+0000 7fc6b4eb5640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-16T23:27:13.723 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-16T23:27:13.780 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-16T23:27:13.781 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-16T23:27:13.781 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-16T23:27:13.795 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-16T23:27:13.796 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-16T23:27:13.850 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-16T23:27:13.850 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-16T23:27:13.905 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-16T23:27:13.905 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-16T23:27:13.961 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-16T23:27:13.961 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-16T23:27:14.022 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-16T23:27:14.022 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-16T23:27:14.081 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-16T23:27:14.082 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-16T23:27:14.096 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-16T23:27:14.096 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-16T23:27:14.151 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-16T23:27:14.151 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-16T23:27:14.211 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-16T23:27:14.211 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-16T23:27:14.267 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-16T23:27:14.268 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-16T23:27:14.323 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-16T23:27:14.324 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-16T23:27:14.379 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-16T23:27:14.379 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-16T23:27:14.386 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-16T23:27:14.386 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-16T23:27:14.392 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-10-16T23:27:14.393 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-16T23:27:14.399 INFO:tasks.ceph:Adding keys to all mons... 2023-10-16T23:27:14.399 DEBUG:teuthology.orchestra.run.smithi012:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-16T23:27:14.402 DEBUG:teuthology.orchestra.run.smithi031:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-16T23:27:14.426 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr.y] 2023-10-16T23:27:14.426 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCyxi1l9tONGBAA1HmdQW/2x97bZBcuZl41/w== 2023-10-16T23:27:14.426 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a] 2023-10-16T23:27:14.426 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCyxi1l2rdhHxAAkJRJVQuNlEaRUsEVR75SDg== 2023-10-16T23:27:14.427 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.0] 2023-10-16T23:27:14.427 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQC1xi1lRG/ILxAA2pKW/DATb1oC1nMHfptt0A== 2023-10-16T23:27:14.427 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.1] 2023-10-16T23:27:14.427 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQC4xi1lV7c0NxAAwNK0WYMphwDVdKnXLcTLSQ== 2023-10-16T23:27:14.427 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.2] 2023-10-16T23:27:14.428 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQC8xi1lQllwBBAA5Hc0XFZZ5do+vII64Ms2fg== 2023-10-16T23:27:14.428 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.3] 2023-10-16T23:27:14.428 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQC/xi1lNn4MDRAAXBl3HbUL7MO+2u5ls61uuw== 2023-10-16T23:27:14.428 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr.x] 2023-10-16T23:27:14.429 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCyxi1l0B6WGxAATVbecd1tj2KM0GcioBskLA== 2023-10-16T23:27:14.429 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b] 2023-10-16T23:27:14.429 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCyxi1lCtlYJRAAm/BlDp9NjQ9BwDQHd/zyeQ== 2023-10-16T23:27:14.429 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.4] 2023-10-16T23:27:14.429 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDFxi1l1GTHEhAAzIraluwxo1lFY9ZGY5SzJA== 2023-10-16T23:27:14.430 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.5] 2023-10-16T23:27:14.430 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDIxi1ldRIDGhAANE+fQCMEK4LYrl+T9MTz3g== 2023-10-16T23:27:14.430 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.6] 2023-10-16T23:27:14.430 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDLxi1lSeBGIhAAfXpZNnHTkQBGCfpzTSRA/Q== 2023-10-16T23:27:14.430 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.7] 2023-10-16T23:27:14.431 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDOxi1lfvTnKRAAUnEB69ZjH3EZ/45wlV8VMA== 2023-10-16T23:27:14.431 INFO:teuthology.orchestra.run.smithi012.stdout:[client.0] 2023-10-16T23:27:14.431 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCyxi1l5GEDKxAAPs9XfmZPAUhZuC8a7hXyUQ== 2023-10-16T23:27:14.431 INFO:teuthology.orchestra.run.smithi012.stdout:[client.1] 2023-10-16T23:27:14.431 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCyxi1lowhqLhAAHL3jIMJVgyFOetJ+0c6iuQ== 2023-10-16T23:27:14.432 INFO:teuthology.orchestra.run.smithi012.stdout:[client.2] 2023-10-16T23:27:14.432 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCyxi1l0t8sMhAAUMm7vk1YN+HoWg/QotHPSA== 2023-10-16T23:27:14.434 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.y] 2023-10-16T23:27:14.434 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCyxi1l9tONGBAA1HmdQW/2x97bZBcuZl41/w== 2023-10-16T23:27:14.434 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2023-10-16T23:27:14.434 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCyxi1l2rdhHxAAkJRJVQuNlEaRUsEVR75SDg== 2023-10-16T23:27:14.434 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.0] 2023-10-16T23:27:14.435 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQC1xi1lRG/ILxAA2pKW/DATb1oC1nMHfptt0A== 2023-10-16T23:27:14.435 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.1] 2023-10-16T23:27:14.435 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQC4xi1lV7c0NxAAwNK0WYMphwDVdKnXLcTLSQ== 2023-10-16T23:27:14.435 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.2] 2023-10-16T23:27:14.435 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQC8xi1lQllwBBAA5Hc0XFZZ5do+vII64Ms2fg== 2023-10-16T23:27:14.436 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.3] 2023-10-16T23:27:14.436 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQC/xi1lNn4MDRAAXBl3HbUL7MO+2u5ls61uuw== 2023-10-16T23:27:14.436 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.x] 2023-10-16T23:27:14.436 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCyxi1l0B6WGxAATVbecd1tj2KM0GcioBskLA== 2023-10-16T23:27:14.436 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2023-10-16T23:27:14.437 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCyxi1lCtlYJRAAm/BlDp9NjQ9BwDQHd/zyeQ== 2023-10-16T23:27:14.437 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.4] 2023-10-16T23:27:14.437 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDFxi1l1GTHEhAAzIraluwxo1lFY9ZGY5SzJA== 2023-10-16T23:27:14.437 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.5] 2023-10-16T23:27:14.437 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDIxi1ldRIDGhAANE+fQCMEK4LYrl+T9MTz3g== 2023-10-16T23:27:14.438 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.6] 2023-10-16T23:27:14.438 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDLxi1lSeBGIhAAfXpZNnHTkQBGCfpzTSRA/Q== 2023-10-16T23:27:14.438 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.7] 2023-10-16T23:27:14.438 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDOxi1lfvTnKRAAUnEB69ZjH3EZ/45wlV8VMA== 2023-10-16T23:27:14.439 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2023-10-16T23:27:14.439 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCyxi1l5GEDKxAAPs9XfmZPAUhZuC8a7hXyUQ== 2023-10-16T23:27:14.439 INFO:teuthology.orchestra.run.smithi031.stdout:[client.1] 2023-10-16T23:27:14.439 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCyxi1lowhqLhAAHL3jIMJVgyFOetJ+0c6iuQ== 2023-10-16T23:27:14.439 INFO:teuthology.orchestra.run.smithi031.stdout:[client.2] 2023-10-16T23:27:14.440 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCyxi1l0t8sMhAAUMm7vk1YN+HoWg/QotHPSA== 2023-10-16T23:27:14.441 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T23:27:14.479 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T23:27:14.529 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T23:27:14.532 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T23:27:14.618 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T23:27:14.621 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T23:27:14.701 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T23:27:14.707 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T23:27:14.787 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T23:27:14.791 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T23:27:14.872 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T23:27:14.875 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T23:27:14.960 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T23:27:14.962 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T23:27:15.006 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T23:27:15.009 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T23:27:15.095 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T23:27:15.098 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T23:27:15.138 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T23:27:15.183 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T23:27:15.228 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T23:27:15.230 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T23:27:15.311 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T23:27:15.315 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T23:27:15.398 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T23:27:15.401 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T23:27:15.486 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T23:27:15.488 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T23:27:15.535 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T23:27:15.538 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T23:27:15.624 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-16T23:27:15.624 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-16T23:27:15.635 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T23:27:15.726 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-16T23:27:15.738 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-16T23:27:15.753 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T23:27:15.856 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-16T23:27:15.868 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-16T23:27:15.921 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T23:27:16.019 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-16T23:27:16.029 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-16T23:27:16.032 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-16T23:27:16.075 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-16T23:27:16.077 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-16T23:27:16.078 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-16T23:27:16.080 INFO:tasks.ceph.mon.a:Started 2023-10-16T23:27:16.081 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-16T23:27:16.081 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-16T23:27:16.120 INFO:tasks.ceph.mon.b:Started 2023-10-16T23:27:16.121 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-16T23:27:16.121 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-16T23:27:16.123 INFO:tasks.ceph.mon.c:Started 2023-10-16T23:27:16.123 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-16T23:27:16.123 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-16T23:27:16.124 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-16T23:27:16.126 INFO:tasks.ceph.mgr.y:Started 2023-10-16T23:27:16.127 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-16T23:27:16.127 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-16T23:27:16.129 INFO:tasks.ceph.mgr.x:Started 2023-10-16T23:27:16.130 INFO:tasks.ceph:Setting crush tunables to default 2023-10-16T23:27:16.130 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd crush tunables default 2023-10-16T23:27:16.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.248+0000 7ffaffdd6640 1 Processor -- start 2023-10-16T23:27:16.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.248+0000 7ffaffdd6640 1 -- start start 2023-10-16T23:27:16.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.248+0000 7ffaffdd6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf806e6d0 0x7ffaf814ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:16.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.248+0000 7ffaffdd6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffaf80705d0 0x7ffaf80c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:16.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.248+0000 7ffaffdd6640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf806f130 con 0x7ffaf814eba0 2023-10-16T23:27:16.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.248+0000 7ffaffdd6640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf8070da0 con 0x7ffaf80705d0 2023-10-16T23:27:16.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.248+0000 7ffaffdd6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf80b86f0 con 0x7ffaf806e6d0 2023-10-16T23:27:16.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.248+0000 7ffafe373640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffaf80705d0 0x7ffaf80c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:16.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.248+0000 7ffafe373640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffaf80705d0 0x7ffaf80c1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53928/0 (socket says 172.21.15.12:53928) 2023-10-16T23:27:16.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.248+0000 7ffafe373640 1 -- 172.21.15.12:0/797946361 learned_addr learned my addr 172.21.15.12:0/797946361 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:16.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.248+0000 7ffafd371640 1 --2- 172.21.15.12:0/797946361 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf806e6d0 0x7ffaf814ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:16.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.248+0000 7ffafe373640 1 -- 172.21.15.12:0/797946361 >> v2:172.21.15.12:3300/0 conn(0x7ffaf80705d0 msgr2=0x7ffaf80c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-16T23:27:16.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.248+0000 7ffafe373640 1 -- 172.21.15.12:0/797946361 >> v2:172.21.15.12:3300/0 conn(0x7ffaf80705d0 msgr2=0x7ffaf80c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T23:27:16.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.248+0000 7ffafe373640 1 --2- 172.21.15.12:0/797946361 >> v2:172.21.15.12:3300/0 conn(0x7ffaf80705d0 0x7ffaf80c1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T23:27:16.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.248+0000 7ffafe373640 1 --2- 172.21.15.12:0/797946361 >> v2:172.21.15.12:3300/0 conn(0x7ffaf80705d0 0x7ffaf80c1c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T23:27:16.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.248+0000 7ffafd371640 1 -- 172.21.15.12:0/797946361 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf806e6d0 msgr2=0x7ffaf814ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T23:27:16.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.248+0000 7ffafd371640 1 -- 172.21.15.12:0/797946361 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf806e6d0 msgr2=0x7ffaf814ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T23:27:16.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.248+0000 7ffafd371640 1 --2- 172.21.15.12:0/797946361 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf806e6d0 0x7ffaf814ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T23:27:16.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.248+0000 7ffafd371640 1 --2- 172.21.15.12:0/797946361 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf806e6d0 0x7ffaf814ef80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T23:27:16.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.452+0000 7ffafe373640 1 --2- 172.21.15.12:0/797946361 >> v2:172.21.15.12:3300/0 conn(0x7ffaf80705d0 0x7ffaf80c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:16.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.452+0000 7ffafd371640 1 --2- 172.21.15.12:0/797946361 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf806e6d0 0x7ffaf814ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:16.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.452+0000 7ffafe373640 1 -- 172.21.15.12:0/797946361 >> v2:172.21.15.12:3300/0 conn(0x7ffaf80705d0 msgr2=0x7ffaf80c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T23:27:16.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.452+0000 7ffafe373640 1 -- 172.21.15.12:0/797946361 >> v2:172.21.15.12:3300/0 conn(0x7ffaf80705d0 msgr2=0x7ffaf80c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T23:27:16.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.452+0000 7ffafe373640 1 --2- 172.21.15.12:0/797946361 >> v2:172.21.15.12:3300/0 conn(0x7ffaf80705d0 0x7ffaf80c1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T23:27:16.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.452+0000 7ffafe373640 1 --2- 172.21.15.12:0/797946361 >> v2:172.21.15.12:3300/0 conn(0x7ffaf80705d0 0x7ffaf80c1c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T23:27:16.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.452+0000 7ffafd371640 1 -- 172.21.15.12:0/797946361 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf806e6d0 msgr2=0x7ffaf814ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-16T23:27:16.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.452+0000 7ffafd371640 1 -- 172.21.15.12:0/797946361 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf806e6d0 msgr2=0x7ffaf814ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T23:27:16.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.452+0000 7ffafd371640 1 --2- 172.21.15.12:0/797946361 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf806e6d0 0x7ffaf814ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T23:27:16.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.452+0000 7ffafd371640 1 --2- 172.21.15.12:0/797946361 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf806e6d0 0x7ffaf814ef80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T23:27:16.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.500+0000 7ffafcb70640 1 -- 172.21.15.12:0/797946361 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923476542 0 0) 0x7ffaf806f130 con 0x7ffaf814eba0 2023-10-16T23:27:16.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.500+0000 7ffafcb70640 1 -- 172.21.15.12:0/797946361 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffae4003530 con 0x7ffaf814eba0 2023-10-16T23:27:16.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.508+0000 7ffafcb70640 1 -- 172.21.15.12:0/797946361 <== mon.1 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2032277782 0 0) 0x7ffae4003530 con 0x7ffaf814eba0 2023-10-16T23:27:16.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.508+0000 7ffafcb70640 1 -- 172.21.15.12:0/797946361 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf806e6d0 msgr2=0x7ffaf814ef80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T23:27:16.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.508+0000 7ffafcb70640 1 --2- 172.21.15.12:0/797946361 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf806e6d0 0x7ffaf814ef80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:16.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.508+0000 7ffafcb70640 1 -- 172.21.15.12:0/797946361 >> v2:172.21.15.12:3300/0 conn(0x7ffaf80705d0 msgr2=0x7ffaf80c1c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T23:27:16.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.508+0000 7ffafcb70640 1 --2- 172.21.15.12:0/797946361 >> v2:172.21.15.12:3300/0 conn(0x7ffaf80705d0 0x7ffaf80c1c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:16.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.508+0000 7ffafcb70640 1 -- 172.21.15.12:0/797946361 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf80c1020 con 0x7ffaf814eba0 2023-10-16T23:27:16.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.508+0000 7ffafcb70640 1 -- 172.21.15.12:0/797946361 <== mon.1 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7ffae8001680 con 0x7ffaf814eba0 2023-10-16T23:27:16.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.508+0000 7ffafcb70640 1 -- 172.21.15.12:0/797946361 >> v1:172.21.15.31:6789/0 conn(0x7ffaf814eba0 legacy=0x7ffaf8152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:16.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.508+0000 7ffafcb70640 1 --2- 172.21.15.12:0/797946361 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf806e6d0 0x7ffae40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:16.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.508+0000 7ffafcb70640 1 --2- 172.21.15.12:0/797946361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffae4004030 0x7ffae40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:16.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.508+0000 7ffafcb70640 1 --2- 172.21.15.12:0/797946361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffae4004d10 0x7ffae4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:16.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.508+0000 7ffafcb70640 1 -- 172.21.15.12:0/797946361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf80b86f0 con 0x7ffae4004d10 2023-10-16T23:27:16.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.508+0000 7ffafcb70640 1 -- 172.21.15.12:0/797946361 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae400bbd0 con 0x7ffae4004030 2023-10-16T23:27:16.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.508+0000 7ffafcb70640 1 -- 172.21.15.12:0/797946361 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffae400bd90 con 0x7ffaf806e6d0 2023-10-16T23:27:16.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.508+0000 7ffafe373640 1 --2- 172.21.15.12:0/797946361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffae4004d10 0x7ffae4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:16.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.512+0000 7ffafdb72640 1 --2- 172.21.15.12:0/797946361 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf806e6d0 0x7ffae40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:16.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.512+0000 7ffafd371640 1 --2- 172.21.15.12:0/797946361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffae4004030 0x7ffae40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:16.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.512+0000 7ffafe373640 1 -- 172.21.15.12:0/797946361 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf806e6d0 msgr2=0x7ffae40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:16.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.512+0000 7ffafe373640 1 --2- 172.21.15.12:0/797946361 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf806e6d0 0x7ffae40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:16.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.512+0000 7ffafe373640 1 -- 172.21.15.12:0/797946361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffae4004030 msgr2=0x7ffae40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:16.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.512+0000 7ffafe373640 1 --2- 172.21.15.12:0/797946361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffae4004030 0x7ffae40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:16.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.512+0000 7ffafe373640 1 -- 172.21.15.12:0/797946361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae4003530 con 0x7ffae4004d10 2023-10-16T23:27:16.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.516+0000 7ffafe373640 1 --2- 172.21.15.12:0/797946361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffae4004d10 0x7ffae4005190 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0009ce0 tx=0x7ffaf001cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2d9ff9d40fe90b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:16.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.516+0000 7ffafcb70640 1 -- 172.21.15.12:0/797946361 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf00a5b30 con 0x7ffae4004d10 2023-10-16T23:27:16.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.516+0000 7ffafcb70640 1 -- 172.21.15.12:0/797946361 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf00a9070 con 0x7ffae4004d10 2023-10-16T23:27:16.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.516+0000 7ffafcb70640 1 -- 172.21.15.12:0/797946361 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf00af400 con 0x7ffae4004d10 2023-10-16T23:27:16.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.520+0000 7ffaffdd6640 1 -- 172.21.15.12:0/797946361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffae4004d10 msgr2=0x7ffae4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:16.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.520+0000 7ffaffdd6640 1 --2- 172.21.15.12:0/797946361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffae4004d10 0x7ffae4005190 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0009ce0 tx=0x7ffaf001cd50 comp rx=0 tx=0).stop 2023-10-16T23:27:16.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.520+0000 7ffafe373640 1 -- 172.21.15.12:0/797946361 reap_dead start 2023-10-16T23:27:16.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.520+0000 7ffaffdd6640 1 -- 172.21.15.12:0/797946361 shutdown_connections 2023-10-16T23:27:16.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.520+0000 7ffaffdd6640 1 -- 172.21.15.12:0/797946361 >> 172.21.15.12:0/797946361 conn(0x7ffaf806b800 msgr2=0x7ffaf806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:16.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.520+0000 7ffaffdd6640 1 -- 172.21.15.12:0/797946361 shutdown_connections 2023-10-16T23:27:16.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.520+0000 7ffaffdd6640 1 -- 172.21.15.12:0/797946361 wait complete. 2023-10-16T23:27:16.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.520+0000 7ffaffdd6640 1 Processor -- start 2023-10-16T23:27:16.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.520+0000 7ffaffdd6640 1 -- start start 2023-10-16T23:27:16.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.524+0000 7ffaffdd6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffae4004d10 0x7ffaf80c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:16.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.524+0000 7ffaffdd6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaf81e7520 0x7ffaf80c3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:16.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.524+0000 7ffaffdd6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf80c3d70 0x7ffaf81e7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:16.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.524+0000 7ffaffdd6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf8152260 con 0x7ffae4004d10 2023-10-16T23:27:16.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.524+0000 7ffaffdd6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf80c4b50 con 0x7ffaf81e7520 2023-10-16T23:27:16.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.524+0000 7ffaffdd6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf80c4e00 con 0x7ffaf80c3d70 2023-10-16T23:27:16.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.524+0000 7ffafdb72640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffae4004d10 0x7ffaf80c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:16.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.524+0000 7ffafdb72640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffae4004d10 0x7ffaf80c4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53974/0 (socket says 172.21.15.12:53974) 2023-10-16T23:27:16.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.524+0000 7ffafdb72640 1 -- 172.21.15.12:0/3621835657 learned_addr learned my addr 172.21.15.12:0/3621835657 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:16.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.524+0000 7ffafd371640 1 --2- 172.21.15.12:0/3621835657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaf81e7520 0x7ffaf80c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:16.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.524+0000 7ffafe373640 1 --2- 172.21.15.12:0/3621835657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf80c3d70 0x7ffaf81e7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:16.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.524+0000 7ffafdb72640 1 -- 172.21.15.12:0/3621835657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf80c3d70 msgr2=0x7ffaf81e7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:16.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.524+0000 7ffafdb72640 1 --2- 172.21.15.12:0/3621835657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf80c3d70 0x7ffaf81e7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:16.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.524+0000 7ffafdb72640 1 -- 172.21.15.12:0/3621835657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaf81e7520 msgr2=0x7ffaf80c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:16.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.524+0000 7ffafdb72640 1 --2- 172.21.15.12:0/3621835657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaf81e7520 0x7ffaf80c3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:16.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.524+0000 7ffafdb72640 1 -- 172.21.15.12:0/3621835657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf80c50e0 con 0x7ffae4004d10 2023-10-16T23:27:16.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.524+0000 7ffafd371640 1 --2- 172.21.15.12:0/3621835657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaf81e7520 0x7ffaf80c3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T23:27:16.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.524+0000 7ffafdb72640 1 --2- 172.21.15.12:0/3621835657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffae4004d10 0x7ffaf80c4610 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffae800f800 tx=0x7ffae800fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:16.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.524+0000 7ffaee7fc640 1 -- 172.21.15.12:0/3621835657 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae80052e0 con 0x7ffae4004d10 2023-10-16T23:27:16.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.524+0000 7ffaee7fc640 1 -- 172.21.15.12:0/3621835657 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae8005440 con 0x7ffae4004d10 2023-10-16T23:27:16.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.524+0000 7ffaffdd6640 1 -- 172.21.15.12:0/3621835657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf80c2b40 con 0x7ffae4004d10 2023-10-16T23:27:16.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.524+0000 7ffaee7fc640 1 -- 172.21.15.12:0/3621835657 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae800d950 con 0x7ffae4004d10 2023-10-16T23:27:16.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.524+0000 7ffaffdd6640 1 -- 172.21.15.12:0/3621835657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf81e8150 con 0x7ffae4004d10 2023-10-16T23:27:16.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.524+0000 7ffaee7fc640 1 -- 172.21.15.12:0/3621835657 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ffae8003600 con 0x7ffae4004d10 2023-10-16T23:27:16.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.524+0000 7ffaee7fc640 1 -- 172.21.15.12:0/3621835657 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ffae801d4a0 con 0x7ffae4004d10 2023-10-16T23:27:16.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.528+0000 7ffaffdd6640 1 -- 172.21.15.12:0/3621835657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf80c5320 con 0x7ffae4004d10 2023-10-16T23:27:16.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.532+0000 7ffaee7fc640 1 -- 172.21.15.12:0/3621835657 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7ffae8003a90 con 0x7ffae4004d10 2023-10-16T23:27:16.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.596+0000 7ffaffdd6640 1 -- 172.21.15.12:0/3621835657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ffaf80673a0 con 0x7ffae4004d10 2023-10-16T23:27:16.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.604+0000 7ffaee7fc640 1 -- 172.21.15.12:0/3621835657 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ffae8003c30 con 0x7ffae4004d10 2023-10-16T23:27:16.607 INFO:teuthology.orchestra.run.smithi012.stderr:adjusted tunables profile to default 2023-10-16T23:27:16.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.604+0000 7ffaffdd6640 1 -- 172.21.15.12:0/3621835657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffae4004d10 msgr2=0x7ffaf80c4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:16.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.604+0000 7ffaffdd6640 1 --2- 172.21.15.12:0/3621835657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffae4004d10 0x7ffaf80c4610 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffae800f800 tx=0x7ffae800fcc0 comp rx=0 tx=0).stop 2023-10-16T23:27:16.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.604+0000 7ffaffdd6640 1 -- 172.21.15.12:0/3621835657 shutdown_connections 2023-10-16T23:27:16.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.604+0000 7ffaffdd6640 1 --2- 172.21.15.12:0/3621835657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf80c3d70 0x7ffaf81e7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:16.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.604+0000 7ffaffdd6640 1 --2- 172.21.15.12:0/3621835657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaf81e7520 0x7ffaf80c3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:16.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.604+0000 7ffaffdd6640 1 --2- 172.21.15.12:0/3621835657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffae4004d10 0x7ffaf80c4610 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:16.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.604+0000 7ffaffdd6640 1 -- 172.21.15.12:0/3621835657 >> 172.21.15.12:0/3621835657 conn(0x7ffaf806b800 msgr2=0x7ffaf81594f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:16.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.604+0000 7ffaffdd6640 1 -- 172.21.15.12:0/3621835657 shutdown_connections 2023-10-16T23:27:16.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:16.604+0000 7ffaffdd6640 1 -- 172.21.15.12:0/3621835657 wait complete. 2023-10-16T23:27:16.630 INFO:tasks.ceph:check_enable_crimson: False 2023-10-16T23:27:16.630 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-16T23:27:16.631 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-16T23:27:16.631 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-16T23:27:16.643 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-16T23:27:16.643 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-16T23:27:16.698 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-16T23:27:16.698 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-16T23:27:16.709 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-10-16T23:27:16.705+0000 7f1c8a538180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-16T23:27:16.722 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-16T23:27:16.720+0000 7fdb4035e180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-16T23:27:16.734 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-16T23:27:16.734 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-16T23:27:16.790 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-16T23:27:16.790 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-16T23:27:16.804 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-16T23:27:16.804 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-16T23:27:16.859 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-16T23:27:16.859 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-16T23:27:16.917 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-10-16T23:27:16.917 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-16T23:27:16.971 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new 73e70f98-6f5e-4464-b34e-931faac41cc9 0 2023-10-16T23:27:17.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.137+0000 7f610fef0640 1 Processor -- start 2023-10-16T23:27:17.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.137+0000 7f610fef0640 1 -- start start 2023-10-16T23:27:17.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.141+0000 7f610fef0640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f610806cb00 0x7f610806f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:17.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.141+0000 7f610fef0640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61080c1420 0x7f610806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:17.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.141+0000 7f610fef0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f61080a72d0 0x7f61080bf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:17.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.141+0000 7f610fef0640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6108071570 con 0x7f610806cb00 2023-10-16T23:27:17.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.141+0000 7f610fef0640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f610806fde0 con 0x7f61080a72d0 2023-10-16T23:27:17.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.141+0000 7f610fef0640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61080bdeb0 con 0x7f61080c1420 2023-10-16T23:27:17.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.141+0000 7f610d48b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61080c1420 0x7f610806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:17.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.141+0000 7f610e48d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f61080a72d0 0x7f61080bf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:17.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.141+0000 7f610d48b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61080c1420 0x7f610806d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:43178/0 (socket says 172.21.15.31:43178) 2023-10-16T23:27:17.147 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.141+0000 7f610d48b640 1 -- 172.21.15.31:0/1718523549 learned_addr learned my addr 172.21.15.31:0/1718523549 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-16T23:27:17.147 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.141+0000 7f610e48d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f61080a72d0 0x7f61080bf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53752/0 (socket says 172.21.15.31:53752) 2023-10-16T23:27:17.147 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.141+0000 7f610dc8c640 1 --2- 172.21.15.31:0/1718523549 >> v2:172.21.15.12:3300/0 conn(0x7f610806cb00 0x7f610806f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:17.147 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.141+0000 7f610d48b640 1 -- 172.21.15.31:0/1718523549 >> v2:172.21.15.31:3300/0 conn(0x7f61080a72d0 msgr2=0x7f61080bf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:17.148 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.141+0000 7f610d48b640 1 --2- 172.21.15.31:0/1718523549 >> v2:172.21.15.31:3300/0 conn(0x7f61080a72d0 0x7f61080bf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.148 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.141+0000 7f610d48b640 1 -- 172.21.15.31:0/1718523549 >> v2:172.21.15.12:3300/0 conn(0x7f610806cb00 msgr2=0x7f610806f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:17.148 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.141+0000 7f610d48b640 1 --2- 172.21.15.31:0/1718523549 >> v2:172.21.15.12:3300/0 conn(0x7f610806cb00 0x7f610806f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.148 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.141+0000 7f610d48b640 1 -- 172.21.15.31:0/1718523549 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610806dc80 con 0x7f61080c1420 2023-10-16T23:27:17.148 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.141+0000 7f610dc8c640 1 --2- 172.21.15.31:0/1718523549 >> v2:172.21.15.12:3300/0 conn(0x7f610806cb00 0x7f610806f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:27:17.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.141+0000 7f610e48d640 1 --2- 172.21.15.31:0/1718523549 >> v2:172.21.15.31:3300/0 conn(0x7f61080a72d0 0x7f61080bf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T23:27:17.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.141+0000 7f610d48b640 1 --2- 172.21.15.31:0/1718523549 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61080c1420 0x7f610806d740 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f61080a1110 tx=0x7f60f801ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33dc89f45858b6ac server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:17.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.141+0000 7f610cc8a640 1 -- 172.21.15.31:0/1718523549 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f80a89b0 con 0x7f61080c1420 2023-10-16T23:27:17.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.141+0000 7f610cc8a640 1 -- 172.21.15.31:0/1718523549 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f80a8b10 con 0x7f61080c1420 2023-10-16T23:27:17.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.141+0000 7f610cc8a640 1 -- 172.21.15.31:0/1718523549 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f80a8ea0 con 0x7f61080c1420 2023-10-16T23:27:17.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610fef0640 1 -- 172.21.15.31:0/1718523549 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61080c1420 msgr2=0x7f610806d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:17.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610fef0640 1 --2- 172.21.15.31:0/1718523549 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61080c1420 0x7f610806d740 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f61080a1110 tx=0x7f60f801ecf0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610fef0640 1 -- 172.21.15.31:0/1718523549 shutdown_connections 2023-10-16T23:27:17.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610fef0640 1 --2- 172.21.15.31:0/1718523549 >> v2:172.21.15.31:3300/0 conn(0x7f61080a72d0 0x7f61080bf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610fef0640 1 --2- 172.21.15.31:0/1718523549 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61080c1420 0x7f610806d740 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610fef0640 1 --2- 172.21.15.31:0/1718523549 >> v2:172.21.15.12:3300/0 conn(0x7f610806cb00 0x7f610806f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610fef0640 1 -- 172.21.15.31:0/1718523549 >> 172.21.15.31:0/1718523549 conn(0x7f61080c18f0 msgr2=0x7f61080c1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:17.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610fef0640 1 -- 172.21.15.31:0/1718523549 shutdown_connections 2023-10-16T23:27:17.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610fef0640 1 -- 172.21.15.31:0/1718523549 wait complete. 2023-10-16T23:27:17.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610fef0640 1 Processor -- start 2023-10-16T23:27:17.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610fef0640 1 -- start start 2023-10-16T23:27:17.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610fef0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f610806cb00 0x7f61081e5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:17.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610fef0640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61080a72d0 0x7f61081e2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:17.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610fef0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f610814abd0 0x7f6108155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:17.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610fef0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61081e62a0 con 0x7f610806cb00 2023-10-16T23:27:17.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610fef0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610814dd70 con 0x7f610814abd0 2023-10-16T23:27:17.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610fef0640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61080a6340 con 0x7f61080a72d0 2023-10-16T23:27:17.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610d48b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61080a72d0 0x7f61081e2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:17.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610e48d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f610814abd0 0x7f6108155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:17.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610e48d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f610814abd0 0x7f6108155800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53754/0 (socket says 172.21.15.31:53754) 2023-10-16T23:27:17.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610e48d640 1 -- 172.21.15.31:0/3452761017 learned_addr learned my addr 172.21.15.31:0/3452761017 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-16T23:27:17.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610d48b640 1 --2- 172.21.15.31:0/3452761017 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61080a72d0 0x7f61081e2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:43194/0 (socket says 172.21.15.31:43194) 2023-10-16T23:27:17.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610dc8c640 1 --2- 172.21.15.31:0/3452761017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f610806cb00 0x7f61081e5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:17.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610e48d640 1 -- 172.21.15.31:0/3452761017 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61080a72d0 msgr2=0x7f61081e2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:17.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610e48d640 1 --2- 172.21.15.31:0/3452761017 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61080a72d0 0x7f61081e2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610e48d640 1 -- 172.21.15.31:0/3452761017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f610806cb00 msgr2=0x7f61081e5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:17.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610e48d640 1 --2- 172.21.15.31:0/3452761017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f610806cb00 0x7f61081e5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610e48d640 1 -- 172.21.15.31:0/3452761017 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6100009a70 con 0x7f610814abd0 2023-10-16T23:27:17.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610e48d640 1 --2- 172.21.15.31:0/3452761017 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f610814abd0 0x7f6108155800 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f610000efb0 tx=0x7f610000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:17.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f60fe7fc640 1 -- 172.21.15.31:0/3452761017 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100009d50 con 0x7f610814abd0 2023-10-16T23:27:17.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f60fe7fc640 1 -- 172.21.15.31:0/3452761017 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610000f040 con 0x7f610814abd0 2023-10-16T23:27:17.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610fef0640 1 -- 172.21.15.31:0/3452761017 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f80094d0 con 0x7f610814abd0 2023-10-16T23:27:17.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f60fe7fc640 1 -- 172.21.15.31:0/3452761017 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61000146a0 con 0x7f610814abd0 2023-10-16T23:27:17.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f610fef0640 1 -- 172.21.15.31:0/3452761017 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f610814b210 con 0x7f610814abd0 2023-10-16T23:27:17.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f60fe7fc640 1 -- 172.21.15.31:0/3452761017 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6100014b00 con 0x7f610814abd0 2023-10-16T23:27:17.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.145+0000 7f60fe7fc640 1 -- 172.21.15.31:0/3452761017 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f61000133e0 con 0x7f610814abd0 2023-10-16T23:27:17.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.149+0000 7f610fef0640 1 -- 172.21.15.31:0/3452761017 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f610814b070 con 0x7f610814abd0 2023-10-16T23:27:17.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.157+0000 7f60fe7fc640 1 -- 172.21.15.31:0/3452761017 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f610003bb00 con 0x7f610814abd0 2023-10-16T23:27:17.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.221+0000 7f610fef0640 1 -- 172.21.15.31:0/3452761017 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "73e70f98-6f5e-4464-b34e-931faac41cc9", "id": 0} v 0) v1 -- 0x7f61080673a0 con 0x7f610814abd0 2023-10-16T23:27:17.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.229+0000 7f60fe7fc640 1 -- 172.21.15.31:0/3452761017 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "73e70f98-6f5e-4464-b34e-931faac41cc9", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f610002a070 con 0x7f610814abd0 2023-10-16T23:27:17.234 INFO:teuthology.orchestra.run.smithi031.stdout:0 2023-10-16T23:27:17.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.233+0000 7f610fef0640 1 -- 172.21.15.31:0/3452761017 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f610814abd0 msgr2=0x7f6108155800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:17.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.233+0000 7f610fef0640 1 --2- 172.21.15.31:0/3452761017 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f610814abd0 0x7f6108155800 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f610000efb0 tx=0x7f610000c490 comp rx=0 tx=0).stop 2023-10-16T23:27:17.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.233+0000 7f610fef0640 1 -- 172.21.15.31:0/3452761017 shutdown_connections 2023-10-16T23:27:17.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.233+0000 7f610fef0640 1 --2- 172.21.15.31:0/3452761017 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f610814abd0 0x7f6108155800 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.233+0000 7f610fef0640 1 --2- 172.21.15.31:0/3452761017 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f61080a72d0 0x7f61081e2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.233+0000 7f610fef0640 1 --2- 172.21.15.31:0/3452761017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f610806cb00 0x7f61081e5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.233+0000 7f610fef0640 1 -- 172.21.15.31:0/3452761017 >> 172.21.15.31:0/3452761017 conn(0x7f61080c18f0 msgr2=0x7f61080a1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:17.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.233+0000 7f610fef0640 1 -- 172.21.15.31:0/3452761017 shutdown_connections 2023-10-16T23:27:17.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.233+0000 7f610fef0640 1 -- 172.21.15.31:0/3452761017 wait complete. 2023-10-16T23:27:17.247 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-10-16T23:27:17.241+0000 7f1c8a538180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-16T23:27:17.250 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new ff722efe-b3f9-4cc0-bbde-f4d4d8055a70 1 2023-10-16T23:27:17.315 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-16T23:27:17.312+0000 7fdb4035e180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-16T23:27:17.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.361+0000 7f949c664640 1 Processor -- start 2023-10-16T23:27:17.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.361+0000 7f949c664640 1 -- start start 2023-10-16T23:27:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.361+0000 7f949c664640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f949414fd80 0x7f94940b9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.361+0000 7f949c664640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94941502d0 con 0x7f949414cad0 2023-10-16T23:27:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.361+0000 7f949c664640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f949406fcf0 con 0x7f949406d080 2023-10-16T23:27:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.361+0000 7f949c664640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94940700d0 con 0x7f949414fd80 2023-10-16T23:27:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.361+0000 7f949ac01640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f949414fd80 0x7f94940b9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.361+0000 7f949a400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f949406d080 0x7f949414c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55452/0 (socket says 172.21.15.31:55452) 2023-10-16T23:27:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.361+0000 7f949a400640 1 -- 172.21.15.31:0/3106595906 learned_addr learned my addr 172.21.15.31:0/3106595906 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-16T23:27:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.361+0000 7f949ac01640 1 -- 172.21.15.31:0/3106595906 >> v1:172.21.15.31:6789/0 conn(0x7f949406d080 legacy=0x7f949414c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.361+0000 7f949ac01640 1 -- 172.21.15.31:0/3106595906 >> v1:172.21.15.12:6789/0 conn(0x7f949414cad0 legacy=0x7f94940bd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.361+0000 7f949ac01640 1 -- 172.21.15.31:0/3106595906 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949406dda0 con 0x7f949414fd80 2023-10-16T23:27:17.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.365+0000 7f949ac01640 1 --2- 172.21.15.31:0/3106595906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f949414fd80 0x7f94940b9570 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f948c009d90 tx=0x7f948c01c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e6c35936ab3c10f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:17.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.365+0000 7f94993fe640 1 -- 172.21.15.31:0/3106595906 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c0a5960 con 0x7f949414fd80 2023-10-16T23:27:17.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.365+0000 7f94993fe640 1 -- 172.21.15.31:0/3106595906 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948c0a5ac0 con 0x7f949414fd80 2023-10-16T23:27:17.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.365+0000 7f94993fe640 1 -- 172.21.15.31:0/3106595906 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c0a5e50 con 0x7f949414fd80 2023-10-16T23:27:17.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.365+0000 7f949c664640 1 -- 172.21.15.31:0/3106595906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f949414fd80 msgr2=0x7f94940b9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:17.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.365+0000 7f949c664640 1 --2- 172.21.15.31:0/3106595906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f949414fd80 0x7f94940b9570 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f948c009d90 tx=0x7f948c01c880 comp rx=0 tx=0).stop 2023-10-16T23:27:17.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.365+0000 7f949c664640 1 -- 172.21.15.31:0/3106595906 shutdown_connections 2023-10-16T23:27:17.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.365+0000 7f949c664640 1 --2- 172.21.15.31:0/3106595906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f949414fd80 0x7f94940b9570 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.365+0000 7f949c664640 1 -- 172.21.15.31:0/3106595906 >> 172.21.15.31:0/3106595906 conn(0x7f94940c2a70 msgr2=0x7f94940c2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:17.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.365+0000 7f949c664640 1 -- 172.21.15.31:0/3106595906 shutdown_connections 2023-10-16T23:27:17.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.365+0000 7f949c664640 1 -- 172.21.15.31:0/3106595906 wait complete. 2023-10-16T23:27:17.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.365+0000 7f949c664640 1 Processor -- start 2023-10-16T23:27:17.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.365+0000 7f949c664640 1 -- start start 2023-10-16T23:27:17.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.369+0000 7f949c664640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f949406d080 0x7f9494146740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:17.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.369+0000 7f949c664640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f949414cad0 0x7f94941ead30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:17.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.369+0000 7f949c664640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f949414fd80 0x7f9494147c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:17.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.369+0000 7f949c664640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9494148da0 con 0x7f949406d080 2023-10-16T23:27:17.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.369+0000 7f949c664640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9494146c80 con 0x7f949414fd80 2023-10-16T23:27:17.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.369+0000 7f949c664640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9494148820 con 0x7f949414cad0 2023-10-16T23:27:17.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.369+0000 7f9499bff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f949414cad0 0x7f94941ead30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:17.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.369+0000 7f949ac01640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f949414fd80 0x7f9494147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:17.375 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.369+0000 7f9499bff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f949414cad0 0x7f94941ead30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:43208/0 (socket says 172.21.15.31:43208) 2023-10-16T23:27:17.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.369+0000 7f9499bff640 1 -- 172.21.15.31:0/4089725088 learned_addr learned my addr 172.21.15.31:0/4089725088 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-16T23:27:17.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.369+0000 7f949a400640 1 --2- 172.21.15.31:0/4089725088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f949406d080 0x7f9494146740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:17.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.369+0000 7f9499bff640 1 -- 172.21.15.31:0/4089725088 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f949414fd80 msgr2=0x7f9494147c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:17.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.369+0000 7f9499bff640 1 --2- 172.21.15.31:0/4089725088 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f949414fd80 0x7f9494147c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.376 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.369+0000 7f9499bff640 1 -- 172.21.15.31:0/4089725088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f949406d080 msgr2=0x7f9494146740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:17.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.369+0000 7f9499bff640 1 --2- 172.21.15.31:0/4089725088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f949406d080 0x7f9494146740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.369+0000 7f9499bff640 1 -- 172.21.15.31:0/4089725088 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c009a70 con 0x7f949414cad0 2023-10-16T23:27:17.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.369+0000 7f9499bff640 1 --2- 172.21.15.31:0/4089725088 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f949414cad0 0x7f94941ead30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f948400c450 tx=0x7f948400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:17.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.369+0000 7f948affd640 1 -- 172.21.15.31:0/4089725088 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9484012830 con 0x7f949414cad0 2023-10-16T23:27:17.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.369+0000 7f948affd640 1 -- 172.21.15.31:0/4089725088 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94840129b0 con 0x7f949414cad0 2023-10-16T23:27:17.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.369+0000 7f949c664640 1 -- 172.21.15.31:0/4089725088 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9494148ac0 con 0x7f949414cad0 2023-10-16T23:27:17.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.369+0000 7f948affd640 1 -- 172.21.15.31:0/4089725088 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9484012d60 con 0x7f949414cad0 2023-10-16T23:27:17.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.369+0000 7f949c664640 1 -- 172.21.15.31:0/4089725088 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949414cf50 con 0x7f949414cad0 2023-10-16T23:27:17.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.369+0000 7f948affd640 1 -- 172.21.15.31:0/4089725088 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f948401c760 con 0x7f949414cad0 2023-10-16T23:27:17.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.369+0000 7f948affd640 1 -- 172.21.15.31:0/4089725088 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f948401b850 con 0x7f949414cad0 2023-10-16T23:27:17.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.369+0000 7f949c664640 1 -- 172.21.15.31:0/4089725088 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949414d1d0 con 0x7f949414cad0 2023-10-16T23:27:17.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.373+0000 7f948affd640 1 -- 172.21.15.31:0/4089725088 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f948401cbf0 con 0x7f949414cad0 2023-10-16T23:27:17.427 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-10-16T23:27:17.425+0000 7f1c8a538180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-16T23:27:17.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.441+0000 7f949c664640 1 -- 172.21.15.31:0/4089725088 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ff722efe-b3f9-4cc0-bbde-f4d4d8055a70", "id": 1} v 0) v1 -- 0x7f94940673a0 con 0x7f949414cad0 2023-10-16T23:27:17.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.445+0000 7f948affd640 1 -- 172.21.15.31:0/4089725088 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ff722efe-b3f9-4cc0-bbde-f4d4d8055a70", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f948402b0b0 con 0x7f949414cad0 2023-10-16T23:27:17.451 INFO:teuthology.orchestra.run.smithi031.stdout:1 2023-10-16T23:27:17.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.449+0000 7f949c664640 1 -- 172.21.15.31:0/4089725088 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f949414cad0 msgr2=0x7f94941ead30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:17.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.449+0000 7f949c664640 1 --2- 172.21.15.31:0/4089725088 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f949414cad0 0x7f94941ead30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f948400c450 tx=0x7f948400c910 comp rx=0 tx=0).stop 2023-10-16T23:27:17.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.449+0000 7f949c664640 1 -- 172.21.15.31:0/4089725088 shutdown_connections 2023-10-16T23:27:17.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.449+0000 7f949c664640 1 --2- 172.21.15.31:0/4089725088 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f949414fd80 0x7f9494147c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.449+0000 7f949c664640 1 --2- 172.21.15.31:0/4089725088 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f949414cad0 0x7f94941ead30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.449+0000 7f949c664640 1 --2- 172.21.15.31:0/4089725088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f949406d080 0x7f9494146740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.449+0000 7f949c664640 1 -- 172.21.15.31:0/4089725088 >> 172.21.15.31:0/4089725088 conn(0x7f94940c2a70 msgr2=0x7f9494149280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:17.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.449+0000 7f949c664640 1 -- 172.21.15.31:0/4089725088 shutdown_connections 2023-10-16T23:27:17.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.449+0000 7f949c664640 1 -- 172.21.15.31:0/4089725088 wait complete. 2023-10-16T23:27:17.467 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new 9baf25db-dce0-4065-90d6-f35867286be2 2 2023-10-16T23:27:17.511 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-16T23:27:17.508+0000 7fdb4035e180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-16T23:27:17.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.581+0000 7f90f20d2640 1 Processor -- start 2023-10-16T23:27:17.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.581+0000 7f90f20d2640 1 -- start start 2023-10-16T23:27:17.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.585+0000 7f90f20d2640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f90ec06f300 0x7f90ec0ba2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:17.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.585+0000 7f90f20d2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f90ec06f6e0 0x7f90ec0babf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:17.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.585+0000 7f90f20d2640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90ec06fc70 con 0x7f90ec070b90 2023-10-16T23:27:17.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.585+0000 7f90f20d2640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90ec1355f0 con 0x7f90ec06f6e0 2023-10-16T23:27:17.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.585+0000 7f90f20d2640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90ec150590 con 0x7f90ec06f300 2023-10-16T23:27:17.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.585+0000 7f90eb7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f90ec06f300 0x7f90ec0ba2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:17.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.585+0000 7f90eaffd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f90ec070b90 0x7f90ec14fe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55464/0 (socket says 172.21.15.31:55464) 2023-10-16T23:27:17.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.585+0000 7f90eaffd640 1 -- 172.21.15.31:0/3266545706 learned_addr learned my addr 172.21.15.31:0/3266545706 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-10-16T23:27:17.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.585+0000 7f90ebfff640 1 --2- 172.21.15.31:0/3266545706 >> v2:172.21.15.12:3300/0 conn(0x7f90ec06f6e0 0x7f90ec0babf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:17.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.585+0000 7f90eb7fe640 1 -- 172.21.15.31:0/3266545706 >> v2:172.21.15.12:3300/0 conn(0x7f90ec06f6e0 msgr2=0x7f90ec0babf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:17.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.585+0000 7f90eb7fe640 1 --2- 172.21.15.31:0/3266545706 >> v2:172.21.15.12:3300/0 conn(0x7f90ec06f6e0 0x7f90ec0babf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.585+0000 7f90eb7fe640 1 -- 172.21.15.31:0/3266545706 >> v1:172.21.15.31:6789/0 conn(0x7f90ec070b90 legacy=0x7f90ec14fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:17.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.585+0000 7f90eb7fe640 1 -- 172.21.15.31:0/3266545706 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec0706a0 con 0x7f90ec06f300 2023-10-16T23:27:17.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.585+0000 7f90ea7fc640 1 -- 172.21.15.31:0/3266545706 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3256814638 0 0) 0x7f90ec06fc70 con 0x7f90ec070b90 2023-10-16T23:27:17.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.585+0000 7f90eb7fe640 1 --2- 172.21.15.31:0/3266545706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90ec06f300 0x7f90ec0ba2f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f90ec073100 tx=0x7f90dc01c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=490cb4739e04956a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:17.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.585+0000 7f90ea7fc640 1 -- 172.21.15.31:0/3266545706 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0ab600 con 0x7f90ec06f300 2023-10-16T23:27:17.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.585+0000 7f90ea7fc640 1 -- 172.21.15.31:0/3266545706 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc0a7050 con 0x7f90ec06f300 2023-10-16T23:27:17.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.585+0000 7f90ea7fc640 1 -- 172.21.15.31:0/3266545706 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0ab980 con 0x7f90ec06f300 2023-10-16T23:27:17.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.589+0000 7f90f20d2640 1 -- 172.21.15.31:0/3266545706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90ec06f300 msgr2=0x7f90ec0ba2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:17.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.589+0000 7f90f20d2640 1 --2- 172.21.15.31:0/3266545706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90ec06f300 0x7f90ec0ba2f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f90ec073100 tx=0x7f90dc01c3d0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.589+0000 7f90f20d2640 1 -- 172.21.15.31:0/3266545706 shutdown_connections 2023-10-16T23:27:17.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.589+0000 7f90f20d2640 1 --2- 172.21.15.31:0/3266545706 >> v2:172.21.15.12:3300/0 conn(0x7f90ec06f6e0 0x7f90ec0babf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.589+0000 7f90f20d2640 1 --2- 172.21.15.31:0/3266545706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90ec06f300 0x7f90ec0ba2f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.589+0000 7f90f20d2640 1 -- 172.21.15.31:0/3266545706 >> 172.21.15.31:0/3266545706 conn(0x7f90ec069d30 msgr2=0x7f90ec06a140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:17.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.589+0000 7f90f20d2640 1 -- 172.21.15.31:0/3266545706 shutdown_connections 2023-10-16T23:27:17.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.589+0000 7f90f20d2640 1 -- 172.21.15.31:0/3266545706 wait complete. 2023-10-16T23:27:17.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.589+0000 7f90f20d2640 1 Processor -- start 2023-10-16T23:27:17.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.589+0000 7f90f20d2640 1 -- start start 2023-10-16T23:27:17.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.589+0000 7f90f20d2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90ec06f300 0x7f90ec0c1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:17.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.589+0000 7f90f20d2640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f90ec06f6e0 0x7f90ec1eab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:17.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.589+0000 7f90f20d2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90ec070b90 0x7f90ec1eb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:17.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.589+0000 7f90f20d2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0c2010 con 0x7f90ec06f300 2023-10-16T23:27:17.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.589+0000 7f90f20d2640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0c1880 con 0x7f90ec070b90 2023-10-16T23:27:17.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.589+0000 7f90f20d2640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec14afa0 con 0x7f90ec06f6e0 2023-10-16T23:27:17.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.589+0000 7f90ebfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90ec070b90 0x7f90ec1eb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:17.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.589+0000 7f90ebfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90ec070b90 0x7f90ec1eb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53778/0 (socket says 172.21.15.31:53778) 2023-10-16T23:27:17.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.589+0000 7f90ebfff640 1 -- 172.21.15.31:0/719994886 learned_addr learned my addr 172.21.15.31:0/719994886 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-16T23:27:17.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.589+0000 7f90eaffd640 1 --2- 172.21.15.31:0/719994886 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f90ec06f6e0 0x7f90ec1eab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:17.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.589+0000 7f90eb7fe640 1 --2- 172.21.15.31:0/719994886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90ec06f300 0x7f90ec0c1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:17.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.589+0000 7f90ebfff640 1 -- 172.21.15.31:0/719994886 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f90ec06f6e0 msgr2=0x7f90ec1eab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:17.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.589+0000 7f90ebfff640 1 --2- 172.21.15.31:0/719994886 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f90ec06f6e0 0x7f90ec1eab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.589+0000 7f90ebfff640 1 -- 172.21.15.31:0/719994886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90ec06f300 msgr2=0x7f90ec0c1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:17.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.589+0000 7f90ebfff640 1 --2- 172.21.15.31:0/719994886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90ec06f300 0x7f90ec0c1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.589+0000 7f90ebfff640 1 -- 172.21.15.31:0/719994886 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90dc009420 con 0x7f90ec070b90 2023-10-16T23:27:17.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.593+0000 7f90ebfff640 1 --2- 172.21.15.31:0/719994886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90ec070b90 0x7f90ec1eb080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f90e4007e40 tx=0x7f90e400e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:17.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.593+0000 7f90d3fff640 1 -- 172.21.15.31:0/719994886 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4014620 con 0x7f90ec070b90 2023-10-16T23:27:17.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.593+0000 7f90d3fff640 1 -- 172.21.15.31:0/719994886 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e400ee90 con 0x7f90ec070b90 2023-10-16T23:27:17.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.593+0000 7f90f20d2640 1 -- 172.21.15.31:0/719994886 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ec14c070 con 0x7f90ec070b90 2023-10-16T23:27:17.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.593+0000 7f90d3fff640 1 -- 172.21.15.31:0/719994886 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e40149e0 con 0x7f90ec070b90 2023-10-16T23:27:17.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.593+0000 7f90f20d2640 1 -- 172.21.15.31:0/719994886 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ec14ad40 con 0x7f90ec070b90 2023-10-16T23:27:17.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.593+0000 7f90d3fff640 1 -- 172.21.15.31:0/719994886 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f90e401e460 con 0x7f90ec070b90 2023-10-16T23:27:17.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.593+0000 7f90d3fff640 1 -- 172.21.15.31:0/719994886 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f90e401d7e0 con 0x7f90ec070b90 2023-10-16T23:27:17.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.593+0000 7f90f20d2640 1 -- 172.21.15.31:0/719994886 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90ec0673a0 con 0x7f90ec070b90 2023-10-16T23:27:17.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.597+0000 7f90d3fff640 1 -- 172.21.15.31:0/719994886 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f90e401d3c0 con 0x7f90ec070b90 2023-10-16T23:27:17.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.661+0000 7f90f20d2640 1 -- 172.21.15.31:0/719994886 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9baf25db-dce0-4065-90d6-f35867286be2", "id": 2} v 0) v1 -- 0x7f90ec071c40 con 0x7f90ec070b90 2023-10-16T23:27:17.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.673+0000 7f90d3fff640 1 -- 172.21.15.31:0/719994886 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9baf25db-dce0-4065-90d6-f35867286be2", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f90e401dac0 con 0x7f90ec070b90 2023-10-16T23:27:17.677 INFO:teuthology.orchestra.run.smithi031.stdout:2 2023-10-16T23:27:17.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.673+0000 7f90f20d2640 1 -- 172.21.15.31:0/719994886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90ec070b90 msgr2=0x7f90ec1eb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:17.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.673+0000 7f90f20d2640 1 --2- 172.21.15.31:0/719994886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90ec070b90 0x7f90ec1eb080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f90e4007e40 tx=0x7f90e400e4b0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.673+0000 7f90f20d2640 1 -- 172.21.15.31:0/719994886 shutdown_connections 2023-10-16T23:27:17.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.673+0000 7f90f20d2640 1 --2- 172.21.15.31:0/719994886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90ec070b90 0x7f90ec1eb080 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.673+0000 7f90f20d2640 1 --2- 172.21.15.31:0/719994886 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f90ec06f6e0 0x7f90ec1eab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.673+0000 7f90f20d2640 1 --2- 172.21.15.31:0/719994886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90ec06f300 0x7f90ec0c1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.673+0000 7f90f20d2640 1 -- 172.21.15.31:0/719994886 >> 172.21.15.31:0/719994886 conn(0x7f90ec069d30 msgr2=0x7f90ec0bcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:17.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.673+0000 7f90f20d2640 1 -- 172.21.15.31:0/719994886 shutdown_connections 2023-10-16T23:27:17.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.673+0000 7f90f20d2640 1 -- 172.21.15.31:0/719994886 wait complete. 2023-10-16T23:27:17.694 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new 8a620ad3-2294-470d-8a8c-66f177f5fbe7 3 2023-10-16T23:27:17.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.801+0000 7f7434ced640 1 Processor -- start 2023-10-16T23:27:17.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.801+0000 7f7434ced640 1 -- start start 2023-10-16T23:27:17.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.801+0000 7f7434ced640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f743006b660 0x7f743014ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:17.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.801+0000 7f7434ced640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f743006be00 0x7f743014ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:17.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.801+0000 7f7434ced640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f74300a0ca0 0x7f7430152c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:17.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.801+0000 7f7434ced640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743006fc90 con 0x7f74300a0ca0 2023-10-16T23:27:17.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.801+0000 7f7434ced640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74300c1100 con 0x7f743006b660 2023-10-16T23:27:17.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.801+0000 7f7434ced640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74300c16c0 con 0x7f743006be00 2023-10-16T23:27:17.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.801+0000 7f7427fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f743006be00 0x7f743014ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:17.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.801+0000 7f742e59c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f743006b660 0x7f743014ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:17.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.801+0000 7f7427fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f743006be00 0x7f743014ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:43222/0 (socket says 172.21.15.31:43222) 2023-10-16T23:27:17.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.801+0000 7f7427fff640 1 -- 172.21.15.31:0/1107808589 learned_addr learned my addr 172.21.15.31:0/1107808589 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-16T23:27:17.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.801+0000 7f742ed9d640 1 --2- 172.21.15.31:0/1107808589 >> v2:172.21.15.12:3300/0 conn(0x7f74300a0ca0 0x7f7430152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:17.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.801+0000 7f7427fff640 1 -- 172.21.15.31:0/1107808589 >> v2:172.21.15.31:3300/0 conn(0x7f743006b660 msgr2=0x7f743014ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:17.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.801+0000 7f7427fff640 1 --2- 172.21.15.31:0/1107808589 >> v2:172.21.15.31:3300/0 conn(0x7f743006b660 0x7f743014ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.801+0000 7f7427fff640 1 -- 172.21.15.31:0/1107808589 >> v2:172.21.15.12:3300/0 conn(0x7f74300a0ca0 msgr2=0x7f7430152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:17.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.801+0000 7f7427fff640 1 --2- 172.21.15.31:0/1107808589 >> v2:172.21.15.12:3300/0 conn(0x7f74300a0ca0 0x7f7430152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.801+0000 7f7427fff640 1 -- 172.21.15.31:0/1107808589 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74300c1350 con 0x7f743006be00 2023-10-16T23:27:17.808 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.801+0000 7f742ed9d640 1 --2- 172.21.15.31:0/1107808589 >> v2:172.21.15.12:3300/0 conn(0x7f74300a0ca0 0x7f7430152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:17.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.801+0000 7f7427fff640 1 --2- 172.21.15.31:0/1107808589 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f743006be00 0x7f743014ef80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f743006ac00 tx=0x7f741801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed314b84c9e8673c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:17.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.801+0000 7f742dd9b640 1 -- 172.21.15.31:0/1107808589 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74180ab600 con 0x7f743006be00 2023-10-16T23:27:17.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.801+0000 7f742dd9b640 1 -- 172.21.15.31:0/1107808589 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74180a7050 con 0x7f743006be00 2023-10-16T23:27:17.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.801+0000 7f742dd9b640 1 -- 172.21.15.31:0/1107808589 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74180ab980 con 0x7f743006be00 2023-10-16T23:27:17.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f7434ced640 1 -- 172.21.15.31:0/1107808589 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f743006be00 msgr2=0x7f743014ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:17.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f7434ced640 1 --2- 172.21.15.31:0/1107808589 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f743006be00 0x7f743014ef80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f743006ac00 tx=0x7f741801c3e0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f7434ced640 1 -- 172.21.15.31:0/1107808589 shutdown_connections 2023-10-16T23:27:17.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f7434ced640 1 --2- 172.21.15.31:0/1107808589 >> v2:172.21.15.12:3300/0 conn(0x7f74300a0ca0 0x7f7430152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f7434ced640 1 --2- 172.21.15.31:0/1107808589 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f743006be00 0x7f743014ef80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f7434ced640 1 --2- 172.21.15.31:0/1107808589 >> v2:172.21.15.31:3300/0 conn(0x7f743006b660 0x7f743014ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f7434ced640 1 -- 172.21.15.31:0/1107808589 >> 172.21.15.31:0/1107808589 conn(0x7f74300c18f0 msgr2=0x7f74300c1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:17.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f7434ced640 1 -- 172.21.15.31:0/1107808589 shutdown_connections 2023-10-16T23:27:17.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f7434ced640 1 -- 172.21.15.31:0/1107808589 wait complete. 2023-10-16T23:27:17.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f7434ced640 1 Processor -- start 2023-10-16T23:27:17.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f7434ced640 1 -- start start 2023-10-16T23:27:17.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f7434ced640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f743006b660 0x7f743014b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:17.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f7434ced640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f743006be00 0x7f74300bd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:17.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f7434ced640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74300a0ca0 0x7f74300a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:17.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f7434ced640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743014a110 con 0x7f743006be00 2023-10-16T23:27:17.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f7434ced640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743014b580 con 0x7f743006b660 2023-10-16T23:27:17.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f7434ced640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74301eac80 con 0x7f74300a0ca0 2023-10-16T23:27:17.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f742e59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f743006b660 0x7f743014b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:17.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f742ed9d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74300a0ca0 0x7f74300a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:17.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f742e59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f743006b660 0x7f743014b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53788/0 (socket says 172.21.15.31:53788) 2023-10-16T23:27:17.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f742e59c640 1 -- 172.21.15.31:0/618772105 learned_addr learned my addr 172.21.15.31:0/618772105 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-16T23:27:17.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f7427fff640 1 --2- 172.21.15.31:0/618772105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f743006be00 0x7f74300bd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:17.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f742ed9d640 1 -- 172.21.15.31:0/618772105 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f743006b660 msgr2=0x7f743014b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:17.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f742ed9d640 1 --2- 172.21.15.31:0/618772105 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f743006b660 0x7f743014b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f742ed9d640 1 -- 172.21.15.31:0/618772105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f743006be00 msgr2=0x7f74300bd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:17.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f742ed9d640 1 --2- 172.21.15.31:0/618772105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f743006be00 0x7f74300bd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f742ed9d640 1 -- 172.21.15.31:0/618772105 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74180094d0 con 0x7f74300a0ca0 2023-10-16T23:27:17.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f742e59c640 1 --2- 172.21.15.31:0/618772105 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f743006b660 0x7f743014b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T23:27:17.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f742ed9d640 1 --2- 172.21.15.31:0/618772105 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74300a0ca0 0x7f74300a46f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f742800ccc0 tx=0x7f742800a650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:17.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f7426ffd640 1 -- 172.21.15.31:0/618772105 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742800f680 con 0x7f74300a0ca0 2023-10-16T23:27:17.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f7426ffd640 1 -- 172.21.15.31:0/618772105 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742800f800 con 0x7f74300a0ca0 2023-10-16T23:27:17.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f7434ced640 1 -- 172.21.15.31:0/618772105 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74300bcd90 con 0x7f74300a0ca0 2023-10-16T23:27:17.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f7426ffd640 1 -- 172.21.15.31:0/618772105 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742800fbb0 con 0x7f74300a0ca0 2023-10-16T23:27:17.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f7434ced640 1 -- 172.21.15.31:0/618772105 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743014a360 con 0x7f74300a0ca0 2023-10-16T23:27:17.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f7426ffd640 1 -- 172.21.15.31:0/618772105 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f742800b040 con 0x7f74300a0ca0 2023-10-16T23:27:17.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.805+0000 7f7426ffd640 1 -- 172.21.15.31:0/618772105 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f742800fd10 con 0x7f74300a0ca0 2023-10-16T23:27:17.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.809+0000 7f7434ced640 1 -- 172.21.15.31:0/618772105 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74300673a0 con 0x7f74300a0ca0 2023-10-16T23:27:17.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.809+0000 7f7426ffd640 1 -- 172.21.15.31:0/618772105 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f74280188e0 con 0x7f74300a0ca0 2023-10-16T23:27:17.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.877+0000 7f7434ced640 1 -- 172.21.15.31:0/618772105 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8a620ad3-2294-470d-8a8c-66f177f5fbe7", "id": 3} v 0) v1 -- 0x7f7430066e80 con 0x7f74300a0ca0 2023-10-16T23:27:17.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.889+0000 7f7426ffd640 1 -- 172.21.15.31:0/618772105 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8a620ad3-2294-470d-8a8c-66f177f5fbe7", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7428018bf0 con 0x7f74300a0ca0 2023-10-16T23:27:17.893 INFO:teuthology.orchestra.run.smithi031.stdout:3 2023-10-16T23:27:17.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.889+0000 7f7434ced640 1 -- 172.21.15.31:0/618772105 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74300a0ca0 msgr2=0x7f74300a46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:17.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.889+0000 7f7434ced640 1 --2- 172.21.15.31:0/618772105 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74300a0ca0 0x7f74300a46f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f742800ccc0 tx=0x7f742800a650 comp rx=0 tx=0).stop 2023-10-16T23:27:17.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.889+0000 7f7434ced640 1 -- 172.21.15.31:0/618772105 shutdown_connections 2023-10-16T23:27:17.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.889+0000 7f7434ced640 1 --2- 172.21.15.31:0/618772105 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f74300a0ca0 0x7f74300a46f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.889+0000 7f7434ced640 1 --2- 172.21.15.31:0/618772105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f743006be00 0x7f74300bd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.889+0000 7f7434ced640 1 --2- 172.21.15.31:0/618772105 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f743006b660 0x7f743014b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:17.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.889+0000 7f7434ced640 1 -- 172.21.15.31:0/618772105 >> 172.21.15.31:0/618772105 conn(0x7f74300c18f0 msgr2=0x7f743014df40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:17.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.889+0000 7f7434ced640 1 -- 172.21.15.31:0/618772105 shutdown_connections 2023-10-16T23:27:17.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:17.889+0000 7f7434ced640 1 -- 172.21.15.31:0/618772105 wait complete. 2023-10-16T23:27:17.909 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new a8824d77-7405-40f5-9234-60889802b184 4 2023-10-16T23:27:18.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.017+0000 7f0cb951d640 1 Processor -- start 2023-10-16T23:27:18.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.017+0000 7f0cb951d640 1 -- start start 2023-10-16T23:27:18.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.017+0000 7f0cb951d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0cb40bea50 0x7f0cb40bc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:18.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.017+0000 7f0cb951d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cb40ba070 0x7f0cb40bcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:18.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.017+0000 7f0cb951d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb406de10 con 0x7f0cb40b9b40 2023-10-16T23:27:18.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.017+0000 7f0cb951d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb40bc150 con 0x7f0cb40bea50 2023-10-16T23:27:18.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.017+0000 7f0cb951d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb40ba660 con 0x7f0cb40ba070 2023-10-16T23:27:18.024 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.017+0000 7f0cb37fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cb40ba070 0x7f0cb40bcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:18.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.017+0000 7f0cb37fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cb40ba070 0x7f0cb40bcac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:43242/0 (socket says 172.21.15.31:43242) 2023-10-16T23:27:18.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.017+0000 7f0cb37fe640 1 -- 172.21.15.31:0/315676309 learned_addr learned my addr 172.21.15.31:0/315676309 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-16T23:27:18.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.021+0000 7f0cb2ffd640 1 --2- 172.21.15.31:0/315676309 >> v2:172.21.15.12:3300/0 conn(0x7f0cb40bea50 0x7f0cb40bc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:18.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.021+0000 7f0cb37fe640 1 -- 172.21.15.31:0/315676309 >> v2:172.21.15.12:3300/0 conn(0x7f0cb40bea50 msgr2=0x7f0cb40bc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:18.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.021+0000 7f0cb37fe640 1 --2- 172.21.15.31:0/315676309 >> v2:172.21.15.12:3300/0 conn(0x7f0cb40bea50 0x7f0cb40bc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.025 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.021+0000 7f0cb37fe640 1 -- 172.21.15.31:0/315676309 >> v1:172.21.15.12:6789/0 conn(0x7f0cb40b9b40 legacy=0x7f0cb41507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:18.026 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.021+0000 7f0cb37fe640 1 -- 172.21.15.31:0/315676309 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb40ba940 con 0x7f0cb40ba070 2023-10-16T23:27:18.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.021+0000 7f0cb37fe640 1 --2- 172.21.15.31:0/315676309 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cb40ba070 0x7f0cb40bcac0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0cac009e50 tx=0x7f0cac01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71dee8b07b835191 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:18.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.021+0000 7f0cb1ffb640 1 -- 172.21.15.31:0/315676309 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac0a5600 con 0x7f0cb40ba070 2023-10-16T23:27:18.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.021+0000 7f0cb1ffb640 1 -- 172.21.15.31:0/315676309 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cac0a5760 con 0x7f0cb40ba070 2023-10-16T23:27:18.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.021+0000 7f0cb1ffb640 1 -- 172.21.15.31:0/315676309 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac0a5af0 con 0x7f0cb40ba070 2023-10-16T23:27:18.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.021+0000 7f0cb951d640 1 -- 172.21.15.31:0/315676309 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cb40ba070 msgr2=0x7f0cb40bcac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:18.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.021+0000 7f0cb951d640 1 --2- 172.21.15.31:0/315676309 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cb40ba070 0x7f0cb40bcac0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0cac009e50 tx=0x7f0cac01c940 comp rx=0 tx=0).stop 2023-10-16T23:27:18.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.021+0000 7f0cb951d640 1 -- 172.21.15.31:0/315676309 shutdown_connections 2023-10-16T23:27:18.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.021+0000 7f0cb951d640 1 --2- 172.21.15.31:0/315676309 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cb40ba070 0x7f0cb40bcac0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.021+0000 7f0cb951d640 1 --2- 172.21.15.31:0/315676309 >> v2:172.21.15.12:3300/0 conn(0x7f0cb40bea50 0x7f0cb40bc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.021+0000 7f0cb951d640 1 -- 172.21.15.31:0/315676309 >> 172.21.15.31:0/315676309 conn(0x7f0cb40c2a70 msgr2=0x7f0cb40c2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:18.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.021+0000 7f0cb951d640 1 -- 172.21.15.31:0/315676309 shutdown_connections 2023-10-16T23:27:18.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.021+0000 7f0cb951d640 1 -- 172.21.15.31:0/315676309 wait complete. 2023-10-16T23:27:18.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cb951d640 1 Processor -- start 2023-10-16T23:27:18.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cb951d640 1 -- start start 2023-10-16T23:27:18.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cb951d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cb40b9b40 0x7f0cb4140c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:18.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cb951d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cb40ba070 0x7f0cb413c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:18.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cb951d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb40bea50 0x7f0cb413c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:18.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cb951d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb41e9430 con 0x7f0cb40b9b40 2023-10-16T23:27:18.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cb951d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb41411c0 con 0x7f0cb40bea50 2023-10-16T23:27:18.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cb951d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb4147590 con 0x7f0cb40ba070 2023-10-16T23:27:18.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cb27fc640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cb40ba070 0x7f0cb413c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:18.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cb37fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb40bea50 0x7f0cb413c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:18.033 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cb27fc640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cb40ba070 0x7f0cb413c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:43248/0 (socket says 172.21.15.31:43248) 2023-10-16T23:27:18.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cb27fc640 1 -- 172.21.15.31:0/1296347776 learned_addr learned my addr 172.21.15.31:0/1296347776 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-16T23:27:18.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cb2ffd640 1 --2- 172.21.15.31:0/1296347776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cb40b9b40 0x7f0cb4140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:18.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cb37fe640 1 -- 172.21.15.31:0/1296347776 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cb40ba070 msgr2=0x7f0cb413c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:18.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cb37fe640 1 --2- 172.21.15.31:0/1296347776 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cb40ba070 0x7f0cb413c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cb37fe640 1 -- 172.21.15.31:0/1296347776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cb40b9b40 msgr2=0x7f0cb4140c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:18.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cb37fe640 1 --2- 172.21.15.31:0/1296347776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cb40b9b40 0x7f0cb4140c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cb37fe640 1 -- 172.21.15.31:0/1296347776 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cac009b30 con 0x7f0cb40bea50 2023-10-16T23:27:18.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cb37fe640 1 --2- 172.21.15.31:0/1296347776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb40bea50 0x7f0cb413c8e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0cac0ab000 tx=0x7f0cac0196e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:18.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cab7fe640 1 -- 172.21.15.31:0/1296347776 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac0b8670 con 0x7f0cb40bea50 2023-10-16T23:27:18.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cab7fe640 1 -- 172.21.15.31:0/1296347776 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cac0b87d0 con 0x7f0cb40bea50 2023-10-16T23:27:18.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cb951d640 1 -- 172.21.15.31:0/1296347776 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb413ce20 con 0x7f0cb40bea50 2023-10-16T23:27:18.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cab7fe640 1 -- 172.21.15.31:0/1296347776 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac0b8b80 con 0x7f0cb40bea50 2023-10-16T23:27:18.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cb951d640 1 -- 172.21.15.31:0/1296347776 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb40b9120 con 0x7f0cb40bea50 2023-10-16T23:27:18.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cab7fe640 1 -- 172.21.15.31:0/1296347776 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0cac0039a0 con 0x7f0cb40bea50 2023-10-16T23:27:18.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cab7fe640 1 -- 172.21.15.31:0/1296347776 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f0cac0c1410 con 0x7f0cb40bea50 2023-10-16T23:27:18.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.025+0000 7f0cb951d640 1 -- 172.21.15.31:0/1296347776 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb41e95e0 con 0x7f0cb40bea50 2023-10-16T23:27:18.037 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.029+0000 7f0cab7fe640 1 -- 172.21.15.31:0/1296347776 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f0cb41e95e0 con 0x7f0cb40bea50 2023-10-16T23:27:18.047 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-10-16T23:27:18.045+0000 7f1c8a538180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-16T23:27:18.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.093+0000 7f0cb951d640 1 -- 172.21.15.31:0/1296347776 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a8824d77-7405-40f5-9234-60889802b184", "id": 4} v 0) v1 -- 0x7f0cb41477b0 con 0x7f0cb40bea50 2023-10-16T23:27:18.104 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-10-16T23:27:18.101+0000 7f1c8a538180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-16T23:27:18.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.105+0000 7f0cab7fe640 1 -- 172.21.15.31:0/1296347776 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a8824d77-7405-40f5-9234-60889802b184", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0cac0bc020 con 0x7f0cb40bea50 2023-10-16T23:27:18.109 INFO:teuthology.orchestra.run.smithi031.stdout:4 2023-10-16T23:27:18.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.105+0000 7f0cb951d640 1 -- 172.21.15.31:0/1296347776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb40bea50 msgr2=0x7f0cb413c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:18.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.105+0000 7f0cb951d640 1 --2- 172.21.15.31:0/1296347776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb40bea50 0x7f0cb413c8e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0cac0ab000 tx=0x7f0cac0196e0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.105+0000 7f0cb951d640 1 -- 172.21.15.31:0/1296347776 shutdown_connections 2023-10-16T23:27:18.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.105+0000 7f0cb951d640 1 --2- 172.21.15.31:0/1296347776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb40bea50 0x7f0cb413c8e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.105+0000 7f0cb951d640 1 --2- 172.21.15.31:0/1296347776 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0cb40ba070 0x7f0cb413c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.105+0000 7f0cb951d640 1 --2- 172.21.15.31:0/1296347776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0cb40b9b40 0x7f0cb4140c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.105+0000 7f0cb951d640 1 -- 172.21.15.31:0/1296347776 >> 172.21.15.31:0/1296347776 conn(0x7f0cb40c2a70 msgr2=0x7f0cb40bd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:18.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.105+0000 7f0cb951d640 1 -- 172.21.15.31:0/1296347776 shutdown_connections 2023-10-16T23:27:18.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.105+0000 7f0cb951d640 1 -- 172.21.15.31:0/1296347776 wait complete. 2023-10-16T23:27:18.126 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new 3bb01192-a47c-48e9-9662-285e3f6f4b57 5 2023-10-16T23:27:18.138 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-16T23:27:18.132+0000 7fdb4035e180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-16T23:27:18.162 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-10-16T23:27:18.157+0000 7f1c8a538180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-16T23:27:18.192 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-16T23:27:18.188+0000 7fdb4035e180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-16T23:27:18.245 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-10-16T23:27:18.241+0000 7f1c8a538180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-16T23:27:18.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.241+0000 7f52bfcac640 1 Processor -- start 2023-10-16T23:27:18.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.245+0000 7f52bfcac640 1 -- start start 2023-10-16T23:27:18.247 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-16T23:27:18.244+0000 7fdb4035e180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-16T23:27:18.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.245+0000 7f52bfcac640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f52b80bea50 0x7f52b80bc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:18.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.245+0000 7f52bfcac640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f52b80ba070 0x7f52b80bcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:18.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.245+0000 7f52bfcac640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52b806de10 con 0x7f52b80b9b40 2023-10-16T23:27:18.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.245+0000 7f52bfcac640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52b80bc150 con 0x7f52b80bea50 2023-10-16T23:27:18.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.245+0000 7f52bfcac640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52b80ba660 con 0x7f52b80ba070 2023-10-16T23:27:18.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.245+0000 7f52be249640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f52b80ba070 0x7f52b80bcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:18.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.245+0000 7f52be249640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f52b80ba070 0x7f52b80bcac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53806/0 (socket says 172.21.15.31:53806) 2023-10-16T23:27:18.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.245+0000 7f52be249640 1 -- 172.21.15.31:0/4049437508 learned_addr learned my addr 172.21.15.31:0/4049437508 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-16T23:27:18.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.245+0000 7f52bda48640 1 --2- 172.21.15.31:0/4049437508 >> v2:172.21.15.12:3300/0 conn(0x7f52b80bea50 0x7f52b80bc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:18.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.245+0000 7f52be249640 1 -- 172.21.15.31:0/4049437508 >> v2:172.21.15.12:3300/0 conn(0x7f52b80bea50 msgr2=0x7f52b80bc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:18.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.245+0000 7f52be249640 1 --2- 172.21.15.31:0/4049437508 >> v2:172.21.15.12:3300/0 conn(0x7f52b80bea50 0x7f52b80bc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.245+0000 7f52be249640 1 -- 172.21.15.31:0/4049437508 >> v1:172.21.15.12:6789/0 conn(0x7f52b80b9b40 legacy=0x7f52b81507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:18.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.245+0000 7f52be249640 1 -- 172.21.15.31:0/4049437508 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b80ba940 con 0x7f52b80ba070 2023-10-16T23:27:18.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52be249640 1 --2- 172.21.15.31:0/4049437508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52b80ba070 0x7f52b80bcac0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f52b8070750 tx=0x7f52a801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e337483ef7f8a60 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:18.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bca46640 1 -- 172.21.15.31:0/4049437508 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a80ab600 con 0x7f52b80ba070 2023-10-16T23:27:18.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bca46640 1 -- 172.21.15.31:0/4049437508 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a80a7050 con 0x7f52b80ba070 2023-10-16T23:27:18.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bca46640 1 -- 172.21.15.31:0/4049437508 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a80ab980 con 0x7f52b80ba070 2023-10-16T23:27:18.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bfcac640 1 -- 172.21.15.31:0/4049437508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52b80ba070 msgr2=0x7f52b80bcac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:18.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bfcac640 1 --2- 172.21.15.31:0/4049437508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52b80ba070 0x7f52b80bcac0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f52b8070750 tx=0x7f52a801c470 comp rx=0 tx=0).stop 2023-10-16T23:27:18.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bfcac640 1 -- 172.21.15.31:0/4049437508 shutdown_connections 2023-10-16T23:27:18.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bfcac640 1 --2- 172.21.15.31:0/4049437508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52b80ba070 0x7f52b80bcac0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.254 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bfcac640 1 --2- 172.21.15.31:0/4049437508 >> v2:172.21.15.12:3300/0 conn(0x7f52b80bea50 0x7f52b80bc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bfcac640 1 -- 172.21.15.31:0/4049437508 >> 172.21.15.31:0/4049437508 conn(0x7f52b80c2a70 msgr2=0x7f52b80c2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:18.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bfcac640 1 -- 172.21.15.31:0/4049437508 shutdown_connections 2023-10-16T23:27:18.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bfcac640 1 -- 172.21.15.31:0/4049437508 wait complete. 2023-10-16T23:27:18.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bfcac640 1 Processor -- start 2023-10-16T23:27:18.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bfcac640 1 -- start start 2023-10-16T23:27:18.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bfcac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52b80b9b40 0x7f52b8140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:18.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bfcac640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52b80ba070 0x7f52b8140840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:18.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bfcac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52b80bea50 0x7f52b81e8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:18.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bfcac640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b8140d80 con 0x7f52b80bea50 2023-10-16T23:27:18.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bfcac640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b814f260 con 0x7f52b80b9b40 2023-10-16T23:27:18.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bfcac640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b814f540 con 0x7f52b80ba070 2023-10-16T23:27:18.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bda48640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52b80b9b40 0x7f52b8140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:18.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bda48640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52b80b9b40 0x7f52b8140fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53810/0 (socket says 172.21.15.31:53810) 2023-10-16T23:27:18.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bda48640 1 -- 172.21.15.31:0/3498967904 learned_addr learned my addr 172.21.15.31:0/3498967904 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-16T23:27:18.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bd247640 1 --2- 172.21.15.31:0/3498967904 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52b80ba070 0x7f52b8140840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:18.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52be249640 1 --2- 172.21.15.31:0/3498967904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52b80bea50 0x7f52b81e8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:18.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bda48640 1 -- 172.21.15.31:0/3498967904 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52b80ba070 msgr2=0x7f52b8140840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:18.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bda48640 1 --2- 172.21.15.31:0/3498967904 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52b80ba070 0x7f52b8140840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bda48640 1 -- 172.21.15.31:0/3498967904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52b80bea50 msgr2=0x7f52b81e8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:18.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.249+0000 7f52bda48640 1 --2- 172.21.15.31:0/3498967904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52b80bea50 0x7f52b81e8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.253+0000 7f52bda48640 1 -- 172.21.15.31:0/3498967904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a80094d0 con 0x7f52b80b9b40 2023-10-16T23:27:18.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.253+0000 7f52be249640 1 --2- 172.21.15.31:0/3498967904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52b80bea50 0x7f52b81e8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:27:18.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.253+0000 7f52bda48640 1 --2- 172.21.15.31:0/3498967904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52b80b9b40 0x7f52b8140fd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f52b0007e60 tx=0x7f52b000e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:18.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.253+0000 7f52b67fc640 1 -- 172.21.15.31:0/3498967904 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b0014620 con 0x7f52b80b9b40 2023-10-16T23:27:18.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.253+0000 7f52b67fc640 1 -- 172.21.15.31:0/3498967904 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b000ee90 con 0x7f52b80b9b40 2023-10-16T23:27:18.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.253+0000 7f52b67fc640 1 -- 172.21.15.31:0/3498967904 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b00149e0 con 0x7f52b80b9b40 2023-10-16T23:27:18.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.253+0000 7f52bfcac640 1 -- 172.21.15.31:0/3498967904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b814f820 con 0x7f52b80b9b40 2023-10-16T23:27:18.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.253+0000 7f52bfcac640 1 -- 172.21.15.31:0/3498967904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b81e8b60 con 0x7f52b80b9b40 2023-10-16T23:27:18.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.253+0000 7f52b67fc640 1 -- 172.21.15.31:0/3498967904 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f52b001e460 con 0x7f52b80b9b40 2023-10-16T23:27:18.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.253+0000 7f52b67fc640 1 -- 172.21.15.31:0/3498967904 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f52b001d940 con 0x7f52b80b9b40 2023-10-16T23:27:18.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.253+0000 7f52bfcac640 1 -- 172.21.15.31:0/3498967904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b814f0c0 con 0x7f52b80b9b40 2023-10-16T23:27:18.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.253+0000 7f52b67fc640 1 -- 172.21.15.31:0/3498967904 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f52b814f0c0 con 0x7f52b80b9b40 2023-10-16T23:27:18.302 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-10-16T23:27:18.297+0000 7f1c8a538180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-16T23:27:18.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.321+0000 7f52bfcac640 1 -- 172.21.15.31:0/3498967904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3bb01192-a47c-48e9-9662-285e3f6f4b57", "id": 5} v 0) v1 -- 0x7f52b80673a0 con 0x7f52b80b9b40 2023-10-16T23:27:18.327 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-16T23:27:18.324+0000 7fdb4035e180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-16T23:27:18.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.333+0000 7f52b67fc640 1 -- 172.21.15.31:0/3498967904 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3bb01192-a47c-48e9-9662-285e3f6f4b57", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f52b001dca0 con 0x7f52b80b9b40 2023-10-16T23:27:18.337 INFO:teuthology.orchestra.run.smithi031.stdout:5 2023-10-16T23:27:18.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.333+0000 7f52bfcac640 1 -- 172.21.15.31:0/3498967904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52b80b9b40 msgr2=0x7f52b8140fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:18.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.333+0000 7f52bfcac640 1 --2- 172.21.15.31:0/3498967904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52b80b9b40 0x7f52b8140fd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f52b0007e60 tx=0x7f52b000e4b0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.333+0000 7f52bfcac640 1 -- 172.21.15.31:0/3498967904 shutdown_connections 2023-10-16T23:27:18.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.333+0000 7f52bfcac640 1 --2- 172.21.15.31:0/3498967904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52b80bea50 0x7f52b81e8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.333+0000 7f52bfcac640 1 --2- 172.21.15.31:0/3498967904 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52b80ba070 0x7f52b8140840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.333+0000 7f52bfcac640 1 --2- 172.21.15.31:0/3498967904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52b80b9b40 0x7f52b8140fd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.333+0000 7f52bfcac640 1 -- 172.21.15.31:0/3498967904 >> 172.21.15.31:0/3498967904 conn(0x7f52b80c2a70 msgr2=0x7f52b8144e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:18.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.333+0000 7f52bfcac640 1 -- 172.21.15.31:0/3498967904 shutdown_connections 2023-10-16T23:27:18.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.333+0000 7f52bfcac640 1 -- 172.21.15.31:0/3498967904 wait complete. 2023-10-16T23:27:18.353 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new 1e2d18e4-73e6-4a37-826c-35eca4d96935 6 2023-10-16T23:27:18.382 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-16T23:27:18.380+0000 7fdb4035e180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-16T23:27:18.385 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-10-16T23:27:18.381+0000 7f1c8a538180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-16T23:27:18.441 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-10-16T23:27:18.437+0000 7f1c8a538180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-16T23:27:18.462 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-16T23:27:18.460+0000 7fdb4035e180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-16T23:27:18.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.493+0000 7f2b369ae640 1 Processor -- start 2023-10-16T23:27:18.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.493+0000 7f2b369ae640 1 -- start start 2023-10-16T23:27:18.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.497+0000 7f2b369ae640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2b300a6e70 0x7f2b300bffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:18.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.497+0000 7f2b369ae640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b3006c920 0x7f2b3006fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:18.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.497+0000 7f2b369ae640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b300bfcd0 con 0x7f2b30070130 2023-10-16T23:27:18.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.497+0000 7f2b369ae640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b300c13c0 con 0x7f2b300a6e70 2023-10-16T23:27:18.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.497+0000 7f2b369ae640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b300bf9f0 con 0x7f2b3006c920 2023-10-16T23:27:18.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.497+0000 7f2b2f7fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b3006c920 0x7f2b3006fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:18.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.497+0000 7f2b2f7fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b3006c920 0x7f2b3006fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:43252/0 (socket says 172.21.15.31:43252) 2023-10-16T23:27:18.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.497+0000 7f2b2f7fe640 1 -- 172.21.15.31:0/2300874702 learned_addr learned my addr 172.21.15.31:0/2300874702 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-16T23:27:18.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.497+0000 7f2b2ffff640 1 --2- 172.21.15.31:0/2300874702 >> v2:172.21.15.12:3300/0 conn(0x7f2b300a6e70 0x7f2b300bffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:18.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.497+0000 7f2b2f7fe640 1 -- 172.21.15.31:0/2300874702 >> v2:172.21.15.12:3300/0 conn(0x7f2b300a6e70 msgr2=0x7f2b300bffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:18.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.497+0000 7f2b2f7fe640 1 --2- 172.21.15.31:0/2300874702 >> v2:172.21.15.12:3300/0 conn(0x7f2b300a6e70 0x7f2b300bffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.497+0000 7f2b2f7fe640 1 -- 172.21.15.31:0/2300874702 >> v1:172.21.15.12:6789/0 conn(0x7f2b30070130 legacy=0x7f2b3014dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:18.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.497+0000 7f2b2f7fe640 1 -- 172.21.15.31:0/2300874702 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b300bdeb0 con 0x7f2b3006c920 2023-10-16T23:27:18.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.497+0000 7f2b2f7fe640 1 --2- 172.21.15.31:0/2300874702 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b3006c920 0x7f2b3006fbf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009870 tx=0x7f2b1801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edaeabdd16765d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:18.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.497+0000 7f2b2effd640 1 -- 172.21.15.31:0/2300874702 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b180aa680 con 0x7f2b3006c920 2023-10-16T23:27:18.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.497+0000 7f2b2effd640 1 -- 172.21.15.31:0/2300874702 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b180aa7e0 con 0x7f2b3006c920 2023-10-16T23:27:18.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.497+0000 7f2b2effd640 1 -- 172.21.15.31:0/2300874702 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b180aab70 con 0x7f2b3006c920 2023-10-16T23:27:18.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b369ae640 1 -- 172.21.15.31:0/2300874702 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b3006c920 msgr2=0x7f2b3006fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:18.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b369ae640 1 --2- 172.21.15.31:0/2300874702 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b3006c920 0x7f2b3006fbf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009870 tx=0x7f2b1801c540 comp rx=0 tx=0).stop 2023-10-16T23:27:18.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b369ae640 1 -- 172.21.15.31:0/2300874702 shutdown_connections 2023-10-16T23:27:18.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b369ae640 1 --2- 172.21.15.31:0/2300874702 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b3006c920 0x7f2b3006fbf0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b369ae640 1 --2- 172.21.15.31:0/2300874702 >> v2:172.21.15.12:3300/0 conn(0x7f2b300a6e70 0x7f2b300bffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b369ae640 1 -- 172.21.15.31:0/2300874702 >> 172.21.15.31:0/2300874702 conn(0x7f2b300c18f0 msgr2=0x7f2b300c1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:18.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b369ae640 1 -- 172.21.15.31:0/2300874702 shutdown_connections 2023-10-16T23:27:18.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b369ae640 1 -- 172.21.15.31:0/2300874702 wait complete. 2023-10-16T23:27:18.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b369ae640 1 Processor -- start 2023-10-16T23:27:18.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b369ae640 1 -- start start 2023-10-16T23:27:18.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b369ae640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b30070130 0x7f2b3013f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:18.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b369ae640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b300a6e70 0x7f2b301e89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:18.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b369ae640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b3013ffc0 0x7f2b301e8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:18.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b369ae640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b301e9470 con 0x7f2b30070130 2023-10-16T23:27:18.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b369ae640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b300a1470 con 0x7f2b300a6e70 2023-10-16T23:27:18.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b369ae640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b301e96e0 con 0x7f2b3013ffc0 2023-10-16T23:27:18.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b2f7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b300a6e70 0x7f2b301e89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:18.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b34f4b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b3013ffc0 0x7f2b301e8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:18.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b2f7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b300a6e70 0x7f2b301e89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53820/0 (socket says 172.21.15.31:53820) 2023-10-16T23:27:18.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b2f7fe640 1 -- 172.21.15.31:0/3176415 learned_addr learned my addr 172.21.15.31:0/3176415 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-16T23:27:18.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b34f4b640 1 --2- 172.21.15.31:0/3176415 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b3013ffc0 0x7f2b301e8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:43254/0 (socket says 172.21.15.31:43254) 2023-10-16T23:27:18.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b2ffff640 1 --2- 172.21.15.31:0/3176415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b30070130 0x7f2b3013f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:18.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b2f7fe640 1 -- 172.21.15.31:0/3176415 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b3013ffc0 msgr2=0x7f2b301e8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:18.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b2f7fe640 1 --2- 172.21.15.31:0/3176415 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b3013ffc0 0x7f2b301e8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b2f7fe640 1 -- 172.21.15.31:0/3176415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b30070130 msgr2=0x7f2b3013f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:18.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b2f7fe640 1 --2- 172.21.15.31:0/3176415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b30070130 0x7f2b3013f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b2f7fe640 1 -- 172.21.15.31:0/3176415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b180094d0 con 0x7f2b300a6e70 2023-10-16T23:27:18.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b2ffff640 1 --2- 172.21.15.31:0/3176415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b30070130 0x7f2b3013f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:27:18.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b2f7fe640 1 --2- 172.21.15.31:0/3176415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b300a6e70 0x7f2b301e89f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2b180ac040 tx=0x7f2b1801ad80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:18.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b2cff9640 1 -- 172.21.15.31:0/3176415 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b180b3800 con 0x7f2b300a6e70 2023-10-16T23:27:18.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b2cff9640 1 -- 172.21.15.31:0/3176415 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b180b3980 con 0x7f2b300a6e70 2023-10-16T23:27:18.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b369ae640 1 -- 172.21.15.31:0/3176415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b300bd7d0 con 0x7f2b300a6e70 2023-10-16T23:27:18.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b2cff9640 1 -- 172.21.15.31:0/3176415 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b180b3d30 con 0x7f2b300a6e70 2023-10-16T23:27:18.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b369ae640 1 -- 172.21.15.31:0/3176415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b30144970 con 0x7f2b300a6e70 2023-10-16T23:27:18.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b2cff9640 1 -- 172.21.15.31:0/3176415 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2b180bd6f0 con 0x7f2b300a6e70 2023-10-16T23:27:18.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.501+0000 7f2b2cff9640 1 -- 172.21.15.31:0/3176415 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f2b180c6ac0 con 0x7f2b300a6e70 2023-10-16T23:27:18.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.505+0000 7f2b369ae640 1 -- 172.21.15.31:0/3176415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b300673a0 con 0x7f2b300a6e70 2023-10-16T23:27:18.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.505+0000 7f2b2cff9640 1 -- 172.21.15.31:0/3176415 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f2b180c6c80 con 0x7f2b300a6e70 2023-10-16T23:27:18.516 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-16T23:27:18.512+0000 7fdb4035e180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-16T23:27:18.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.573+0000 7f2b369ae640 1 -- 172.21.15.31:0/3176415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1e2d18e4-73e6-4a37-826c-35eca4d96935", "id": 6} v 0) v1 -- 0x7f2b301e9820 con 0x7f2b300a6e70 2023-10-16T23:27:18.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.581+0000 7f2b2cff9640 1 -- 172.21.15.31:0/3176415 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1e2d18e4-73e6-4a37-826c-35eca4d96935", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2b180c6e20 con 0x7f2b300a6e70 2023-10-16T23:27:18.587 INFO:teuthology.orchestra.run.smithi031.stdout:6 2023-10-16T23:27:18.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.585+0000 7f2b369ae640 1 -- 172.21.15.31:0/3176415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b300a6e70 msgr2=0x7f2b301e89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:18.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.585+0000 7f2b369ae640 1 --2- 172.21.15.31:0/3176415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b300a6e70 0x7f2b301e89f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2b180ac040 tx=0x7f2b1801ad80 comp rx=0 tx=0).stop 2023-10-16T23:27:18.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.585+0000 7f2b369ae640 1 -- 172.21.15.31:0/3176415 shutdown_connections 2023-10-16T23:27:18.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.585+0000 7f2b369ae640 1 --2- 172.21.15.31:0/3176415 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b3013ffc0 0x7f2b301e8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.585+0000 7f2b369ae640 1 --2- 172.21.15.31:0/3176415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b300a6e70 0x7f2b301e89f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.585+0000 7f2b369ae640 1 --2- 172.21.15.31:0/3176415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b30070130 0x7f2b3013f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.585+0000 7f2b369ae640 1 -- 172.21.15.31:0/3176415 >> 172.21.15.31:0/3176415 conn(0x7f2b300c18f0 msgr2=0x7f2b30143fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:18.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.585+0000 7f2b369ae640 1 -- 172.21.15.31:0/3176415 shutdown_connections 2023-10-16T23:27:18.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.585+0000 7f2b369ae640 1 -- 172.21.15.31:0/3176415 wait complete. 2023-10-16T23:27:18.594 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-10-16T23:27:18.589+0000 7f1c8a538180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-16T23:27:18.603 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new e0f369c0-562b-4440-a5aa-12275c29412b 7 2023-10-16T23:27:18.659 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-10-16T23:27:18.657+0000 7f1c8a538180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-16T23:27:18.662 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-16T23:27:18.660+0000 7fdb4035e180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-16T23:27:18.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.709+0000 7f6077642640 1 Processor -- start 2023-10-16T23:27:18.714 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.709+0000 7f6077642640 1 -- start start 2023-10-16T23:27:18.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.709+0000 7f6077642640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60700b5ee0 0x7f60700b7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:18.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.709+0000 7f6077642640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f60700b80e0 0x7f607014c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:18.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.709+0000 7f6077642640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6070134f20 con 0x7f607014f910 2023-10-16T23:27:18.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.709+0000 7f6077642640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6070135690 con 0x7f60700b80e0 2023-10-16T23:27:18.716 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.709+0000 7f6077642640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6070070980 con 0x7f60700b5ee0 2023-10-16T23:27:18.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.709+0000 7f6074bdd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60700b5ee0 0x7f60700b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:18.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.709+0000 7f6074bdd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60700b5ee0 0x7f60700b7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:43262/0 (socket says 172.21.15.31:43262) 2023-10-16T23:27:18.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.709+0000 7f6074bdd640 1 -- 172.21.15.31:0/681382614 learned_addr learned my addr 172.21.15.31:0/681382614 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-16T23:27:18.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.709+0000 7f6075bdf640 1 --2- 172.21.15.31:0/681382614 >> v2:172.21.15.12:3300/0 conn(0x7f60700b80e0 0x7f607014c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:18.717 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.709+0000 7f6074bdd640 1 -- 172.21.15.31:0/681382614 >> v2:172.21.15.12:3300/0 conn(0x7f60700b80e0 msgr2=0x7f607014c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:18.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.709+0000 7f6074bdd640 1 --2- 172.21.15.31:0/681382614 >> v2:172.21.15.12:3300/0 conn(0x7f60700b80e0 0x7f607014c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.709+0000 7f6074bdd640 1 -- 172.21.15.31:0/681382614 >> v1:172.21.15.12:6789/0 conn(0x7f607014f910 legacy=0x7f60700b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:18.718 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.709+0000 7f6074bdd640 1 -- 172.21.15.31:0/681382614 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60700b7c60 con 0x7f60700b5ee0 2023-10-16T23:27:18.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.713+0000 7f6074bdd640 1 --2- 172.21.15.31:0/681382614 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60700b5ee0 0x7f60700b7720 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f606c009870 tx=0x7f606c01c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f323415552a36ec0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:18.719 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.713+0000 7f6063fff640 1 -- 172.21.15.31:0/681382614 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c0ac630 con 0x7f60700b5ee0 2023-10-16T23:27:18.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.713+0000 7f6063fff640 1 -- 172.21.15.31:0/681382614 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606c0ac790 con 0x7f60700b5ee0 2023-10-16T23:27:18.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.713+0000 7f6063fff640 1 -- 172.21.15.31:0/681382614 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c0acb20 con 0x7f60700b5ee0 2023-10-16T23:27:18.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.713+0000 7f6077642640 1 -- 172.21.15.31:0/681382614 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60700b5ee0 msgr2=0x7f60700b7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:18.720 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.713+0000 7f6077642640 1 --2- 172.21.15.31:0/681382614 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60700b5ee0 0x7f60700b7720 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f606c009870 tx=0x7f606c01c500 comp rx=0 tx=0).stop 2023-10-16T23:27:18.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.713+0000 7f6077642640 1 -- 172.21.15.31:0/681382614 shutdown_connections 2023-10-16T23:27:18.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.713+0000 7f6077642640 1 --2- 172.21.15.31:0/681382614 >> v2:172.21.15.12:3300/0 conn(0x7f60700b80e0 0x7f607014c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.713+0000 7f6077642640 1 --2- 172.21.15.31:0/681382614 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60700b5ee0 0x7f60700b7720 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.713+0000 7f6077642640 1 -- 172.21.15.31:0/681382614 >> 172.21.15.31:0/681382614 conn(0x7f6070069d30 msgr2=0x7f607006a140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:18.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.713+0000 7f6077642640 1 -- 172.21.15.31:0/681382614 shutdown_connections 2023-10-16T23:27:18.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.713+0000 7f6077642640 1 -- 172.21.15.31:0/681382614 wait complete. 2023-10-16T23:27:18.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f6077642640 1 Processor -- start 2023-10-16T23:27:18.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f6077642640 1 -- start start 2023-10-16T23:27:18.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f6077642640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60700b5ee0 0x7f6070149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:18.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f6077642640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60700b80e0 0x7f60701eabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:18.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f6077642640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f607014f910 0x7f6070132220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:18.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f6077642640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6070151ef0 con 0x7f607014f910 2023-10-16T23:27:18.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f6077642640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6070131d90 con 0x7f60700b80e0 2023-10-16T23:27:18.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f6077642640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6070149ab0 con 0x7f60700b5ee0 2023-10-16T23:27:18.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f60753de640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60700b5ee0 0x7f6070149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:18.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f6074bdd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60700b80e0 0x7f60701eabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:18.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f6074bdd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60700b80e0 0x7f60701eabd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53822/0 (socket says 172.21.15.31:53822) 2023-10-16T23:27:18.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f60753de640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60700b5ee0 0x7f6070149570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:43272/0 (socket says 172.21.15.31:43272) 2023-10-16T23:27:18.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f6074bdd640 1 -- 172.21.15.31:0/2267596763 learned_addr learned my addr 172.21.15.31:0/2267596763 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-10-16T23:27:18.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f6075bdf640 1 --2- 172.21.15.31:0/2267596763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f607014f910 0x7f6070132220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:18.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f6074bdd640 1 -- 172.21.15.31:0/2267596763 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60700b5ee0 msgr2=0x7f6070149570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:18.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f6074bdd640 1 --2- 172.21.15.31:0/2267596763 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60700b5ee0 0x7f6070149570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f6074bdd640 1 -- 172.21.15.31:0/2267596763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f607014f910 msgr2=0x7f6070132220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:18.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f6074bdd640 1 --2- 172.21.15.31:0/2267596763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f607014f910 0x7f6070132220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f6074bdd640 1 -- 172.21.15.31:0/2267596763 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606c0094d0 con 0x7f60700b80e0 2023-10-16T23:27:18.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f6074bdd640 1 --2- 172.21.15.31:0/2267596763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60700b80e0 0x7f60701eabd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f606c0af040 tx=0x7f606c0192a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:18.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f6061ffb640 1 -- 172.21.15.31:0/2267596763 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c0b7670 con 0x7f60700b80e0 2023-10-16T23:27:18.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f6061ffb640 1 -- 172.21.15.31:0/2267596763 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606c0b77d0 con 0x7f60700b80e0 2023-10-16T23:27:18.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f6077642640 1 -- 172.21.15.31:0/2267596763 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6070156290 con 0x7f60700b80e0 2023-10-16T23:27:18.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f6061ffb640 1 -- 172.21.15.31:0/2267596763 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c0b7b80 con 0x7f60700b80e0 2023-10-16T23:27:18.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f6077642640 1 -- 172.21.15.31:0/2267596763 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f607012f2c0 con 0x7f60700b80e0 2023-10-16T23:27:18.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f6061ffb640 1 -- 172.21.15.31:0/2267596763 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f606c0b3070 con 0x7f60700b80e0 2023-10-16T23:27:18.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f6061ffb640 1 -- 172.21.15.31:0/2267596763 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f606c0c1c80 con 0x7f60700b80e0 2023-10-16T23:27:18.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.717+0000 7f6077642640 1 -- 172.21.15.31:0/2267596763 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6070131b80 con 0x7f60700b80e0 2023-10-16T23:27:18.730 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-16T23:27:18.720+0000 7fdb4035e180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-16T23:27:18.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.721+0000 7f6061ffb640 1 -- 172.21.15.31:0/2267596763 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f606c0b1070 con 0x7f60700b80e0 2023-10-16T23:27:18.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.789+0000 7f6077642640 1 -- 172.21.15.31:0/2267596763 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e0f369c0-562b-4440-a5aa-12275c29412b", "id": 7} v 0) v1 -- 0x7f60700673a0 con 0x7f60700b80e0 2023-10-16T23:27:18.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.797+0000 7f6061ffb640 1 -- 172.21.15.31:0/2267596763 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e0f369c0-562b-4440-a5aa-12275c29412b", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f606c0a8050 con 0x7f60700b80e0 2023-10-16T23:27:18.801 INFO:teuthology.orchestra.run.smithi031.stdout:7 2023-10-16T23:27:18.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.797+0000 7f6077642640 1 -- 172.21.15.31:0/2267596763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60700b80e0 msgr2=0x7f60701eabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:18.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.797+0000 7f6077642640 1 --2- 172.21.15.31:0/2267596763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60700b80e0 0x7f60701eabd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f606c0af040 tx=0x7f606c0192a0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.797+0000 7f6077642640 1 -- 172.21.15.31:0/2267596763 shutdown_connections 2023-10-16T23:27:18.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.797+0000 7f6077642640 1 --2- 172.21.15.31:0/2267596763 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f607014f910 0x7f6070132220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.797+0000 7f6077642640 1 --2- 172.21.15.31:0/2267596763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60700b80e0 0x7f60701eabd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.797+0000 7f6077642640 1 --2- 172.21.15.31:0/2267596763 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60700b5ee0 0x7f6070149570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.797+0000 7f6077642640 1 -- 172.21.15.31:0/2267596763 >> 172.21.15.31:0/2267596763 conn(0x7f6070069d30 msgr2=0x7f607006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:18.803 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.797+0000 7f6077642640 1 -- 172.21.15.31:0/2267596763 shutdown_connections 2023-10-16T23:27:18.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-10-16T23:27:18.797+0000 7f6077642640 1 -- 172.21.15.31:0/2267596763 wait complete. 2023-10-16T23:27:18.816 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-16T23:27:18.817 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-16T23:27:18.819 INFO:tasks.ceph.osd.0:Started 2023-10-16T23:27:18.820 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-16T23:27:18.820 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-16T23:27:18.823 INFO:tasks.ceph.osd.1:Started 2023-10-16T23:27:18.823 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-16T23:27:18.823 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-16T23:27:18.826 INFO:tasks.ceph.osd.2:Started 2023-10-16T23:27:18.826 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-16T23:27:18.827 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-16T23:27:18.830 INFO:tasks.ceph.osd.3:Started 2023-10-16T23:27:18.830 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-16T23:27:18.830 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-16T23:27:18.832 INFO:tasks.ceph.osd.4:Started 2023-10-16T23:27:18.833 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-16T23:27:18.833 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-16T23:27:18.835 INFO:tasks.ceph.osd.5:Started 2023-10-16T23:27:18.835 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-16T23:27:18.836 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-16T23:27:18.838 INFO:tasks.ceph.osd.6:Started 2023-10-16T23:27:18.838 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-16T23:27:18.839 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-16T23:27:18.841 INFO:tasks.ceph.osd.7:Started 2023-10-16T23:27:18.841 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T23:27:18.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.952+0000 7ff3ee32d640 1 Processor -- start 2023-10-16T23:27:18.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.952+0000 7ff3ee32d640 1 -- start start 2023-10-16T23:27:18.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.952+0000 7ff3ee32d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff3e80a8c00 0x7ff3e814cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:18.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.952+0000 7ff3ee32d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff3e80a8250 0x7ff3e80bf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:18.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.952+0000 7ff3ee32d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e80a86a0 con 0x7ff3e80c34c0 2023-10-16T23:27:18.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.952+0000 7ff3ee32d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e814dae0 con 0x7ff3e80a8c00 2023-10-16T23:27:18.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.952+0000 7ff3ee32d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e814ddc0 con 0x7ff3e80a8250 2023-10-16T23:27:18.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.952+0000 7ff3e7fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff3e80c34c0 0x7ff3e814c400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48368/0 (socket says 172.21.15.12:48368) 2023-10-16T23:27:18.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.952+0000 7ff3e77fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff3e80a8c00 0x7ff3e814cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:18.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.952+0000 7ff3e7fff640 1 -- 172.21.15.12:0/338732269 learned_addr learned my addr 172.21.15.12:0/338732269 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:18.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.952+0000 7ff3ec8ca640 1 --2- 172.21.15.12:0/338732269 >> v2:172.21.15.31:3300/0 conn(0x7ff3e80a8250 0x7ff3e80bf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:18.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.952+0000 7ff3e77fe640 1 -- 172.21.15.12:0/338732269 >> v2:172.21.15.31:3300/0 conn(0x7ff3e80a8250 msgr2=0x7ff3e80bf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:18.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.952+0000 7ff3e77fe640 1 --2- 172.21.15.12:0/338732269 >> v2:172.21.15.31:3300/0 conn(0x7ff3e80a8250 0x7ff3e80bf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.952+0000 7ff3e77fe640 1 -- 172.21.15.12:0/338732269 >> v1:172.21.15.12:6789/0 conn(0x7ff3e80c34c0 legacy=0x7ff3e814c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:18.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.952+0000 7ff3e77fe640 1 -- 172.21.15.12:0/338732269 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e814e0a0 con 0x7ff3e80a8c00 2023-10-16T23:27:18.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3e77fe640 1 --2- 172.21.15.12:0/338732269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3e80a8c00 0x7ff3e814cb10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff3e814d050 tx=0x7ff3d001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=396c1debec91286b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:18.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3e6ffd640 1 -- 172.21.15.12:0/338732269 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d00ab600 con 0x7ff3e80a8c00 2023-10-16T23:27:18.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3e6ffd640 1 -- 172.21.15.12:0/338732269 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d00a7050 con 0x7ff3e80a8c00 2023-10-16T23:27:18.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3e6ffd640 1 -- 172.21.15.12:0/338732269 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d00ab980 con 0x7ff3e80a8c00 2023-10-16T23:27:18.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3ee32d640 1 -- 172.21.15.12:0/338732269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3e80a8c00 msgr2=0x7ff3e814cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:18.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3ee32d640 1 --2- 172.21.15.12:0/338732269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3e80a8c00 0x7ff3e814cb10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff3e814d050 tx=0x7ff3d001c460 comp rx=0 tx=0).stop 2023-10-16T23:27:18.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3ee32d640 1 -- 172.21.15.12:0/338732269 shutdown_connections 2023-10-16T23:27:18.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3ee32d640 1 --2- 172.21.15.12:0/338732269 >> v2:172.21.15.31:3300/0 conn(0x7ff3e80a8250 0x7ff3e80bf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3ee32d640 1 --2- 172.21.15.12:0/338732269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3e80a8c00 0x7ff3e814cb10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3ee32d640 1 -- 172.21.15.12:0/338732269 >> 172.21.15.12:0/338732269 conn(0x7ff3e806ba00 msgr2=0x7ff3e80c2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:18.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3ee32d640 1 -- 172.21.15.12:0/338732269 shutdown_connections 2023-10-16T23:27:18.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3ee32d640 1 -- 172.21.15.12:0/338732269 wait complete. 2023-10-16T23:27:18.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3ee32d640 1 Processor -- start 2023-10-16T23:27:18.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3ee32d640 1 -- start start 2023-10-16T23:27:18.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3ee32d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3e80a8250 0x7ff3e8146120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:18.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3ee32d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3e80a8c00 0x7ff3e806eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:18.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3ee32d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3e80c34c0 0x7ff3e8156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:18.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3ee32d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e806f400 con 0x7ff3e80c34c0 2023-10-16T23:27:18.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3ee32d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e81434f0 con 0x7ff3e80a8c00 2023-10-16T23:27:18.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3ee32d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e806f620 con 0x7ff3e80a8250 2023-10-16T23:27:18.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3ec8ca640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3e80c34c0 0x7ff3e8156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:18.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3ec8ca640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3e80c34c0 0x7ff3e8156d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53388/0 (socket says 172.21.15.12:53388) 2023-10-16T23:27:18.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3ec8ca640 1 -- 172.21.15.12:0/2027098128 learned_addr learned my addr 172.21.15.12:0/2027098128 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:18.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3e7fff640 1 --2- 172.21.15.12:0/2027098128 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3e80a8250 0x7ff3e8146120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:18.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3ec8ca640 1 -- 172.21.15.12:0/2027098128 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3e80a8250 msgr2=0x7ff3e8146120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:18.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3ec8ca640 1 --2- 172.21.15.12:0/2027098128 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3e80a8250 0x7ff3e8146120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3ec8ca640 1 -- 172.21.15.12:0/2027098128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3e80a8c00 msgr2=0x7ff3e806eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:18.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3ec8ca640 1 --2- 172.21.15.12:0/2027098128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3e80a8c00 0x7ff3e806eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:18.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3ec8ca640 1 -- 172.21.15.12:0/2027098128 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d0009420 con 0x7ff3e80c34c0 2023-10-16T23:27:18.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3e7fff640 1 --2- 172.21.15.12:0/2027098128 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3e80a8250 0x7ff3e8146120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:27:18.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3ec8ca640 1 --2- 172.21.15.12:0/2027098128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3e80c34c0 0x7ff3e8156d60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800d800 tx=0x7ff3d800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:18.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.956+0000 7ff3e4ff9640 1 -- 172.21.15.12:0/2027098128 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d800b6c0 con 0x7ff3e80c34c0 2023-10-16T23:27:18.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.960+0000 7ff3e4ff9640 1 -- 172.21.15.12:0/2027098128 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d800b820 con 0x7ff3e80c34c0 2023-10-16T23:27:18.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.960+0000 7ff3e4ff9640 1 -- 172.21.15.12:0/2027098128 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d800bbd0 con 0x7ff3e80c34c0 2023-10-16T23:27:18.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.960+0000 7ff3ee32d640 1 -- 172.21.15.12:0/2027098128 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e806f900 con 0x7ff3e80c34c0 2023-10-16T23:27:18.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.960+0000 7ff3ee32d640 1 -- 172.21.15.12:0/2027098128 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e8143160 con 0x7ff3e80c34c0 2023-10-16T23:27:18.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.960+0000 7ff3e4ff9640 1 -- 172.21.15.12:0/2027098128 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff3d801e760 con 0x7ff3e80c34c0 2023-10-16T23:27:18.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.960+0000 7ff3e4ff9640 1 -- 172.21.15.12:0/2027098128 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ff3d8014bf0 con 0x7ff3e80c34c0 2023-10-16T23:27:18.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.960+0000 7ff3ee32d640 1 -- 172.21.15.12:0/2027098128 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3e80673a0 con 0x7ff3e80c34c0 2023-10-16T23:27:18.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:18.976+0000 7ff3e4ff9640 1 -- 172.21.15.12:0/2027098128 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7ff3d8014e40 con 0x7ff3e80c34c0 2023-10-16T23:27:19.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:19.072+0000 7ff3ee32d640 1 -- 172.21.15.12:0/2027098128 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3e81ee310 con 0x7ff3e80c34c0 2023-10-16T23:27:19.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:19.072+0000 7ff3e4ff9640 1 -- 172.21.15.12:0/2027098128 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff3d8014520 con 0x7ff3e80c34c0 2023-10-16T23:27:19.077 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:19.077 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":10,"fsid":"0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51","created":"2023-10-16T23:27:16.468087+0000","modified":"2023-10-16T23:27:18.793212+0000","last_up_change":"0.000000","last_in_change":"2023-10-16T23:27:18.793212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"73e70f98-6f5e-4464-b34e-931faac41cc9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ff722efe-b3f9-4cc0-bbde-f4d4d8055a70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9baf25db-dce0-4065-90d6-f35867286be2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8a620ad3-2294-470d-8a8c-66f177f5fbe7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a8824d77-7405-40f5-9234-60889802b184","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3bb01192-a47c-48e9-9662-285e3f6f4b57","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1e2d18e4-73e6-4a37-826c-35eca4d96935","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e0f369c0-562b-4440-a5aa-12275c29412b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T23:27:19.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:19.080+0000 7ff3ee32d640 1 -- 172.21.15.12:0/2027098128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3e80c34c0 msgr2=0x7ff3e8156d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:19.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:19.080+0000 7ff3ee32d640 1 --2- 172.21.15.12:0/2027098128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3e80c34c0 0x7ff3e8156d60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800d800 tx=0x7ff3d800dcc0 comp rx=0 tx=0).stop 2023-10-16T23:27:19.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:19.080+0000 7ff3ee32d640 1 -- 172.21.15.12:0/2027098128 shutdown_connections 2023-10-16T23:27:19.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:19.080+0000 7ff3ee32d640 1 --2- 172.21.15.12:0/2027098128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3e80c34c0 0x7ff3e8156d60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:19.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:19.080+0000 7ff3ee32d640 1 --2- 172.21.15.12:0/2027098128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3e80a8c00 0x7ff3e806eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:19.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:19.080+0000 7ff3ee32d640 1 --2- 172.21.15.12:0/2027098128 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff3e80a8250 0x7ff3e8146120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:19.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:19.080+0000 7ff3ee32d640 1 -- 172.21.15.12:0/2027098128 >> 172.21.15.12:0/2027098128 conn(0x7ff3e806ba00 msgr2=0x7ff3e814c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:19.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:19.080+0000 7ff3ee32d640 1 -- 172.21.15.12:0/2027098128 shutdown_connections 2023-10-16T23:27:19.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:19.080+0000 7ff3ee32d640 1 -- 172.21.15.12:0/2027098128 wait complete. 2023-10-16T23:27:19.101 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-16T23:27:19.101 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-16T23:27:19.320 INFO:tasks.ceph.mgr.x.smithi031.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-10-16T23:27:19.320 INFO:tasks.ceph.mgr.x.smithi031.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-10-16T23:27:19.321 INFO:tasks.ceph.mgr.x.smithi031.stderr: from numpy import show_config as show_numpy_config 2023-10-16T23:27:19.345 INFO:tasks.ceph.mgr.y.smithi012.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-10-16T23:27:19.345 INFO:tasks.ceph.mgr.y.smithi012.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-10-16T23:27:19.345 INFO:tasks.ceph.mgr.y.smithi012.stderr: from numpy import show_config as show_numpy_config 2023-10-16T23:27:19.360 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-10-16T23:27:19.357+0000 7f1c8a538180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-16T23:27:19.415 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-16T23:27:19.412+0000 7fdb4035e180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-16T23:27:19.436 INFO:tasks.ceph.osd.7.smithi031.stderr:2023-10-16T23:27:19.433+0000 7fb3d0049640 -1 Falling back to public interface 2023-10-16T23:27:19.437 INFO:tasks.ceph.osd.5.smithi031.stderr:2023-10-16T23:27:19.433+0000 7f7c87227640 -1 Falling back to public interface 2023-10-16T23:27:19.445 INFO:tasks.ceph.osd.4.smithi031.stderr:2023-10-16T23:27:19.441+0000 7fd90448a640 -1 Falling back to public interface 2023-10-16T23:27:19.448 INFO:tasks.ceph.osd.6.smithi031.stderr:2023-10-16T23:27:19.445+0000 7f9845781640 -1 Falling back to public interface 2023-10-16T23:27:19.451 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-10-16T23:27:19.448+0000 7f4e1f223640 -1 Falling back to public interface 2023-10-16T23:27:19.459 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-10-16T23:27:19.456+0000 7f9872ea7640 -1 Falling back to public interface 2023-10-16T23:27:19.460 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-10-16T23:27:19.456+0000 7fd90cf8e640 -1 Falling back to public interface 2023-10-16T23:27:19.460 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-10-16T23:27:19.456+0000 7f1d7c86f640 -1 Falling back to public interface 2023-10-16T23:27:19.522 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-10-16T23:27:19.517+0000 7f1c8a538180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-16T23:27:19.597 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-16T23:27:19.592+0000 7fdb4035e180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-16T23:27:19.698 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-10-16T23:27:19.693+0000 7f1c8a538180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-16T23:27:19.770 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-10-16T23:27:19.765+0000 7f1c8a538180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-16T23:27:19.778 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-16T23:27:19.776+0000 7fdb4035e180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-16T23:27:19.849 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-16T23:27:19.844+0000 7fdb4035e180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-16T23:27:19.907 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-16T23:27:19.909 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-10-16T23:27:19.905+0000 7f1c8a538180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-16T23:27:19.989 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-16T23:27:19.984+0000 7fdb4035e180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-16T23:27:20.025 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.020+0000 7f1ca4891640 1 Processor -- start 2023-10-16T23:27:20.025 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.020+0000 7f1ca4891640 1 -- start start 2023-10-16T23:27:20.027 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.024+0000 7f1ca4891640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1ca002b360 0x7f1ca00a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:20.027 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.024+0000 7f1ca4891640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ca00a76b0 0x7f1ca01529d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:20.027 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.024+0000 7f1ca4891640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1ca0152f10 0x7f1ca014ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:20.027 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.024+0000 7f1ca4891640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca00c1510 con 0x7f1ca002b360 2023-10-16T23:27:20.028 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.024+0000 7f1ca4891640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca006db40 con 0x7f1ca0152f10 2023-10-16T23:27:20.028 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.024+0000 7f1ca4891640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca00714d0 con 0x7f1ca00a76b0 2023-10-16T23:27:20.028 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.024+0000 7f1c9e59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1ca002b360 0x7f1ca00a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:20.028 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.024+0000 7f1c9e59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1ca002b360 0x7f1ca00a0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53400/0 (socket says 172.21.15.12:53400) 2023-10-16T23:27:20.028 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.024+0000 7f1c9e59c640 1 -- 172.21.15.12:0/1865567417 learned_addr learned my addr 172.21.15.12:0/1865567417 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:20.029 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.024+0000 7f1c9ed9d640 1 --2- 172.21.15.12:0/1865567417 >> v2:172.21.15.31:3300/0 conn(0x7f1ca0152f10 0x7f1ca014ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:20.029 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.024+0000 7f1c9dd9b640 1 --2- 172.21.15.12:0/1865567417 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ca00a76b0 0x7f1ca01529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:20.029 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.024+0000 7f1c9e59c640 1 -- 172.21.15.12:0/1865567417 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ca00a76b0 msgr2=0x7f1ca01529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:20.029 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.024+0000 7f1c9e59c640 1 --2- 172.21.15.12:0/1865567417 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ca00a76b0 0x7f1ca01529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:20.029 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.024+0000 7f1c9e59c640 1 -- 172.21.15.12:0/1865567417 >> v2:172.21.15.31:3300/0 conn(0x7f1ca0152f10 msgr2=0x7f1ca014ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:20.030 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.024+0000 7f1c9e59c640 1 --2- 172.21.15.12:0/1865567417 >> v2:172.21.15.31:3300/0 conn(0x7f1ca0152f10 0x7f1ca014ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:20.030 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.024+0000 7f1c9e59c640 1 -- 172.21.15.12:0/1865567417 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca006fbb0 con 0x7f1ca002b360 2023-10-16T23:27:20.033 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.024+0000 7f1c9e59c640 1 --2- 172.21.15.12:0/1865567417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ca002b360 0x7f1ca00a0d30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1ca00704d0 tx=0x7f1c9001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1afe648e01e23 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:20.033 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.024+0000 7f1c9d59a640 1 -- 172.21.15.12:0/1865567417 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c900ad680 con 0x7f1ca002b360 2023-10-16T23:27:20.033 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.024+0000 7f1c9d59a640 1 -- 172.21.15.12:0/1865567417 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c900ad7e0 con 0x7f1ca002b360 2023-10-16T23:27:20.034 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.024+0000 7f1c9d59a640 1 -- 172.21.15.12:0/1865567417 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c900adb70 con 0x7f1ca002b360 2023-10-16T23:27:20.034 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1ca4891640 1 -- 172.21.15.12:0/1865567417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ca002b360 msgr2=0x7f1ca00a0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:20.034 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1ca4891640 1 --2- 172.21.15.12:0/1865567417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ca002b360 0x7f1ca00a0d30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1ca00704d0 tx=0x7f1c9001c4d0 comp rx=0 tx=0).stop 2023-10-16T23:27:20.034 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1ca4891640 1 -- 172.21.15.12:0/1865567417 shutdown_connections 2023-10-16T23:27:20.034 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1ca4891640 1 --2- 172.21.15.12:0/1865567417 >> v2:172.21.15.31:3300/0 conn(0x7f1ca0152f10 0x7f1ca014ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:20.035 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1ca4891640 1 --2- 172.21.15.12:0/1865567417 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ca00a76b0 0x7f1ca01529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:20.035 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1ca4891640 1 --2- 172.21.15.12:0/1865567417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ca002b360 0x7f1ca00a0d30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:20.035 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1ca4891640 1 -- 172.21.15.12:0/1865567417 >> 172.21.15.12:0/1865567417 conn(0x7f1ca00c18b0 msgr2=0x7f1ca00c1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:20.035 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1ca4891640 1 -- 172.21.15.12:0/1865567417 shutdown_connections 2023-10-16T23:27:20.035 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1ca4891640 1 -- 172.21.15.12:0/1865567417 wait complete. 2023-10-16T23:27:20.036 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1ca4891640 1 Processor -- start 2023-10-16T23:27:20.036 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1ca4891640 1 -- start start 2023-10-16T23:27:20.036 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1ca4891640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ca002b360 0x7f1ca00a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:20.036 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1ca4891640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ca00a76b0 0x7f1ca01eb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:20.036 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1ca4891640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ca0152f10 0x7f1ca00a28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:20.037 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1ca4891640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca00a3f80 con 0x7f1ca0152f10 2023-10-16T23:27:20.037 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1ca4891640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca00a33a0 con 0x7f1ca002b360 2023-10-16T23:27:20.037 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1ca4891640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca00a3680 con 0x7f1ca00a76b0 2023-10-16T23:27:20.037 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1c9ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ca0152f10 0x7f1ca00a28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:20.037 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1c9ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ca0152f10 0x7f1ca00a28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53412/0 (socket says 172.21.15.12:53412) 2023-10-16T23:27:20.037 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1c9ed9d640 1 -- 172.21.15.12:0/2082495944 learned_addr learned my addr 172.21.15.12:0/2082495944 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:20.038 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1c9e59c640 1 --2- 172.21.15.12:0/2082495944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ca002b360 0x7f1ca00a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:20.038 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1c9dd9b640 1 --2- 172.21.15.12:0/2082495944 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ca00a76b0 0x7f1ca01eb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:20.038 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1c9ed9d640 1 -- 172.21.15.12:0/2082495944 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ca00a76b0 msgr2=0x7f1ca01eb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:20.038 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1c9ed9d640 1 --2- 172.21.15.12:0/2082495944 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ca00a76b0 0x7f1ca01eb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:20.039 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1c9ed9d640 1 -- 172.21.15.12:0/2082495944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ca002b360 msgr2=0x7f1ca00a14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:20.039 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1c9ed9d640 1 --2- 172.21.15.12:0/2082495944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ca002b360 0x7f1ca00a14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:20.039 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1c9ed9d640 1 -- 172.21.15.12:0/2082495944 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c900094d0 con 0x7f1ca0152f10 2023-10-16T23:27:20.039 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1c9ed9d640 1 --2- 172.21.15.12:0/2082495944 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ca0152f10 0x7f1ca00a28c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1c9800ef90 tx=0x7f1c9800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:20.039 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1c96ffd640 1 -- 172.21.15.12:0/2082495944 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c98009b20 con 0x7f1ca0152f10 2023-10-16T23:27:20.039 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1c96ffd640 1 -- 172.21.15.12:0/2082495944 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9800f040 con 0x7f1ca0152f10 2023-10-16T23:27:20.040 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1c96ffd640 1 -- 172.21.15.12:0/2082495944 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c980146c0 con 0x7f1ca0152f10 2023-10-16T23:27:20.040 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1ca4891640 1 -- 172.21.15.12:0/2082495944 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca01eb650 con 0x7f1ca0152f10 2023-10-16T23:27:20.040 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1ca4891640 1 -- 172.21.15.12:0/2082495944 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca01ebbf0 con 0x7f1ca0152f10 2023-10-16T23:27:20.040 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1c96ffd640 1 -- 172.21.15.12:0/2082495944 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1c98014b20 con 0x7f1ca0152f10 2023-10-16T23:27:20.040 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.028+0000 7f1c96ffd640 1 -- 172.21.15.12:0/2082495944 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f1c9801db30 con 0x7f1ca0152f10 2023-10-16T23:27:20.041 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.032+0000 7f1ca4891640 1 -- 172.21.15.12:0/2082495944 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca00673a0 con 0x7f1ca0152f10 2023-10-16T23:27:20.041 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.032+0000 7f1c96ffd640 1 -- 172.21.15.12:0/2082495944 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f1c9803bb00 con 0x7f1ca0152f10 2023-10-16T23:27:20.091 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.088+0000 7f1ca4891640 1 -- 172.21.15.12:0/2082495944 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ca00738a0 con 0x7f1ca0152f10 2023-10-16T23:27:20.092 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.088+0000 7f1c96ffd640 1 -- 172.21.15.12:0/2082495944 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f1c9802a070 con 0x7f1ca0152f10 2023-10-16T23:27:20.093 INFO:teuthology.misc.health.smithi012.stdout: 2023-10-16T23:27:20.093 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":10,"fsid":"0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51","created":"2023-10-16T23:27:16.468087+0000","modified":"2023-10-16T23:27:18.793212+0000","last_up_change":"0.000000","last_in_change":"2023-10-16T23:27:18.793212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"73e70f98-6f5e-4464-b34e-931faac41cc9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ff722efe-b3f9-4cc0-bbde-f4d4d8055a70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9baf25db-dce0-4065-90d6-f35867286be2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8a620ad3-2294-470d-8a8c-66f177f5fbe7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a8824d77-7405-40f5-9234-60889802b184","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3bb01192-a47c-48e9-9662-285e3f6f4b57","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1e2d18e4-73e6-4a37-826c-35eca4d96935","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e0f369c0-562b-4440-a5aa-12275c29412b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T23:27:20.094 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.088+0000 7f1ca4891640 1 -- 172.21.15.12:0/2082495944 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ca0152f10 msgr2=0x7f1ca00a28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:20.094 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.088+0000 7f1ca4891640 1 --2- 172.21.15.12:0/2082495944 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ca0152f10 0x7f1ca00a28c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1c9800ef90 tx=0x7f1c9800c490 comp rx=0 tx=0).stop 2023-10-16T23:27:20.094 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.088+0000 7f1ca4891640 1 -- 172.21.15.12:0/2082495944 shutdown_connections 2023-10-16T23:27:20.094 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.088+0000 7f1ca4891640 1 --2- 172.21.15.12:0/2082495944 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ca0152f10 0x7f1ca00a28c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:20.095 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.088+0000 7f1ca4891640 1 --2- 172.21.15.12:0/2082495944 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ca00a76b0 0x7f1ca01eb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:20.095 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.088+0000 7f1ca4891640 1 --2- 172.21.15.12:0/2082495944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ca002b360 0x7f1ca00a14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:20.095 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.088+0000 7f1ca4891640 1 -- 172.21.15.12:0/2082495944 >> 172.21.15.12:0/2082495944 conn(0x7f1ca00c18b0 msgr2=0x7f1ca0065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:20.095 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.088+0000 7f1ca4891640 1 -- 172.21.15.12:0/2082495944 shutdown_connections 2023-10-16T23:27:20.095 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:20.088+0000 7f1ca4891640 1 -- 172.21.15.12:0/2082495944 wait complete. 2023-10-16T23:27:20.107 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-16T23:27:20.545 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-10-16T23:27:20.541+0000 7f1c8a538180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-16T23:27:20.624 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-10-16T23:27:20.621+0000 7f1c8a538180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-16T23:27:20.631 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-16T23:27:20.628+0000 7fdb4035e180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-16T23:27:20.710 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-16T23:27:20.708+0000 7fdb4035e180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-16T23:27:20.803 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-10-16T23:27:20.797+0000 7f1c8a538180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-16T23:27:20.880 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-10-16T23:27:20.877+0000 7f1c8a538180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-16T23:27:20.888 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-16T23:27:20.884+0000 7fdb4035e180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-16T23:27:20.965 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-16T23:27:20.960+0000 7fdb4035e180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-16T23:27:21.185 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-10-16T23:27:21.181+0000 7f1c8a538180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-16T23:27:21.247 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-10-16T23:27:21.241+0000 7f1c8a538180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-16T23:27:21.268 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-16T23:27:21.264+0000 7fdb4035e180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-16T23:27:21.333 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-16T23:27:21.328+0000 7fdb4035e180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-16T23:27:22.297 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-10-16T23:27:22.293+0000 7f1c31dfa640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-16T23:27:22.298 INFO:tasks.ceph.mgr.x.smithi031.stderr:2023-10-16T23:27:22.293+0000 7f1c31dfa640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-16T23:27:23.228 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-10-16T23:27:23.224+0000 7fd90cf8e640 -1 osd.2 0 log_to_monitors true 2023-10-16T23:27:23.248 INFO:tasks.ceph.osd.7.smithi031.stderr:2023-10-16T23:27:23.244+0000 7fb3d0049640 -1 osd.7 0 log_to_monitors true 2023-10-16T23:27:23.294 INFO:tasks.ceph.osd.4.smithi031.stderr:2023-10-16T23:27:23.288+0000 7fd90448a640 -1 osd.4 0 log_to_monitors true 2023-10-16T23:27:23.330 INFO:tasks.ceph.osd.6.smithi031.stderr:2023-10-16T23:27:23.324+0000 7f9845781640 -1 osd.6 0 log_to_monitors true 2023-10-16T23:27:23.340 INFO:tasks.ceph.osd.5.smithi031.stderr:2023-10-16T23:27:23.336+0000 7f7c87227640 -1 osd.5 0 log_to_monitors true 2023-10-16T23:27:23.369 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-10-16T23:27:23.364+0000 7f9872ea7640 -1 osd.1 0 log_to_monitors true 2023-10-16T23:27:23.369 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-10-16T23:27:23.364+0000 7f1d7c86f640 -1 osd.0 0 log_to_monitors true 2023-10-16T23:27:23.452 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-10-16T23:27:23.448+0000 7f4e1f223640 -1 osd.3 0 log_to_monitors true 2023-10-16T23:27:25.377 INFO:tasks.ceph.osd.7.smithi031.stderr:2023-10-16T23:27:25.372+0000 7fb3cb7cb640 -1 osd.7 0 waiting for initial osdmap 2023-10-16T23:27:25.394 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-10-16T23:27:25.392+0000 7fd908710640 -1 osd.2 0 waiting for initial osdmap 2023-10-16T23:27:25.597 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-10-16T23:27:25.596+0000 7fd900d55640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T23:27:25.644 INFO:tasks.ceph.osd.7.smithi031.stderr:2023-10-16T23:27:25.640+0000 7fb3c3e10640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T23:27:26.911 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-16T23:27:27.078 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.076+0000 7f8f1e175640 1 Processor -- start 2023-10-16T23:27:27.078 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.076+0000 7f8f1e175640 1 -- start start 2023-10-16T23:27:27.079 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.076+0000 7f8f1e175640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8f180b9c80 0x7f8f180bc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:27.079 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.076+0000 7f8f1e175640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f180a20b0 con 0x7f8f180baf60 2023-10-16T23:27:27.080 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.076+0000 7f8f1e175640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f1814fef0 con 0x7f8f180ba060 2023-10-16T23:27:27.080 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.076+0000 7f8f1e175640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f1806b570 con 0x7f8f180b9c80 2023-10-16T23:27:27.080 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.076+0000 7f8f177fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8f180b9c80 0x7f8f180bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:27.080 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.076+0000 7f8f177fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8f180b9c80 0x7f8f180bc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53472/0 (socket says 172.21.15.12:53472) 2023-10-16T23:27:27.080 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.076+0000 7f8f177fe640 1 -- 172.21.15.12:0/820825477 learned_addr learned my addr 172.21.15.12:0/820825477 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:27.081 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.076+0000 7f8f177fe640 1 -- 172.21.15.12:0/820825477 >> v1:172.21.15.31:6789/0 conn(0x7f8f180ba060 legacy=0x7f8f18148f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:27.081 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.076+0000 7f8f177fe640 1 -- 172.21.15.12:0/820825477 >> v1:172.21.15.12:6789/0 conn(0x7f8f180baf60 legacy=0x7f8f180bb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:27.082 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.076+0000 7f8f167fc640 1 -- 172.21.15.12:0/820825477 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187519386 0 0) 0x7f8f180a20b0 con 0x7f8f180baf60 2023-10-16T23:27:27.082 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.076+0000 7f8f177fe640 1 -- 172.21.15.12:0/820825477 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f181501d0 con 0x7f8f180b9c80 2023-10-16T23:27:27.083 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.080+0000 7f8f177fe640 1 --2- 172.21.15.12:0/820825477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f180b9c80 0x7f8f180bc300 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009e50 tx=0x7f8f1001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21a06222cace5f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:27.083 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.080+0000 7f8f167fc640 1 -- 172.21.15.12:0/820825477 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f100a56e0 con 0x7f8f180b9c80 2023-10-16T23:27:27.084 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.080+0000 7f8f167fc640 1 -- 172.21.15.12:0/820825477 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f100a5840 con 0x7f8f180b9c80 2023-10-16T23:27:27.084 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.080+0000 7f8f167fc640 1 -- 172.21.15.12:0/820825477 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f100a5bd0 con 0x7f8f180b9c80 2023-10-16T23:27:27.085 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.080+0000 7f8f1e175640 1 -- 172.21.15.12:0/820825477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f180b9c80 msgr2=0x7f8f180bc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:27.085 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.080+0000 7f8f1e175640 1 --2- 172.21.15.12:0/820825477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f180b9c80 0x7f8f180bc300 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009e50 tx=0x7f8f1001c910 comp rx=0 tx=0).stop 2023-10-16T23:27:27.085 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.080+0000 7f8f1e175640 1 -- 172.21.15.12:0/820825477 shutdown_connections 2023-10-16T23:27:27.085 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.080+0000 7f8f1e175640 1 --2- 172.21.15.12:0/820825477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f180b9c80 0x7f8f180bc300 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:27.085 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.080+0000 7f8f1e175640 1 -- 172.21.15.12:0/820825477 >> 172.21.15.12:0/820825477 conn(0x7f8f180c06d0 msgr2=0x7f8f180c0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:27.086 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.080+0000 7f8f1e175640 1 -- 172.21.15.12:0/820825477 shutdown_connections 2023-10-16T23:27:27.086 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.080+0000 7f8f1e175640 1 -- 172.21.15.12:0/820825477 wait complete. 2023-10-16T23:27:27.087 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.084+0000 7f8f1e175640 1 Processor -- start 2023-10-16T23:27:27.087 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.084+0000 7f8f1e175640 1 -- start start 2023-10-16T23:27:27.088 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.084+0000 7f8f1e175640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f180ba060 0x7f8f18145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:27.088 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.084+0000 7f8f1e175640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f180baf60 0x7f8f1806f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:27.088 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.084+0000 7f8f1e175640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f18070d40 0x7f8f181eab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:27.088 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.084+0000 7f8f1e175640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f181465f0 con 0x7f8f180baf60 2023-10-16T23:27:27.089 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.084+0000 7f8f1e175640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f181eb570 con 0x7f8f180ba060 2023-10-16T23:27:27.089 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.084+0000 7f8f1e175640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1814ef40 con 0x7f8f18070d40 2023-10-16T23:27:27.089 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.084+0000 7f8f177fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f180ba060 0x7f8f18145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:27.089 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.084+0000 7f8f177fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f180ba060 0x7f8f18145ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:50492/0 (socket says 172.21.15.12:50492) 2023-10-16T23:27:27.089 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.084+0000 7f8f177fe640 1 -- 172.21.15.12:0/3679244165 learned_addr learned my addr 172.21.15.12:0/3679244165 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:27.090 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.084+0000 7f8f16ffd640 1 --2- 172.21.15.12:0/3679244165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f180baf60 0x7f8f1806f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:27.090 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.084+0000 7f8f17fff640 1 --2- 172.21.15.12:0/3679244165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f18070d40 0x7f8f181eab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:27.091 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.084+0000 7f8f177fe640 1 -- 172.21.15.12:0/3679244165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f18070d40 msgr2=0x7f8f181eab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:27.091 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.084+0000 7f8f177fe640 1 --2- 172.21.15.12:0/3679244165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f18070d40 0x7f8f181eab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:27.091 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.084+0000 7f8f177fe640 1 -- 172.21.15.12:0/3679244165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f180baf60 msgr2=0x7f8f1806f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:27.092 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.084+0000 7f8f177fe640 1 --2- 172.21.15.12:0/3679244165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f180baf60 0x7f8f1806f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:27.092 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.084+0000 7f8f177fe640 1 -- 172.21.15.12:0/3679244165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f10009b30 con 0x7f8f180ba060 2023-10-16T23:27:27.092 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.084+0000 7f8f177fe640 1 --2- 172.21.15.12:0/3679244165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f180ba060 0x7f8f18145ef0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8f1001a540 tx=0x7f8f100196b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:27.092 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.084+0000 7f8efffff640 1 -- 172.21.15.12:0/3679244165 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f100b8670 con 0x7f8f180ba060 2023-10-16T23:27:27.092 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.084+0000 7f8efffff640 1 -- 172.21.15.12:0/3679244165 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f100b87f0 con 0x7f8f180ba060 2023-10-16T23:27:27.093 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.084+0000 7f8f1e175640 1 -- 172.21.15.12:0/3679244165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f1813d9b0 con 0x7f8f180ba060 2023-10-16T23:27:27.093 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.088+0000 7f8efffff640 1 -- 172.21.15.12:0/3679244165 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f100b8ba0 con 0x7f8f180ba060 2023-10-16T23:27:27.093 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.088+0000 7f8f1e175640 1 -- 172.21.15.12:0/3679244165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f18070010 con 0x7f8f180ba060 2023-10-16T23:27:27.093 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.088+0000 7f8f1e175640 1 -- 172.21.15.12:0/3679244165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f18070200 con 0x7f8f180ba060 2023-10-16T23:27:27.094 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.088+0000 7f8efffff640 1 -- 172.21.15.12:0/3679244165 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 85480+0+0 (secure 0 0 0) 0x7f8f100b8d00 con 0x7f8f180ba060 2023-10-16T23:27:27.094 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.088+0000 7f8efffff640 1 --2- 172.21.15.12:0/3679244165 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f8f04065dd0 0x7f8f04068290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:27.095 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.088+0000 7f8efffff640 1 -- 172.21.15.12:0/3679244165 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2791+0+0 (secure 0 0 0) 0x7f8f1011df90 con 0x7f8f180ba060 2023-10-16T23:27:27.095 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.088+0000 7f8f16ffd640 1 --2- 172.21.15.12:0/3679244165 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f8f04065dd0 0x7f8f04068290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:27.095 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.092+0000 7f8f16ffd640 1 --2- 172.21.15.12:0/3679244165 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f8f04065dd0 0x7f8f04068290 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8f180707a0 tx=0x7f8f08007e40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:27.101 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.100+0000 7f8efffff640 1 -- 172.21.15.12:0/3679244165 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f8f100ec5c0 con 0x7f8f180ba060 2023-10-16T23:27:27.117 INFO:tasks.ceph.osd.4.smithi031.stderr:2023-10-16T23:27:27.112+0000 7fd8ffc0c640 -1 osd.4 0 waiting for initial osdmap 2023-10-16T23:27:27.173 INFO:tasks.ceph.osd.5.smithi031.stderr:2023-10-16T23:27:27.128+0000 7f7c829a9640 -1 osd.5 0 waiting for initial osdmap 2023-10-16T23:27:27.173 INFO:tasks.ceph.osd.4.smithi031.stderr:2023-10-16T23:27:27.156+0000 7fd8f8251640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T23:27:27.174 INFO:tasks.ceph.osd.5.smithi031.stderr:2023-10-16T23:27:27.168+0000 7f7c7afee640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T23:27:27.177 INFO:tasks.ceph.osd.6.smithi031.stderr:2023-10-16T23:27:27.172+0000 7f9840f03640 -1 osd.6 0 waiting for initial osdmap 2023-10-16T23:27:27.180 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-10-16T23:27:27.176+0000 7f1d77ff1640 -1 osd.0 0 waiting for initial osdmap 2023-10-16T23:27:27.185 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-10-16T23:27:27.180+0000 7f986e629640 -1 osd.1 0 waiting for initial osdmap 2023-10-16T23:27:27.204 INFO:tasks.ceph.osd.6.smithi031.stderr:2023-10-16T23:27:27.200+0000 7f9839548640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T23:27:27.213 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-10-16T23:27:27.208+0000 7f4e1a9a5640 -1 osd.3 0 waiting for initial osdmap 2023-10-16T23:27:27.213 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-10-16T23:27:27.212+0000 7f1d70636640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T23:27:27.225 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-10-16T23:27:27.224+0000 7f9866c6e640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T23:27:27.237 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-10-16T23:27:27.236+0000 7f4e12fea640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T23:27:27.301 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.296+0000 7f8f1e175640 1 -- 172.21.15.12:0/3679244165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f18070200 con 0x7f8f180ba060 2023-10-16T23:27:27.303 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.300+0000 7f8efffff640 1 -- 172.21.15.12:0/3679244165 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7908 (secure 0 0 0) 0x7f8f100efbe0 con 0x7f8f180ba060 2023-10-16T23:27:27.303 INFO:teuthology.misc.health.smithi012.stdout: 2023-10-16T23:27:27.303 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":14,"fsid":"0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51","created":"2023-10-16T23:27:16.468087+0000","modified":"2023-10-16T23:27:26.607715+0000","last_up_change":"2023-10-16T23:27:26.607715+0000","last_in_change":"2023-10-16T23:27:18.793212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"73e70f98-6f5e-4464-b34e-931faac41cc9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ff722efe-b3f9-4cc0-bbde-f4d4d8055a70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9baf25db-dce0-4065-90d6-f35867286be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6809","nonce":38073},{"type":"v1","addr":"172.21.15.12:6810","nonce":38073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":38073},{"type":"v1","addr":"172.21.15.12:6817","nonce":38073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":38073},{"type":"v1","addr":"172.21.15.12:6830","nonce":38073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":38073},{"type":"v1","addr":"172.21.15.12:6826","nonce":38073}]},"public_addr":"172.21.15.12:6810/38073","cluster_addr":"172.21.15.12:6817/38073","heartbeat_back_addr":"172.21.15.12:6830/38073","heartbeat_front_addr":"172.21.15.12:6826/38073","state":["exists","up"]},{"osd":3,"uuid":"8a620ad3-2294-470d-8a8c-66f177f5fbe7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a8824d77-7405-40f5-9234-60889802b184","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3bb01192-a47c-48e9-9662-285e3f6f4b57","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1e2d18e4-73e6-4a37-826c-35eca4d96935","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e0f369c0-562b-4440-a5aa-12275c29412b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":38265},{"type":"v1","addr":"172.21.15.31:6801","nonce":38265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":38265},{"type":"v1","addr":"172.21.15.31:6803","nonce":38265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":38265},{"type":"v1","addr":"172.21.15.31:6810","nonce":38265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":38265},{"type":"v1","addr":"172.21.15.31:6806","nonce":38265}]},"public_addr":"172.21.15.31:6801/38265","cluster_addr":"172.21.15.31:6803/38265","heartbeat_back_addr":"172.21.15.31:6810/38265","heartbeat_front_addr":"172.21.15.31:6806/38265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T23:27:27.305 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.300+0000 7f8f1e175640 1 -- 172.21.15.12:0/3679244165 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f8f04065dd0 msgr2=0x7f8f04068290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:27.305 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.300+0000 7f8f1e175640 1 --2- 172.21.15.12:0/3679244165 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f8f04065dd0 0x7f8f04068290 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8f180707a0 tx=0x7f8f08007e40 comp rx=0 tx=0).stop 2023-10-16T23:27:27.306 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.300+0000 7f8f1e175640 1 -- 172.21.15.12:0/3679244165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f180ba060 msgr2=0x7f8f18145ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:27.306 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.300+0000 7f8f1e175640 1 --2- 172.21.15.12:0/3679244165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f180ba060 0x7f8f18145ef0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8f1001a540 tx=0x7f8f100196b0 comp rx=0 tx=0).stop 2023-10-16T23:27:27.306 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.300+0000 7f8f1e175640 1 -- 172.21.15.12:0/3679244165 shutdown_connections 2023-10-16T23:27:27.306 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.300+0000 7f8f1e175640 1 --2- 172.21.15.12:0/3679244165 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f8f04065dd0 0x7f8f04068290 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:27.307 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.300+0000 7f8f1e175640 1 --2- 172.21.15.12:0/3679244165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f18070d40 0x7f8f181eab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:27.307 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.300+0000 7f8f1e175640 1 --2- 172.21.15.12:0/3679244165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f180baf60 0x7f8f1806f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:27.307 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.300+0000 7f8f1e175640 1 --2- 172.21.15.12:0/3679244165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f180ba060 0x7f8f18145ef0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:27.307 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.300+0000 7f8f1e175640 1 -- 172.21.15.12:0/3679244165 >> 172.21.15.12:0/3679244165 conn(0x7f8f180c06d0 msgr2=0x7f8f18065fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:27.307 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.300+0000 7f8f1e175640 1 -- 172.21.15.12:0/3679244165 shutdown_connections 2023-10-16T23:27:27.308 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:27.300+0000 7f8f1e175640 1 -- 172.21.15.12:0/3679244165 wait complete. 2023-10-16T23:27:27.320 DEBUG:teuthology.misc:2 of 8 OSDs are up 2023-10-16T23:27:34.129 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-16T23:27:34.256 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.252+0000 7fc482675640 1 Processor -- start 2023-10-16T23:27:34.257 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.252+0000 7fc482675640 1 -- start start 2023-10-16T23:27:34.258 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.252+0000 7fc482675640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc47c0a1cb0 0x7fc47c14d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:34.258 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.256+0000 7fc482675640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc47c14dc00 0x7fc47c157a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:34.258 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.256+0000 7fc482675640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc47c14d230 con 0x7fc47c14ca50 2023-10-16T23:27:34.258 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.256+0000 7fc482675640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47c151210 con 0x7fc47c14dc00 2023-10-16T23:27:34.259 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.256+0000 7fc482675640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47c1514f0 con 0x7fc47c0a1cb0 2023-10-16T23:27:34.259 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.256+0000 7fc480c12640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc47c14dc00 0x7fc47c157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:34.259 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.256+0000 7fc480c12640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc47c14dc00 0x7fc47c157a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58528/0 (socket says 172.21.15.12:58528) 2023-10-16T23:27:34.259 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.256+0000 7fc480c12640 1 -- 172.21.15.12:0/4040978975 learned_addr learned my addr 172.21.15.12:0/4040978975 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:34.260 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.256+0000 7fc47b7fe640 1 --2- 172.21.15.12:0/4040978975 >> v2:172.21.15.31:3300/0 conn(0x7fc47c0a1cb0 0x7fc47c14d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:34.260 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.256+0000 7fc480c12640 1 -- 172.21.15.12:0/4040978975 >> v2:172.21.15.31:3300/0 conn(0x7fc47c0a1cb0 msgr2=0x7fc47c14d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:34.260 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.256+0000 7fc480c12640 1 --2- 172.21.15.12:0/4040978975 >> v2:172.21.15.31:3300/0 conn(0x7fc47c0a1cb0 0x7fc47c14d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:34.260 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.256+0000 7fc480c12640 1 -- 172.21.15.12:0/4040978975 >> v1:172.21.15.12:6789/0 conn(0x7fc47c14ca50 legacy=0x7fc47c0a59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:34.260 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.256+0000 7fc480c12640 1 -- 172.21.15.12:0/4040978975 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c0a60c0 con 0x7fc47c14dc00 2023-10-16T23:27:34.261 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.256+0000 7fc480c12640 1 --2- 172.21.15.12:0/4040978975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc47c14dc00 0x7fc47c157a10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc47c06db60 tx=0x7fc47401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef8e178af522757 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:34.262 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.256+0000 7fc47affd640 1 -- 172.21.15.12:0/4040978975 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4740a5600 con 0x7fc47c14dc00 2023-10-16T23:27:34.262 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.256+0000 7fc47affd640 1 -- 172.21.15.12:0/4040978975 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4740a5760 con 0x7fc47c14dc00 2023-10-16T23:27:34.262 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.256+0000 7fc47affd640 1 -- 172.21.15.12:0/4040978975 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4740a5af0 con 0x7fc47c14dc00 2023-10-16T23:27:34.262 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.256+0000 7fc482675640 1 -- 172.21.15.12:0/4040978975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc47c14dc00 msgr2=0x7fc47c157a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:34.262 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.256+0000 7fc482675640 1 --2- 172.21.15.12:0/4040978975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc47c14dc00 0x7fc47c157a10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc47c06db60 tx=0x7fc47401c940 comp rx=0 tx=0).stop 2023-10-16T23:27:34.263 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.256+0000 7fc482675640 1 -- 172.21.15.12:0/4040978975 shutdown_connections 2023-10-16T23:27:34.263 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.256+0000 7fc482675640 1 --2- 172.21.15.12:0/4040978975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc47c14dc00 0x7fc47c157a10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:34.263 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.256+0000 7fc482675640 1 --2- 172.21.15.12:0/4040978975 >> v2:172.21.15.31:3300/0 conn(0x7fc47c0a1cb0 0x7fc47c14d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:34.263 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.256+0000 7fc482675640 1 -- 172.21.15.12:0/4040978975 >> 172.21.15.12:0/4040978975 conn(0x7fc47c0c06d0 msgr2=0x7fc47c0c0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:34.263 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.256+0000 7fc482675640 1 -- 172.21.15.12:0/4040978975 shutdown_connections 2023-10-16T23:27:34.264 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.256+0000 7fc482675640 1 -- 172.21.15.12:0/4040978975 wait complete. 2023-10-16T23:27:34.266 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc482675640 1 Processor -- start 2023-10-16T23:27:34.266 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc482675640 1 -- start start 2023-10-16T23:27:34.266 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc482675640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc47c0a1cb0 0x7fc47c0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:34.267 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc482675640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc47c14ca50 0x7fc47c1e54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:34.267 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc482675640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc47c14dc00 0x7fc47c1e5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:34.267 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc482675640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c0b7090 con 0x7fc47c0a1cb0 2023-10-16T23:27:34.267 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc482675640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c144eb0 con 0x7fc47c14dc00 2023-10-16T23:27:34.267 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc482675640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c1e5f60 con 0x7fc47c14ca50 2023-10-16T23:27:34.268 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc47bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc47c0a1cb0 0x7fc47c0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:34.268 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc47bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc47c0a1cb0 0x7fc47c0b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58538/0 (socket says 172.21.15.12:58538) 2023-10-16T23:27:34.268 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc47bfff640 1 -- 172.21.15.12:0/2933052145 learned_addr learned my addr 172.21.15.12:0/2933052145 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:34.268 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc480c12640 1 --2- 172.21.15.12:0/2933052145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc47c14dc00 0x7fc47c1e5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:34.268 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc47b7fe640 1 --2- 172.21.15.12:0/2933052145 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc47c14ca50 0x7fc47c1e54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:34.269 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc47bfff640 1 -- 172.21.15.12:0/2933052145 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc47c14ca50 msgr2=0x7fc47c1e54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:34.269 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc47bfff640 1 --2- 172.21.15.12:0/2933052145 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc47c14ca50 0x7fc47c1e54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:34.269 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc47bfff640 1 -- 172.21.15.12:0/2933052145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc47c14dc00 msgr2=0x7fc47c1e5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:34.269 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc47bfff640 1 --2- 172.21.15.12:0/2933052145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc47c14dc00 0x7fc47c1e5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:34.269 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc47bfff640 1 -- 172.21.15.12:0/2933052145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc474009b30 con 0x7fc47c0a1cb0 2023-10-16T23:27:34.270 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc480c12640 1 --2- 172.21.15.12:0/2933052145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc47c14dc00 0x7fc47c1e5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:34.270 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc47b7fe640 1 --2- 172.21.15.12:0/2933052145 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc47c14ca50 0x7fc47c1e54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:34.270 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc47bfff640 1 --2- 172.21.15.12:0/2933052145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc47c0a1cb0 0x7fc47c0b6260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc47000c500 tx=0x7fc47000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:34.270 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc478ff9640 1 -- 172.21.15.12:0/2933052145 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470005220 con 0x7fc47c0a1cb0 2023-10-16T23:27:34.270 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc478ff9640 1 -- 172.21.15.12:0/2933052145 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc470005380 con 0x7fc47c0a1cb0 2023-10-16T23:27:34.271 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc478ff9640 1 -- 172.21.15.12:0/2933052145 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470007270 con 0x7fc47c0a1cb0 2023-10-16T23:27:34.271 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc482675640 1 -- 172.21.15.12:0/2933052145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc47c157ba0 con 0x7fc47c0a1cb0 2023-10-16T23:27:34.271 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc482675640 1 -- 172.21.15.12:0/2933052145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc47c149560 con 0x7fc47c0a1cb0 2023-10-16T23:27:34.271 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.260+0000 7fc482675640 1 -- 172.21.15.12:0/2933052145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc47c0673a0 con 0x7fc47c0a1cb0 2023-10-16T23:27:34.271 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.264+0000 7fc478ff9640 1 -- 172.21.15.12:0/2933052145 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fc4700073d0 con 0x7fc47c0a1cb0 2023-10-16T23:27:34.272 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.264+0000 7fc478ff9640 1 --2- 172.21.15.12:0/2933052145 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fc468065e60 0x7fc468068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:34.272 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.264+0000 7fc478ff9640 1 -- 172.21.15.12:0/2933052145 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc470082d10 con 0x7fc47c0a1cb0 2023-10-16T23:27:34.273 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.264+0000 7fc47b7fe640 1 --2- 172.21.15.12:0/2933052145 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fc468065e60 0x7fc468068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:34.273 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.264+0000 7fc47b7fe640 1 --2- 172.21.15.12:0/2933052145 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fc468065e60 0x7fc468068320 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc47c0b7650 tx=0x7fc46c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:34.273 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.268+0000 7fc478ff9640 1 -- 172.21.15.12:0/2933052145 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fc470088020 con 0x7fc47c0a1cb0 2023-10-16T23:27:34.427 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.424+0000 7fc482675640 1 -- 172.21.15.12:0/2933052145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc47c0c0020 con 0x7fc47c0a1cb0 2023-10-16T23:27:34.429 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.424+0000 7fc478ff9640 1 -- 172.21.15.12:0/2933052145 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12334 (secure 0 0 0) 0x7fc470050780 con 0x7fc47c0a1cb0 2023-10-16T23:27:34.429 INFO:teuthology.misc.health.smithi012.stdout: 2023-10-16T23:27:34.430 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":17,"fsid":"0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51","created":"2023-10-16T23:27:16.468087+0000","modified":"2023-10-16T23:27:30.154383+0000","last_up_change":"2023-10-16T23:27:28.136202+0000","last_in_change":"2023-10-16T23:27:18.793212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T23:27:27.354025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73e70f98-6f5e-4464-b34e-931faac41cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":38075},{"type":"v1","addr":"172.21.15.12:6814","nonce":38075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":38075},{"type":"v1","addr":"172.21.15.12:6819","nonce":38075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":38075},{"type":"v1","addr":"172.21.15.12:6827","nonce":38075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":38075},{"type":"v1","addr":"172.21.15.12:6823","nonce":38075}]},"public_addr":"172.21.15.12:6814/38075","cluster_addr":"172.21.15.12:6819/38075","heartbeat_back_addr":"172.21.15.12:6827/38075","heartbeat_front_addr":"172.21.15.12:6823/38075","state":["exists","up"]},{"osd":1,"uuid":"ff722efe-b3f9-4cc0-bbde-f4d4d8055a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":38076},{"type":"v1","addr":"172.21.15.12:6811","nonce":38076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":38076},{"type":"v1","addr":"172.21.15.12:6818","nonce":38076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":38076},{"type":"v1","addr":"172.21.15.12:6831","nonce":38076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":38076},{"type":"v1","addr":"172.21.15.12:6825","nonce":38076}]},"public_addr":"172.21.15.12:6811/38076","cluster_addr":"172.21.15.12:6818/38076","heartbeat_back_addr":"172.21.15.12:6831/38076","heartbeat_front_addr":"172.21.15.12:6825/38076","state":["exists","up"]},{"osd":2,"uuid":"9baf25db-dce0-4065-90d6-f35867286be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6809","nonce":38073},{"type":"v1","addr":"172.21.15.12:6810","nonce":38073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":38073},{"type":"v1","addr":"172.21.15.12:6817","nonce":38073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":38073},{"type":"v1","addr":"172.21.15.12:6830","nonce":38073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":38073},{"type":"v1","addr":"172.21.15.12:6826","nonce":38073}]},"public_addr":"172.21.15.12:6810/38073","cluster_addr":"172.21.15.12:6817/38073","heartbeat_back_addr":"172.21.15.12:6830/38073","heartbeat_front_addr":"172.21.15.12:6826/38073","state":["exists","up"]},{"osd":3,"uuid":"8a620ad3-2294-470d-8a8c-66f177f5fbe7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":38074},{"type":"v1","addr":"172.21.15.12:6801","nonce":38074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":38074},{"type":"v1","addr":"172.21.15.12:6803","nonce":38074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":38074},{"type":"v1","addr":"172.21.15.12:6807","nonce":38074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":38074},{"type":"v1","addr":"172.21.15.12:6805","nonce":38074}]},"public_addr":"172.21.15.12:6801/38074","cluster_addr":"172.21.15.12:6803/38074","heartbeat_back_addr":"172.21.15.12:6807/38074","heartbeat_front_addr":"172.21.15.12:6805/38074","state":["exists","up"]},{"osd":4,"uuid":"a8824d77-7405-40f5-9234-60889802b184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":38266},{"type":"v1","addr":"172.21.15.31:6817","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":38266},{"type":"v1","addr":"172.21.15.31:6819","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":38266},{"type":"v1","addr":"172.21.15.31:6823","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":38266},{"type":"v1","addr":"172.21.15.31:6821","nonce":38266}]},"public_addr":"172.21.15.31:6817/38266","cluster_addr":"172.21.15.31:6819/38266","heartbeat_back_addr":"172.21.15.31:6823/38266","heartbeat_front_addr":"172.21.15.31:6821/38266","state":["exists","up"]},{"osd":5,"uuid":"3bb01192-a47c-48e9-9662-285e3f6f4b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":38264},{"type":"v1","addr":"172.21.15.31:6807","nonce":38264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":38264},{"type":"v1","addr":"172.21.15.31:6811","nonce":38264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":38264},{"type":"v1","addr":"172.21.15.31:6815","nonce":38264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":38264},{"type":"v1","addr":"172.21.15.31:6813","nonce":38264}]},"public_addr":"172.21.15.31:6807/38264","cluster_addr":"172.21.15.31:6811/38264","heartbeat_back_addr":"172.21.15.31:6815/38264","heartbeat_front_addr":"172.21.15.31:6813/38264","state":["exists","up"]},{"osd":6,"uuid":"1e2d18e4-73e6-4a37-826c-35eca4d96935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":38263},{"type":"v1","addr":"172.21.15.31:6825","nonce":38263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":38263},{"type":"v1","addr":"172.21.15.31:6827","nonce":38263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":38263},{"type":"v1","addr":"172.21.15.31:6831","nonce":38263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":38263},{"type":"v1","addr":"172.21.15.31:6829","nonce":38263}]},"public_addr":"172.21.15.31:6825/38263","cluster_addr":"172.21.15.31:6827/38263","heartbeat_back_addr":"172.21.15.31:6831/38263","heartbeat_front_addr":"172.21.15.31:6829/38263","state":["exists","up"]},{"osd":7,"uuid":"e0f369c0-562b-4440-a5aa-12275c29412b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":38265},{"type":"v1","addr":"172.21.15.31:6801","nonce":38265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":38265},{"type":"v1","addr":"172.21.15.31:6803","nonce":38265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":38265},{"type":"v1","addr":"172.21.15.31:6810","nonce":38265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":38265},{"type":"v1","addr":"172.21.15.31:6806","nonce":38265}]},"public_addr":"172.21.15.31:6801/38265","cluster_addr":"172.21.15.31:6803/38265","heartbeat_back_addr":"172.21.15.31:6810/38265","heartbeat_front_addr":"172.21.15.31:6806/38265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.411815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.372565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.209700+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.414619+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.316843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.300348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.359800+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.219854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T23:27:34.431 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.428+0000 7fc482675640 1 -- 172.21.15.12:0/2933052145 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fc468065e60 msgr2=0x7fc468068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:34.432 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.428+0000 7fc482675640 1 --2- 172.21.15.12:0/2933052145 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fc468065e60 0x7fc468068320 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc47c0b7650 tx=0x7fc46c008040 comp rx=0 tx=0).stop 2023-10-16T23:27:34.432 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.428+0000 7fc482675640 1 -- 172.21.15.12:0/2933052145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc47c0a1cb0 msgr2=0x7fc47c0b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:34.432 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.428+0000 7fc482675640 1 --2- 172.21.15.12:0/2933052145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc47c0a1cb0 0x7fc47c0b6260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc47000c500 tx=0x7fc47000c9c0 comp rx=0 tx=0).stop 2023-10-16T23:27:34.432 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.428+0000 7fc482675640 1 -- 172.21.15.12:0/2933052145 shutdown_connections 2023-10-16T23:27:34.433 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.428+0000 7fc482675640 1 --2- 172.21.15.12:0/2933052145 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fc468065e60 0x7fc468068320 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:34.433 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.428+0000 7fc482675640 1 --2- 172.21.15.12:0/2933052145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc47c14dc00 0x7fc47c1e5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:34.433 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.428+0000 7fc482675640 1 --2- 172.21.15.12:0/2933052145 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc47c14ca50 0x7fc47c1e54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:34.433 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.428+0000 7fc482675640 1 --2- 172.21.15.12:0/2933052145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc47c0a1cb0 0x7fc47c0b6260 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:34.433 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.428+0000 7fc482675640 1 -- 172.21.15.12:0/2933052145 >> 172.21.15.12:0/2933052145 conn(0x7fc47c0c06d0 msgr2=0x7fc47c14b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:34.434 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.428+0000 7fc482675640 1 -- 172.21.15.12:0/2933052145 shutdown_connections 2023-10-16T23:27:34.434 INFO:teuthology.misc.health.smithi012.stderr:2023-10-16T23:27:34.428+0000 7fc482675640 1 -- 172.21.15.12:0/2933052145 wait complete. 2023-10-16T23:27:34.447 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-16T23:27:34.448 INFO:tasks.ceph:Creating RBD pool 2023-10-16T23:27:34.448 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-16T23:27:34.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.576+0000 7f5c9ec97640 1 Processor -- start 2023-10-16T23:27:34.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.576+0000 7f5c9ec97640 1 -- start start 2023-10-16T23:27:34.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.576+0000 7f5c9ec97640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c980c12a0 0x7f5c980b90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:34.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.576+0000 7f5c9ec97640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5c9814b7a0 0x7f5c9814bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:34.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.576+0000 7f5c9ec97640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c981505e0 con 0x7f5c980b3bb0 2023-10-16T23:27:34.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.576+0000 7f5c9ec97640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c9814f7a0 con 0x7f5c9814b7a0 2023-10-16T23:27:34.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.576+0000 7f5c9ec97640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c98070fe0 con 0x7f5c980c12a0 2023-10-16T23:27:34.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.576+0000 7f5c97fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5c980b3bb0 0x7f5c9814fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44696/0 (socket says 172.21.15.12:44696) 2023-10-16T23:27:34.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.576+0000 7f5c97fff640 1 -- 172.21.15.12:0/1898275479 learned_addr learned my addr 172.21.15.12:0/1898275479 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:34.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.576+0000 7f5c9d234640 1 --2- 172.21.15.12:0/1898275479 >> v2:172.21.15.31:3300/0 conn(0x7f5c9814b7a0 0x7f5c9814bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:34.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.576+0000 7f5c9ca33640 1 --2- 172.21.15.12:0/1898275479 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c980c12a0 0x7f5c980b90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:34.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.576+0000 7f5c977fe640 1 -- 172.21.15.12:0/1898275479 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 194508528 0 0) 0x7f5c981505e0 con 0x7f5c980b3bb0 2023-10-16T23:27:34.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.576+0000 7f5c977fe640 1 -- 172.21.15.12:0/1898275479 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c88005740 con 0x7f5c980b3bb0 2023-10-16T23:27:34.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.576+0000 7f5c977fe640 1 -- 172.21.15.12:0/1898275479 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1063195284 0 0) 0x7f5c88005740 con 0x7f5c980b3bb0 2023-10-16T23:27:34.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.576+0000 7f5c9d234640 1 -- 172.21.15.12:0/1898275479 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c980c12a0 msgr2=0x7f5c980b90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:34.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.576+0000 7f5c9d234640 1 --2- 172.21.15.12:0/1898275479 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c980c12a0 0x7f5c980b90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:34.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.576+0000 7f5c9d234640 1 -- 172.21.15.12:0/1898275479 >> v1:172.21.15.12:6789/0 conn(0x7f5c980b3bb0 legacy=0x7f5c9814fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:34.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.576+0000 7f5c9d234640 1 -- 172.21.15.12:0/1898275479 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c980b37e0 con 0x7f5c9814b7a0 2023-10-16T23:27:34.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.580+0000 7f5c9d234640 1 --2- 172.21.15.12:0/1898275479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c9814b7a0 0x7f5c9814bbb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009d90 tx=0x7f5c9001c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=713a47ac0d87781b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:34.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.580+0000 7f5c977fe640 1 -- 172.21.15.12:0/1898275479 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c84001680 con 0x7f5c9814b7a0 2023-10-16T23:27:34.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.580+0000 7f5c977fe640 1 -- 172.21.15.12:0/1898275479 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c900a8460 con 0x7f5c9814b7a0 2023-10-16T23:27:34.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.580+0000 7f5c977fe640 1 -- 172.21.15.12:0/1898275479 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c900a87f0 con 0x7f5c9814b7a0 2023-10-16T23:27:34.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.580+0000 7f5c9ec97640 1 -- 172.21.15.12:0/1898275479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c9814b7a0 msgr2=0x7f5c9814bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:34.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.580+0000 7f5c9ec97640 1 --2- 172.21.15.12:0/1898275479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c9814b7a0 0x7f5c9814bbb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009d90 tx=0x7f5c9001c7e0 comp rx=0 tx=0).stop 2023-10-16T23:27:34.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.580+0000 7f5c9ec97640 1 -- 172.21.15.12:0/1898275479 shutdown_connections 2023-10-16T23:27:34.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.580+0000 7f5c9ec97640 1 --2- 172.21.15.12:0/1898275479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c9814b7a0 0x7f5c9814bbb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:34.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.580+0000 7f5c9ec97640 1 --2- 172.21.15.12:0/1898275479 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c980c12a0 0x7f5c980b90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:34.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.580+0000 7f5c9ec97640 1 -- 172.21.15.12:0/1898275479 >> 172.21.15.12:0/1898275479 conn(0x7f5c9806bb10 msgr2=0x7f5c980c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:34.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.580+0000 7f5c9ec97640 1 -- 172.21.15.12:0/1898275479 shutdown_connections 2023-10-16T23:27:34.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.580+0000 7f5c9ec97640 1 -- 172.21.15.12:0/1898275479 wait complete. 2023-10-16T23:27:34.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.580+0000 7f5c9ec97640 1 Processor -- start 2023-10-16T23:27:34.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.580+0000 7f5c9ec97640 1 -- start start 2023-10-16T23:27:34.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.580+0000 7f5c9ec97640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c980b3bb0 0x7f5c981563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:34.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.580+0000 7f5c9ec97640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c980c12a0 0x7f5c9814e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:34.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.580+0000 7f5c9ec97640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c9814b7a0 0x7f5c98144fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:34.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.580+0000 7f5c9ec97640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c981411d0 con 0x7f5c980b3bb0 2023-10-16T23:27:34.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.580+0000 7f5c9ec97640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c98140ab0 con 0x7f5c9814b7a0 2023-10-16T23:27:34.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.580+0000 7f5c9ec97640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c98145e60 con 0x7f5c980c12a0 2023-10-16T23:27:34.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.580+0000 7f5c9ca33640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c980b3bb0 0x7f5c981563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:34.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.580+0000 7f5c9ca33640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c980b3bb0 0x7f5c981563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58544/0 (socket says 172.21.15.12:58544) 2023-10-16T23:27:34.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.580+0000 7f5c9ca33640 1 -- 172.21.15.12:0/888017532 learned_addr learned my addr 172.21.15.12:0/888017532 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:34.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.584+0000 7f5c9d234640 1 --2- 172.21.15.12:0/888017532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c9814b7a0 0x7f5c98144fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:34.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.584+0000 7f5c97fff640 1 --2- 172.21.15.12:0/888017532 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c980c12a0 0x7f5c9814e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:34.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.584+0000 7f5c9ca33640 1 -- 172.21.15.12:0/888017532 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c980c12a0 msgr2=0x7f5c9814e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:34.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.584+0000 7f5c9ca33640 1 --2- 172.21.15.12:0/888017532 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c980c12a0 0x7f5c9814e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:34.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.584+0000 7f5c9ca33640 1 -- 172.21.15.12:0/888017532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c9814b7a0 msgr2=0x7f5c98144fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:34.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.584+0000 7f5c9ca33640 1 --2- 172.21.15.12:0/888017532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c9814b7a0 0x7f5c98144fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:34.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.584+0000 7f5c9ca33640 1 -- 172.21.15.12:0/888017532 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c90009a70 con 0x7f5c980b3bb0 2023-10-16T23:27:34.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.584+0000 7f5c9d234640 1 --2- 172.21.15.12:0/888017532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c9814b7a0 0x7f5c98144fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:34.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.584+0000 7f5c9ca33640 1 --2- 172.21.15.12:0/888017532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c980b3bb0 0x7f5c981563f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c00e930 tx=0x7f5c8c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:34.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.584+0000 7f5c957fa640 1 -- 172.21.15.12:0/888017532 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c009690 con 0x7f5c980b3bb0 2023-10-16T23:27:34.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.584+0000 7f5c957fa640 1 -- 172.21.15.12:0/888017532 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8c00ca00 con 0x7f5c980b3bb0 2023-10-16T23:27:34.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.584+0000 7f5c9ec97640 1 -- 172.21.15.12:0/888017532 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c981eb310 con 0x7f5c980b3bb0 2023-10-16T23:27:34.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.584+0000 7f5c957fa640 1 -- 172.21.15.12:0/888017532 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c00cd70 con 0x7f5c980b3bb0 2023-10-16T23:27:34.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.584+0000 7f5c9ec97640 1 -- 172.21.15.12:0/888017532 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c98141d60 con 0x7f5c980b3bb0 2023-10-16T23:27:34.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.584+0000 7f5c9ec97640 1 -- 172.21.15.12:0/888017532 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c980673a0 con 0x7f5c980b3bb0 2023-10-16T23:27:34.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.584+0000 7f5c957fa640 1 -- 172.21.15.12:0/888017532 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f5c8c013470 con 0x7f5c980b3bb0 2023-10-16T23:27:34.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.584+0000 7f5c957fa640 1 --2- 172.21.15.12:0/888017532 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5c7c065e60 0x7f5c7c068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:34.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.584+0000 7f5c957fa640 1 -- 172.21.15.12:0/888017532 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5c8c083510 con 0x7f5c980b3bb0 2023-10-16T23:27:34.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.584+0000 7f5c97fff640 1 --2- 172.21.15.12:0/888017532 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5c7c065e60 0x7f5c7c068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:34.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.584+0000 7f5c97fff640 1 --2- 172.21.15.12:0/888017532 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5c7c065e60 0x7f5c7c068320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5c84001ec0 tx=0x7f5c84009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:34.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.588+0000 7f5c957fa640 1 -- 172.21.15.12:0/888017532 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f5c8c051160 con 0x7f5c980b3bb0 2023-10-16T23:27:34.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:34.744+0000 7f5c9ec97640 1 -- 172.21.15.12:0/888017532 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f5c9806e920 con 0x7f5c980b3bb0 2023-10-16T23:27:35.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.252+0000 7f5c957fa640 1 -- 172.21.15.12:0/888017532 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7f5c8c054780 con 0x7f5c980b3bb0 2023-10-16T23:27:35.257 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'rbd' created 2023-10-16T23:27:35.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.256+0000 7f5c9ec97640 1 -- 172.21.15.12:0/888017532 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5c7c065e60 msgr2=0x7f5c7c068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:35.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.256+0000 7f5c9ec97640 1 --2- 172.21.15.12:0/888017532 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5c7c065e60 0x7f5c7c068320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5c84001ec0 tx=0x7f5c84009040 comp rx=0 tx=0).stop 2023-10-16T23:27:35.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.256+0000 7f5c9ec97640 1 -- 172.21.15.12:0/888017532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c980b3bb0 msgr2=0x7f5c981563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:35.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.256+0000 7f5c9ec97640 1 --2- 172.21.15.12:0/888017532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c980b3bb0 0x7f5c981563f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c00e930 tx=0x7f5c8c00edf0 comp rx=0 tx=0).stop 2023-10-16T23:27:35.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.256+0000 7f5c9ec97640 1 -- 172.21.15.12:0/888017532 shutdown_connections 2023-10-16T23:27:35.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.256+0000 7f5c9ec97640 1 --2- 172.21.15.12:0/888017532 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5c7c065e60 0x7f5c7c068320 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:35.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.256+0000 7f5c9ec97640 1 --2- 172.21.15.12:0/888017532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c9814b7a0 0x7f5c98144fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:35.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.256+0000 7f5c9ec97640 1 --2- 172.21.15.12:0/888017532 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c980c12a0 0x7f5c9814e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:35.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.256+0000 7f5c9ec97640 1 --2- 172.21.15.12:0/888017532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c980b3bb0 0x7f5c981563f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:35.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.256+0000 7f5c9ec97640 1 -- 172.21.15.12:0/888017532 >> 172.21.15.12:0/888017532 conn(0x7f5c9806bb10 msgr2=0x7f5c98143900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:35.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.256+0000 7f5c9ec97640 1 -- 172.21.15.12:0/888017532 shutdown_connections 2023-10-16T23:27:35.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.256+0000 7f5c9ec97640 1 -- 172.21.15.12:0/888017532 wait complete. 2023-10-16T23:27:35.287 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-16T23:27:35.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.416+0000 7fe640131640 1 Processor -- start 2023-10-16T23:27:35.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.416+0000 7fe640131640 1 -- start start 2023-10-16T23:27:35.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.416+0000 7fe640131640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe63814f1b0 0x7fe6380bb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:35.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.416+0000 7fe640131640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63806e9b0 con 0x7fe63814ad30 2023-10-16T23:27:35.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.416+0000 7fe640131640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63814fa70 con 0x7fe63814f590 2023-10-16T23:27:35.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.416+0000 7fe640131640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe638071280 con 0x7fe63814f1b0 2023-10-16T23:27:35.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63e6ce640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe63814ad30 0x7fe63814b160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44706/0 (socket says 172.21.15.12:44706) 2023-10-16T23:27:35.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63e6ce640 1 -- 172.21.15.12:0/3332768294 learned_addr learned my addr 172.21.15.12:0/3332768294 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:35.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63decd640 1 --2- 172.21.15.12:0/3332768294 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe63814f1b0 0x7fe6380bb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:35.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63cecb640 1 -- 172.21.15.12:0/3332768294 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3614300463 0 0) 0x7fe63806e9b0 con 0x7fe63814ad30 2023-10-16T23:27:35.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63cecb640 1 -- 172.21.15.12:0/3332768294 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe624003530 con 0x7fe63814ad30 2023-10-16T23:27:35.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63cecb640 1 -- 172.21.15.12:0/3332768294 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2959900741 0 0) 0x7fe624003530 con 0x7fe63814ad30 2023-10-16T23:27:35.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63cecb640 1 -- 172.21.15.12:0/3332768294 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe63814f1b0 msgr2=0x7fe6380bb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:35.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63cecb640 1 --2- 172.21.15.12:0/3332768294 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe63814f1b0 0x7fe6380bb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:35.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63cecb640 1 -- 172.21.15.12:0/3332768294 >> v1:172.21.15.31:6789/0 conn(0x7fe63814f590 legacy=0x7fe63814c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:35.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63cecb640 1 -- 172.21.15.12:0/3332768294 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63814caf0 con 0x7fe63814ad30 2023-10-16T23:27:35.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63cecb640 1 -- 172.21.15.12:0/3332768294 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7fe630001a00 con 0x7fe63814ad30 2023-10-16T23:27:35.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63cecb640 1 -- 172.21.15.12:0/3332768294 >> v1:172.21.15.12:6789/0 conn(0x7fe63814ad30 legacy=0x7fe63814b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:35.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63cecb640 1 --2- 172.21.15.12:0/3332768294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6240039b0 0x7fe624003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:35.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63cecb640 1 --2- 172.21.15.12:0/3332768294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6240047d0 0x7fe624004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:35.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63cecb640 1 --2- 172.21.15.12:0/3332768294 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe63814f1b0 0x7fe6240051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:35.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63cecb640 1 -- 172.21.15.12:0/3332768294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe638071280 con 0x7fe6240039b0 2023-10-16T23:27:35.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63cecb640 1 -- 172.21.15.12:0/3332768294 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62400bac0 con 0x7fe6240047d0 2023-10-16T23:27:35.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63cecb640 1 -- 172.21.15.12:0/3332768294 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62400bc80 con 0x7fe63814f1b0 2023-10-16T23:27:35.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63decd640 1 --2- 172.21.15.12:0/3332768294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6240039b0 0x7fe624003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:35.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63d6cc640 1 --2- 172.21.15.12:0/3332768294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6240047d0 0x7fe624004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:35.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63e6ce640 1 --2- 172.21.15.12:0/3332768294 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe63814f1b0 0x7fe6240051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:35.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63decd640 1 -- 172.21.15.12:0/3332768294 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe63814f1b0 msgr2=0x7fe6240051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:35.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63decd640 1 --2- 172.21.15.12:0/3332768294 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe63814f1b0 0x7fe6240051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:35.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63decd640 1 -- 172.21.15.12:0/3332768294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6240047d0 msgr2=0x7fe624004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:35.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63decd640 1 --2- 172.21.15.12:0/3332768294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6240047d0 0x7fe624004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:35.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63decd640 1 -- 172.21.15.12:0/3332768294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe624003530 con 0x7fe6240039b0 2023-10-16T23:27:35.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63d6cc640 1 --2- 172.21.15.12:0/3332768294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6240047d0 0x7fe624004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:35.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63decd640 1 --2- 172.21.15.12:0/3332768294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6240039b0 0x7fe624003dd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe63400aae0 tx=0x7fe63401dfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e5a4ec6bca1fcf server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:35.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63cecb640 1 -- 172.21.15.12:0/3332768294 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6340a6e90 con 0x7fe6240039b0 2023-10-16T23:27:35.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63cecb640 1 -- 172.21.15.12:0/3332768294 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6340ae440 con 0x7fe6240039b0 2023-10-16T23:27:35.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.420+0000 7fe63cecb640 1 -- 172.21.15.12:0/3332768294 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6340ae7f0 con 0x7fe6240039b0 2023-10-16T23:27:35.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe640131640 1 -- 172.21.15.12:0/3332768294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6240039b0 msgr2=0x7fe624003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:35.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe640131640 1 --2- 172.21.15.12:0/3332768294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6240039b0 0x7fe624003dd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe63400aae0 tx=0x7fe63401dfa0 comp rx=0 tx=0).stop 2023-10-16T23:27:35.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe63e6ce640 1 -- 172.21.15.12:0/3332768294 reap_dead start 2023-10-16T23:27:35.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe640131640 1 -- 172.21.15.12:0/3332768294 shutdown_connections 2023-10-16T23:27:35.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe640131640 1 -- 172.21.15.12:0/3332768294 >> 172.21.15.12:0/3332768294 conn(0x7fe6380bd240 msgr2=0x7fe6380bd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:35.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe640131640 1 -- 172.21.15.12:0/3332768294 shutdown_connections 2023-10-16T23:27:35.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe640131640 1 -- 172.21.15.12:0/3332768294 wait complete. 2023-10-16T23:27:35.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe640131640 1 Processor -- start 2023-10-16T23:27:35.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe640131640 1 -- start start 2023-10-16T23:27:35.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe640131640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6240039b0 0x7fe638142e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:35.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe640131640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6380b6dc0 0x7fe638141e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:35.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe640131640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6381459d0 0x7fe638142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:35.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe640131640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe638143370 con 0x7fe6381459d0 2023-10-16T23:27:35.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe640131640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe638142b90 con 0x7fe6240039b0 2023-10-16T23:27:35.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe640131640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6380b38d0 con 0x7fe6380b6dc0 2023-10-16T23:27:35.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe63e6ce640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6381459d0 0x7fe638142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:35.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe63e6ce640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6381459d0 0x7fe638142370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58564/0 (socket says 172.21.15.12:58564) 2023-10-16T23:27:35.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe63e6ce640 1 -- 172.21.15.12:0/2315095996 learned_addr learned my addr 172.21.15.12:0/2315095996 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:35.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe63decd640 1 --2- 172.21.15.12:0/2315095996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6240039b0 0x7fe638142e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:35.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe63d6cc640 1 --2- 172.21.15.12:0/2315095996 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6380b6dc0 0x7fe638141e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:35.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe63e6ce640 1 -- 172.21.15.12:0/2315095996 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6380b6dc0 msgr2=0x7fe638141e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:35.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe63e6ce640 1 --2- 172.21.15.12:0/2315095996 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6380b6dc0 0x7fe638141e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:35.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe63e6ce640 1 -- 172.21.15.12:0/2315095996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6240039b0 msgr2=0x7fe638142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:35.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe63e6ce640 1 --2- 172.21.15.12:0/2315095996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6240039b0 0x7fe638142e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:35.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe63e6ce640 1 -- 172.21.15.12:0/2315095996 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6381428b0 con 0x7fe6381459d0 2023-10-16T23:27:35.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe63d6cc640 1 --2- 172.21.15.12:0/2315095996 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6380b6dc0 0x7fe638141e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:27:35.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe63e6ce640 1 --2- 172.21.15.12:0/2315095996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6381459d0 0x7fe638142370 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe63806b330 tx=0x7fe63000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:35.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe62e7fc640 1 -- 172.21.15.12:0/2315095996 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630004d70 con 0x7fe6381459d0 2023-10-16T23:27:35.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe62e7fc640 1 -- 172.21.15.12:0/2315095996 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63000bb80 con 0x7fe6381459d0 2023-10-16T23:27:35.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe640131640 1 -- 172.21.15.12:0/2315095996 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe638143650 con 0x7fe6381459d0 2023-10-16T23:27:35.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe62e7fc640 1 -- 172.21.15.12:0/2315095996 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630007110 con 0x7fe6381459d0 2023-10-16T23:27:35.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.424+0000 7fe640131640 1 -- 172.21.15.12:0/2315095996 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6381e8b10 con 0x7fe6381459d0 2023-10-16T23:27:35.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.428+0000 7fe640131640 1 -- 172.21.15.12:0/2315095996 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6380b3a90 con 0x7fe6381459d0 2023-10-16T23:27:35.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.428+0000 7fe62e7fc640 1 -- 172.21.15.12:0/2315095996 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fe630007270 con 0x7fe6381459d0 2023-10-16T23:27:35.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.428+0000 7fe62e7fc640 1 --2- 172.21.15.12:0/2315095996 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe61c065e60 0x7fe61c068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:35.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.428+0000 7fe62e7fc640 1 -- 172.21.15.12:0/2315095996 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5199+0+0 (secure 0 0 0) 0x7fe630083270 con 0x7fe6381459d0 2023-10-16T23:27:35.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.428+0000 7fe63decd640 1 --2- 172.21.15.12:0/2315095996 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe61c065e60 0x7fe61c068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:35.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.428+0000 7fe63decd640 1 --2- 172.21.15.12:0/2315095996 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe61c065e60 0x7fe61c068320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe6340b0000 tx=0x7fe6340046d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:35.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.432+0000 7fe62e7fc640 1 -- 172.21.15.12:0/2315095996 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fe630050d60 con 0x7fe6381459d0 2023-10-16T23:27:35.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:35.588+0000 7fe640131640 1 -- 172.21.15.12:0/2315095996 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe6380673a0 con 0x7fe6381459d0 2023-10-16T23:27:36.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.264+0000 7fe62e7fc640 1 -- 172.21.15.12:0/2315095996 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7fe630054380 con 0x7fe6381459d0 2023-10-16T23:27:36.268 INFO:teuthology.orchestra.run.smithi012.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-16T23:27:36.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.268+0000 7fe640131640 1 -- 172.21.15.12:0/2315095996 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe61c065e60 msgr2=0x7fe61c068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:36.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.268+0000 7fe640131640 1 --2- 172.21.15.12:0/2315095996 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe61c065e60 0x7fe61c068320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe6340b0000 tx=0x7fe6340046d0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.268+0000 7fe640131640 1 -- 172.21.15.12:0/2315095996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6381459d0 msgr2=0x7fe638142370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:36.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.268+0000 7fe640131640 1 --2- 172.21.15.12:0/2315095996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6381459d0 0x7fe638142370 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe63806b330 tx=0x7fe63000b4a0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.268+0000 7fe640131640 1 -- 172.21.15.12:0/2315095996 shutdown_connections 2023-10-16T23:27:36.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.268+0000 7fe640131640 1 --2- 172.21.15.12:0/2315095996 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe61c065e60 0x7fe61c068320 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.268+0000 7fe640131640 1 --2- 172.21.15.12:0/2315095996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6381459d0 0x7fe638142370 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.268+0000 7fe640131640 1 --2- 172.21.15.12:0/2315095996 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6380b6dc0 0x7fe638141e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.268+0000 7fe640131640 1 --2- 172.21.15.12:0/2315095996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6240039b0 0x7fe638142e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.268+0000 7fe640131640 1 -- 172.21.15.12:0/2315095996 >> 172.21.15.12:0/2315095996 conn(0x7fe6380bd240 msgr2=0x7fe6380bb620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:36.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.268+0000 7fe640131640 1 -- 172.21.15.12:0/2315095996 shutdown_connections 2023-10-16T23:27:36.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.268+0000 7fe640131640 1 -- 172.21.15.12:0/2315095996 wait complete. 2023-10-16T23:27:36.295 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-16T23:27:36.296 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-16T23:27:36.297 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-16T23:27:36.299 INFO:tasks.ceph.mds.a:Started 2023-10-16T23:27:36.300 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-16T23:27:36.300 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-16T23:27:36.303 INFO:tasks.ceph.mds.b:Started 2023-10-16T23:27:36.303 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-16T23:27:36.304 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T23:27:36.388 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2023-10-16T23:27:36.394 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2023-10-16T23:27:36.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.424+0000 7f3e40e22640 1 Processor -- start 2023-10-16T23:27:36.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.424+0000 7f3e40e22640 1 -- start start 2023-10-16T23:27:36.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.424+0000 7f3e40e22640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e3c0c1da0 0x7f3e3c070c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:36.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.424+0000 7f3e40e22640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3e3c0bb420 0x7f3e3c138520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:36.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.424+0000 7f3e40e22640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3e3c138a60 0x7f3e3c06e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:36.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.424+0000 7f3e40e22640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3c0bb180 con 0x7f3e3c138a60 2023-10-16T23:27:36.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.424+0000 7f3e40e22640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3c0704e0 con 0x7f3e3c0bb420 2023-10-16T23:27:36.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.424+0000 7f3e40e22640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c14f430 con 0x7f3e3c0c1da0 2023-10-16T23:27:36.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.424+0000 7f3e3ad9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3e3c138a60 0x7f3e3c06e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:36.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.424+0000 7f3e3ad9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3e3c138a60 0x7f3e3c06e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58578/0 (socket says 172.21.15.12:58578) 2023-10-16T23:27:36.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.424+0000 7f3e3ad9d640 1 -- 172.21.15.12:0/2095297557 learned_addr learned my addr 172.21.15.12:0/2095297557 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:36.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.424+0000 7f3e3a59c640 1 --2- 172.21.15.12:0/2095297557 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e3c0c1da0 0x7f3e3c070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:36.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.424+0000 7f3e39d9b640 1 --2- 172.21.15.12:0/2095297557 >> v2:172.21.15.31:3300/0 conn(0x7f3e3c0bb420 0x7f3e3c138520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:36.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.424+0000 7f3e3ad9d640 1 -- 172.21.15.12:0/2095297557 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e3c0c1da0 msgr2=0x7f3e3c070c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:36.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.424+0000 7f3e3ad9d640 1 --2- 172.21.15.12:0/2095297557 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e3c0c1da0 0x7f3e3c070c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.424+0000 7f3e3ad9d640 1 -- 172.21.15.12:0/2095297557 >> v2:172.21.15.31:3300/0 conn(0x7f3e3c0bb420 msgr2=0x7f3e3c138520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:36.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.424+0000 7f3e3ad9d640 1 --2- 172.21.15.12:0/2095297557 >> v2:172.21.15.31:3300/0 conn(0x7f3e3c0bb420 0x7f3e3c138520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.424+0000 7f3e3ad9d640 1 -- 172.21.15.12:0/2095297557 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c0bada0 con 0x7f3e3c138a60 2023-10-16T23:27:36.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e3ad9d640 1 --2- 172.21.15.12:0/2095297557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e3c138a60 0x7f3e3c06e6d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c0c25b0 tx=0x7f3e3401c1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eefca6425e35688 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:36.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e3959a640 1 -- 172.21.15.12:0/2095297557 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e340ab600 con 0x7f3e3c138a60 2023-10-16T23:27:36.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e3959a640 1 -- 172.21.15.12:0/2095297557 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e340a7050 con 0x7f3e3c138a60 2023-10-16T23:27:36.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e3959a640 1 -- 172.21.15.12:0/2095297557 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e340ab980 con 0x7f3e3c138a60 2023-10-16T23:27:36.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e40e22640 1 -- 172.21.15.12:0/2095297557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e3c138a60 msgr2=0x7f3e3c06e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:36.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e40e22640 1 --2- 172.21.15.12:0/2095297557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e3c138a60 0x7f3e3c06e6d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c0c25b0 tx=0x7f3e3401c1e0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e40e22640 1 -- 172.21.15.12:0/2095297557 shutdown_connections 2023-10-16T23:27:36.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e40e22640 1 --2- 172.21.15.12:0/2095297557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e3c138a60 0x7f3e3c06e6d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e40e22640 1 --2- 172.21.15.12:0/2095297557 >> v2:172.21.15.31:3300/0 conn(0x7f3e3c0bb420 0x7f3e3c138520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e40e22640 1 --2- 172.21.15.12:0/2095297557 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e3c0c1da0 0x7f3e3c070c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e40e22640 1 -- 172.21.15.12:0/2095297557 >> 172.21.15.12:0/2095297557 conn(0x7f3e3c06b830 msgr2=0x7f3e3c06bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e40e22640 1 -- 172.21.15.12:0/2095297557 shutdown_connections 2023-10-16T23:27:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e40e22640 1 -- 172.21.15.12:0/2095297557 wait complete. 2023-10-16T23:27:36.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e40e22640 1 Processor -- start 2023-10-16T23:27:36.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e40e22640 1 -- start start 2023-10-16T23:27:36.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e40e22640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e3c0bb420 0x7f3e3c132800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:36.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e40e22640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e3c0c1da0 0x7f3e3c131c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:36.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e40e22640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e3c138a60 0x7f3e3c1ea950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:36.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e40e22640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c1374d0 con 0x7f3e3c0bb420 2023-10-16T23:27:36.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e40e22640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c137920 con 0x7f3e3c138a60 2023-10-16T23:27:36.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e40e22640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c1525c0 con 0x7f3e3c0c1da0 2023-10-16T23:27:36.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e3a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e3c0bb420 0x7f3e3c132800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:36.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e3a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e3c0bb420 0x7f3e3c132800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58582/0 (socket says 172.21.15.12:58582) 2023-10-16T23:27:36.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e3a59c640 1 -- 172.21.15.12:0/2304199464 learned_addr learned my addr 172.21.15.12:0/2304199464 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:36.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e39d9b640 1 --2- 172.21.15.12:0/2304199464 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e3c0c1da0 0x7f3e3c131c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:36.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e3ad9d640 1 --2- 172.21.15.12:0/2304199464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e3c138a60 0x7f3e3c1ea950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:36.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e3a59c640 1 -- 172.21.15.12:0/2304199464 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e3c0c1da0 msgr2=0x7f3e3c131c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:36.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e3a59c640 1 --2- 172.21.15.12:0/2304199464 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e3c0c1da0 0x7f3e3c131c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e3a59c640 1 -- 172.21.15.12:0/2304199464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e3c138a60 msgr2=0x7f3e3c1ea950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:36.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e3a59c640 1 --2- 172.21.15.12:0/2304199464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e3c138a60 0x7f3e3c1ea950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e3a59c640 1 -- 172.21.15.12:0/2304199464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e340094d0 con 0x7f3e3c0bb420 2023-10-16T23:27:36.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.428+0000 7f3e39d9b640 1 --2- 172.21.15.12:0/2304199464 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e3c0c1da0 0x7f3e3c131c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:27:36.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.432+0000 7f3e3a59c640 1 --2- 172.21.15.12:0/2304199464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e3c0bb420 0x7f3e3c132800 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c00ce10 tx=0x7f3e2c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:36.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.432+0000 7f3e32ffd640 1 -- 172.21.15.12:0/2304199464 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c003ba0 con 0x7f3e3c0bb420 2023-10-16T23:27:36.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.432+0000 7f3e32ffd640 1 -- 172.21.15.12:0/2304199464 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2c003d00 con 0x7f3e3c0bb420 2023-10-16T23:27:36.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.432+0000 7f3e32ffd640 1 -- 172.21.15.12:0/2304199464 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c004240 con 0x7f3e3c0bb420 2023-10-16T23:27:36.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.432+0000 7f3e40e22640 1 -- 172.21.15.12:0/2304199464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e3c137bc0 con 0x7f3e3c0bb420 2023-10-16T23:27:36.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.432+0000 7f3e40e22640 1 -- 172.21.15.12:0/2304199464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e3c1528a0 con 0x7f3e3c0bb420 2023-10-16T23:27:36.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.432+0000 7f3e40e22640 1 -- 172.21.15.12:0/2304199464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e3c152ac0 con 0x7f3e3c0bb420 2023-10-16T23:27:36.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.432+0000 7f3e32ffd640 1 -- 172.21.15.12:0/2304199464 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f3e2c0043a0 con 0x7f3e3c0bb420 2023-10-16T23:27:36.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.432+0000 7f3e32ffd640 1 --2- 172.21.15.12:0/2304199464 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3e1c065eb0 0x7f3e1c068370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:36.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.432+0000 7f3e32ffd640 1 -- 172.21.15.12:0/2304199464 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3e2c012070 con 0x7f3e3c0bb420 2023-10-16T23:27:36.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.432+0000 7f3e39d9b640 1 --2- 172.21.15.12:0/2304199464 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3e1c065eb0 0x7f3e1c068370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:36.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.432+0000 7f3e39d9b640 1 --2- 172.21.15.12:0/2304199464 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3e1c065eb0 0x7f3e1c068370 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c1341e0 tx=0x7f3e24008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:36.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.436+0000 7f3e32ffd640 1 -- 172.21.15.12:0/2304199464 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f3e2c0517d0 con 0x7f3e3c0bb420 2023-10-16T23:27:36.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.596+0000 7f3e40e22640 1 -- 172.21.15.12:0/2304199464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e3c0673a0 con 0x7f3e3c0bb420 2023-10-16T23:27:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.596+0000 7f3e32ffd640 1 -- 172.21.15.12:0/2304199464 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14133 (secure 0 0 0) 0x7f3e2c054df0 con 0x7f3e3c0bb420 2023-10-16T23:27:36.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:36.599 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":19,"fsid":"0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51","created":"2023-10-16T23:27:16.468087+0000","modified":"2023-10-16T23:27:36.251986+0000","last_up_change":"2023-10-16T23:27:28.136202+0000","last_in_change":"2023-10-16T23:27:18.793212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T23:27:27.354025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-16T23:27:34.786446+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73e70f98-6f5e-4464-b34e-931faac41cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":38075},{"type":"v1","addr":"172.21.15.12:6814","nonce":38075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":38075},{"type":"v1","addr":"172.21.15.12:6819","nonce":38075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":38075},{"type":"v1","addr":"172.21.15.12:6827","nonce":38075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":38075},{"type":"v1","addr":"172.21.15.12:6823","nonce":38075}]},"public_addr":"172.21.15.12:6814/38075","cluster_addr":"172.21.15.12:6819/38075","heartbeat_back_addr":"172.21.15.12:6827/38075","heartbeat_front_addr":"172.21.15.12:6823/38075","state":["exists","up"]},{"osd":1,"uuid":"ff722efe-b3f9-4cc0-bbde-f4d4d8055a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":38076},{"type":"v1","addr":"172.21.15.12:6811","nonce":38076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":38076},{"type":"v1","addr":"172.21.15.12:6818","nonce":38076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":38076},{"type":"v1","addr":"172.21.15.12:6831","nonce":38076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":38076},{"type":"v1","addr":"172.21.15.12:6825","nonce":38076}]},"public_addr":"172.21.15.12:6811/38076","cluster_addr":"172.21.15.12:6818/38076","heartbeat_back_addr":"172.21.15.12:6831/38076","heartbeat_front_addr":"172.21.15.12:6825/38076","state":["exists","up"]},{"osd":2,"uuid":"9baf25db-dce0-4065-90d6-f35867286be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6809","nonce":38073},{"type":"v1","addr":"172.21.15.12:6810","nonce":38073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":38073},{"type":"v1","addr":"172.21.15.12:6817","nonce":38073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":38073},{"type":"v1","addr":"172.21.15.12:6830","nonce":38073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":38073},{"type":"v1","addr":"172.21.15.12:6826","nonce":38073}]},"public_addr":"172.21.15.12:6810/38073","cluster_addr":"172.21.15.12:6817/38073","heartbeat_back_addr":"172.21.15.12:6830/38073","heartbeat_front_addr":"172.21.15.12:6826/38073","state":["exists","up"]},{"osd":3,"uuid":"8a620ad3-2294-470d-8a8c-66f177f5fbe7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":38074},{"type":"v1","addr":"172.21.15.12:6801","nonce":38074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":38074},{"type":"v1","addr":"172.21.15.12:6803","nonce":38074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":38074},{"type":"v1","addr":"172.21.15.12:6807","nonce":38074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":38074},{"type":"v1","addr":"172.21.15.12:6805","nonce":38074}]},"public_addr":"172.21.15.12:6801/38074","cluster_addr":"172.21.15.12:6803/38074","heartbeat_back_addr":"172.21.15.12:6807/38074","heartbeat_front_addr":"172.21.15.12:6805/38074","state":["exists","up"]},{"osd":4,"uuid":"a8824d77-7405-40f5-9234-60889802b184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":38266},{"type":"v1","addr":"172.21.15.31:6817","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":38266},{"type":"v1","addr":"172.21.15.31:6819","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":38266},{"type":"v1","addr":"172.21.15.31:6823","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":38266},{"type":"v1","addr":"172.21.15.31:6821","nonce":38266}]},"public_addr":"172.21.15.31:6817/38266","cluster_addr":"172.21.15.31:6819/38266","heartbeat_back_addr":"172.21.15.31:6823/38266","heartbeat_front_addr":"172.21.15.31:6821/38266","state":["exists","up"]},{"osd":5,"uuid":"3bb01192-a47c-48e9-9662-285e3f6f4b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":38264},{"type":"v1","addr":"172.21.15.31:6807","nonce":38264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":38264},{"type":"v1","addr":"172.21.15.31:6811","nonce":38264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":38264},{"type":"v1","addr":"172.21.15.31:6815","nonce":38264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":38264},{"type":"v1","addr":"172.21.15.31:6813","nonce":38264}]},"public_addr":"172.21.15.31:6807/38264","cluster_addr":"172.21.15.31:6811/38264","heartbeat_back_addr":"172.21.15.31:6815/38264","heartbeat_front_addr":"172.21.15.31:6813/38264","state":["exists","up"]},{"osd":6,"uuid":"1e2d18e4-73e6-4a37-826c-35eca4d96935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":38263},{"type":"v1","addr":"172.21.15.31:6825","nonce":38263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":38263},{"type":"v1","addr":"172.21.15.31:6827","nonce":38263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":38263},{"type":"v1","addr":"172.21.15.31:6831","nonce":38263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":38263},{"type":"v1","addr":"172.21.15.31:6829","nonce":38263}]},"public_addr":"172.21.15.31:6825/38263","cluster_addr":"172.21.15.31:6827/38263","heartbeat_back_addr":"172.21.15.31:6831/38263","heartbeat_front_addr":"172.21.15.31:6829/38263","state":["exists","up"]},{"osd":7,"uuid":"e0f369c0-562b-4440-a5aa-12275c29412b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":38265},{"type":"v1","addr":"172.21.15.31:6801","nonce":38265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":38265},{"type":"v1","addr":"172.21.15.31:6803","nonce":38265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":38265},{"type":"v1","addr":"172.21.15.31:6810","nonce":38265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":38265},{"type":"v1","addr":"172.21.15.31:6806","nonce":38265}]},"public_addr":"172.21.15.31:6801/38265","cluster_addr":"172.21.15.31:6803/38265","heartbeat_back_addr":"172.21.15.31:6810/38265","heartbeat_front_addr":"172.21.15.31:6806/38265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.411815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.372565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.209700+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.414619+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.316843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.300348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.359800+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.219854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T23:27:36.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.596+0000 7f3e40e22640 1 -- 172.21.15.12:0/2304199464 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3e1c065eb0 msgr2=0x7f3e1c068370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:36.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.596+0000 7f3e40e22640 1 --2- 172.21.15.12:0/2304199464 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3e1c065eb0 0x7f3e1c068370 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c1341e0 tx=0x7f3e24008040 comp rx=0 tx=0).stop 2023-10-16T23:27:36.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.596+0000 7f3e40e22640 1 -- 172.21.15.12:0/2304199464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e3c0bb420 msgr2=0x7f3e3c132800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:36.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.596+0000 7f3e40e22640 1 --2- 172.21.15.12:0/2304199464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e3c0bb420 0x7f3e3c132800 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c00ce10 tx=0x7f3e2c00a660 comp rx=0 tx=0).stop 2023-10-16T23:27:36.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.596+0000 7f3e40e22640 1 -- 172.21.15.12:0/2304199464 shutdown_connections 2023-10-16T23:27:36.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.596+0000 7f3e40e22640 1 --2- 172.21.15.12:0/2304199464 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3e1c065eb0 0x7f3e1c068370 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.596+0000 7f3e40e22640 1 --2- 172.21.15.12:0/2304199464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e3c138a60 0x7f3e3c1ea950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.596+0000 7f3e40e22640 1 --2- 172.21.15.12:0/2304199464 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e3c0c1da0 0x7f3e3c131c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.596+0000 7f3e40e22640 1 --2- 172.21.15.12:0/2304199464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e3c0bb420 0x7f3e3c132800 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.596+0000 7f3e40e22640 1 -- 172.21.15.12:0/2304199464 >> 172.21.15.12:0/2304199464 conn(0x7f3e3c06b830 msgr2=0x7f3e3c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.596+0000 7f3e40e22640 1 -- 172.21.15.12:0/2304199464 shutdown_connections 2023-10-16T23:27:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.596+0000 7f3e40e22640 1 -- 172.21.15.12:0/2304199464 wait complete. 2023-10-16T23:27:36.618 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T23:27:27.354025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-16T23:27:34.786446+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T23:27:36.619 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T23:27:36.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.732+0000 7fdfc9216640 1 Processor -- start 2023-10-16T23:27:36.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.732+0000 7fdfc9216640 1 -- start start 2023-10-16T23:27:36.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.732+0000 7fdfc9216640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdfc406e6d0 0x7fdfc414ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:36.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.732+0000 7fdfc9216640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdfc40705d0 0x7fdfc40c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:36.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.732+0000 7fdfc9216640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc406f130 con 0x7fdfc414eba0 2023-10-16T23:27:36.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.732+0000 7fdfc9216640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc4070da0 con 0x7fdfc40705d0 2023-10-16T23:27:36.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.732+0000 7fdfc9216640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc40b86f0 con 0x7fdfc406e6d0 2023-10-16T23:27:36.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.732+0000 7fdfc359e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdfc40705d0 0x7fdfc40c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:36.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.732+0000 7fdfc2d9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdfc414eba0 0x7fdfc4152a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44714/0 (socket says 172.21.15.12:44714) 2023-10-16T23:27:36.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.732+0000 7fdfc2d9d640 1 -- 172.21.15.12:0/3714333608 learned_addr learned my addr 172.21.15.12:0/3714333608 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:36.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.732+0000 7fdfc359e640 1 --2- 172.21.15.12:0/3714333608 >> v2:172.21.15.12:3300/0 conn(0x7fdfc40705d0 0x7fdfc40c1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58586/0 (socket says 172.21.15.12:58586) 2023-10-16T23:27:36.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.732+0000 7fdfc259c640 1 --2- 172.21.15.12:0/3714333608 >> v2:172.21.15.31:3300/0 conn(0x7fdfc406e6d0 0x7fdfc414ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:36.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.732+0000 7fdfc359e640 1 -- 172.21.15.12:0/3714333608 >> v2:172.21.15.31:3300/0 conn(0x7fdfc406e6d0 msgr2=0x7fdfc414ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:36.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.732+0000 7fdfc359e640 1 --2- 172.21.15.12:0/3714333608 >> v2:172.21.15.31:3300/0 conn(0x7fdfc406e6d0 0x7fdfc414ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.732+0000 7fdfc359e640 1 -- 172.21.15.12:0/3714333608 >> v1:172.21.15.12:6789/0 conn(0x7fdfc414eba0 legacy=0x7fdfc4152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:36.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.736+0000 7fdfc359e640 1 -- 172.21.15.12:0/3714333608 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc40709e0 con 0x7fdfc40705d0 2023-10-16T23:27:36.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.736+0000 7fdfc1d9b640 1 -- 172.21.15.12:0/3714333608 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1166599692 0 0) 0x7fdfc406f130 con 0x7fdfc414eba0 2023-10-16T23:27:36.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.736+0000 7fdfc359e640 1 --2- 172.21.15.12:0/3714333608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfc40705d0 0x7fdfc40c1c90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4071650 tx=0x7fdfbc01c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd6626b9457808b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:36.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.736+0000 7fdfc1d9b640 1 -- 172.21.15.12:0/3714333608 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0a57a0 con 0x7fdfc40705d0 2023-10-16T23:27:36.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.736+0000 7fdfc1d9b640 1 -- 172.21.15.12:0/3714333608 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfbc0a5900 con 0x7fdfc40705d0 2023-10-16T23:27:36.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.736+0000 7fdfc1d9b640 1 -- 172.21.15.12:0/3714333608 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0a5c90 con 0x7fdfc40705d0 2023-10-16T23:27:36.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.736+0000 7fdfc9216640 1 -- 172.21.15.12:0/3714333608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfc40705d0 msgr2=0x7fdfc40c1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:36.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.736+0000 7fdfc9216640 1 --2- 172.21.15.12:0/3714333608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfc40705d0 0x7fdfc40c1c90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4071650 tx=0x7fdfbc01c7f0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.736+0000 7fdfc9216640 1 -- 172.21.15.12:0/3714333608 shutdown_connections 2023-10-16T23:27:36.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.736+0000 7fdfc9216640 1 --2- 172.21.15.12:0/3714333608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfc40705d0 0x7fdfc40c1c90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.736+0000 7fdfc9216640 1 --2- 172.21.15.12:0/3714333608 >> v2:172.21.15.31:3300/0 conn(0x7fdfc406e6d0 0x7fdfc414ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.736+0000 7fdfc9216640 1 -- 172.21.15.12:0/3714333608 >> 172.21.15.12:0/3714333608 conn(0x7fdfc406b800 msgr2=0x7fdfc406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:36.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.736+0000 7fdfc9216640 1 -- 172.21.15.12:0/3714333608 shutdown_connections 2023-10-16T23:27:36.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.736+0000 7fdfc9216640 1 -- 172.21.15.12:0/3714333608 wait complete. 2023-10-16T23:27:36.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.736+0000 7fdfc9216640 1 Processor -- start 2023-10-16T23:27:36.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.736+0000 7fdfc9216640 1 -- start start 2023-10-16T23:27:36.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfc9216640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdfc406e6d0 0x7fdfc41475b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:36.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfc9216640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfc40705d0 0x7fdfc414d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfc9216640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfc414eba0 0x7fdfc41eb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfc9216640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc41eab70 con 0x7fdfc40705d0 2023-10-16T23:27:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfc9216640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc414dac0 con 0x7fdfc414eba0 2023-10-16T23:27:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfc9216640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc414e460 con 0x7fdfc406e6d0 2023-10-16T23:27:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfc259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfc40705d0 0x7fdfc414d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfc259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfc40705d0 0x7fdfc414d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58596/0 (socket says 172.21.15.12:58596) 2023-10-16T23:27:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfc259c640 1 -- 172.21.15.12:0/646439184 learned_addr learned my addr 172.21.15.12:0/646439184 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfc2d9d640 1 --2- 172.21.15.12:0/646439184 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdfc406e6d0 0x7fdfc41475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfc359e640 1 --2- 172.21.15.12:0/646439184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfc414eba0 0x7fdfc41eb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfc259c640 1 -- 172.21.15.12:0/646439184 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdfc406e6d0 msgr2=0x7fdfc41475b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfc259c640 1 --2- 172.21.15.12:0/646439184 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdfc406e6d0 0x7fdfc41475b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfc259c640 1 -- 172.21.15.12:0/646439184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfc414eba0 msgr2=0x7fdfc41eb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfc259c640 1 --2- 172.21.15.12:0/646439184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfc414eba0 0x7fdfc41eb000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfc259c640 1 -- 172.21.15.12:0/646439184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc009a70 con 0x7fdfc40705d0 2023-10-16T23:27:36.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfc259c640 1 --2- 172.21.15.12:0/646439184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfc40705d0 0x7fdfc414d580 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800c820 tx=0x7fdfb800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:36.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfab7fe640 1 -- 172.21.15.12:0/646439184 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8004220 con 0x7fdfc40705d0 2023-10-16T23:27:36.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfab7fe640 1 -- 172.21.15.12:0/646439184 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb80043a0 con 0x7fdfc40705d0 2023-10-16T23:27:36.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfc9216640 1 -- 172.21.15.12:0/646439184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc414e740 con 0x7fdfc40705d0 2023-10-16T23:27:36.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfab7fe640 1 -- 172.21.15.12:0/646439184 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8004510 con 0x7fdfc40705d0 2023-10-16T23:27:36.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfc9216640 1 -- 172.21.15.12:0/646439184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc4148200 con 0x7fdfc40705d0 2023-10-16T23:27:36.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfc9216640 1 -- 172.21.15.12:0/646439184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc414e8d0 con 0x7fdfc40705d0 2023-10-16T23:27:36.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfab7fe640 1 -- 172.21.15.12:0/646439184 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fdfb8007a70 con 0x7fdfc40705d0 2023-10-16T23:27:36.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfab7fe640 1 --2- 172.21.15.12:0/646439184 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fdfb0065e60 0x7fdfb0068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:36.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfab7fe640 1 -- 172.21.15.12:0/646439184 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdfb8083380 con 0x7fdfc40705d0 2023-10-16T23:27:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.740+0000 7fdfc2d9d640 1 --2- 172.21.15.12:0/646439184 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fdfb0065e60 0x7fdfb0068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.744+0000 7fdfc2d9d640 1 --2- 172.21.15.12:0/646439184 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fdfb0065e60 0x7fdfb0068320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4000f70 tx=0x7fdfb4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.744+0000 7fdfab7fe640 1 -- 172.21.15.12:0/646439184 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fdfb8050c70 con 0x7fdfc40705d0 2023-10-16T23:27:36.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.900+0000 7fdfc9216640 1 -- 172.21.15.12:0/646439184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdfc41ead20 con 0x7fdfc40705d0 2023-10-16T23:27:36.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.904+0000 7fdfab7fe640 1 -- 172.21.15.12:0/646439184 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdfb801e0a0 con 0x7fdfc40705d0 2023-10-16T23:27:36.906 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-16T23:27:36.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.904+0000 7fdfc9216640 1 -- 172.21.15.12:0/646439184 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fdfb0065e60 msgr2=0x7fdfb0068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:36.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.904+0000 7fdfc9216640 1 --2- 172.21.15.12:0/646439184 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fdfb0065e60 0x7fdfb0068320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4000f70 tx=0x7fdfb4009040 comp rx=0 tx=0).stop 2023-10-16T23:27:36.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.904+0000 7fdfc9216640 1 -- 172.21.15.12:0/646439184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfc40705d0 msgr2=0x7fdfc414d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:36.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.904+0000 7fdfc9216640 1 --2- 172.21.15.12:0/646439184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfc40705d0 0x7fdfc414d580 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800c820 tx=0x7fdfb800cce0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.904+0000 7fdfc9216640 1 -- 172.21.15.12:0/646439184 shutdown_connections 2023-10-16T23:27:36.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.904+0000 7fdfc9216640 1 --2- 172.21.15.12:0/646439184 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fdfb0065e60 0x7fdfb0068320 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.904+0000 7fdfc9216640 1 --2- 172.21.15.12:0/646439184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfc414eba0 0x7fdfc41eb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.904+0000 7fdfc9216640 1 --2- 172.21.15.12:0/646439184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfc40705d0 0x7fdfc414d580 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.904+0000 7fdfc9216640 1 --2- 172.21.15.12:0/646439184 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdfc406e6d0 0x7fdfc41475b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:36.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.904+0000 7fdfc9216640 1 -- 172.21.15.12:0/646439184 >> 172.21.15.12:0/646439184 conn(0x7fdfc406b800 msgr2=0x7fdfc40bf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:36.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.904+0000 7fdfc9216640 1 -- 172.21.15.12:0/646439184 shutdown_connections 2023-10-16T23:27:36.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:36.904+0000 7fdfc9216640 1 -- 172.21.15.12:0/646439184 wait complete. 2023-10-16T23:27:36.924 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-16T23:27:37.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.048+0000 7fe16fe8d640 1 Processor -- start 2023-10-16T23:27:37.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.048+0000 7fe16fe8d640 1 -- start start 2023-10-16T23:27:37.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.048+0000 7fe16fe8d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe16814eba0 0x7fe16814ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:37.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.048+0000 7fe16fe8d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe1680705d0 0x7fe1680c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:37.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.048+0000 7fe16fe8d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe16806f130 con 0x7fe16806e6d0 2023-10-16T23:27:37.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.048+0000 7fe16fe8d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe168070da0 con 0x7fe1680705d0 2023-10-16T23:27:37.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.048+0000 7fe16fe8d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1680b86f0 con 0x7fe16814eba0 2023-10-16T23:27:37.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.048+0000 7fe16e42a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe1680705d0 0x7fe1680c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:37.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.048+0000 7fe16d428640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe16806e6d0 0x7fe168152a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44720/0 (socket says 172.21.15.12:44720) 2023-10-16T23:27:37.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.048+0000 7fe16d428640 1 -- 172.21.15.12:0/2393189934 learned_addr learned my addr 172.21.15.12:0/2393189934 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:37.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.048+0000 7fe16dc29640 1 --2- 172.21.15.12:0/2393189934 >> v2:172.21.15.31:3300/0 conn(0x7fe16814eba0 0x7fe16814ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:37.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.048+0000 7fe16cc27640 1 -- 172.21.15.12:0/2393189934 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3824425913 0 0) 0x7fe16806f130 con 0x7fe16806e6d0 2023-10-16T23:27:37.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.048+0000 7fe16cc27640 1 -- 172.21.15.12:0/2393189934 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe154003530 con 0x7fe16806e6d0 2023-10-16T23:27:37.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.048+0000 7fe16e42a640 1 -- 172.21.15.12:0/2393189934 >> v2:172.21.15.31:3300/0 conn(0x7fe16814eba0 msgr2=0x7fe16814ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:37.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.048+0000 7fe16e42a640 1 --2- 172.21.15.12:0/2393189934 >> v2:172.21.15.31:3300/0 conn(0x7fe16814eba0 0x7fe16814ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.048+0000 7fe16e42a640 1 -- 172.21.15.12:0/2393189934 >> v1:172.21.15.12:6789/0 conn(0x7fe16806e6d0 legacy=0x7fe168152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:37.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.048+0000 7fe16e42a640 1 -- 172.21.15.12:0/2393189934 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1680709e0 con 0x7fe1680705d0 2023-10-16T23:27:37.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16e42a640 1 --2- 172.21.15.12:0/2393189934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1680705d0 0x7fe1680c1c90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe1680c0710 tx=0x7fe16001c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964658beefc1c9e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:37.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16cc27640 1 -- 172.21.15.12:0/2393189934 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1600a57a0 con 0x7fe1680705d0 2023-10-16T23:27:37.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16cc27640 1 -- 172.21.15.12:0/2393189934 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1600a5900 con 0x7fe1680705d0 2023-10-16T23:27:37.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16cc27640 1 -- 172.21.15.12:0/2393189934 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1600a5c90 con 0x7fe1680705d0 2023-10-16T23:27:37.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16fe8d640 1 -- 172.21.15.12:0/2393189934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1680705d0 msgr2=0x7fe1680c1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:37.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16fe8d640 1 --2- 172.21.15.12:0/2393189934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1680705d0 0x7fe1680c1c90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe1680c0710 tx=0x7fe16001c7f0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16fe8d640 1 -- 172.21.15.12:0/2393189934 shutdown_connections 2023-10-16T23:27:37.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16fe8d640 1 --2- 172.21.15.12:0/2393189934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1680705d0 0x7fe1680c1c90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16fe8d640 1 --2- 172.21.15.12:0/2393189934 >> v2:172.21.15.31:3300/0 conn(0x7fe16814eba0 0x7fe16814ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16fe8d640 1 -- 172.21.15.12:0/2393189934 >> 172.21.15.12:0/2393189934 conn(0x7fe16806b800 msgr2=0x7fe16806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:37.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16fe8d640 1 -- 172.21.15.12:0/2393189934 shutdown_connections 2023-10-16T23:27:37.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16fe8d640 1 -- 172.21.15.12:0/2393189934 wait complete. 2023-10-16T23:27:37.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16fe8d640 1 Processor -- start 2023-10-16T23:27:37.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16fe8d640 1 -- start start 2023-10-16T23:27:37.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16fe8d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe16806e6d0 0x7fe1680b9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:37.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16fe8d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1680705d0 0x7fe1680bcf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:37.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16fe8d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe16814eba0 0x7fe1680b88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:37.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16fe8d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1681eafe0 con 0x7fe16814eba0 2023-10-16T23:27:37.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16fe8d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1680bd4c0 con 0x7fe16806e6d0 2023-10-16T23:27:37.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16fe8d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1681ea6f0 con 0x7fe1680705d0 2023-10-16T23:27:37.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16e42a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe16814eba0 0x7fe1680b88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:37.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16e42a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe16814eba0 0x7fe1680b88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58616/0 (socket says 172.21.15.12:58616) 2023-10-16T23:27:37.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16e42a640 1 -- 172.21.15.12:0/1905170921 learned_addr learned my addr 172.21.15.12:0/1905170921 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:37.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16dc29640 1 --2- 172.21.15.12:0/1905170921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe16806e6d0 0x7fe1680b9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:37.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16d428640 1 --2- 172.21.15.12:0/1905170921 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1680705d0 0x7fe1680bcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:37.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16e42a640 1 -- 172.21.15.12:0/1905170921 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1680705d0 msgr2=0x7fe1680bcf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:37.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16e42a640 1 --2- 172.21.15.12:0/1905170921 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1680705d0 0x7fe1680bcf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16e42a640 1 -- 172.21.15.12:0/1905170921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe16806e6d0 msgr2=0x7fe1680b9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:37.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16e42a640 1 --2- 172.21.15.12:0/1905170921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe16806e6d0 0x7fe1680b9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16e42a640 1 -- 172.21.15.12:0/1905170921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe160009a70 con 0x7fe16814eba0 2023-10-16T23:27:37.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16dc29640 1 --2- 172.21.15.12:0/1905170921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe16806e6d0 0x7fe1680b9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:37.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16d428640 1 --2- 172.21.15.12:0/1905170921 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1680705d0 0x7fe1680bcf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:37.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16e42a640 1 --2- 172.21.15.12:0/1905170921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe16814eba0 0x7fe1680b88e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe160009d90 tx=0x7fe160019590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:37.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe15a7fc640 1 -- 172.21.15.12:0/1905170921 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1600b9860 con 0x7fe16814eba0 2023-10-16T23:27:37.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe15a7fc640 1 -- 172.21.15.12:0/1905170921 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1600b99c0 con 0x7fe16814eba0 2023-10-16T23:27:37.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe15a7fc640 1 -- 172.21.15.12:0/1905170921 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1600b9d70 con 0x7fe16814eba0 2023-10-16T23:27:37.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16fe8d640 1 -- 172.21.15.12:0/1905170921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1681ea990 con 0x7fe16814eba0 2023-10-16T23:27:37.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.052+0000 7fe16fe8d640 1 -- 172.21.15.12:0/1905170921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1681eb470 con 0x7fe16814eba0 2023-10-16T23:27:37.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.056+0000 7fe16fe8d640 1 -- 172.21.15.12:0/1905170921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1681eb190 con 0x7fe16814eba0 2023-10-16T23:27:37.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.056+0000 7fe15a7fc640 1 -- 172.21.15.12:0/1905170921 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fe1600ad440 con 0x7fe16814eba0 2023-10-16T23:27:37.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.056+0000 7fe15a7fc640 1 --2- 172.21.15.12:0/1905170921 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe14c065e90 0x7fe14c068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:37.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.056+0000 7fe15a7fc640 1 -- 172.21.15.12:0/1905170921 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe16011e5d0 con 0x7fe16814eba0 2023-10-16T23:27:37.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.056+0000 7fe16dc29640 1 --2- 172.21.15.12:0/1905170921 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe14c065e90 0x7fe14c068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:37.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.056+0000 7fe16dc29640 1 --2- 172.21.15.12:0/1905170921 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe14c065e90 0x7fe14c068350 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe1640097a0 tx=0x7fe164008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:37.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.060+0000 7fe15a7fc640 1 -- 172.21.15.12:0/1905170921 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fe1681eb190 con 0x7fe16814eba0 2023-10-16T23:27:37.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.208+0000 7fe16fe8d640 1 -- 172.21.15.12:0/1905170921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe1681eb190 con 0x7fe16814eba0 2023-10-16T23:27:37.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.208+0000 7fe15a7fc640 1 -- 172.21.15.12:0/1905170921 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe1681eb190 con 0x7fe16814eba0 2023-10-16T23:27:37.213 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-10-16T23:27:37.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.212+0000 7fe16fe8d640 1 -- 172.21.15.12:0/1905170921 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe14c065e90 msgr2=0x7fe14c068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:37.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.212+0000 7fe16fe8d640 1 --2- 172.21.15.12:0/1905170921 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe14c065e90 0x7fe14c068350 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe1640097a0 tx=0x7fe164008040 comp rx=0 tx=0).stop 2023-10-16T23:27:37.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.212+0000 7fe16fe8d640 1 -- 172.21.15.12:0/1905170921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe16814eba0 msgr2=0x7fe1680b88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:37.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.212+0000 7fe16fe8d640 1 --2- 172.21.15.12:0/1905170921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe16814eba0 0x7fe1680b88e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe160009d90 tx=0x7fe160019590 comp rx=0 tx=0).stop 2023-10-16T23:27:37.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.212+0000 7fe16fe8d640 1 -- 172.21.15.12:0/1905170921 shutdown_connections 2023-10-16T23:27:37.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.212+0000 7fe16fe8d640 1 --2- 172.21.15.12:0/1905170921 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe14c065e90 0x7fe14c068350 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.212+0000 7fe16fe8d640 1 --2- 172.21.15.12:0/1905170921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe16814eba0 0x7fe1680b88e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.212+0000 7fe16fe8d640 1 --2- 172.21.15.12:0/1905170921 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1680705d0 0x7fe1680bcf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.212+0000 7fe16fe8d640 1 --2- 172.21.15.12:0/1905170921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe16806e6d0 0x7fe1680b9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.212+0000 7fe16fe8d640 1 -- 172.21.15.12:0/1905170921 >> 172.21.15.12:0/1905170921 conn(0x7fe16806b800 msgr2=0x7fe1680c2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:37.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.212+0000 7fe16fe8d640 1 -- 172.21.15.12:0/1905170921 shutdown_connections 2023-10-16T23:27:37.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.212+0000 7fe16fe8d640 1 -- 172.21.15.12:0/1905170921 wait complete. 2023-10-16T23:27:37.230 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T23:27:37.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.344+0000 7f945cd5a640 1 Processor -- start 2023-10-16T23:27:37.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.344+0000 7f945cd5a640 1 -- start start 2023-10-16T23:27:37.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.344+0000 7f945cd5a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f945806e770 0x7f94580c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:37.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.344+0000 7f945cd5a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f94580bfc30 0x7f9458153150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:37.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.344+0000 7f945cd5a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94580c01e0 con 0x7f94580c1950 2023-10-16T23:27:37.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.344+0000 7f945cd5a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94580b85b0 con 0x7f94580bfc30 2023-10-16T23:27:37.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.344+0000 7f945cd5a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94580b8120 con 0x7f945806e770 2023-10-16T23:27:37.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.344+0000 7f9456d9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f94580bfc30 0x7f9458153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:37.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.344+0000 7f9456d9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f94580bfc30 0x7f9458153150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58626/0 (socket says 172.21.15.12:58626) 2023-10-16T23:27:37.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.344+0000 7f9456d9d640 1 -- 172.21.15.12:0/2574018359 learned_addr learned my addr 172.21.15.12:0/2574018359 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:37.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.344+0000 7f944ffff640 1 --2- 172.21.15.12:0/2574018359 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f945806e770 0x7f94580c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:37.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.344+0000 7f9456d9d640 1 -- 172.21.15.12:0/2574018359 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f945806e770 msgr2=0x7f94580c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:37.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.344+0000 7f9456d9d640 1 --2- 172.21.15.12:0/2574018359 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f945806e770 0x7f94580c1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.344+0000 7f9456d9d640 1 -- 172.21.15.12:0/2574018359 >> v1:172.21.15.31:6789/0 conn(0x7f94580c1950 legacy=0x7f9458152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:37.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.344+0000 7f9456d9d640 1 -- 172.21.15.12:0/2574018359 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94580b7db0 con 0x7f94580bfc30 2023-10-16T23:27:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.344+0000 7f9456d9d640 1 --2- 172.21.15.12:0/2574018359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94580bfc30 0x7f9458153150 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9450009e50 tx=0x7f945001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f536eb1b7c32d61d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:37.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.344+0000 7f9455d9b640 1 -- 172.21.15.12:0/2574018359 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94500a57e0 con 0x7f94580bfc30 2023-10-16T23:27:37.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.344+0000 7f9455d9b640 1 -- 172.21.15.12:0/2574018359 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94500a5940 con 0x7f94580bfc30 2023-10-16T23:27:37.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.344+0000 7f9455d9b640 1 -- 172.21.15.12:0/2574018359 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94500a5cd0 con 0x7f94580bfc30 2023-10-16T23:27:37.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f945cd5a640 1 -- 172.21.15.12:0/2574018359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94580bfc30 msgr2=0x7f9458153150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:37.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f945cd5a640 1 --2- 172.21.15.12:0/2574018359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94580bfc30 0x7f9458153150 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9450009e50 tx=0x7f945001c940 comp rx=0 tx=0).stop 2023-10-16T23:27:37.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f945cd5a640 1 -- 172.21.15.12:0/2574018359 shutdown_connections 2023-10-16T23:27:37.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f945cd5a640 1 --2- 172.21.15.12:0/2574018359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94580bfc30 0x7f9458153150 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f945cd5a640 1 --2- 172.21.15.12:0/2574018359 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f945806e770 0x7f94580c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f945cd5a640 1 -- 172.21.15.12:0/2574018359 >> 172.21.15.12:0/2574018359 conn(0x7f945806b5d0 msgr2=0x7f945806b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:37.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f945cd5a640 1 -- 172.21.15.12:0/2574018359 shutdown_connections 2023-10-16T23:27:37.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f945cd5a640 1 -- 172.21.15.12:0/2574018359 wait complete. 2023-10-16T23:27:37.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f945cd5a640 1 Processor -- start 2023-10-16T23:27:37.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f945cd5a640 1 -- start start 2023-10-16T23:27:37.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f945cd5a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f945806e770 0x7f945814de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:37.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f945cd5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94580bfc30 0x7f945814e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:37.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f945cd5a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94580c1950 0x7f94581e7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:37.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f945cd5a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94580c5370 con 0x7f94580bfc30 2023-10-16T23:27:37.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f945cd5a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94580c5950 con 0x7f945806e770 2023-10-16T23:27:37.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f945cd5a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94580bb2e0 con 0x7f94580c1950 2023-10-16T23:27:37.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f944ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94580bfc30 0x7f945814e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:37.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f944ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94580bfc30 0x7f945814e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58642/0 (socket says 172.21.15.12:58642) 2023-10-16T23:27:37.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f944ffff640 1 -- 172.21.15.12:0/378960356 learned_addr learned my addr 172.21.15.12:0/378960356 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:37.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f9456d9d640 1 --2- 172.21.15.12:0/378960356 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94580c1950 0x7f94581e7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:37.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f945659c640 1 --2- 172.21.15.12:0/378960356 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f945806e770 0x7f945814de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:37.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f944ffff640 1 -- 172.21.15.12:0/378960356 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94580c1950 msgr2=0x7f94581e7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:37.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f944ffff640 1 --2- 172.21.15.12:0/378960356 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94580c1950 0x7f94581e7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f944ffff640 1 -- 172.21.15.12:0/378960356 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f945806e770 msgr2=0x7f945814de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:37.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f944ffff640 1 --2- 172.21.15.12:0/378960356 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f945806e770 0x7f945814de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f944ffff640 1 -- 172.21.15.12:0/378960356 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9450009b30 con 0x7f94580bfc30 2023-10-16T23:27:37.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f945659c640 1 --2- 172.21.15.12:0/378960356 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f945806e770 0x7f945814de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:37.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f944ffff640 1 --2- 172.21.15.12:0/378960356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94580bfc30 0x7f945814e380 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f944000d5d0 tx=0x7f944000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:37.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f944effd640 1 -- 172.21.15.12:0/378960356 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440004240 con 0x7f94580bfc30 2023-10-16T23:27:37.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f944effd640 1 -- 172.21.15.12:0/378960356 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94400043a0 con 0x7f94580bfc30 2023-10-16T23:27:37.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f945cd5a640 1 -- 172.21.15.12:0/378960356 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94580c55c0 con 0x7f94580bfc30 2023-10-16T23:27:37.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f944effd640 1 -- 172.21.15.12:0/378960356 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440003840 con 0x7f94580bfc30 2023-10-16T23:27:37.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.348+0000 7f945cd5a640 1 -- 172.21.15.12:0/378960356 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94580b9280 con 0x7f94580bfc30 2023-10-16T23:27:37.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.352+0000 7f945cd5a640 1 -- 172.21.15.12:0/378960356 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94580673a0 con 0x7f94580bfc30 2023-10-16T23:27:37.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.352+0000 7f944effd640 1 -- 172.21.15.12:0/378960356 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f94400039a0 con 0x7f94580bfc30 2023-10-16T23:27:37.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.352+0000 7f944effd640 1 --2- 172.21.15.12:0/378960356 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9438065e60 0x7f9438068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:37.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.352+0000 7f944effd640 1 -- 172.21.15.12:0/378960356 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9440083680 con 0x7f94580bfc30 2023-10-16T23:27:37.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.352+0000 7f945659c640 1 --2- 172.21.15.12:0/378960356 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9438065e60 0x7f9438068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:37.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.352+0000 7f945659c640 1 --2- 172.21.15.12:0/378960356 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9438065e60 0x7f9438068320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9448003e40 tx=0x7f9448009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:37.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.356+0000 7f944effd640 1 -- 172.21.15.12:0/378960356 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f94400510b0 con 0x7f94580bfc30 2023-10-16T23:27:37.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.548+0000 7f945cd5a640 1 -- 172.21.15.12:0/378960356 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94580b8dd0 con 0x7f94580bfc30 2023-10-16T23:27:37.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.548+0000 7f944effd640 1 -- 172.21.15.12:0/378960356 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2009 (secure 0 0 0) 0x7f94400546d0 con 0x7f94580bfc30 2023-10-16T23:27:37.551 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:37.551 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3365013557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3365013557},{"type":"v1","addr":"172.21.15.31:6835","nonce":3365013557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/593938276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":593938276},{"type":"v1","addr":"172.21.15.12:6833","nonce":593938276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-16T23:27:37.552 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 3 2023-10-16T23:27:37.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.548+0000 7f945cd5a640 1 -- 172.21.15.12:0/378960356 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9438065e60 msgr2=0x7f9438068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.548+0000 7f945cd5a640 1 --2- 172.21.15.12:0/378960356 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9438065e60 0x7f9438068320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9448003e40 tx=0x7f9448009040 comp rx=0 tx=0).stop 2023-10-16T23:27:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.548+0000 7f945cd5a640 1 -- 172.21.15.12:0/378960356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94580bfc30 msgr2=0x7f945814e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.548+0000 7f945cd5a640 1 --2- 172.21.15.12:0/378960356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94580bfc30 0x7f945814e380 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f944000d5d0 tx=0x7f944000da90 comp rx=0 tx=0).stop 2023-10-16T23:27:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.548+0000 7f945cd5a640 1 -- 172.21.15.12:0/378960356 shutdown_connections 2023-10-16T23:27:37.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.548+0000 7f945cd5a640 1 --2- 172.21.15.12:0/378960356 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9438065e60 0x7f9438068320 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.548+0000 7f945cd5a640 1 --2- 172.21.15.12:0/378960356 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f94580c1950 0x7f94581e7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.548+0000 7f945cd5a640 1 --2- 172.21.15.12:0/378960356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94580bfc30 0x7f945814e380 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.548+0000 7f945cd5a640 1 --2- 172.21.15.12:0/378960356 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f945806e770 0x7f945814de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.552+0000 7f945cd5a640 1 -- 172.21.15.12:0/378960356 >> 172.21.15.12:0/378960356 conn(0x7f945806b5d0 msgr2=0x7f94581526b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:37.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.552+0000 7f945cd5a640 1 -- 172.21.15.12:0/378960356 shutdown_connections 2023-10-16T23:27:37.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.552+0000 7f945cd5a640 1 -- 172.21.15.12:0/378960356 wait complete. 2023-10-16T23:27:37.570 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T23:27:37.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.684+0000 7fae69f4d640 1 Processor -- start 2023-10-16T23:27:37.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.684+0000 7fae69f4d640 1 -- start start 2023-10-16T23:27:37.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.684+0000 7fae69f4d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fae6406b660 0x7fae640bf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:37.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.684+0000 7fae69f4d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae6406d7c0 con 0x7fae6406c8a0 2023-10-16T23:27:37.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.684+0000 7fae69f4d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae64071690 con 0x7fae64150310 2023-10-16T23:27:37.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.684+0000 7fae69f4d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae640bfcc0 con 0x7fae6406b660 2023-10-16T23:27:37.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.684+0000 7fae637fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fae6406b660 0x7fae640bf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:37.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.684+0000 7fae62ffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fae6406c8a0 0x7fae6414fc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44734/0 (socket says 172.21.15.12:44734) 2023-10-16T23:27:37.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.684+0000 7fae62ffd640 1 -- 172.21.15.12:0/3304828687 learned_addr learned my addr 172.21.15.12:0/3304828687 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:37.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.684+0000 7fae637fe640 1 -- 172.21.15.12:0/3304828687 >> v1:172.21.15.31:6789/0 conn(0x7fae64150310 legacy=0x7fae64157ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:37.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.684+0000 7fae637fe640 1 -- 172.21.15.12:0/3304828687 >> v1:172.21.15.12:6789/0 conn(0x7fae6406c8a0 legacy=0x7fae6414fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:37.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.684+0000 7fae637fe640 1 -- 172.21.15.12:0/3304828687 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6406d2e0 con 0x7fae6406b660 2023-10-16T23:27:37.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.688+0000 7fae637fe640 1 --2- 172.21.15.12:0/3304828687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae6406b660 0x7fae640bf780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fae5c0097c0 tx=0x7fae5c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff1bf2a30b5cd45 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:37.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.688+0000 7fae627fc640 1 -- 172.21.15.12:0/3304828687 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c0ab640 con 0x7fae6406b660 2023-10-16T23:27:37.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.688+0000 7fae627fc640 1 -- 172.21.15.12:0/3304828687 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5c0a7070 con 0x7fae6406b660 2023-10-16T23:27:37.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.688+0000 7fae627fc640 1 -- 172.21.15.12:0/3304828687 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c0ab9c0 con 0x7fae6406b660 2023-10-16T23:27:37.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.688+0000 7fae69f4d640 1 -- 172.21.15.12:0/3304828687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae6406b660 msgr2=0x7fae640bf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:37.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.688+0000 7fae69f4d640 1 --2- 172.21.15.12:0/3304828687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae6406b660 0x7fae640bf780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fae5c0097c0 tx=0x7fae5c01c440 comp rx=0 tx=0).stop 2023-10-16T23:27:37.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.688+0000 7fae69f4d640 1 -- 172.21.15.12:0/3304828687 shutdown_connections 2023-10-16T23:27:37.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.688+0000 7fae69f4d640 1 --2- 172.21.15.12:0/3304828687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae6406b660 0x7fae640bf780 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.688+0000 7fae69f4d640 1 -- 172.21.15.12:0/3304828687 >> 172.21.15.12:0/3304828687 conn(0x7fae640a3f20 msgr2=0x7fae640c1880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:37.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.688+0000 7fae69f4d640 1 -- 172.21.15.12:0/3304828687 shutdown_connections 2023-10-16T23:27:37.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.688+0000 7fae69f4d640 1 -- 172.21.15.12:0/3304828687 wait complete. 2023-10-16T23:27:37.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.688+0000 7fae69f4d640 1 Processor -- start 2023-10-16T23:27:37.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.688+0000 7fae69f4d640 1 -- start start 2023-10-16T23:27:37.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.688+0000 7fae69f4d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae6406b660 0x7fae64148f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:37.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.688+0000 7fae69f4d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae6406c8a0 0x7fae6414ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:37.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.688+0000 7fae69f4d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae64150310 0x7fae64145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:37.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.692+0000 7fae69f4d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae64146dc0 con 0x7fae64150310 2023-10-16T23:27:37.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.692+0000 7fae69f4d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae64146fc0 con 0x7fae6406b660 2023-10-16T23:27:37.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.692+0000 7fae69f4d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae64140610 con 0x7fae6406c8a0 2023-10-16T23:27:37.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.692+0000 7fae63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae64150310 0x7fae64145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:37.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.692+0000 7fae63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae64150310 0x7fae64145bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58658/0 (socket says 172.21.15.12:58658) 2023-10-16T23:27:37.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.692+0000 7fae63fff640 1 -- 172.21.15.12:0/1134655371 learned_addr learned my addr 172.21.15.12:0/1134655371 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:37.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.692+0000 7fae62ffd640 1 --2- 172.21.15.12:0/1134655371 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae6406c8a0 0x7fae6414ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:37.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.692+0000 7fae637fe640 1 --2- 172.21.15.12:0/1134655371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae6406b660 0x7fae64148f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:37.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.692+0000 7fae63fff640 1 -- 172.21.15.12:0/1134655371 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae6406c8a0 msgr2=0x7fae6414ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:37.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.692+0000 7fae63fff640 1 --2- 172.21.15.12:0/1134655371 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae6406c8a0 0x7fae6414ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.692+0000 7fae63fff640 1 -- 172.21.15.12:0/1134655371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae6406b660 msgr2=0x7fae64148f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:37.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.692+0000 7fae63fff640 1 --2- 172.21.15.12:0/1134655371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae6406b660 0x7fae64148f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.692+0000 7fae63fff640 1 -- 172.21.15.12:0/1134655371 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5c009420 con 0x7fae64150310 2023-10-16T23:27:37.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.692+0000 7fae637fe640 1 --2- 172.21.15.12:0/1134655371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae6406b660 0x7fae64148f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:27:37.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.692+0000 7fae63fff640 1 --2- 172.21.15.12:0/1134655371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae64150310 0x7fae64145bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fae5400be90 tx=0x7fae5400bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:37.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.692+0000 7fae4bfff640 1 -- 172.21.15.12:0/1134655371 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae54014440 con 0x7fae64150310 2023-10-16T23:27:37.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.692+0000 7fae4bfff640 1 -- 172.21.15.12:0/1134655371 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae540145a0 con 0x7fae64150310 2023-10-16T23:27:37.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.692+0000 7fae69f4d640 1 -- 172.21.15.12:0/1134655371 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae640be850 con 0x7fae64150310 2023-10-16T23:27:37.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.692+0000 7fae4bfff640 1 -- 172.21.15.12:0/1134655371 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae54014990 con 0x7fae64150310 2023-10-16T23:27:37.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.692+0000 7fae69f4d640 1 -- 172.21.15.12:0/1134655371 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae6414b060 con 0x7fae64150310 2023-10-16T23:27:37.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.692+0000 7fae69f4d640 1 -- 172.21.15.12:0/1134655371 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae640673a0 con 0x7fae64150310 2023-10-16T23:27:37.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.692+0000 7fae4bfff640 1 -- 172.21.15.12:0/1134655371 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fae5401d3b0 con 0x7fae64150310 2023-10-16T23:27:37.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.692+0000 7fae4bfff640 1 --2- 172.21.15.12:0/1134655371 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fae50065e90 0x7fae50068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:37.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.692+0000 7fae4bfff640 1 -- 172.21.15.12:0/1134655371 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fae54083660 con 0x7fae64150310 2023-10-16T23:27:37.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.692+0000 7fae637fe640 1 --2- 172.21.15.12:0/1134655371 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fae50065e90 0x7fae50068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:37.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.696+0000 7fae637fe640 1 --2- 172.21.15.12:0/1134655371 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fae50065e90 0x7fae50068350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fae5c0af000 tx=0x7fae5c0a7000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:37.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.696+0000 7fae4bfff640 1 -- 172.21.15.12:0/1134655371 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fae54050ff0 con 0x7fae64150310 2023-10-16T23:27:37.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.848+0000 7fae69f4d640 1 -- 172.21.15.12:0/1134655371 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae64142ab0 con 0x7fae64150310 2023-10-16T23:27:37.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.848+0000 7fae4bfff640 1 -- 172.21.15.12:0/1134655371 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14120 (secure 0 0 0) 0x7fae54054610 con 0x7fae64150310 2023-10-16T23:27:37.854 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:37.854 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":20,"fsid":"0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51","created":"2023-10-16T23:27:16.468087+0000","modified":"2023-10-16T23:27:37.260848+0000","last_up_change":"2023-10-16T23:27:28.136202+0000","last_in_change":"2023-10-16T23:27:18.793212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T23:27:27.354025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-16T23:27:34.786446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73e70f98-6f5e-4464-b34e-931faac41cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":38075},{"type":"v1","addr":"172.21.15.12:6814","nonce":38075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":38075},{"type":"v1","addr":"172.21.15.12:6819","nonce":38075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":38075},{"type":"v1","addr":"172.21.15.12:6827","nonce":38075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":38075},{"type":"v1","addr":"172.21.15.12:6823","nonce":38075}]},"public_addr":"172.21.15.12:6814/38075","cluster_addr":"172.21.15.12:6819/38075","heartbeat_back_addr":"172.21.15.12:6827/38075","heartbeat_front_addr":"172.21.15.12:6823/38075","state":["exists","up"]},{"osd":1,"uuid":"ff722efe-b3f9-4cc0-bbde-f4d4d8055a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":38076},{"type":"v1","addr":"172.21.15.12:6811","nonce":38076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":38076},{"type":"v1","addr":"172.21.15.12:6818","nonce":38076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":38076},{"type":"v1","addr":"172.21.15.12:6831","nonce":38076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":38076},{"type":"v1","addr":"172.21.15.12:6825","nonce":38076}]},"public_addr":"172.21.15.12:6811/38076","cluster_addr":"172.21.15.12:6818/38076","heartbeat_back_addr":"172.21.15.12:6831/38076","heartbeat_front_addr":"172.21.15.12:6825/38076","state":["exists","up"]},{"osd":2,"uuid":"9baf25db-dce0-4065-90d6-f35867286be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6809","nonce":38073},{"type":"v1","addr":"172.21.15.12:6810","nonce":38073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":38073},{"type":"v1","addr":"172.21.15.12:6817","nonce":38073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":38073},{"type":"v1","addr":"172.21.15.12:6830","nonce":38073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":38073},{"type":"v1","addr":"172.21.15.12:6826","nonce":38073}]},"public_addr":"172.21.15.12:6810/38073","cluster_addr":"172.21.15.12:6817/38073","heartbeat_back_addr":"172.21.15.12:6830/38073","heartbeat_front_addr":"172.21.15.12:6826/38073","state":["exists","up"]},{"osd":3,"uuid":"8a620ad3-2294-470d-8a8c-66f177f5fbe7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":38074},{"type":"v1","addr":"172.21.15.12:6801","nonce":38074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":38074},{"type":"v1","addr":"172.21.15.12:6803","nonce":38074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":38074},{"type":"v1","addr":"172.21.15.12:6807","nonce":38074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":38074},{"type":"v1","addr":"172.21.15.12:6805","nonce":38074}]},"public_addr":"172.21.15.12:6801/38074","cluster_addr":"172.21.15.12:6803/38074","heartbeat_back_addr":"172.21.15.12:6807/38074","heartbeat_front_addr":"172.21.15.12:6805/38074","state":["exists","up"]},{"osd":4,"uuid":"a8824d77-7405-40f5-9234-60889802b184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":38266},{"type":"v1","addr":"172.21.15.31:6817","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":38266},{"type":"v1","addr":"172.21.15.31:6819","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":38266},{"type":"v1","addr":"172.21.15.31:6823","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":38266},{"type":"v1","addr":"172.21.15.31:6821","nonce":38266}]},"public_addr":"172.21.15.31:6817/38266","cluster_addr":"172.21.15.31:6819/38266","heartbeat_back_addr":"172.21.15.31:6823/38266","heartbeat_front_addr":"172.21.15.31:6821/38266","state":["exists","up"]},{"osd":5,"uuid":"3bb01192-a47c-48e9-9662-285e3f6f4b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":38264},{"type":"v1","addr":"172.21.15.31:6807","nonce":38264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":38264},{"type":"v1","addr":"172.21.15.31:6811","nonce":38264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":38264},{"type":"v1","addr":"172.21.15.31:6815","nonce":38264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":38264},{"type":"v1","addr":"172.21.15.31:6813","nonce":38264}]},"public_addr":"172.21.15.31:6807/38264","cluster_addr":"172.21.15.31:6811/38264","heartbeat_back_addr":"172.21.15.31:6815/38264","heartbeat_front_addr":"172.21.15.31:6813/38264","state":["exists","up"]},{"osd":6,"uuid":"1e2d18e4-73e6-4a37-826c-35eca4d96935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":38263},{"type":"v1","addr":"172.21.15.31:6825","nonce":38263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":38263},{"type":"v1","addr":"172.21.15.31:6827","nonce":38263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":38263},{"type":"v1","addr":"172.21.15.31:6831","nonce":38263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":38263},{"type":"v1","addr":"172.21.15.31:6829","nonce":38263}]},"public_addr":"172.21.15.31:6825/38263","cluster_addr":"172.21.15.31:6827/38263","heartbeat_back_addr":"172.21.15.31:6831/38263","heartbeat_front_addr":"172.21.15.31:6829/38263","state":["exists","up"]},{"osd":7,"uuid":"e0f369c0-562b-4440-a5aa-12275c29412b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":38265},{"type":"v1","addr":"172.21.15.31:6801","nonce":38265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":38265},{"type":"v1","addr":"172.21.15.31:6803","nonce":38265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":38265},{"type":"v1","addr":"172.21.15.31:6810","nonce":38265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":38265},{"type":"v1","addr":"172.21.15.31:6806","nonce":38265}]},"public_addr":"172.21.15.31:6801/38265","cluster_addr":"172.21.15.31:6803/38265","heartbeat_back_addr":"172.21.15.31:6810/38265","heartbeat_front_addr":"172.21.15.31:6806/38265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.411815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.372565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.209700+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.414619+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.316843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.300348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.359800+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.219854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T23:27:37.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.852+0000 7fae69f4d640 1 -- 172.21.15.12:0/1134655371 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fae50065e90 msgr2=0x7fae50068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:37.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.852+0000 7fae69f4d640 1 --2- 172.21.15.12:0/1134655371 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fae50065e90 0x7fae50068350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fae5c0af000 tx=0x7fae5c0a7000 comp rx=0 tx=0).stop 2023-10-16T23:27:37.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.852+0000 7fae69f4d640 1 -- 172.21.15.12:0/1134655371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae64150310 msgr2=0x7fae64145bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:37.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.852+0000 7fae69f4d640 1 --2- 172.21.15.12:0/1134655371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae64150310 0x7fae64145bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fae5400be90 tx=0x7fae5400bf80 comp rx=0 tx=0).stop 2023-10-16T23:27:37.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.852+0000 7fae69f4d640 1 -- 172.21.15.12:0/1134655371 shutdown_connections 2023-10-16T23:27:37.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.852+0000 7fae69f4d640 1 --2- 172.21.15.12:0/1134655371 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fae50065e90 0x7fae50068350 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.852+0000 7fae69f4d640 1 --2- 172.21.15.12:0/1134655371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae64150310 0x7fae64145bf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.852+0000 7fae69f4d640 1 --2- 172.21.15.12:0/1134655371 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae6406c8a0 0x7fae6414ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.852+0000 7fae69f4d640 1 --2- 172.21.15.12:0/1134655371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae6406b660 0x7fae64148f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.852+0000 7fae69f4d640 1 -- 172.21.15.12:0/1134655371 >> 172.21.15.12:0/1134655371 conn(0x7fae640a3f20 msgr2=0x7fae641506f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:37.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.852+0000 7fae69f4d640 1 -- 172.21.15.12:0/1134655371 shutdown_connections 2023-10-16T23:27:37.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.852+0000 7fae69f4d640 1 -- 172.21.15.12:0/1134655371 wait complete. 2023-10-16T23:27:37.871 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T23:27:27.354025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-16T23:27:34.786446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T23:27:37.872 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T23:27:37.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.984+0000 7fe9f2faf640 1 Processor -- start 2023-10-16T23:27:37.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.984+0000 7fe9f2faf640 1 -- start start 2023-10-16T23:27:37.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.984+0000 7fe9f2faf640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9ec0c12a0 0x7fe9ec0b90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:37.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.984+0000 7fe9f2faf640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe9ec0b3bb0 0x7fe9ec14fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:37.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.984+0000 7fe9f2faf640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9ec070fe0 con 0x7fe9ec150410 2023-10-16T23:27:37.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.984+0000 7fe9f2faf640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9ec14f7a0 con 0x7fe9ec0b3bb0 2023-10-16T23:27:37.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.984+0000 7fe9f2faf640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0b37e0 con 0x7fe9ec0c12a0 2023-10-16T23:27:37.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.984+0000 7fe9ebfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe9ec0b3bb0 0x7fe9ec14fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:37.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.984+0000 7fe9f0d4b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9ec0c12a0 0x7fe9ec0b90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:37.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.984+0000 7fe9ebfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe9ec0b3bb0 0x7fe9ec14fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:57394/0 (socket says 172.21.15.12:57394) 2023-10-16T23:27:37.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.984+0000 7fe9ebfff640 1 -- 172.21.15.12:0/169461449 learned_addr learned my addr 172.21.15.12:0/169461449 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:37.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.984+0000 7fe9f154c640 1 --1- 172.21.15.12:0/169461449 >> v1:172.21.15.31:6789/0 conn(0x7fe9ec150410 0x7fe9ec14b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:51440/0 (socket says 172.21.15.12:51440) 2023-10-16T23:27:37.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.984+0000 7fe9ebfff640 1 -- 172.21.15.12:0/169461449 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9ec0c12a0 msgr2=0x7fe9ec0b90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:37.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.984+0000 7fe9ebfff640 1 --2- 172.21.15.12:0/169461449 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9ec0c12a0 0x7fe9ec0b90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.984+0000 7fe9ebfff640 1 -- 172.21.15.12:0/169461449 >> v1:172.21.15.31:6789/0 conn(0x7fe9ec150410 legacy=0x7fe9ec14b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:37.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.984+0000 7fe9ebfff640 1 -- 172.21.15.12:0/169461449 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec14f9b0 con 0x7fe9ec0b3bb0 2023-10-16T23:27:37.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.984+0000 7fe9f0d4b640 1 --2- 172.21.15.12:0/169461449 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9ec0c12a0 0x7fe9ec0b90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T23:27:37.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9ebfff640 1 --2- 172.21.15.12:0/169461449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9ec0b3bb0 0x7fe9ec14fed0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe9e000bb10 tx=0x7fe9e001eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c934256b583bf0cd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:37.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9eb7fe640 1 -- 172.21.15.12:0/169461449 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e00a7ab0 con 0x7fe9ec0b3bb0 2023-10-16T23:27:37.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9eb7fe640 1 -- 172.21.15.12:0/169461449 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e00a7c10 con 0x7fe9ec0b3bb0 2023-10-16T23:27:37.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9eb7fe640 1 -- 172.21.15.12:0/169461449 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e00af440 con 0x7fe9ec0b3bb0 2023-10-16T23:27:37.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9f2faf640 1 -- 172.21.15.12:0/169461449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9ec0b3bb0 msgr2=0x7fe9ec14fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:37.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9f2faf640 1 --2- 172.21.15.12:0/169461449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9ec0b3bb0 0x7fe9ec14fed0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe9e000bb10 tx=0x7fe9e001eb80 comp rx=0 tx=0).stop 2023-10-16T23:27:37.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9f2faf640 1 -- 172.21.15.12:0/169461449 shutdown_connections 2023-10-16T23:27:37.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9f2faf640 1 --2- 172.21.15.12:0/169461449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9ec0b3bb0 0x7fe9ec14fed0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9f2faf640 1 --2- 172.21.15.12:0/169461449 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9ec0c12a0 0x7fe9ec0b90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9f2faf640 1 -- 172.21.15.12:0/169461449 >> 172.21.15.12:0/169461449 conn(0x7fe9ec06bb10 msgr2=0x7fe9ec0c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:37.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9f2faf640 1 -- 172.21.15.12:0/169461449 shutdown_connections 2023-10-16T23:27:37.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9f2faf640 1 -- 172.21.15.12:0/169461449 wait complete. 2023-10-16T23:27:37.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9f2faf640 1 Processor -- start 2023-10-16T23:27:37.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9f2faf640 1 -- start start 2023-10-16T23:27:37.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9f2faf640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9ec0b3bb0 0x7fe9ec14d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:37.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9f2faf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9ec0c12a0 0x7fe9ec143fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:37.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9f2faf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9ec1e8300 0x7fe9ec155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:37.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9f2faf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec14d210 con 0x7fe9ec0c12a0 2023-10-16T23:27:37.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9f2faf640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec13ca70 con 0x7fe9ec1e8300 2023-10-16T23:27:37.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9f2faf640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec1444e0 con 0x7fe9ec0b3bb0 2023-10-16T23:27:37.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9ebfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9ec0c12a0 0x7fe9ec143fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:37.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9ebfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9ec0c12a0 0x7fe9ec143fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58664/0 (socket says 172.21.15.12:58664) 2023-10-16T23:27:37.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9ebfff640 1 -- 172.21.15.12:0/4280483775 learned_addr learned my addr 172.21.15.12:0/4280483775 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:37.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9f0d4b640 1 --2- 172.21.15.12:0/4280483775 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9ec0b3bb0 0x7fe9ec14d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:37.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9ebfff640 1 -- 172.21.15.12:0/4280483775 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9ec0b3bb0 msgr2=0x7fe9ec14d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:37.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9ebfff640 1 --2- 172.21.15.12:0/4280483775 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9ec0b3bb0 0x7fe9ec14d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:37.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9ebfff640 1 -- 172.21.15.12:0/4280483775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9ec1e8300 msgr2=0x7fe9ec155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:38.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9ebfff640 1 --2- 172.21.15.12:0/4280483775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9ec1e8300 0x7fe9ec155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.988+0000 7fe9ebfff640 1 -- 172.21.15.12:0/4280483775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc009420 con 0x7fe9ec0c12a0 2023-10-16T23:27:38.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.992+0000 7fe9ebfff640 1 --2- 172.21.15.12:0/4280483775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9ec0c12a0 0x7fe9ec143fa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe9e000b2c0 tx=0x7fe9e001b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:38.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.992+0000 7fe9e97fa640 1 -- 172.21.15.12:0/4280483775 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e00b9600 con 0x7fe9ec0c12a0 2023-10-16T23:27:38.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.992+0000 7fe9e97fa640 1 -- 172.21.15.12:0/4280483775 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e00b9780 con 0x7fe9ec0c12a0 2023-10-16T23:27:38.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.992+0000 7fe9f2faf640 1 -- 172.21.15.12:0/4280483775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e000b770 con 0x7fe9ec0c12a0 2023-10-16T23:27:38.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.992+0000 7fe9e97fa640 1 -- 172.21.15.12:0/4280483775 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e00b9b30 con 0x7fe9ec0c12a0 2023-10-16T23:27:38.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.992+0000 7fe9f2faf640 1 -- 172.21.15.12:0/4280483775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ec155140 con 0x7fe9ec0c12a0 2023-10-16T23:27:38.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.992+0000 7fe9f2faf640 1 -- 172.21.15.12:0/4280483775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9ec154cc0 con 0x7fe9ec0c12a0 2023-10-16T23:27:38.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.992+0000 7fe9e97fa640 1 -- 172.21.15.12:0/4280483775 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fe9e00b9c90 con 0x7fe9ec0c12a0 2023-10-16T23:27:38.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.992+0000 7fe9e97fa640 1 --2- 172.21.15.12:0/4280483775 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe9d8065e90 0x7fe9d8068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:38.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.992+0000 7fe9e97fa640 1 -- 172.21.15.12:0/4280483775 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe9e011eaf0 con 0x7fe9ec0c12a0 2023-10-16T23:27:38.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.992+0000 7fe9f0d4b640 1 --2- 172.21.15.12:0/4280483775 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe9d8065e90 0x7fe9d8068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:38.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.992+0000 7fe9f0d4b640 1 --2- 172.21.15.12:0/4280483775 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe9d8065e90 0x7fe9d8068350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009c80 tx=0x7fe9dc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:38.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:37.996+0000 7fe9e97fa640 1 -- 172.21.15.12:0/4280483775 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fe9ec154cc0 con 0x7fe9ec0c12a0 2023-10-16T23:27:38.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.148+0000 7fe9f2faf640 1 -- 172.21.15.12:0/4280483775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe9ec154cc0 con 0x7fe9ec0c12a0 2023-10-16T23:27:38.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.152+0000 7fe9e97fa640 1 -- 172.21.15.12:0/4280483775 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe9ec154cc0 con 0x7fe9ec0c12a0 2023-10-16T23:27:38.154 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-16T23:27:38.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.152+0000 7fe9f2faf640 1 -- 172.21.15.12:0/4280483775 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe9d8065e90 msgr2=0x7fe9d8068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:38.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.152+0000 7fe9f2faf640 1 --2- 172.21.15.12:0/4280483775 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe9d8065e90 0x7fe9d8068350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009c80 tx=0x7fe9dc008040 comp rx=0 tx=0).stop 2023-10-16T23:27:38.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.152+0000 7fe9f2faf640 1 -- 172.21.15.12:0/4280483775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9ec0c12a0 msgr2=0x7fe9ec143fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:38.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.152+0000 7fe9f2faf640 1 --2- 172.21.15.12:0/4280483775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9ec0c12a0 0x7fe9ec143fa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe9e000b2c0 tx=0x7fe9e001b920 comp rx=0 tx=0).stop 2023-10-16T23:27:38.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.152+0000 7fe9f2faf640 1 -- 172.21.15.12:0/4280483775 shutdown_connections 2023-10-16T23:27:38.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.152+0000 7fe9f2faf640 1 --2- 172.21.15.12:0/4280483775 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe9d8065e90 0x7fe9d8068350 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.152+0000 7fe9f2faf640 1 --2- 172.21.15.12:0/4280483775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9ec1e8300 0x7fe9ec155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.152+0000 7fe9f2faf640 1 --2- 172.21.15.12:0/4280483775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9ec0c12a0 0x7fe9ec143fa0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.152+0000 7fe9f2faf640 1 --2- 172.21.15.12:0/4280483775 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9ec0b3bb0 0x7fe9ec14d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.152+0000 7fe9f2faf640 1 -- 172.21.15.12:0/4280483775 >> 172.21.15.12:0/4280483775 conn(0x7fe9ec06bb10 msgr2=0x7fe9ec1454f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:38.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.152+0000 7fe9f2faf640 1 -- 172.21.15.12:0/4280483775 shutdown_connections 2023-10-16T23:27:38.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.152+0000 7fe9f2faf640 1 -- 172.21.15.12:0/4280483775 wait complete. 2023-10-16T23:27:38.172 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-16T23:27:38.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.284+0000 7f287ba61640 1 Processor -- start 2023-10-16T23:27:38.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.284+0000 7f287ba61640 1 -- start start 2023-10-16T23:27:38.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f287ba61640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f287414eba0 0x7f287414ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:38.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f287ba61640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f287406e6d0 0x7f28740705d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:38.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f287ba61640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287406f130 con 0x7f2874152a60 2023-10-16T23:27:38.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f287ba61640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2874070da0 con 0x7f287406e6d0 2023-10-16T23:27:38.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f287ba61640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28740b86f0 con 0x7f287414eba0 2023-10-16T23:27:38.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f2879ffe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2874152a60 0x7f28740c1c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46550/0 (socket says 172.21.15.12:46550) 2023-10-16T23:27:38.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f2879ffe640 1 -- 172.21.15.12:0/3561491211 learned_addr learned my addr 172.21.15.12:0/3561491211 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f2878ffc640 1 --2- 172.21.15.12:0/3561491211 >> v2:172.21.15.31:3300/0 conn(0x7f287406e6d0 0x7f28740705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f28797fd640 1 --2- 172.21.15.12:0/3561491211 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f287414eba0 0x7f287414ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f286bfff640 1 -- 172.21.15.12:0/3561491211 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2720237735 0 0) 0x7f287406f130 con 0x7f2874152a60 2023-10-16T23:27:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f286bfff640 1 -- 172.21.15.12:0/3561491211 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2860003530 con 0x7f2874152a60 2023-10-16T23:27:38.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f286bfff640 1 -- 172.21.15.12:0/3561491211 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2852643072 0 0) 0x7f2860003530 con 0x7f2874152a60 2023-10-16T23:27:38.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f286bfff640 1 -- 172.21.15.12:0/3561491211 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f287414eba0 msgr2=0x7f287414ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:38.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f286bfff640 1 --2- 172.21.15.12:0/3561491211 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f287414eba0 0x7f287414ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f286bfff640 1 -- 172.21.15.12:0/3561491211 >> v2:172.21.15.31:3300/0 conn(0x7f287406e6d0 msgr2=0x7f28740705d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:38.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f286bfff640 1 --2- 172.21.15.12:0/3561491211 >> v2:172.21.15.31:3300/0 conn(0x7f287406e6d0 0x7f28740705d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f286bfff640 1 -- 172.21.15.12:0/3561491211 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28740c1020 con 0x7f2874152a60 2023-10-16T23:27:38.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f286bfff640 1 -- 172.21.15.12:0/3561491211 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7f286c001a00 con 0x7f2874152a60 2023-10-16T23:27:38.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f286bfff640 1 -- 172.21.15.12:0/3561491211 >> v1:172.21.15.12:6789/0 conn(0x7f2874152a60 legacy=0x7f28740c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:38.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f286bfff640 1 --2- 172.21.15.12:0/3561491211 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f287414eba0 0x7f28600039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:38.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f286bfff640 1 --2- 172.21.15.12:0/3561491211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2860003f30 0x7f28600047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:38.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f286bfff640 1 --2- 172.21.15.12:0/3561491211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2860004d10 0x7f2860005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:38.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f286bfff640 1 -- 172.21.15.12:0/3561491211 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28740b86f0 con 0x7f2860003f30 2023-10-16T23:27:38.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f286bfff640 1 -- 172.21.15.12:0/3561491211 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286000ba40 con 0x7f2860004d10 2023-10-16T23:27:38.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f286bfff640 1 -- 172.21.15.12:0/3561491211 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286000bc00 con 0x7f287414eba0 2023-10-16T23:27:38.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f2878ffc640 1 --2- 172.21.15.12:0/3561491211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2860003f30 0x7f28600047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:38.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f2879ffe640 1 --2- 172.21.15.12:0/3561491211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2860004d10 0x7f2860005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:38.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f2878ffc640 1 -- 172.21.15.12:0/3561491211 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f287414eba0 msgr2=0x7f28600039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:38.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f2878ffc640 1 --2- 172.21.15.12:0/3561491211 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f287414eba0 0x7f28600039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f2878ffc640 1 -- 172.21.15.12:0/3561491211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2860004d10 msgr2=0x7f2860005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:38.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f2878ffc640 1 --2- 172.21.15.12:0/3561491211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2860004d10 0x7f2860005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f2878ffc640 1 -- 172.21.15.12:0/3561491211 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2860003530 con 0x7f2860003f30 2023-10-16T23:27:38.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f2879ffe640 1 --2- 172.21.15.12:0/3561491211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2860004d10 0x7f2860005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.288+0000 7f2878ffc640 1 --2- 172.21.15.12:0/3561491211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2860003f30 0x7f28600047d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2864009ae0 tx=0x7f286401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc528132a825def server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f286bfff640 1 -- 172.21.15.12:0/3561491211 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28640a5570 con 0x7f2860003f30 2023-10-16T23:27:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f286bfff640 1 -- 172.21.15.12:0/3561491211 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28640a56d0 con 0x7f2860003f30 2023-10-16T23:27:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f286bfff640 1 -- 172.21.15.12:0/3561491211 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28640a5a80 con 0x7f2860003f30 2023-10-16T23:27:38.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f287ba61640 1 -- 172.21.15.12:0/3561491211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2860003f30 msgr2=0x7f28600047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:38.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f287ba61640 1 --2- 172.21.15.12:0/3561491211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2860003f30 0x7f28600047d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2864009ae0 tx=0x7f286401ca90 comp rx=0 tx=0).stop 2023-10-16T23:27:38.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f2879ffe640 1 -- 172.21.15.12:0/3561491211 reap_dead start 2023-10-16T23:27:38.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f287ba61640 1 -- 172.21.15.12:0/3561491211 shutdown_connections 2023-10-16T23:27:38.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f287ba61640 1 -- 172.21.15.12:0/3561491211 >> 172.21.15.12:0/3561491211 conn(0x7f287406b800 msgr2=0x7f287406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:38.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f287ba61640 1 -- 172.21.15.12:0/3561491211 shutdown_connections 2023-10-16T23:27:38.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f287ba61640 1 -- 172.21.15.12:0/3561491211 wait complete. 2023-10-16T23:27:38.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f287ba61640 1 Processor -- start 2023-10-16T23:27:38.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f287ba61640 1 -- start start 2023-10-16T23:27:38.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f287ba61640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2860003f30 0x7f2874156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:38.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f287ba61640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2874157b40 0x7f2874156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:38.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f287ba61640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2874157520 0x7f2874140ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:38.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f287ba61640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287414ac50 con 0x7f2874157520 2023-10-16T23:27:38.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f287ba61640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28740c37c0 con 0x7f2860003f30 2023-10-16T23:27:38.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f287ba61640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28740c2b40 con 0x7f2874157b40 2023-10-16T23:27:38.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f2879ffe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2874157520 0x7f2874140ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:38.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f2879ffe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2874157520 0x7f2874140ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40662/0 (socket says 172.21.15.12:40662) 2023-10-16T23:27:38.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f2879ffe640 1 -- 172.21.15.12:0/4112796701 learned_addr learned my addr 172.21.15.12:0/4112796701 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:38.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f2878ffc640 1 --2- 172.21.15.12:0/4112796701 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2874157b40 0x7f2874156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:38.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f28797fd640 1 --2- 172.21.15.12:0/4112796701 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2860003f30 0x7f2874156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:38.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f2879ffe640 1 -- 172.21.15.12:0/4112796701 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2874157b40 msgr2=0x7f2874156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:38.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f2879ffe640 1 --2- 172.21.15.12:0/4112796701 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2874157b40 0x7f2874156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f2879ffe640 1 -- 172.21.15.12:0/4112796701 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2860003f30 msgr2=0x7f2874156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:38.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f2879ffe640 1 --2- 172.21.15.12:0/4112796701 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2860003f30 0x7f2874156aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f2879ffe640 1 -- 172.21.15.12:0/4112796701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28740c2de0 con 0x7f2874157520 2023-10-16T23:27:38.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.292+0000 7f2878ffc640 1 --2- 172.21.15.12:0/4112796701 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2874157b40 0x7f2874156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:38.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.296+0000 7f2879ffe640 1 --2- 172.21.15.12:0/4112796701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2874157520 0x7f2874140ba0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f286c001470 tx=0x7f286c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:38.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.296+0000 7f2869ffb640 1 -- 172.21.15.12:0/4112796701 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c004d70 con 0x7f2874157520 2023-10-16T23:27:38.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.296+0000 7f2869ffb640 1 -- 172.21.15.12:0/4112796701 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c00bb20 con 0x7f2874157520 2023-10-16T23:27:38.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.296+0000 7f287ba61640 1 -- 172.21.15.12:0/4112796701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28740c34e0 con 0x7f2874157520 2023-10-16T23:27:38.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.296+0000 7f2869ffb640 1 -- 172.21.15.12:0/4112796701 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c00beb0 con 0x7f2874157520 2023-10-16T23:27:38.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.296+0000 7f287ba61640 1 -- 172.21.15.12:0/4112796701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28740bba70 con 0x7f2874157520 2023-10-16T23:27:38.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.296+0000 7f287ba61640 1 -- 172.21.15.12:0/4112796701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28740c2f70 con 0x7f2874157520 2023-10-16T23:27:38.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.296+0000 7f2869ffb640 1 -- 172.21.15.12:0/4112796701 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f286c007320 con 0x7f2874157520 2023-10-16T23:27:38.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.296+0000 7f2869ffb640 1 --2- 172.21.15.12:0/4112796701 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2858065e60 0x7f2858068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:38.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.296+0000 7f2869ffb640 1 -- 172.21.15.12:0/4112796701 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f286c083860 con 0x7f2874157520 2023-10-16T23:27:38.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.296+0000 7f28797fd640 1 --2- 172.21.15.12:0/4112796701 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2858065e60 0x7f2858068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:38.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.296+0000 7f28797fd640 1 --2- 172.21.15.12:0/4112796701 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2858065e60 0x7f2858068320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f28700047c0 tx=0x7f2870008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:38.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.300+0000 7f2869ffb640 1 -- 172.21.15.12:0/4112796701 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f286c051350 con 0x7f2874157520 2023-10-16T23:27:38.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.452+0000 7f287ba61640 1 -- 172.21.15.12:0/4112796701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f28740673a0 con 0x7f2874157520 2023-10-16T23:27:38.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.452+0000 7f2869ffb640 1 -- 172.21.15.12:0/4112796701 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f286c054970 con 0x7f2874157520 2023-10-16T23:27:38.456 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-10-16T23:27:38.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.452+0000 7f287ba61640 1 -- 172.21.15.12:0/4112796701 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2858065e60 msgr2=0x7f2858068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:38.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.452+0000 7f287ba61640 1 --2- 172.21.15.12:0/4112796701 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2858065e60 0x7f2858068320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f28700047c0 tx=0x7f2870008040 comp rx=0 tx=0).stop 2023-10-16T23:27:38.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.452+0000 7f287ba61640 1 -- 172.21.15.12:0/4112796701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2874157520 msgr2=0x7f2874140ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:38.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.452+0000 7f287ba61640 1 --2- 172.21.15.12:0/4112796701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2874157520 0x7f2874140ba0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f286c001470 tx=0x7f286c00b4a0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.456+0000 7f287ba61640 1 -- 172.21.15.12:0/4112796701 shutdown_connections 2023-10-16T23:27:38.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.456+0000 7f287ba61640 1 --2- 172.21.15.12:0/4112796701 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2858065e60 0x7f2858068320 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.456+0000 7f287ba61640 1 --2- 172.21.15.12:0/4112796701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2874157520 0x7f2874140ba0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.456+0000 7f287ba61640 1 --2- 172.21.15.12:0/4112796701 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2874157b40 0x7f2874156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.456+0000 7f287ba61640 1 --2- 172.21.15.12:0/4112796701 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2860003f30 0x7f2874156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.456+0000 7f287ba61640 1 -- 172.21.15.12:0/4112796701 >> 172.21.15.12:0/4112796701 conn(0x7f287406b800 msgr2=0x7f2874159330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:38.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.456+0000 7f287ba61640 1 -- 172.21.15.12:0/4112796701 shutdown_connections 2023-10-16T23:27:38.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.456+0000 7f287ba61640 1 -- 172.21.15.12:0/4112796701 wait complete. 2023-10-16T23:27:38.473 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-16T23:27:38.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.596+0000 7ff501f55640 1 Processor -- start 2023-10-16T23:27:38.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.596+0000 7ff501f55640 1 -- start start 2023-10-16T23:27:38.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.596+0000 7ff501f55640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff4fc150070 0x7ff4fc06c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:38.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.596+0000 7ff501f55640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff4fc0715f0 0x7ff4fc0beae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:38.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.596+0000 7ff501f55640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4fc06b400 0x7ff4fc152930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:38.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.596+0000 7ff501f55640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4fc0bf910 con 0x7ff4fc0715f0 2023-10-16T23:27:38.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.596+0000 7ff501f55640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4fc06cde0 con 0x7ff4fc150070 2023-10-16T23:27:38.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.596+0000 7ff501f55640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc0c03b0 con 0x7ff4fc06b400 2023-10-16T23:27:38.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.596+0000 7ff4f3fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff4fc0715f0 0x7ff4fc0beae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:38.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.596+0000 7ff4f3fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff4fc0715f0 0x7ff4fc0beae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40670/0 (socket says 172.21.15.12:40670) 2023-10-16T23:27:38.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.596+0000 7ff4f3fff640 1 -- 172.21.15.12:0/1223970182 learned_addr learned my addr 172.21.15.12:0/1223970182 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:38.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.596+0000 7ff4fb7fe640 1 --2- 172.21.15.12:0/1223970182 >> v2:172.21.15.31:3300/0 conn(0x7ff4fc150070 0x7ff4fc06c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:38.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.596+0000 7ff4f3fff640 1 -- 172.21.15.12:0/1223970182 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4fc06b400 msgr2=0x7ff4fc152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:38.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.596+0000 7ff4fbfff640 1 --2- 172.21.15.12:0/1223970182 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4fc06b400 0x7ff4fc152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:38.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.596+0000 7ff4f3fff640 1 --2- 172.21.15.12:0/1223970182 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4fc06b400 0x7ff4fc152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.596+0000 7ff4f3fff640 1 -- 172.21.15.12:0/1223970182 >> v2:172.21.15.31:3300/0 conn(0x7ff4fc150070 msgr2=0x7ff4fc06c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:38.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.596+0000 7ff4f3fff640 1 --2- 172.21.15.12:0/1223970182 >> v2:172.21.15.31:3300/0 conn(0x7ff4fc150070 0x7ff4fc06c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.596+0000 7ff4f3fff640 1 -- 172.21.15.12:0/1223970182 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4fc0bfb20 con 0x7ff4fc0715f0 2023-10-16T23:27:38.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.596+0000 7ff4fb7fe640 1 --2- 172.21.15.12:0/1223970182 >> v2:172.21.15.31:3300/0 conn(0x7ff4fc150070 0x7ff4fc06c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:38.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.596+0000 7ff4fbfff640 1 --2- 172.21.15.12:0/1223970182 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4fc06b400 0x7ff4fc152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:38.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff4f3fff640 1 --2- 172.21.15.12:0/1223970182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4fc0715f0 0x7ff4fc0beae0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0bf340 tx=0x7ff4e401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d682b31ce6c05 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:38.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff4faffd640 1 -- 172.21.15.12:0/1223970182 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e40ab600 con 0x7ff4fc0715f0 2023-10-16T23:27:38.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff4faffd640 1 -- 172.21.15.12:0/1223970182 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e40a7050 con 0x7ff4fc0715f0 2023-10-16T23:27:38.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff4faffd640 1 -- 172.21.15.12:0/1223970182 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e40ab980 con 0x7ff4fc0715f0 2023-10-16T23:27:38.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff501f55640 1 -- 172.21.15.12:0/1223970182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4fc0715f0 msgr2=0x7ff4fc0beae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:38.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff501f55640 1 --2- 172.21.15.12:0/1223970182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4fc0715f0 0x7ff4fc0beae0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0bf340 tx=0x7ff4e401c470 comp rx=0 tx=0).stop 2023-10-16T23:27:38.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff501f55640 1 -- 172.21.15.12:0/1223970182 shutdown_connections 2023-10-16T23:27:38.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff501f55640 1 --2- 172.21.15.12:0/1223970182 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4fc06b400 0x7ff4fc152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff501f55640 1 --2- 172.21.15.12:0/1223970182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4fc0715f0 0x7ff4fc0beae0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff501f55640 1 --2- 172.21.15.12:0/1223970182 >> v2:172.21.15.31:3300/0 conn(0x7ff4fc150070 0x7ff4fc06c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff501f55640 1 -- 172.21.15.12:0/1223970182 >> 172.21.15.12:0/1223970182 conn(0x7ff4fc0a3f20 msgr2=0x7ff4fc0c1880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff501f55640 1 -- 172.21.15.12:0/1223970182 shutdown_connections 2023-10-16T23:27:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff501f55640 1 -- 172.21.15.12:0/1223970182 wait complete. 2023-10-16T23:27:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff501f55640 1 Processor -- start 2023-10-16T23:27:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff501f55640 1 -- start start 2023-10-16T23:27:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff501f55640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4fc06b400 0x7ff4fc151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff501f55640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4fc150070 0x7ff4fc148240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff501f55640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4fc146e70 0x7ff4fc0a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff501f55640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc152a70 con 0x7ff4fc150070 2023-10-16T23:27:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff501f55640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc148780 con 0x7ff4fc146e70 2023-10-16T23:27:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff501f55640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc0a6120 con 0x7ff4fc06b400 2023-10-16T23:27:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff4f3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4fc150070 0x7ff4fc148240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff4f3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4fc150070 0x7ff4fc148240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40686/0 (socket says 172.21.15.12:40686) 2023-10-16T23:27:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff4f3fff640 1 -- 172.21.15.12:0/415734648 learned_addr learned my addr 172.21.15.12:0/415734648 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff4fb7fe640 1 --2- 172.21.15.12:0/415734648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4fc06b400 0x7ff4fc151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff4f3fff640 1 -- 172.21.15.12:0/415734648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4fc06b400 msgr2=0x7ff4fc151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:38.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff4f3fff640 1 --2- 172.21.15.12:0/415734648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4fc06b400 0x7ff4fc151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff4f3fff640 1 -- 172.21.15.12:0/415734648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4fc146e70 msgr2=0x7ff4fc0a4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:38.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff4f3fff640 1 --2- 172.21.15.12:0/415734648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4fc146e70 0x7ff4fc0a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff4f3fff640 1 -- 172.21.15.12:0/415734648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e40094d0 con 0x7ff4fc150070 2023-10-16T23:27:38.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff4f3fff640 1 --2- 172.21.15.12:0/415734648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4fc150070 0x7ff4fc148240 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4000c10 tx=0x7ff4e4019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:38.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff4f8ff9640 1 -- 172.21.15.12:0/415734648 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e40b6640 con 0x7ff4fc150070 2023-10-16T23:27:38.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff4f8ff9640 1 -- 172.21.15.12:0/415734648 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e40b67a0 con 0x7ff4fc150070 2023-10-16T23:27:38.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff501f55640 1 -- 172.21.15.12:0/415734648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4fc0a5df0 con 0x7ff4fc150070 2023-10-16T23:27:38.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.600+0000 7ff4f8ff9640 1 -- 172.21.15.12:0/415734648 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e40b6b50 con 0x7ff4fc150070 2023-10-16T23:27:38.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.604+0000 7ff501f55640 1 -- 172.21.15.12:0/415734648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4fc147590 con 0x7ff4fc150070 2023-10-16T23:27:38.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.604+0000 7ff501f55640 1 -- 172.21.15.12:0/415734648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4fc0a5f80 con 0x7ff4fc150070 2023-10-16T23:27:38.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.604+0000 7ff4f8ff9640 1 -- 172.21.15.12:0/415734648 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7ff4e40b2040 con 0x7ff4fc150070 2023-10-16T23:27:38.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.604+0000 7ff4f8ff9640 1 --2- 172.21.15.12:0/415734648 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7ff4dc065e60 0x7ff4dc068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:38.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.604+0000 7ff4f8ff9640 1 -- 172.21.15.12:0/415734648 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff4e411d1e0 con 0x7ff4fc150070 2023-10-16T23:27:38.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.604+0000 7ff4fb7fe640 1 --2- 172.21.15.12:0/415734648 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7ff4dc065e60 0x7ff4dc068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:38.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.604+0000 7ff4fb7fe640 1 --2- 172.21.15.12:0/415734648 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7ff4dc065e60 0x7ff4dc068320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec006fd0 tx=0x7ff4ec008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:38.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.608+0000 7ff4f8ff9640 1 -- 172.21.15.12:0/415734648 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7ff4fc0a5f80 con 0x7ff4fc150070 2023-10-16T23:27:38.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.764+0000 7ff501f55640 1 -- 172.21.15.12:0/415734648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff4fc0a5f80 con 0x7ff4fc150070 2023-10-16T23:27:38.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.764+0000 7ff4f8ff9640 1 -- 172.21.15.12:0/415734648 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7ff4fc0a5f80 con 0x7ff4fc150070 2023-10-16T23:27:38.770 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:38.770 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-10-16T23:27:38.770 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-16T23:27:38.770 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2023-10-16T23:27:38.770 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2023-10-16T23:27:38.771 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-16T23:27:38.771 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-16T23:27:38.771 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 2, 2023-10-16T23:27:38.771 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "rbd" 2023-10-16T23:27:38.771 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-16T23:27:38.772 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-10-16T23:27:38.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.768+0000 7ff501f55640 1 -- 172.21.15.12:0/415734648 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7ff4dc065e60 msgr2=0x7ff4dc068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:38.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.768+0000 7ff501f55640 1 --2- 172.21.15.12:0/415734648 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7ff4dc065e60 0x7ff4dc068320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec006fd0 tx=0x7ff4ec008040 comp rx=0 tx=0).stop 2023-10-16T23:27:38.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.768+0000 7ff501f55640 1 -- 172.21.15.12:0/415734648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4fc150070 msgr2=0x7ff4fc148240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:38.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.768+0000 7ff501f55640 1 --2- 172.21.15.12:0/415734648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4fc150070 0x7ff4fc148240 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4000c10 tx=0x7ff4e4019210 comp rx=0 tx=0).stop 2023-10-16T23:27:38.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.768+0000 7ff501f55640 1 -- 172.21.15.12:0/415734648 shutdown_connections 2023-10-16T23:27:38.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.768+0000 7ff501f55640 1 --2- 172.21.15.12:0/415734648 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7ff4dc065e60 0x7ff4dc068320 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.768+0000 7ff501f55640 1 --2- 172.21.15.12:0/415734648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4fc146e70 0x7ff4fc0a4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.768+0000 7ff501f55640 1 --2- 172.21.15.12:0/415734648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4fc150070 0x7ff4fc148240 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.768+0000 7ff501f55640 1 --2- 172.21.15.12:0/415734648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff4fc06b400 0x7ff4fc151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.768+0000 7ff501f55640 1 -- 172.21.15.12:0/415734648 >> 172.21.15.12:0/415734648 conn(0x7ff4fc0a3f20 msgr2=0x7ff4fc071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:38.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.768+0000 7ff501f55640 1 -- 172.21.15.12:0/415734648 shutdown_connections 2023-10-16T23:27:38.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.768+0000 7ff501f55640 1 -- 172.21.15.12:0/415734648 wait complete. 2023-10-16T23:27:38.788 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-16T23:27:38.789 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-16T23:27:38.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.916+0000 7ff8d9093640 1 Processor -- start 2023-10-16T23:27:38.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.916+0000 7ff8d9093640 1 -- start start 2023-10-16T23:27:38.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.916+0000 7ff8d9093640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8d414d1f0 0x7ff8d40b7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:38.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.916+0000 7ff8d9093640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d40b5ee0 con 0x7ff8d414e170 2023-10-16T23:27:38.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.916+0000 7ff8d9093640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d40b6130 con 0x7ff8d40bf210 2023-10-16T23:27:38.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.916+0000 7ff8d9093640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d40b6410 con 0x7ff8d414d1f0 2023-10-16T23:27:38.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.916+0000 7ff8d359e640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff8d414e170 0x7ff8d40b6930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46562/0 (socket says 172.21.15.12:46562) 2023-10-16T23:27:38.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.916+0000 7ff8d359e640 1 -- 172.21.15.12:0/3739258601 learned_addr learned my addr 172.21.15.12:0/3739258601 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:38.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.920+0000 7ff8d259c640 1 --2- 172.21.15.12:0/3739258601 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8d414d1f0 0x7ff8d40b7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:38.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.920+0000 7ff8d1d9b640 1 -- 172.21.15.12:0/3739258601 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 924680928 0 0) 0x7ff8d40b5ee0 con 0x7ff8d414e170 2023-10-16T23:27:38.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.920+0000 7ff8d1d9b640 1 -- 172.21.15.12:0/3739258601 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8bc003530 con 0x7ff8d414e170 2023-10-16T23:27:38.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.920+0000 7ff8d1d9b640 1 -- 172.21.15.12:0/3739258601 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506607372 0 0) 0x7ff8d40b6130 con 0x7ff8d40bf210 2023-10-16T23:27:38.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.920+0000 7ff8d259c640 1 -- 172.21.15.12:0/3739258601 >> v1:172.21.15.31:6789/0 conn(0x7ff8d40bf210 legacy=0x7ff8d40bf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:38.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.920+0000 7ff8d259c640 1 -- 172.21.15.12:0/3739258601 >> v1:172.21.15.12:6789/0 conn(0x7ff8d414e170 legacy=0x7ff8d40b6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:38.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.920+0000 7ff8d259c640 1 -- 172.21.15.12:0/3739258601 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d40b7040 con 0x7ff8d414d1f0 2023-10-16T23:27:38.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.920+0000 7ff8d259c640 1 --2- 172.21.15.12:0/3739258601 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8d414d1f0 0x7ff8d40b7770 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff8c80097f0 tx=0x7ff8c801c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5ad6a76219ddf3e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:38.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.920+0000 7ff8d1d9b640 1 -- 172.21.15.12:0/3739258601 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c80a8050 con 0x7ff8d414d1f0 2023-10-16T23:27:38.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.920+0000 7ff8d1d9b640 1 -- 172.21.15.12:0/3739258601 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c80ac5f0 con 0x7ff8d414d1f0 2023-10-16T23:27:38.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.920+0000 7ff8d1d9b640 1 -- 172.21.15.12:0/3739258601 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c80ac980 con 0x7ff8d414d1f0 2023-10-16T23:27:38.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.920+0000 7ff8d9093640 1 -- 172.21.15.12:0/3739258601 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8d414d1f0 msgr2=0x7ff8d40b7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:38.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.920+0000 7ff8d9093640 1 --2- 172.21.15.12:0/3739258601 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8d414d1f0 0x7ff8d40b7770 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff8c80097f0 tx=0x7ff8c801c370 comp rx=0 tx=0).stop 2023-10-16T23:27:38.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.920+0000 7ff8d9093640 1 -- 172.21.15.12:0/3739258601 shutdown_connections 2023-10-16T23:27:38.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.920+0000 7ff8d9093640 1 --2- 172.21.15.12:0/3739258601 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8d414d1f0 0x7ff8d40b7770 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.920+0000 7ff8d9093640 1 -- 172.21.15.12:0/3739258601 >> 172.21.15.12:0/3739258601 conn(0x7ff8d40c2960 msgr2=0x7ff8d40c2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:38.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8d9093640 1 -- 172.21.15.12:0/3739258601 shutdown_connections 2023-10-16T23:27:38.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8d9093640 1 -- 172.21.15.12:0/3739258601 wait complete. 2023-10-16T23:27:38.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8d9093640 1 Processor -- start 2023-10-16T23:27:38.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8d9093640 1 -- start start 2023-10-16T23:27:38.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8d9093640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8d40bf210 0x7ff8d41e80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:38.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8d9093640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8d414d1f0 0x7ff8d4130410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:38.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8d9093640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8d414e170 0x7ff8d4128e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:38.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8d9093640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d4131110 con 0x7ff8d414e170 2023-10-16T23:27:38.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8d9093640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d41e8950 con 0x7ff8d40bf210 2023-10-16T23:27:38.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8d9093640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d41e8c10 con 0x7ff8d414d1f0 2023-10-16T23:27:38.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8d359e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8d414e170 0x7ff8d4128e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:38.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8d359e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8d414e170 0x7ff8d4128e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40702/0 (socket says 172.21.15.12:40702) 2023-10-16T23:27:38.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8d359e640 1 -- 172.21.15.12:0/3580919648 learned_addr learned my addr 172.21.15.12:0/3580919648 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:38.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8d259c640 1 --2- 172.21.15.12:0/3580919648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8d414d1f0 0x7ff8d4130410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:38.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8d2d9d640 1 --2- 172.21.15.12:0/3580919648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8d40bf210 0x7ff8d41e80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:38.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8d359e640 1 -- 172.21.15.12:0/3580919648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8d414d1f0 msgr2=0x7ff8d4130410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:38.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8d359e640 1 --2- 172.21.15.12:0/3580919648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8d414d1f0 0x7ff8d4130410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8d359e640 1 -- 172.21.15.12:0/3580919648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8d40bf210 msgr2=0x7ff8d41e80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:38.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8d359e640 1 --2- 172.21.15.12:0/3580919648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8d40bf210 0x7ff8d41e80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:38.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8d359e640 1 -- 172.21.15.12:0/3580919648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c8009420 con 0x7ff8d414e170 2023-10-16T23:27:38.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8d259c640 1 --2- 172.21.15.12:0/3580919648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8d414d1f0 0x7ff8d4130410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:27:38.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8d359e640 1 --2- 172.21.15.12:0/3580919648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8d414e170 0x7ff8d4128e40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00ca20 tx=0x7ff8cc00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:38.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8bb7fe640 1 -- 172.21.15.12:0/3580919648 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc00abd0 con 0x7ff8d414e170 2023-10-16T23:27:38.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8bb7fe640 1 -- 172.21.15.12:0/3580919648 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8cc00ad30 con 0x7ff8d414e170 2023-10-16T23:27:38.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8d9093640 1 -- 172.21.15.12:0/3580919648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d40bec10 con 0x7ff8d414e170 2023-10-16T23:27:38.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8bb7fe640 1 -- 172.21.15.12:0/3580919648 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc012620 con 0x7ff8d414e170 2023-10-16T23:27:38.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.924+0000 7ff8d9093640 1 -- 172.21.15.12:0/3580919648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d4130950 con 0x7ff8d414e170 2023-10-16T23:27:38.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.928+0000 7ff8d9093640 1 -- 172.21.15.12:0/3580919648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d41e87c0 con 0x7ff8d414e170 2023-10-16T23:27:38.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.928+0000 7ff8bb7fe640 1 -- 172.21.15.12:0/3580919648 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7ff8cc007070 con 0x7ff8d414e170 2023-10-16T23:27:38.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.928+0000 7ff8bb7fe640 1 --2- 172.21.15.12:0/3580919648 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7ff8c0065e60 0x7ff8c0068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:38.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.928+0000 7ff8bb7fe640 1 -- 172.21.15.12:0/3580919648 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff8cc0833c0 con 0x7ff8d414e170 2023-10-16T23:27:38.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.928+0000 7ff8d2d9d640 1 --2- 172.21.15.12:0/3580919648 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7ff8c0065e60 0x7ff8c0068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:38.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.928+0000 7ff8d2d9d640 1 --2- 172.21.15.12:0/3580919648 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7ff8c0065e60 0x7ff8c0068320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4000f70 tx=0x7ff8c4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:38.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:38.932+0000 7ff8bb7fe640 1 -- 172.21.15.12:0/3580919648 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7ff8cc050d60 con 0x7ff8d414e170 2023-10-16T23:27:39.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.088+0000 7ff8d9093640 1 -- 172.21.15.12:0/3580919648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff8d40673a0 con 0x7ff8d414e170 2023-10-16T23:27:39.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.288+0000 7ff8bb7fe640 1 -- 172.21.15.12:0/3580919648 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff8cc0170b0 con 0x7ff8d414e170 2023-10-16T23:27:39.294 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2023-10-16T23:27:39.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.296+0000 7ff8d9093640 1 -- 172.21.15.12:0/3580919648 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7ff8c0065e60 msgr2=0x7ff8c0068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:39.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.296+0000 7ff8d9093640 1 --2- 172.21.15.12:0/3580919648 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7ff8c0065e60 0x7ff8c0068320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4000f70 tx=0x7ff8c4009040 comp rx=0 tx=0).stop 2023-10-16T23:27:39.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.296+0000 7ff8d9093640 1 -- 172.21.15.12:0/3580919648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8d414e170 msgr2=0x7ff8d4128e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:39.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.296+0000 7ff8d9093640 1 --2- 172.21.15.12:0/3580919648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8d414e170 0x7ff8d4128e40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00ca20 tx=0x7ff8cc00cee0 comp rx=0 tx=0).stop 2023-10-16T23:27:39.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.296+0000 7ff8d9093640 1 -- 172.21.15.12:0/3580919648 shutdown_connections 2023-10-16T23:27:39.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.296+0000 7ff8d9093640 1 --2- 172.21.15.12:0/3580919648 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7ff8c0065e60 0x7ff8c0068320 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:39.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.296+0000 7ff8d9093640 1 --2- 172.21.15.12:0/3580919648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8d414e170 0x7ff8d4128e40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:39.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.296+0000 7ff8d9093640 1 --2- 172.21.15.12:0/3580919648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8d414d1f0 0x7ff8d4130410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:39.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.296+0000 7ff8d9093640 1 --2- 172.21.15.12:0/3580919648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8d40bf210 0x7ff8d41e80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:39.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.296+0000 7ff8d9093640 1 -- 172.21.15.12:0/3580919648 >> 172.21.15.12:0/3580919648 conn(0x7ff8d40c2960 msgr2=0x7ff8d40c0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:39.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.300+0000 7ff8d9093640 1 -- 172.21.15.12:0/3580919648 shutdown_connections 2023-10-16T23:27:39.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.300+0000 7ff8d9093640 1 -- 172.21.15.12:0/3580919648 wait complete. 2023-10-16T23:27:39.322 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-16T23:27:39.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.456+0000 7fe661be1640 1 Processor -- start 2023-10-16T23:27:39.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.456+0000 7fe661be1640 1 -- start start 2023-10-16T23:27:39.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.456+0000 7fe661be1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe65c0b8350 0x7fe65c071150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:39.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.456+0000 7fe661be1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe65c0bd230 0x7fe65c146a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:39.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.456+0000 7fe661be1640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65c0b8f00 con 0x7fe65c072ec0 2023-10-16T23:27:39.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.456+0000 7fe661be1640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe65c0ba3e0 con 0x7fe65c0bd230 2023-10-16T23:27:39.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.456+0000 7fe661be1640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe65c14db60 con 0x7fe65c0b8350 2023-10-16T23:27:39.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.456+0000 7fe65affd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe65c072ec0 0x7fe65c0b8730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46566/0 (socket says 172.21.15.12:46566) 2023-10-16T23:27:39.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.456+0000 7fe65affd640 1 -- 172.21.15.12:0/479722953 learned_addr learned my addr 172.21.15.12:0/479722953 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:39.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.456+0000 7fe65bfff640 1 --2- 172.21.15.12:0/479722953 >> v2:172.21.15.12:3300/0 conn(0x7fe65c0bd230 0x7fe65c146a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:39.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.456+0000 7fe65b7fe640 1 --2- 172.21.15.12:0/479722953 >> v2:172.21.15.31:3300/0 conn(0x7fe65c0b8350 0x7fe65c071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:39.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.456+0000 7fe65a7fc640 1 -- 172.21.15.12:0/479722953 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055317785 0 0) 0x7fe65c0b8f00 con 0x7fe65c072ec0 2023-10-16T23:27:39.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.456+0000 7fe65a7fc640 1 -- 172.21.15.12:0/479722953 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe648003530 con 0x7fe65c072ec0 2023-10-16T23:27:39.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.456+0000 7fe65bfff640 1 -- 172.21.15.12:0/479722953 >> v2:172.21.15.31:3300/0 conn(0x7fe65c0b8350 msgr2=0x7fe65c071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:39.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.456+0000 7fe65bfff640 1 --2- 172.21.15.12:0/479722953 >> v2:172.21.15.31:3300/0 conn(0x7fe65c0b8350 0x7fe65c071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:39.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.456+0000 7fe65bfff640 1 -- 172.21.15.12:0/479722953 >> v1:172.21.15.12:6789/0 conn(0x7fe65c072ec0 legacy=0x7fe65c0b8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:39.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.456+0000 7fe65bfff640 1 -- 172.21.15.12:0/479722953 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c14de40 con 0x7fe65c0bd230 2023-10-16T23:27:39.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe65bfff640 1 --2- 172.21.15.12:0/479722953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe65c0bd230 0x7fe65c146a70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe65c068620 tx=0x7fe64401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c841dbf8169cdb97 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:39.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe65a7fc640 1 -- 172.21.15.12:0/479722953 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6440ab680 con 0x7fe65c0bd230 2023-10-16T23:27:39.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe65a7fc640 1 -- 172.21.15.12:0/479722953 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6440ab7e0 con 0x7fe65c0bd230 2023-10-16T23:27:39.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe65a7fc640 1 -- 172.21.15.12:0/479722953 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6440abb70 con 0x7fe65c0bd230 2023-10-16T23:27:39.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe661be1640 1 -- 172.21.15.12:0/479722953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe65c0bd230 msgr2=0x7fe65c146a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:39.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe661be1640 1 --2- 172.21.15.12:0/479722953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe65c0bd230 0x7fe65c146a70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe65c068620 tx=0x7fe64401c460 comp rx=0 tx=0).stop 2023-10-16T23:27:39.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe661be1640 1 -- 172.21.15.12:0/479722953 shutdown_connections 2023-10-16T23:27:39.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe661be1640 1 --2- 172.21.15.12:0/479722953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe65c0bd230 0x7fe65c146a70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:39.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe661be1640 1 --2- 172.21.15.12:0/479722953 >> v2:172.21.15.31:3300/0 conn(0x7fe65c0b8350 0x7fe65c071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:39.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe661be1640 1 -- 172.21.15.12:0/479722953 >> 172.21.15.12:0/479722953 conn(0x7fe65c0bdb40 msgr2=0x7fe65c0bdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:39.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe661be1640 1 -- 172.21.15.12:0/479722953 shutdown_connections 2023-10-16T23:27:39.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe661be1640 1 -- 172.21.15.12:0/479722953 wait complete. 2023-10-16T23:27:39.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe661be1640 1 Processor -- start 2023-10-16T23:27:39.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe661be1640 1 -- start start 2023-10-16T23:27:39.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe661be1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe65c072ec0 0x7fe65c14bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:39.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe661be1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe65c0b8350 0x7fe65c13a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:39.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe661be1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe65c0bd230 0x7fe65c13aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:39.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe661be1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c14c220 con 0x7fe65c0b8350 2023-10-16T23:27:39.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe661be1640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c1eb460 con 0x7fe65c0bd230 2023-10-16T23:27:39.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe661be1640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c13be40 con 0x7fe65c072ec0 2023-10-16T23:27:39.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe65affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe65c0b8350 0x7fe65c13a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:39.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe65affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe65c0b8350 0x7fe65c13a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40710/0 (socket says 172.21.15.12:40710) 2023-10-16T23:27:39.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe65affd640 1 -- 172.21.15.12:0/1565905800 learned_addr learned my addr 172.21.15.12:0/1565905800 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:39.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe65bfff640 1 --2- 172.21.15.12:0/1565905800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe65c0bd230 0x7fe65c13aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:39.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe65affd640 1 -- 172.21.15.12:0/1565905800 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe65c072ec0 msgr2=0x7fe65c14bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:39.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe65affd640 1 --2- 172.21.15.12:0/1565905800 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe65c072ec0 0x7fe65c14bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:39.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe65affd640 1 -- 172.21.15.12:0/1565905800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe65c0bd230 msgr2=0x7fe65c13aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:39.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe65affd640 1 --2- 172.21.15.12:0/1565905800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe65c0bd230 0x7fe65c13aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:39.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.460+0000 7fe65affd640 1 -- 172.21.15.12:0/1565905800 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe644009420 con 0x7fe65c0b8350 2023-10-16T23:27:39.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.464+0000 7fe65affd640 1 --2- 172.21.15.12:0/1565905800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe65c0b8350 0x7fe65c13a760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00cb40 tx=0x7fe64c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:39.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.464+0000 7fe653fff640 1 -- 172.21.15.12:0/1565905800 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c00aca0 con 0x7fe65c0b8350 2023-10-16T23:27:39.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.464+0000 7fe653fff640 1 -- 172.21.15.12:0/1565905800 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64c00ae00 con 0x7fe65c0b8350 2023-10-16T23:27:39.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.464+0000 7fe661be1640 1 -- 172.21.15.12:0/1565905800 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe65c1eb700 con 0x7fe65c0b8350 2023-10-16T23:27:39.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.464+0000 7fe653fff640 1 -- 172.21.15.12:0/1565905800 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c012620 con 0x7fe65c0b8350 2023-10-16T23:27:39.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.464+0000 7fe661be1640 1 -- 172.21.15.12:0/1565905800 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe65c13c320 con 0x7fe65c0b8350 2023-10-16T23:27:39.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.464+0000 7fe661be1640 1 -- 172.21.15.12:0/1565905800 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe65c0673a0 con 0x7fe65c0b8350 2023-10-16T23:27:39.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.464+0000 7fe653fff640 1 -- 172.21.15.12:0/1565905800 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fe64c007070 con 0x7fe65c0b8350 2023-10-16T23:27:39.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.464+0000 7fe653fff640 1 --2- 172.21.15.12:0/1565905800 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe63c065e60 0x7fe63c068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:39.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.464+0000 7fe653fff640 1 -- 172.21.15.12:0/1565905800 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fe64c083690 con 0x7fe65c0b8350 2023-10-16T23:27:39.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.464+0000 7fe65b7fe640 1 --2- 172.21.15.12:0/1565905800 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe63c065e60 0x7fe63c068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:39.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.464+0000 7fe65b7fe640 1 --2- 172.21.15.12:0/1565905800 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe63c065e60 0x7fe63c068320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe654006aa0 tx=0x7fe654006a30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:39.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.468+0000 7fe653fff640 1 -- 172.21.15.12:0/1565905800 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fe64c050ec0 con 0x7fe65c0b8350 2023-10-16T23:27:39.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:39.632+0000 7fe661be1640 1 -- 172.21.15.12:0/1565905800 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe65c0b9b40 con 0x7fe65c0b8350 2023-10-16T23:27:40.034 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:27:40.037 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:27:40.040 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:27:40.042 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:27:40.045 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:27:40.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.296+0000 7fe653fff640 1 -- 172.21.15.12:0/1565905800 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v22) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe64c001c10 con 0x7fe65c0b8350 2023-10-16T23:27:40.302 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2023-10-16T23:27:40.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.316+0000 7fe661be1640 1 -- 172.21.15.12:0/1565905800 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe63c065e60 msgr2=0x7fe63c068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:40.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.316+0000 7fe661be1640 1 --2- 172.21.15.12:0/1565905800 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe63c065e60 0x7fe63c068320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe654006aa0 tx=0x7fe654006a30 comp rx=0 tx=0).stop 2023-10-16T23:27:40.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.316+0000 7fe661be1640 1 -- 172.21.15.12:0/1565905800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe65c0b8350 msgr2=0x7fe65c13a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:40.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.316+0000 7fe661be1640 1 --2- 172.21.15.12:0/1565905800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe65c0b8350 0x7fe65c13a760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00cb40 tx=0x7fe64c00a060 comp rx=0 tx=0).stop 2023-10-16T23:27:40.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.320+0000 7fe661be1640 1 -- 172.21.15.12:0/1565905800 shutdown_connections 2023-10-16T23:27:40.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.320+0000 7fe661be1640 1 --2- 172.21.15.12:0/1565905800 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe63c065e60 0x7fe63c068320 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:40.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.320+0000 7fe661be1640 1 --2- 172.21.15.12:0/1565905800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe65c0bd230 0x7fe65c13aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:40.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.320+0000 7fe661be1640 1 --2- 172.21.15.12:0/1565905800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe65c0b8350 0x7fe65c13a760 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:40.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.320+0000 7fe661be1640 1 --2- 172.21.15.12:0/1565905800 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe65c072ec0 0x7fe65c14bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:40.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.320+0000 7fe661be1640 1 -- 172.21.15.12:0/1565905800 >> 172.21.15.12:0/1565905800 conn(0x7fe65c0bdb40 msgr2=0x7fe65c06f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:40.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.320+0000 7fe661be1640 1 -- 172.21.15.12:0/1565905800 shutdown_connections 2023-10-16T23:27:40.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.320+0000 7fe661be1640 1 -- 172.21.15.12:0/1565905800 wait complete. 2023-10-16T23:27:40.352 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-16T23:27:40.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb6269f4640 1 Processor -- start 2023-10-16T23:27:40.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb6269f4640 1 -- start start 2023-10-16T23:27:40.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb6269f4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb6200a6e70 0x7fb6200bffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:40.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb6269f4640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6200bfcd0 con 0x7fb62006c920 2023-10-16T23:27:40.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb6269f4640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6200c13c0 con 0x7fb62014dc10 2023-10-16T23:27:40.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb6269f4640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6200bf9f0 con 0x7fb6200a6e70 2023-10-16T23:27:40.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb61f7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb62006c920 0x7fb62006fbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46574/0 (socket says 172.21.15.12:46574) 2023-10-16T23:27:40.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb61f7fe640 1 -- 172.21.15.12:0/372654738 learned_addr learned my addr 172.21.15.12:0/372654738 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:40.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb61ffff640 1 --2- 172.21.15.12:0/372654738 >> v2:172.21.15.31:3300/0 conn(0x7fb6200a6e70 0x7fb6200bffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:40.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb61effd640 1 -- 172.21.15.12:0/372654738 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010858604 0 0) 0x7fb6200bfcd0 con 0x7fb62006c920 2023-10-16T23:27:40.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb61effd640 1 -- 172.21.15.12:0/372654738 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb60c003530 con 0x7fb62006c920 2023-10-16T23:27:40.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb61effd640 1 -- 172.21.15.12:0/372654738 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 832466491 0 0) 0x7fb60c003530 con 0x7fb62006c920 2023-10-16T23:27:40.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb61effd640 1 -- 172.21.15.12:0/372654738 >> v2:172.21.15.31:3300/0 conn(0x7fb6200a6e70 msgr2=0x7fb6200bffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:40.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb61effd640 1 --2- 172.21.15.12:0/372654738 >> v2:172.21.15.31:3300/0 conn(0x7fb6200a6e70 0x7fb6200bffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:40.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb61effd640 1 -- 172.21.15.12:0/372654738 >> v1:172.21.15.31:6789/0 conn(0x7fb62014dc10 legacy=0x7fb620157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:40.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb61effd640 1 -- 172.21.15.12:0/372654738 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6200bdeb0 con 0x7fb62006c920 2023-10-16T23:27:40.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb61effd640 1 -- 172.21.15.12:0/372654738 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7fb608001680 con 0x7fb62006c920 2023-10-16T23:27:40.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb61effd640 1 -- 172.21.15.12:0/372654738 >> v1:172.21.15.12:6789/0 conn(0x7fb62006c920 legacy=0x7fb62006fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:40.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb61effd640 1 --2- 172.21.15.12:0/372654738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb60c003980 0x7fb60c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:40.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb61effd640 1 --2- 172.21.15.12:0/372654738 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb60c0047d0 0x7fb60c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:40.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb61effd640 1 --2- 172.21.15.12:0/372654738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb60c005190 0x7fb60c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:40.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb61effd640 1 -- 172.21.15.12:0/372654738 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6200bf9f0 con 0x7fb60c005190 2023-10-16T23:27:40.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb61effd640 1 -- 172.21.15.12:0/372654738 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c00c030 con 0x7fb60c003980 2023-10-16T23:27:40.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb61effd640 1 -- 172.21.15.12:0/372654738 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c00c1f0 con 0x7fb60c0047d0 2023-10-16T23:27:40.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb624f91640 1 --2- 172.21.15.12:0/372654738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb60c005190 0x7fb60c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:40.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb61ffff640 1 --2- 172.21.15.12:0/372654738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb60c003980 0x7fb60c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:40.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb61f7fe640 1 --2- 172.21.15.12:0/372654738 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb60c0047d0 0x7fb60c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:40.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb624f91640 1 -- 172.21.15.12:0/372654738 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb60c0047d0 msgr2=0x7fb60c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:40.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb624f91640 1 --2- 172.21.15.12:0/372654738 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb60c0047d0 0x7fb60c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:40.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb624f91640 1 -- 172.21.15.12:0/372654738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb60c003980 msgr2=0x7fb60c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:40.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb624f91640 1 --2- 172.21.15.12:0/372654738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb60c003980 0x7fb60c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:40.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.476+0000 7fb624f91640 1 -- 172.21.15.12:0/372654738 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60c003530 con 0x7fb60c005190 2023-10-16T23:27:40.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.480+0000 7fb624f91640 1 -- 172.21.15.12:0/372654738 reap_dead start 2023-10-16T23:27:40.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.480+0000 7fb624f91640 1 --2- 172.21.15.12:0/372654738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb60c005190 0x7fb60c00b990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb618001e70 tx=0x7fb61801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6017eacd04127112 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:40.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.480+0000 7fb61effd640 1 -- 172.21.15.12:0/372654738 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb618003b80 con 0x7fb60c005190 2023-10-16T23:27:40.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.480+0000 7fb61effd640 1 -- 172.21.15.12:0/372654738 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb618003d00 con 0x7fb60c005190 2023-10-16T23:27:40.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.480+0000 7fb61effd640 1 -- 172.21.15.12:0/372654738 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb618005260 con 0x7fb60c005190 2023-10-16T23:27:40.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.480+0000 7fb6269f4640 1 -- 172.21.15.12:0/372654738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb60c005190 msgr2=0x7fb60c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:40.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.480+0000 7fb6269f4640 1 --2- 172.21.15.12:0/372654738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb60c005190 0x7fb60c00b990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb618001e70 tx=0x7fb61801c760 comp rx=0 tx=0).stop 2023-10-16T23:27:40.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.480+0000 7fb6269f4640 1 -- 172.21.15.12:0/372654738 shutdown_connections 2023-10-16T23:27:40.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.480+0000 7fb6269f4640 1 --2- 172.21.15.12:0/372654738 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb60c005190 0x7fb60c00b990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:40.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.480+0000 7fb6269f4640 1 -- 172.21.15.12:0/372654738 >> 172.21.15.12:0/372654738 conn(0x7fb6200c18f0 msgr2=0x7fb6200c1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:40.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.480+0000 7fb6269f4640 1 -- 172.21.15.12:0/372654738 shutdown_connections 2023-10-16T23:27:40.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.480+0000 7fb6269f4640 1 -- 172.21.15.12:0/372654738 wait complete. 2023-10-16T23:27:40.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.480+0000 7fb6269f4640 1 Processor -- start 2023-10-16T23:27:40.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.480+0000 7fb6269f4640 1 -- start start 2023-10-16T23:27:40.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.480+0000 7fb6269f4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb60c005190 0x7fb620144ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:40.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.484+0000 7fb6269f4640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb62014e4a0 0x7fb62014e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:40.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.484+0000 7fb6269f4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb620145770 0x7fb620145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:40.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.484+0000 7fb6269f4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb620146130 con 0x7fb620145770 2023-10-16T23:27:40.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.484+0000 7fb6269f4640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb620147b50 con 0x7fb60c005190 2023-10-16T23:27:40.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.484+0000 7fb6269f4640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6201e2860 con 0x7fb62014e4a0 2023-10-16T23:27:40.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.484+0000 7fb624f91640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb620145770 0x7fb620145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:40.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.484+0000 7fb624f91640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb620145770 0x7fb620145bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40728/0 (socket says 172.21.15.12:40728) 2023-10-16T23:27:40.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.484+0000 7fb624f91640 1 -- 172.21.15.12:0/3427317518 learned_addr learned my addr 172.21.15.12:0/3427317518 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:40.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.484+0000 7fb61ffff640 1 --2- 172.21.15.12:0/3427317518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb60c005190 0x7fb620144ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:40.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.484+0000 7fb61f7fe640 1 --2- 172.21.15.12:0/3427317518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb62014e4a0 0x7fb62014e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:40.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.484+0000 7fb624f91640 1 -- 172.21.15.12:0/3427317518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb62014e4a0 msgr2=0x7fb62014e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:40.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.484+0000 7fb624f91640 1 --2- 172.21.15.12:0/3427317518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb62014e4a0 0x7fb62014e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:40.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.484+0000 7fb624f91640 1 -- 172.21.15.12:0/3427317518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb60c005190 msgr2=0x7fb620144ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:40.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.484+0000 7fb624f91640 1 --2- 172.21.15.12:0/3427317518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb60c005190 0x7fb620144ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:40.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.484+0000 7fb624f91640 1 -- 172.21.15.12:0/3427317518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6201e2b00 con 0x7fb620145770 2023-10-16T23:27:40.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.484+0000 7fb624f91640 1 --2- 172.21.15.12:0/3427317518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb620145770 0x7fb620145bf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb61801d000 tx=0x7fb60c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:40.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.484+0000 7fb61cff9640 1 -- 172.21.15.12:0/3427317518 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6180ac070 con 0x7fb620145770 2023-10-16T23:27:40.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.484+0000 7fb61cff9640 1 -- 172.21.15.12:0/3427317518 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb618003b90 con 0x7fb620145770 2023-10-16T23:27:40.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.484+0000 7fb6269f4640 1 -- 172.21.15.12:0/3427317518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6201e2de0 con 0x7fb620145770 2023-10-16T23:27:40.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.484+0000 7fb61cff9640 1 -- 172.21.15.12:0/3427317518 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb618006d80 con 0x7fb620145770 2023-10-16T23:27:40.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.484+0000 7fb6269f4640 1 -- 172.21.15.12:0/3427317518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb620150460 con 0x7fb620145770 2023-10-16T23:27:40.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.484+0000 7fb6269f4640 1 -- 172.21.15.12:0/3427317518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6200673a0 con 0x7fb620145770 2023-10-16T23:27:40.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.484+0000 7fb61cff9640 1 -- 172.21.15.12:0/3427317518 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fb618007030 con 0x7fb620145770 2023-10-16T23:27:40.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.484+0000 7fb61cff9640 1 --2- 172.21.15.12:0/3427317518 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb600065e60 0x7fb600068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:40.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.484+0000 7fb61cff9640 1 -- 172.21.15.12:0/3427317518 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fb61811c830 con 0x7fb620145770 2023-10-16T23:27:40.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.484+0000 7fb61ffff640 1 --2- 172.21.15.12:0/3427317518 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb600065e60 0x7fb600068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:40.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.488+0000 7fb61ffff640 1 --2- 172.21.15.12:0/3427317518 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb600065e60 0x7fb600068320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb6100099b0 tx=0x7fb610008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:40.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.488+0000 7fb61cff9640 1 -- 172.21.15.12:0/3427317518 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fb6180ea020 con 0x7fb620145770 2023-10-16T23:27:40.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.680+0000 7fb6269f4640 1 -- 172.21.15.12:0/3427317518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb6200a1250 con 0x7fb620145770 2023-10-16T23:27:40.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.692+0000 7fb61cff9640 1 -- 172.21.15.12:0/3427317518 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb618007dc0 con 0x7fb620145770 2023-10-16T23:27:40.697 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 3 and data pool 4 2023-10-16T23:27:40.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.696+0000 7fb6269f4640 1 -- 172.21.15.12:0/3427317518 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb600065e60 msgr2=0x7fb600068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:40.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.696+0000 7fb6269f4640 1 --2- 172.21.15.12:0/3427317518 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb600065e60 0x7fb600068320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb6100099b0 tx=0x7fb610008040 comp rx=0 tx=0).stop 2023-10-16T23:27:40.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.696+0000 7fb6269f4640 1 -- 172.21.15.12:0/3427317518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb620145770 msgr2=0x7fb620145bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:40.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.696+0000 7fb6269f4640 1 --2- 172.21.15.12:0/3427317518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb620145770 0x7fb620145bf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb61801d000 tx=0x7fb60c005800 comp rx=0 tx=0).stop 2023-10-16T23:27:40.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.700+0000 7fb6269f4640 1 -- 172.21.15.12:0/3427317518 shutdown_connections 2023-10-16T23:27:40.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.700+0000 7fb6269f4640 1 --2- 172.21.15.12:0/3427317518 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb600065e60 0x7fb600068320 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:40.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.700+0000 7fb6269f4640 1 --2- 172.21.15.12:0/3427317518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb620145770 0x7fb620145bf0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:40.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.700+0000 7fb6269f4640 1 --2- 172.21.15.12:0/3427317518 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb62014e4a0 0x7fb62014e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:40.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.700+0000 7fb6269f4640 1 --2- 172.21.15.12:0/3427317518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb60c005190 0x7fb620144ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:40.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.700+0000 7fb6269f4640 1 -- 172.21.15.12:0/3427317518 >> 172.21.15.12:0/3427317518 conn(0x7fb6200c18f0 msgr2=0x7fb620070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:40.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.700+0000 7fb6269f4640 1 -- 172.21.15.12:0/3427317518 shutdown_connections 2023-10-16T23:27:40.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.700+0000 7fb6269f4640 1 -- 172.21.15.12:0/3427317518 wait complete. 2023-10-16T23:27:40.733 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T23:27:40.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.856+0000 7fd6f8848640 1 Processor -- start 2023-10-16T23:27:40.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.856+0000 7fd6f8848640 1 -- start start 2023-10-16T23:27:40.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.856+0000 7fd6f8848640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd6f40c1950 0x7fd6f40c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:40.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.856+0000 7fd6f8848640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd6f40bfc30 0x7fd6f4153150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:40.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.856+0000 7fd6f8848640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f40c01e0 con 0x7fd6f406e770 2023-10-16T23:27:40.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.856+0000 7fd6f8848640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f40b85b0 con 0x7fd6f40c1950 2023-10-16T23:27:40.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.856+0000 7fd6f8848640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f40b8120 con 0x7fd6f40bfc30 2023-10-16T23:27:40.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.856+0000 7fd6f259c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd6f40c1950 0x7fd6f40c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:40.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.856+0000 7fd6f259c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd6f40c1950 0x7fd6f40c1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40730/0 (socket says 172.21.15.12:40730) 2023-10-16T23:27:40.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.856+0000 7fd6f259c640 1 -- 172.21.15.12:0/1497422818 learned_addr learned my addr 172.21.15.12:0/1497422818 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:40.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.856+0000 7fd6f2d9d640 1 --2- 172.21.15.12:0/1497422818 >> v2:172.21.15.31:3300/0 conn(0x7fd6f40bfc30 0x7fd6f4153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:40.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.856+0000 7fd6f259c640 1 -- 172.21.15.12:0/1497422818 >> v2:172.21.15.31:3300/0 conn(0x7fd6f40bfc30 msgr2=0x7fd6f4153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:40.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.856+0000 7fd6f259c640 1 --2- 172.21.15.12:0/1497422818 >> v2:172.21.15.31:3300/0 conn(0x7fd6f40bfc30 0x7fd6f4153150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:40.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.856+0000 7fd6f259c640 1 -- 172.21.15.12:0/1497422818 >> v1:172.21.15.31:6789/0 conn(0x7fd6f406e770 legacy=0x7fd6f4152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:40.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.856+0000 7fd6f259c640 1 -- 172.21.15.12:0/1497422818 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f40b7db0 con 0x7fd6f40c1950 2023-10-16T23:27:40.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f259c640 1 --2- 172.21.15.12:0/1497422818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6f40c1950 0x7fd6f40c1d30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd6f40c2480 tx=0x7fd6e401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c6c1826a7a624c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:40.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f159a640 1 -- 172.21.15.12:0/1497422818 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e40ab650 con 0x7fd6f40c1950 2023-10-16T23:27:40.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f159a640 1 -- 172.21.15.12:0/1497422818 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e40ab7b0 con 0x7fd6f40c1950 2023-10-16T23:27:40.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f159a640 1 -- 172.21.15.12:0/1497422818 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e40abb40 con 0x7fd6f40c1950 2023-10-16T23:27:40.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f8848640 1 -- 172.21.15.12:0/1497422818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6f40c1950 msgr2=0x7fd6f40c1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:40.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f8848640 1 --2- 172.21.15.12:0/1497422818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6f40c1950 0x7fd6f40c1d30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd6f40c2480 tx=0x7fd6e401c430 comp rx=0 tx=0).stop 2023-10-16T23:27:40.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f8848640 1 -- 172.21.15.12:0/1497422818 shutdown_connections 2023-10-16T23:27:40.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f8848640 1 --2- 172.21.15.12:0/1497422818 >> v2:172.21.15.31:3300/0 conn(0x7fd6f40bfc30 0x7fd6f4153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:40.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f8848640 1 --2- 172.21.15.12:0/1497422818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6f40c1950 0x7fd6f40c1d30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:40.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f8848640 1 -- 172.21.15.12:0/1497422818 >> 172.21.15.12:0/1497422818 conn(0x7fd6f406b5d0 msgr2=0x7fd6f406b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:40.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f8848640 1 -- 172.21.15.12:0/1497422818 shutdown_connections 2023-10-16T23:27:40.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f8848640 1 -- 172.21.15.12:0/1497422818 wait complete. 2023-10-16T23:27:40.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f8848640 1 Processor -- start 2023-10-16T23:27:40.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f8848640 1 -- start start 2023-10-16T23:27:40.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f8848640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6f406e770 0x7fd6f40c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:40.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f8848640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6f40bfc30 0x7fd6f41471c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:40.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f8848640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd6f40c1950 0x7fd6f4147700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:40.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f8848640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f40c3170 con 0x7fd6f40bfc30 2023-10-16T23:27:40.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f8848640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f40ba270 con 0x7fd6f406e770 2023-10-16T23:27:40.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f8848640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f40ba550 con 0x7fd6f40c1950 2023-10-16T23:27:40.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f1d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6f40bfc30 0x7fd6f41471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:40.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f1d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6f40bfc30 0x7fd6f41471c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40746/0 (socket says 172.21.15.12:40746) 2023-10-16T23:27:40.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f1d9b640 1 -- 172.21.15.12:0/2317259389 learned_addr learned my addr 172.21.15.12:0/2317259389 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:40.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f259c640 1 --2- 172.21.15.12:0/2317259389 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6f406e770 0x7fd6f40c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:40.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f2d9d640 1 --2- 172.21.15.12:0/2317259389 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd6f40c1950 0x7fd6f4147700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:40.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f1d9b640 1 -- 172.21.15.12:0/2317259389 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd6f40c1950 msgr2=0x7fd6f4147700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:40.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f1d9b640 1 --2- 172.21.15.12:0/2317259389 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd6f40c1950 0x7fd6f4147700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:40.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f1d9b640 1 -- 172.21.15.12:0/2317259389 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6f406e770 msgr2=0x7fd6f40c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:40.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f1d9b640 1 --2- 172.21.15.12:0/2317259389 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6f406e770 0x7fd6f40c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:40.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f1d9b640 1 -- 172.21.15.12:0/2317259389 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e40094d0 con 0x7fd6f40bfc30 2023-10-16T23:27:40.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f2d9d640 1 --2- 172.21.15.12:0/2317259389 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd6f40c1950 0x7fd6f4147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:27:40.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f1d9b640 1 --2- 172.21.15.12:0/2317259389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6f40bfc30 0x7fd6f41471c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800b410 tx=0x7fd6e800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:40.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6e2ffd640 1 -- 172.21.15.12:0/2317259389 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8004020 con 0x7fd6f40bfc30 2023-10-16T23:27:40.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6e2ffd640 1 -- 172.21.15.12:0/2317259389 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e8004180 con 0x7fd6f40bfc30 2023-10-16T23:27:40.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f8848640 1 -- 172.21.15.12:0/2317259389 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f40baa70 con 0x7fd6f40bfc30 2023-10-16T23:27:40.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6e2ffd640 1 -- 172.21.15.12:0/2317259389 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8011630 con 0x7fd6f40bfc30 2023-10-16T23:27:40.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.860+0000 7fd6f8848640 1 -- 172.21.15.12:0/2317259389 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f40bb450 con 0x7fd6f40bfc30 2023-10-16T23:27:40.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.864+0000 7fd6f8848640 1 -- 172.21.15.12:0/2317259389 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f40673a0 con 0x7fd6f40bfc30 2023-10-16T23:27:40.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.864+0000 7fd6e2ffd640 1 -- 172.21.15.12:0/2317259389 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fd6e8011790 con 0x7fd6f40bfc30 2023-10-16T23:27:40.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.864+0000 7fd6e2ffd640 1 --2- 172.21.15.12:0/2317259389 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd6d4065e60 0x7fd6d4068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:40.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.864+0000 7fd6e2ffd640 1 -- 172.21.15.12:0/2317259389 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd6e8083560 con 0x7fd6f40bfc30 2023-10-16T23:27:40.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.864+0000 7fd6f259c640 1 --2- 172.21.15.12:0/2317259389 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd6d4065e60 0x7fd6d4068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:40.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.864+0000 7fd6f259c640 1 --2- 172.21.15.12:0/2317259389 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd6d4065e60 0x7fd6d4068320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40af000 tx=0x7fd6e40b6040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:40.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:40.868+0000 7fd6e2ffd640 1 -- 172.21.15.12:0/2317259389 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fd6e8050bb0 con 0x7fd6f40bfc30 2023-10-16T23:27:41.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.028+0000 7fd6f8848640 1 -- 172.21.15.12:0/2317259389 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6f40ba710 con 0x7fd6f40bfc30 2023-10-16T23:27:41.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.032+0000 7fd6e2ffd640 1 -- 172.21.15.12:0/2317259389 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17776 (secure 0 0 0) 0x7fd6e80541d0 con 0x7fd6f40bfc30 2023-10-16T23:27:41.035 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:41.036 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":23,"fsid":"0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51","created":"2023-10-16T23:27:16.468087+0000","modified":"2023-10-16T23:27:40.686012+0000","last_up_change":"2023-10-16T23:27:28.136202+0000","last_in_change":"2023-10-16T23:27:18.793212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T23:27:27.354025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-16T23:27:34.786446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-16T23:27:39.130341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-16T23:27:39.674572+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73e70f98-6f5e-4464-b34e-931faac41cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":38075},{"type":"v1","addr":"172.21.15.12:6814","nonce":38075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":38075},{"type":"v1","addr":"172.21.15.12:6819","nonce":38075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":38075},{"type":"v1","addr":"172.21.15.12:6827","nonce":38075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":38075},{"type":"v1","addr":"172.21.15.12:6823","nonce":38075}]},"public_addr":"172.21.15.12:6814/38075","cluster_addr":"172.21.15.12:6819/38075","heartbeat_back_addr":"172.21.15.12:6827/38075","heartbeat_front_addr":"172.21.15.12:6823/38075","state":["exists","up"]},{"osd":1,"uuid":"ff722efe-b3f9-4cc0-bbde-f4d4d8055a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":38076},{"type":"v1","addr":"172.21.15.12:6811","nonce":38076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":38076},{"type":"v1","addr":"172.21.15.12:6818","nonce":38076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":38076},{"type":"v1","addr":"172.21.15.12:6831","nonce":38076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":38076},{"type":"v1","addr":"172.21.15.12:6825","nonce":38076}]},"public_addr":"172.21.15.12:6811/38076","cluster_addr":"172.21.15.12:6818/38076","heartbeat_back_addr":"172.21.15.12:6831/38076","heartbeat_front_addr":"172.21.15.12:6825/38076","state":["exists","up"]},{"osd":2,"uuid":"9baf25db-dce0-4065-90d6-f35867286be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6809","nonce":38073},{"type":"v1","addr":"172.21.15.12:6810","nonce":38073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":38073},{"type":"v1","addr":"172.21.15.12:6817","nonce":38073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":38073},{"type":"v1","addr":"172.21.15.12:6830","nonce":38073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":38073},{"type":"v1","addr":"172.21.15.12:6826","nonce":38073}]},"public_addr":"172.21.15.12:6810/38073","cluster_addr":"172.21.15.12:6817/38073","heartbeat_back_addr":"172.21.15.12:6830/38073","heartbeat_front_addr":"172.21.15.12:6826/38073","state":["exists","up"]},{"osd":3,"uuid":"8a620ad3-2294-470d-8a8c-66f177f5fbe7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":38074},{"type":"v1","addr":"172.21.15.12:6801","nonce":38074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":38074},{"type":"v1","addr":"172.21.15.12:6803","nonce":38074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":38074},{"type":"v1","addr":"172.21.15.12:6807","nonce":38074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":38074},{"type":"v1","addr":"172.21.15.12:6805","nonce":38074}]},"public_addr":"172.21.15.12:6801/38074","cluster_addr":"172.21.15.12:6803/38074","heartbeat_back_addr":"172.21.15.12:6807/38074","heartbeat_front_addr":"172.21.15.12:6805/38074","state":["exists","up"]},{"osd":4,"uuid":"a8824d77-7405-40f5-9234-60889802b184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":38266},{"type":"v1","addr":"172.21.15.31:6817","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":38266},{"type":"v1","addr":"172.21.15.31:6819","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":38266},{"type":"v1","addr":"172.21.15.31:6823","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":38266},{"type":"v1","addr":"172.21.15.31:6821","nonce":38266}]},"public_addr":"172.21.15.31:6817/38266","cluster_addr":"172.21.15.31:6819/38266","heartbeat_back_addr":"172.21.15.31:6823/38266","heartbeat_front_addr":"172.21.15.31:6821/38266","state":["exists","up"]},{"osd":5,"uuid":"3bb01192-a47c-48e9-9662-285e3f6f4b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":38264},{"type":"v1","addr":"172.21.15.31:6807","nonce":38264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":38264},{"type":"v1","addr":"172.21.15.31:6811","nonce":38264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":38264},{"type":"v1","addr":"172.21.15.31:6815","nonce":38264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":38264},{"type":"v1","addr":"172.21.15.31:6813","nonce":38264}]},"public_addr":"172.21.15.31:6807/38264","cluster_addr":"172.21.15.31:6811/38264","heartbeat_back_addr":"172.21.15.31:6815/38264","heartbeat_front_addr":"172.21.15.31:6813/38264","state":["exists","up"]},{"osd":6,"uuid":"1e2d18e4-73e6-4a37-826c-35eca4d96935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":38263},{"type":"v1","addr":"172.21.15.31:6825","nonce":38263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":38263},{"type":"v1","addr":"172.21.15.31:6827","nonce":38263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":38263},{"type":"v1","addr":"172.21.15.31:6831","nonce":38263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":38263},{"type":"v1","addr":"172.21.15.31:6829","nonce":38263}]},"public_addr":"172.21.15.31:6825/38263","cluster_addr":"172.21.15.31:6827/38263","heartbeat_back_addr":"172.21.15.31:6831/38263","heartbeat_front_addr":"172.21.15.31:6829/38263","state":["exists","up"]},{"osd":7,"uuid":"e0f369c0-562b-4440-a5aa-12275c29412b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":38265},{"type":"v1","addr":"172.21.15.31:6801","nonce":38265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":38265},{"type":"v1","addr":"172.21.15.31:6803","nonce":38265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":38265},{"type":"v1","addr":"172.21.15.31:6810","nonce":38265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":38265},{"type":"v1","addr":"172.21.15.31:6806","nonce":38265}]},"public_addr":"172.21.15.31:6801/38265","cluster_addr":"172.21.15.31:6803/38265","heartbeat_back_addr":"172.21.15.31:6810/38265","heartbeat_front_addr":"172.21.15.31:6806/38265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.411815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.372565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.209700+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.414619+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.316843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.300348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.359800+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.219854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T23:27:41.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.032+0000 7fd6f8848640 1 -- 172.21.15.12:0/2317259389 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd6d4065e60 msgr2=0x7fd6d4068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:41.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.032+0000 7fd6f8848640 1 --2- 172.21.15.12:0/2317259389 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd6d4065e60 0x7fd6d4068320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40af000 tx=0x7fd6e40b6040 comp rx=0 tx=0).stop 2023-10-16T23:27:41.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.032+0000 7fd6f8848640 1 -- 172.21.15.12:0/2317259389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6f40bfc30 msgr2=0x7fd6f41471c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:41.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.032+0000 7fd6f8848640 1 --2- 172.21.15.12:0/2317259389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6f40bfc30 0x7fd6f41471c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800b410 tx=0x7fd6e800b8d0 comp rx=0 tx=0).stop 2023-10-16T23:27:41.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.032+0000 7fd6f8848640 1 -- 172.21.15.12:0/2317259389 shutdown_connections 2023-10-16T23:27:41.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.032+0000 7fd6f8848640 1 --2- 172.21.15.12:0/2317259389 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd6d4065e60 0x7fd6d4068320 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:41.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.036+0000 7fd6f8848640 1 --2- 172.21.15.12:0/2317259389 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd6f40c1950 0x7fd6f4147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:41.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.036+0000 7fd6f8848640 1 --2- 172.21.15.12:0/2317259389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6f40bfc30 0x7fd6f41471c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:41.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.036+0000 7fd6f8848640 1 --2- 172.21.15.12:0/2317259389 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6f406e770 0x7fd6f40c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:41.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.036+0000 7fd6f8848640 1 -- 172.21.15.12:0/2317259389 >> 172.21.15.12:0/2317259389 conn(0x7fd6f406b5d0 msgr2=0x7fd6f4150940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:41.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.036+0000 7fd6f8848640 1 -- 172.21.15.12:0/2317259389 shutdown_connections 2023-10-16T23:27:41.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.036+0000 7fd6f8848640 1 -- 172.21.15.12:0/2317259389 wait complete. 2023-10-16T23:27:41.056 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T23:27:41.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.172+0000 7f6966095640 1 Processor -- start 2023-10-16T23:27:41.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.172+0000 7f6966095640 1 -- start start 2023-10-16T23:27:41.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.172+0000 7f6966095640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f696006b660 0x7f696006ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:41.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.172+0000 7f6966095640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f696014c660 0x7f696014caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:41.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.172+0000 7f6966095640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6960151560 con 0x7f696014cfe0 2023-10-16T23:27:41.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.172+0000 7f6966095640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69600c12b0 con 0x7f696006b660 2023-10-16T23:27:41.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.172+0000 7f6966095640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69600a0f80 con 0x7f696014c660 2023-10-16T23:27:41.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.172+0000 7f695f7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f696006b660 0x7f696006ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:41.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.172+0000 7f695f7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f696006b660 0x7f696006ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40760/0 (socket says 172.21.15.12:40760) 2023-10-16T23:27:41.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.172+0000 7f695f7fe640 1 -- 172.21.15.12:0/2715529351 learned_addr learned my addr 172.21.15.12:0/2715529351 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:41.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.172+0000 7f695effd640 1 --2- 172.21.15.12:0/2715529351 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f696014c660 0x7f696014caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:41.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.172+0000 7f695f7fe640 1 -- 172.21.15.12:0/2715529351 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f696014c660 msgr2=0x7f696014caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:41.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.172+0000 7f695f7fe640 1 --2- 172.21.15.12:0/2715529351 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f696014c660 0x7f696014caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:41.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.172+0000 7f695f7fe640 1 -- 172.21.15.12:0/2715529351 >> v1:172.21.15.31:6789/0 conn(0x7f696014cfe0 legacy=0x7f6960070a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:41.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.172+0000 7f695f7fe640 1 -- 172.21.15.12:0/2715529351 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69600a0ca0 con 0x7f696006b660 2023-10-16T23:27:41.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f695f7fe640 1 --2- 172.21.15.12:0/2715529351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f696006b660 0x7f696006ba40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6950009870 tx=0x7f695001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=418e13c3272fc935 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:41.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f695e7fc640 1 -- 172.21.15.12:0/2715529351 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69500ab680 con 0x7f696006b660 2023-10-16T23:27:41.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f695e7fc640 1 -- 172.21.15.12:0/2715529351 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69500ab7e0 con 0x7f696006b660 2023-10-16T23:27:41.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f695e7fc640 1 -- 172.21.15.12:0/2715529351 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69500abb70 con 0x7f696006b660 2023-10-16T23:27:41.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f6966095640 1 -- 172.21.15.12:0/2715529351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f696006b660 msgr2=0x7f696006ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:41.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f6966095640 1 --2- 172.21.15.12:0/2715529351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f696006b660 0x7f696006ba40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6950009870 tx=0x7f695001c480 comp rx=0 tx=0).stop 2023-10-16T23:27:41.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f6966095640 1 -- 172.21.15.12:0/2715529351 shutdown_connections 2023-10-16T23:27:41.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f6966095640 1 --2- 172.21.15.12:0/2715529351 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f696014c660 0x7f696014caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:41.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f6966095640 1 --2- 172.21.15.12:0/2715529351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f696006b660 0x7f696006ba40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:41.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f6966095640 1 -- 172.21.15.12:0/2715529351 >> 172.21.15.12:0/2715529351 conn(0x7f69600c1910 msgr2=0x7f69600c1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:41.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f6966095640 1 -- 172.21.15.12:0/2715529351 shutdown_connections 2023-10-16T23:27:41.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f6966095640 1 -- 172.21.15.12:0/2715529351 wait complete. 2023-10-16T23:27:41.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f6966095640 1 Processor -- start 2023-10-16T23:27:41.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f6966095640 1 -- start start 2023-10-16T23:27:41.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f6966095640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f696006b660 0x7f69600a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:41.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f6966095640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f696014c660 0x7f69601e83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:41.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f6966095640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f696014cfe0 0x7f696013e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f6966095640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6960141d40 con 0x7f696006b660 2023-10-16T23:27:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f6966095640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69600a5110 con 0x7f696014cfe0 2023-10-16T23:27:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f6966095640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696014fe10 con 0x7f696014c660 2023-10-16T23:27:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f695f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f696006b660 0x7f69600a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:41.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f695f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f696006b660 0x7f69600a4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40768/0 (socket says 172.21.15.12:40768) 2023-10-16T23:27:41.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f695f7fe640 1 -- 172.21.15.12:0/4038914083 learned_addr learned my addr 172.21.15.12:0/4038914083 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:41.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f695effd640 1 --2- 172.21.15.12:0/4038914083 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f696014c660 0x7f69601e83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:41.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f695ffff640 1 --2- 172.21.15.12:0/4038914083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f696014cfe0 0x7f696013e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:41.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f695f7fe640 1 -- 172.21.15.12:0/4038914083 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f696014c660 msgr2=0x7f69601e83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:41.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f695f7fe640 1 --2- 172.21.15.12:0/4038914083 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f696014c660 0x7f69601e83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:41.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f695f7fe640 1 -- 172.21.15.12:0/4038914083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f696014cfe0 msgr2=0x7f696013e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:41.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f695f7fe640 1 --2- 172.21.15.12:0/4038914083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f696014cfe0 0x7f696013e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:41.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f695f7fe640 1 -- 172.21.15.12:0/4038914083 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69500094d0 con 0x7f696006b660 2023-10-16T23:27:41.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.176+0000 7f695f7fe640 1 --2- 172.21.15.12:0/4038914083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f696006b660 0x7f69600a4bd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f695001ab30 tx=0x7f695001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.180+0000 7f6947fff640 1 -- 172.21.15.12:0/4038914083 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69500b4800 con 0x7f696006b660 2023-10-16T23:27:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.180+0000 7f6947fff640 1 -- 172.21.15.12:0/4038914083 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69500b4980 con 0x7f696006b660 2023-10-16T23:27:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.180+0000 7f6966095640 1 -- 172.21.15.12:0/4038914083 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696014f030 con 0x7f696006b660 2023-10-16T23:27:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.180+0000 7f6947fff640 1 -- 172.21.15.12:0/4038914083 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69500b4d30 con 0x7f696006b660 2023-10-16T23:27:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.180+0000 7f6966095640 1 -- 172.21.15.12:0/4038914083 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69600a4670 con 0x7f696006b660 2023-10-16T23:27:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.180+0000 7f6966095640 1 -- 172.21.15.12:0/4038914083 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69600673a0 con 0x7f696006b660 2023-10-16T23:27:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.180+0000 7f6947fff640 1 -- 172.21.15.12:0/4038914083 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f69500be3f0 con 0x7f696006b660 2023-10-16T23:27:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.180+0000 7f6947fff640 1 --2- 172.21.15.12:0/4038914083 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f694c065e90 0x7f694c068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.180+0000 7f6947fff640 1 -- 172.21.15.12:0/4038914083 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f695011e6d0 con 0x7f696006b660 2023-10-16T23:27:41.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.180+0000 7f695effd640 1 --2- 172.21.15.12:0/4038914083 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f694c065e90 0x7f694c068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:41.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.180+0000 7f695effd640 1 --2- 172.21.15.12:0/4038914083 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f694c065e90 0x7f694c068350 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6960149840 tx=0x7f6954008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:41.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.184+0000 7f6947fff640 1 -- 172.21.15.12:0/4038914083 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f69500ebdb0 con 0x7f696006b660 2023-10-16T23:27:41.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.340+0000 7f6966095640 1 -- 172.21.15.12:0/4038914083 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69601e8fe0 con 0x7f696006b660 2023-10-16T23:27:41.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.344+0000 7f6947fff640 1 -- 172.21.15.12:0/4038914083 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17776 (secure 0 0 0) 0x7f69500ef3d0 con 0x7f696006b660 2023-10-16T23:27:41.347 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:41.347 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":23,"fsid":"0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51","created":"2023-10-16T23:27:16.468087+0000","modified":"2023-10-16T23:27:40.686012+0000","last_up_change":"2023-10-16T23:27:28.136202+0000","last_in_change":"2023-10-16T23:27:18.793212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T23:27:27.354025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-16T23:27:34.786446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-16T23:27:39.130341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-16T23:27:39.674572+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73e70f98-6f5e-4464-b34e-931faac41cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":38075},{"type":"v1","addr":"172.21.15.12:6814","nonce":38075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":38075},{"type":"v1","addr":"172.21.15.12:6819","nonce":38075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":38075},{"type":"v1","addr":"172.21.15.12:6827","nonce":38075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":38075},{"type":"v1","addr":"172.21.15.12:6823","nonce":38075}]},"public_addr":"172.21.15.12:6814/38075","cluster_addr":"172.21.15.12:6819/38075","heartbeat_back_addr":"172.21.15.12:6827/38075","heartbeat_front_addr":"172.21.15.12:6823/38075","state":["exists","up"]},{"osd":1,"uuid":"ff722efe-b3f9-4cc0-bbde-f4d4d8055a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":38076},{"type":"v1","addr":"172.21.15.12:6811","nonce":38076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":38076},{"type":"v1","addr":"172.21.15.12:6818","nonce":38076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":38076},{"type":"v1","addr":"172.21.15.12:6831","nonce":38076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":38076},{"type":"v1","addr":"172.21.15.12:6825","nonce":38076}]},"public_addr":"172.21.15.12:6811/38076","cluster_addr":"172.21.15.12:6818/38076","heartbeat_back_addr":"172.21.15.12:6831/38076","heartbeat_front_addr":"172.21.15.12:6825/38076","state":["exists","up"]},{"osd":2,"uuid":"9baf25db-dce0-4065-90d6-f35867286be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6809","nonce":38073},{"type":"v1","addr":"172.21.15.12:6810","nonce":38073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":38073},{"type":"v1","addr":"172.21.15.12:6817","nonce":38073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":38073},{"type":"v1","addr":"172.21.15.12:6830","nonce":38073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":38073},{"type":"v1","addr":"172.21.15.12:6826","nonce":38073}]},"public_addr":"172.21.15.12:6810/38073","cluster_addr":"172.21.15.12:6817/38073","heartbeat_back_addr":"172.21.15.12:6830/38073","heartbeat_front_addr":"172.21.15.12:6826/38073","state":["exists","up"]},{"osd":3,"uuid":"8a620ad3-2294-470d-8a8c-66f177f5fbe7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":38074},{"type":"v1","addr":"172.21.15.12:6801","nonce":38074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":38074},{"type":"v1","addr":"172.21.15.12:6803","nonce":38074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":38074},{"type":"v1","addr":"172.21.15.12:6807","nonce":38074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":38074},{"type":"v1","addr":"172.21.15.12:6805","nonce":38074}]},"public_addr":"172.21.15.12:6801/38074","cluster_addr":"172.21.15.12:6803/38074","heartbeat_back_addr":"172.21.15.12:6807/38074","heartbeat_front_addr":"172.21.15.12:6805/38074","state":["exists","up"]},{"osd":4,"uuid":"a8824d77-7405-40f5-9234-60889802b184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":38266},{"type":"v1","addr":"172.21.15.31:6817","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":38266},{"type":"v1","addr":"172.21.15.31:6819","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":38266},{"type":"v1","addr":"172.21.15.31:6823","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":38266},{"type":"v1","addr":"172.21.15.31:6821","nonce":38266}]},"public_addr":"172.21.15.31:6817/38266","cluster_addr":"172.21.15.31:6819/38266","heartbeat_back_addr":"172.21.15.31:6823/38266","heartbeat_front_addr":"172.21.15.31:6821/38266","state":["exists","up"]},{"osd":5,"uuid":"3bb01192-a47c-48e9-9662-285e3f6f4b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":38264},{"type":"v1","addr":"172.21.15.31:6807","nonce":38264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":38264},{"type":"v1","addr":"172.21.15.31:6811","nonce":38264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":38264},{"type":"v1","addr":"172.21.15.31:6815","nonce":38264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":38264},{"type":"v1","addr":"172.21.15.31:6813","nonce":38264}]},"public_addr":"172.21.15.31:6807/38264","cluster_addr":"172.21.15.31:6811/38264","heartbeat_back_addr":"172.21.15.31:6815/38264","heartbeat_front_addr":"172.21.15.31:6813/38264","state":["exists","up"]},{"osd":6,"uuid":"1e2d18e4-73e6-4a37-826c-35eca4d96935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":38263},{"type":"v1","addr":"172.21.15.31:6825","nonce":38263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":38263},{"type":"v1","addr":"172.21.15.31:6827","nonce":38263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":38263},{"type":"v1","addr":"172.21.15.31:6831","nonce":38263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":38263},{"type":"v1","addr":"172.21.15.31:6829","nonce":38263}]},"public_addr":"172.21.15.31:6825/38263","cluster_addr":"172.21.15.31:6827/38263","heartbeat_back_addr":"172.21.15.31:6831/38263","heartbeat_front_addr":"172.21.15.31:6829/38263","state":["exists","up"]},{"osd":7,"uuid":"e0f369c0-562b-4440-a5aa-12275c29412b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":38265},{"type":"v1","addr":"172.21.15.31:6801","nonce":38265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":38265},{"type":"v1","addr":"172.21.15.31:6803","nonce":38265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":38265},{"type":"v1","addr":"172.21.15.31:6810","nonce":38265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":38265},{"type":"v1","addr":"172.21.15.31:6806","nonce":38265}]},"public_addr":"172.21.15.31:6801/38265","cluster_addr":"172.21.15.31:6803/38265","heartbeat_back_addr":"172.21.15.31:6810/38265","heartbeat_front_addr":"172.21.15.31:6806/38265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.411815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.372565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.209700+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.414619+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.316843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.300348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.359800+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.219854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T23:27:41.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.344+0000 7f6966095640 1 -- 172.21.15.12:0/4038914083 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f694c065e90 msgr2=0x7f694c068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:41.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.344+0000 7f6966095640 1 --2- 172.21.15.12:0/4038914083 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f694c065e90 0x7f694c068350 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6960149840 tx=0x7f6954008040 comp rx=0 tx=0).stop 2023-10-16T23:27:41.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.344+0000 7f6966095640 1 -- 172.21.15.12:0/4038914083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f696006b660 msgr2=0x7f69600a4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:41.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.344+0000 7f6966095640 1 --2- 172.21.15.12:0/4038914083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f696006b660 0x7f69600a4bd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f695001ab30 tx=0x7f695001acc0 comp rx=0 tx=0).stop 2023-10-16T23:27:41.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.344+0000 7f6966095640 1 -- 172.21.15.12:0/4038914083 shutdown_connections 2023-10-16T23:27:41.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.344+0000 7f6966095640 1 --2- 172.21.15.12:0/4038914083 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f694c065e90 0x7f694c068350 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:41.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.344+0000 7f6966095640 1 --2- 172.21.15.12:0/4038914083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f696014cfe0 0x7f696013e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:41.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.344+0000 7f6966095640 1 --2- 172.21.15.12:0/4038914083 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f696014c660 0x7f69601e83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:41.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.344+0000 7f6966095640 1 --2- 172.21.15.12:0/4038914083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f696006b660 0x7f69600a4bd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:41.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.344+0000 7f6966095640 1 -- 172.21.15.12:0/4038914083 >> 172.21.15.12:0/4038914083 conn(0x7f69600c1910 msgr2=0x7f696006c880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:41.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.344+0000 7f6966095640 1 -- 172.21.15.12:0/4038914083 shutdown_connections 2023-10-16T23:27:41.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.344+0000 7f6966095640 1 -- 172.21.15.12:0/4038914083 wait complete. 2023-10-16T23:27:41.365 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-16T23:27:41.417 INFO:tasks.ceph.mds.a.smithi012.stderr:2023-10-16T23:27:41.416+0000 7f28d0e04640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T23:27:41.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.488+0000 7f53ce98c640 1 Processor -- start 2023-10-16T23:27:41.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.488+0000 7f53ce98c640 1 -- start start 2023-10-16T23:27:41.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.492+0000 7f53ce98c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f53c80c12a0 0x7f53c8146c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:41.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.492+0000 7f53ce98c640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c80bc8e0 con 0x7f53c8150880 2023-10-16T23:27:41.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.492+0000 7f53ce98c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c80b3f40 con 0x7f53c80bbe00 2023-10-16T23:27:41.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.492+0000 7f53ce98c640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c80b4220 con 0x7f53c80c12a0 2023-10-16T23:27:41.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.492+0000 7f53c7fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f53c80c12a0 0x7f53c8146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:41.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.492+0000 7f53ccf29640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f53c8150880 0x7f53c8150cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46578/0 (socket says 172.21.15.12:46578) 2023-10-16T23:27:41.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.492+0000 7f53ccf29640 1 -- 172.21.15.12:0/3053746792 learned_addr learned my addr 172.21.15.12:0/3053746792 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:41.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.492+0000 7f53c7fff640 1 -- 172.21.15.12:0/3053746792 >> v1:172.21.15.31:6789/0 conn(0x7f53c80bbe00 legacy=0x7f53c8147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:41.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.492+0000 7f53c7fff640 1 -- 172.21.15.12:0/3053746792 >> v1:172.21.15.12:6789/0 conn(0x7f53c8150880 legacy=0x7f53c8150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:41.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.492+0000 7f53c7fff640 1 -- 172.21.15.12:0/3053746792 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c80b3b80 con 0x7f53c80c12a0 2023-10-16T23:27:41.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.492+0000 7f53c6ffd640 1 -- 172.21.15.12:0/3053746792 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645116774 0 0) 0x7f53c80bc8e0 con 0x7f53c8150880 2023-10-16T23:27:41.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.492+0000 7f53c7fff640 1 --2- 172.21.15.12:0/3053746792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53c80c12a0 0x7f53c8146c10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f53b80097c0 tx=0x7f53b801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db88a0985fc29fa server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:41.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.492+0000 7f53c6ffd640 1 -- 172.21.15.12:0/3053746792 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b80ab660 con 0x7f53c80c12a0 2023-10-16T23:27:41.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.492+0000 7f53c6ffd640 1 -- 172.21.15.12:0/3053746792 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b80ab7c0 con 0x7f53c80c12a0 2023-10-16T23:27:41.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.492+0000 7f53c6ffd640 1 -- 172.21.15.12:0/3053746792 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b80abb50 con 0x7f53c80c12a0 2023-10-16T23:27:41.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53ce98c640 1 -- 172.21.15.12:0/3053746792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53c80c12a0 msgr2=0x7f53c8146c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:41.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53ce98c640 1 --2- 172.21.15.12:0/3053746792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53c80c12a0 0x7f53c8146c10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f53b80097c0 tx=0x7f53b801c440 comp rx=0 tx=0).stop 2023-10-16T23:27:41.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53ce98c640 1 -- 172.21.15.12:0/3053746792 shutdown_connections 2023-10-16T23:27:41.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53ce98c640 1 --2- 172.21.15.12:0/3053746792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53c80c12a0 0x7f53c8146c10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:41.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53ce98c640 1 -- 172.21.15.12:0/3053746792 >> 172.21.15.12:0/3053746792 conn(0x7f53c806bb10 msgr2=0x7f53c80c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:41.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53ce98c640 1 -- 172.21.15.12:0/3053746792 shutdown_connections 2023-10-16T23:27:41.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53ce98c640 1 -- 172.21.15.12:0/3053746792 wait complete. 2023-10-16T23:27:41.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53ce98c640 1 Processor -- start 2023-10-16T23:27:41.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53ce98c640 1 -- start start 2023-10-16T23:27:41.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53ce98c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53c80bbe00 0x7f53c813d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:41.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53ce98c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53c80c12a0 0x7f53c81e8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:41.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53ce98c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53c8150880 0x7f53c81e8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:41.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53ce98c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c814bf80 con 0x7f53c80c12a0 2023-10-16T23:27:41.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53ce98c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c814c410 con 0x7f53c8150880 2023-10-16T23:27:41.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53ce98c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c813d820 con 0x7f53c80bbe00 2023-10-16T23:27:41.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53c77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53c80c12a0 0x7f53c81e8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:41.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53c77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53c80c12a0 0x7f53c81e8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40786/0 (socket says 172.21.15.12:40786) 2023-10-16T23:27:41.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53c77fe640 1 -- 172.21.15.12:0/2871463272 learned_addr learned my addr 172.21.15.12:0/2871463272 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:41.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53ccf29640 1 --2- 172.21.15.12:0/2871463272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53c8150880 0x7f53c81e8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:41.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53c7fff640 1 --2- 172.21.15.12:0/2871463272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53c80bbe00 0x7f53c813d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:41.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53c77fe640 1 -- 172.21.15.12:0/2871463272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53c80bbe00 msgr2=0x7f53c813d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:41.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53c77fe640 1 --2- 172.21.15.12:0/2871463272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53c80bbe00 0x7f53c813d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:41.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53c77fe640 1 -- 172.21.15.12:0/2871463272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53c8150880 msgr2=0x7f53c81e8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:41.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53c77fe640 1 --2- 172.21.15.12:0/2871463272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53c8150880 0x7f53c81e8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:41.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53c77fe640 1 -- 172.21.15.12:0/2871463272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b8009420 con 0x7f53c80c12a0 2023-10-16T23:27:41.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53c7fff640 1 --2- 172.21.15.12:0/2871463272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53c80bbe00 0x7f53c813d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:41.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53ccf29640 1 --2- 172.21.15.12:0/2871463272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53c8150880 0x7f53c81e8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:41.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53c77fe640 1 --2- 172.21.15.12:0/2871463272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53c80c12a0 0x7f53c81e8a20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00c450 tx=0x7f53bc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:41.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53c4ff9640 1 -- 172.21.15.12:0/2871463272 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc012830 con 0x7f53c80c12a0 2023-10-16T23:27:41.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53c4ff9640 1 -- 172.21.15.12:0/2871463272 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53bc0129b0 con 0x7f53c80c12a0 2023-10-16T23:27:41.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53ce98c640 1 -- 172.21.15.12:0/2871463272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c814b930 con 0x7f53c80c12a0 2023-10-16T23:27:41.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53c4ff9640 1 -- 172.21.15.12:0/2871463272 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc012d60 con 0x7f53c80c12a0 2023-10-16T23:27:41.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53ce98c640 1 -- 172.21.15.12:0/2871463272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c814cd10 con 0x7f53c80c12a0 2023-10-16T23:27:41.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.496+0000 7f53ce98c640 1 -- 172.21.15.12:0/2871463272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c80bcd50 con 0x7f53c80c12a0 2023-10-16T23:27:41.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.500+0000 7f53c4ff9640 1 -- 172.21.15.12:0/2871463272 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f53bc01c460 con 0x7f53c80c12a0 2023-10-16T23:27:41.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.500+0000 7f53c4ff9640 1 --2- 172.21.15.12:0/2871463272 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f53b4065e60 0x7f53b4068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:41.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.500+0000 7f53c4ff9640 1 -- 172.21.15.12:0/2871463272 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53bc083740 con 0x7f53c80c12a0 2023-10-16T23:27:41.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.500+0000 7f53c7fff640 1 --2- 172.21.15.12:0/2871463272 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f53b4065e60 0x7f53b4068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:41.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.500+0000 7f53c7fff640 1 --2- 172.21.15.12:0/2871463272 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f53b4065e60 0x7f53b4068320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f53b80af000 tx=0x7f53b8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:41.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.504+0000 7f53c4ff9640 1 -- 172.21.15.12:0/2871463272 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f53c80bcd50 con 0x7f53c80c12a0 2023-10-16T23:27:41.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:41.696+0000 7f53ce98c640 1 -- 172.21.15.12:0/2871463272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f53c814bde0 con 0x7f53c80c12a0 2023-10-16T23:27:42.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.696+0000 7f53c4ff9640 1 -- 172.21.15.12:0/2871463272 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f53c814bde0 con 0x7f53c80c12a0 2023-10-16T23:27:42.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.700+0000 7f53ce98c640 1 -- 172.21.15.12:0/2871463272 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f53b4065e60 msgr2=0x7f53b4068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.700+0000 7f53ce98c640 1 --2- 172.21.15.12:0/2871463272 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f53b4065e60 0x7f53b4068320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f53b80af000 tx=0x7f53b8008040 comp rx=0 tx=0).stop 2023-10-16T23:27:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.700+0000 7f53ce98c640 1 -- 172.21.15.12:0/2871463272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53c80c12a0 msgr2=0x7f53c81e8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.700+0000 7f53ce98c640 1 --2- 172.21.15.12:0/2871463272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53c80c12a0 0x7f53c81e8a20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00c450 tx=0x7f53bc00c910 comp rx=0 tx=0).stop 2023-10-16T23:27:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.700+0000 7f53ce98c640 1 -- 172.21.15.12:0/2871463272 shutdown_connections 2023-10-16T23:27:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.700+0000 7f53ce98c640 1 --2- 172.21.15.12:0/2871463272 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f53b4065e60 0x7f53b4068320 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.700+0000 7f53ce98c640 1 --2- 172.21.15.12:0/2871463272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53c8150880 0x7f53c81e8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.700+0000 7f53ce98c640 1 --2- 172.21.15.12:0/2871463272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53c80c12a0 0x7f53c81e8a20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.700+0000 7f53ce98c640 1 --2- 172.21.15.12:0/2871463272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53c80bbe00 0x7f53c813d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.700+0000 7f53ce98c640 1 -- 172.21.15.12:0/2871463272 >> 172.21.15.12:0/2871463272 conn(0x7f53c806bb10 msgr2=0x7f53c80c0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.700+0000 7f53ce98c640 1 -- 172.21.15.12:0/2871463272 shutdown_connections 2023-10-16T23:27:42.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.700+0000 7f53ce98c640 1 -- 172.21.15.12:0/2871463272 wait complete. 2023-10-16T23:27:42.723 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-16T23:27:42.724 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-16T23:27:42.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.852+0000 7f19ee9ae640 1 Processor -- start 2023-10-16T23:27:42.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.852+0000 7f19ee9ae640 1 -- start start 2023-10-16T23:27:42.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.852+0000 7f19ee9ae640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f19e80c12a0 0x7f19e8146c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:42.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.852+0000 7f19ee9ae640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f19e80bbe00 0x7f19e8147150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:42.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.852+0000 7f19ee9ae640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e80bc8e0 con 0x7f19e8150880 2023-10-16T23:27:42.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.852+0000 7f19ee9ae640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e80b3f40 con 0x7f19e80c12a0 2023-10-16T23:27:42.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.852+0000 7f19ee9ae640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e80b4220 con 0x7f19e80bbe00 2023-10-16T23:27:42.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.852+0000 7f19e7fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f19e80c12a0 0x7f19e8146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:42.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.852+0000 7f19ecf4b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f19e8150880 0x7f19e8150cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46590/0 (socket says 172.21.15.12:46590) 2023-10-16T23:27:42.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.852+0000 7f19ecf4b640 1 -- 172.21.15.12:0/4187222902 learned_addr learned my addr 172.21.15.12:0/4187222902 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:42.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.852+0000 7f19e77fe640 1 --2- 172.21.15.12:0/4187222902 >> v2:172.21.15.31:3300/0 conn(0x7f19e80bbe00 0x7f19e8147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:42.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.852+0000 7f19e7fff640 1 -- 172.21.15.12:0/4187222902 >> v2:172.21.15.31:3300/0 conn(0x7f19e80bbe00 msgr2=0x7f19e8147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:42.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.852+0000 7f19e7fff640 1 --2- 172.21.15.12:0/4187222902 >> v2:172.21.15.31:3300/0 conn(0x7f19e80bbe00 0x7f19e8147150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:42.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.852+0000 7f19e7fff640 1 -- 172.21.15.12:0/4187222902 >> v1:172.21.15.12:6789/0 conn(0x7f19e8150880 legacy=0x7f19e8150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:42.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.852+0000 7f19e6ffd640 1 -- 172.21.15.12:0/4187222902 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1049290838 0 0) 0x7f19e80bc8e0 con 0x7f19e8150880 2023-10-16T23:27:42.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.852+0000 7f19e7fff640 1 -- 172.21.15.12:0/4187222902 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e8147690 con 0x7f19e80c12a0 2023-10-16T23:27:42.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.852+0000 7f19e77fe640 1 --2- 172.21.15.12:0/4187222902 >> v2:172.21.15.31:3300/0 conn(0x7f19e80bbe00 0x7f19e8147150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:27:42.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19e7fff640 1 --2- 172.21.15.12:0/4187222902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19e80c12a0 0x7f19e8146c10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f19e806b1e0 tx=0x7f19d801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2cf88cde3163e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:42.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19e6ffd640 1 -- 172.21.15.12:0/4187222902 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d80ab600 con 0x7f19e80c12a0 2023-10-16T23:27:42.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19e6ffd640 1 -- 172.21.15.12:0/4187222902 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d80a7050 con 0x7f19e80c12a0 2023-10-16T23:27:42.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19e6ffd640 1 -- 172.21.15.12:0/4187222902 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d80ab980 con 0x7f19e80c12a0 2023-10-16T23:27:42.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19ee9ae640 1 -- 172.21.15.12:0/4187222902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19e80c12a0 msgr2=0x7f19e8146c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:42.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19ee9ae640 1 --2- 172.21.15.12:0/4187222902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19e80c12a0 0x7f19e8146c10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f19e806b1e0 tx=0x7f19d801c460 comp rx=0 tx=0).stop 2023-10-16T23:27:42.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19ee9ae640 1 -- 172.21.15.12:0/4187222902 shutdown_connections 2023-10-16T23:27:42.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19ee9ae640 1 --2- 172.21.15.12:0/4187222902 >> v2:172.21.15.31:3300/0 conn(0x7f19e80bbe00 0x7f19e8147150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:42.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19ee9ae640 1 --2- 172.21.15.12:0/4187222902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19e80c12a0 0x7f19e8146c10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:42.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19ee9ae640 1 -- 172.21.15.12:0/4187222902 >> 172.21.15.12:0/4187222902 conn(0x7f19e806bb10 msgr2=0x7f19e80c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:42.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19ee9ae640 1 -- 172.21.15.12:0/4187222902 shutdown_connections 2023-10-16T23:27:42.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19ee9ae640 1 -- 172.21.15.12:0/4187222902 wait complete. 2023-10-16T23:27:42.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19ee9ae640 1 Processor -- start 2023-10-16T23:27:42.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19ee9ae640 1 -- start start 2023-10-16T23:27:42.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19ee9ae640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e80bbe00 0x7f19e80bd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:42.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19ee9ae640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19e80c12a0 0x7f19e8156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:42.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19ee9ae640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19e8150880 0x7f19e814e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:42.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19ee9ae640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e813aee0 con 0x7f19e80c12a0 2023-10-16T23:27:42.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19ee9ae640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e80bdb90 con 0x7f19e80bbe00 2023-10-16T23:27:42.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19ee9ae640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e81567f0 con 0x7f19e8150880 2023-10-16T23:27:42.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19e77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19e80c12a0 0x7f19e8156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:42.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19e77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19e80c12a0 0x7f19e8156ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40804/0 (socket says 172.21.15.12:40804) 2023-10-16T23:27:42.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19e77fe640 1 -- 172.21.15.12:0/2030898387 learned_addr learned my addr 172.21.15.12:0/2030898387 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:42.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19ecf4b640 1 --2- 172.21.15.12:0/2030898387 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19e8150880 0x7f19e814e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:42.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19e7fff640 1 --2- 172.21.15.12:0/2030898387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e80bbe00 0x7f19e80bd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:42.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19e77fe640 1 -- 172.21.15.12:0/2030898387 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19e8150880 msgr2=0x7f19e814e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:42.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19e77fe640 1 --2- 172.21.15.12:0/2030898387 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19e8150880 0x7f19e814e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:42.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19e77fe640 1 -- 172.21.15.12:0/2030898387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e80bbe00 msgr2=0x7f19e80bd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:42.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19e77fe640 1 --2- 172.21.15.12:0/2030898387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e80bbe00 0x7f19e80bd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:42.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19e77fe640 1 -- 172.21.15.12:0/2030898387 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d8009420 con 0x7f19e80c12a0 2023-10-16T23:27:42.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19e7fff640 1 --2- 172.21.15.12:0/2030898387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e80bbe00 0x7f19e80bd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:42.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19e77fe640 1 --2- 172.21.15.12:0/2030898387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19e80c12a0 0x7f19e8156ff0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f19dc00e810 tx=0x7f19dc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:42.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19e4ff9640 1 -- 172.21.15.12:0/2030898387 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc00c8d0 con 0x7f19e80c12a0 2023-10-16T23:27:42.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19e4ff9640 1 -- 172.21.15.12:0/2030898387 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19dc00ca30 con 0x7f19e80c12a0 2023-10-16T23:27:42.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19ee9ae640 1 -- 172.21.15.12:0/2030898387 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e8156ad0 con 0x7f19e80c12a0 2023-10-16T23:27:42.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19e4ff9640 1 -- 172.21.15.12:0/2030898387 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc00cdc0 con 0x7f19e80c12a0 2023-10-16T23:27:42.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.856+0000 7f19ee9ae640 1 -- 172.21.15.12:0/2030898387 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e814b140 con 0x7f19e80c12a0 2023-10-16T23:27:42.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.860+0000 7f19ee9ae640 1 -- 172.21.15.12:0/2030898387 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e8156630 con 0x7f19e80c12a0 2023-10-16T23:27:42.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.860+0000 7f19e4ff9640 1 -- 172.21.15.12:0/2030898387 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f19dc013410 con 0x7f19e80c12a0 2023-10-16T23:27:42.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.860+0000 7f19e4ff9640 1 --2- 172.21.15.12:0/2030898387 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f19d4065e60 0x7f19d4068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:42.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.860+0000 7f19e4ff9640 1 -- 172.21.15.12:0/2030898387 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f19dc0835a0 con 0x7f19e80c12a0 2023-10-16T23:27:42.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.860+0000 7f19e7fff640 1 --2- 172.21.15.12:0/2030898387 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f19d4065e60 0x7f19d4068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:42.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.860+0000 7f19e7fff640 1 --2- 172.21.15.12:0/2030898387 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f19d4065e60 0x7f19d4068320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f19d80ad000 tx=0x7f19d8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:42.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:42.864+0000 7f19e4ff9640 1 -- 172.21.15.12:0/2030898387 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f19dc050c80 con 0x7f19e80c12a0 2023-10-16T23:27:43.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.052+0000 7f19ee9ae640 1 -- 172.21.15.12:0/2030898387 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f19e8156c60 con 0x7f19e80c12a0 2023-10-16T23:27:43.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.708+0000 7f19e4ff9640 1 -- 172.21.15.12:0/2030898387 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f19dc009480 con 0x7f19e80c12a0 2023-10-16T23:27:43.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.712+0000 7f19ee9ae640 1 -- 172.21.15.12:0/2030898387 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f19d4065e60 msgr2=0x7f19d4068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:43.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.712+0000 7f19ee9ae640 1 --2- 172.21.15.12:0/2030898387 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f19d4065e60 0x7f19d4068320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f19d80ad000 tx=0x7f19d8008040 comp rx=0 tx=0).stop 2023-10-16T23:27:43.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.712+0000 7f19ee9ae640 1 -- 172.21.15.12:0/2030898387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19e80c12a0 msgr2=0x7f19e8156ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:43.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.712+0000 7f19ee9ae640 1 --2- 172.21.15.12:0/2030898387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19e80c12a0 0x7f19e8156ff0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f19dc00e810 tx=0x7f19dc00ecd0 comp rx=0 tx=0).stop 2023-10-16T23:27:43.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.712+0000 7f19ee9ae640 1 -- 172.21.15.12:0/2030898387 shutdown_connections 2023-10-16T23:27:43.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.712+0000 7f19ee9ae640 1 --2- 172.21.15.12:0/2030898387 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f19d4065e60 0x7f19d4068320 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:43.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.712+0000 7f19ee9ae640 1 --2- 172.21.15.12:0/2030898387 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f19e8150880 0x7f19e814e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:43.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.712+0000 7f19ee9ae640 1 --2- 172.21.15.12:0/2030898387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19e80c12a0 0x7f19e8156ff0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:43.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.712+0000 7f19ee9ae640 1 --2- 172.21.15.12:0/2030898387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e80bbe00 0x7f19e80bd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:43.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.712+0000 7f19ee9ae640 1 -- 172.21.15.12:0/2030898387 >> 172.21.15.12:0/2030898387 conn(0x7f19e806bb10 msgr2=0x7f19e80ba0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:43.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.712+0000 7f19ee9ae640 1 -- 172.21.15.12:0/2030898387 shutdown_connections 2023-10-16T23:27:43.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.712+0000 7f19ee9ae640 1 -- 172.21.15.12:0/2030898387 wait complete. 2023-10-16T23:27:43.733 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-16T23:27:43.734 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T23:27:43.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.848+0000 7f7719b6f640 1 Processor -- start 2023-10-16T23:27:43.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.848+0000 7f7719b6f640 1 -- start start 2023-10-16T23:27:43.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.848+0000 7f7719b6f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f77140c1130 0x7f77140b8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:43.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.848+0000 7f7719b6f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f771414c520 0x7f771414c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:43.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.848+0000 7f7719b6f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f771414cec0 0x7f77140b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:43.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.848+0000 7f7719b6f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77140b3ca0 con 0x7f77140c1130 2023-10-16T23:27:43.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.848+0000 7f7719b6f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77140b40c0 con 0x7f771414cec0 2023-10-16T23:27:43.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.848+0000 7f7719b6f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77140b7ce0 con 0x7f771414c520 2023-10-16T23:27:43.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.848+0000 7f77137fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f77140c1130 0x7f77140b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:43.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.848+0000 7f77137fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f77140c1130 0x7f77140b8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40806/0 (socket says 172.21.15.12:40806) 2023-10-16T23:27:43.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.848+0000 7f77137fe640 1 -- 172.21.15.12:0/3465237017 learned_addr learned my addr 172.21.15.12:0/3465237017 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:43.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.852+0000 7f7712ffd640 1 --2- 172.21.15.12:0/3465237017 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f771414c520 0x7f771414c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:43.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.852+0000 7f7713fff640 1 --2- 172.21.15.12:0/3465237017 >> v2:172.21.15.31:3300/0 conn(0x7f771414cec0 0x7f77140b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:43.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.852+0000 7f77137fe640 1 -- 172.21.15.12:0/3465237017 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f771414c520 msgr2=0x7f771414c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:43.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.852+0000 7f77137fe640 1 --2- 172.21.15.12:0/3465237017 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f771414c520 0x7f771414c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:43.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.852+0000 7f77137fe640 1 -- 172.21.15.12:0/3465237017 >> v2:172.21.15.31:3300/0 conn(0x7f771414cec0 msgr2=0x7f77140b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:43.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.852+0000 7f77137fe640 1 --2- 172.21.15.12:0/3465237017 >> v2:172.21.15.31:3300/0 conn(0x7f771414cec0 0x7f77140b9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:43.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.852+0000 7f77137fe640 1 -- 172.21.15.12:0/3465237017 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77140c1510 con 0x7f77140c1130 2023-10-16T23:27:43.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.852+0000 7f7712ffd640 1 --2- 172.21.15.12:0/3465237017 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f771414c520 0x7f771414c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:43.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.852+0000 7f7713fff640 1 --2- 172.21.15.12:0/3465237017 >> v2:172.21.15.31:3300/0 conn(0x7f771414cec0 0x7f77140b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:43.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.852+0000 7f77137fe640 1 --2- 172.21.15.12:0/3465237017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77140c1130 0x7f77140b8630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f77140b7820 tx=0x7f770801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db56f94ee8baef50 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:43.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.852+0000 7f77127fc640 1 -- 172.21.15.12:0/3465237017 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77080ac620 con 0x7f77140c1130 2023-10-16T23:27:43.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.852+0000 7f77127fc640 1 -- 172.21.15.12:0/3465237017 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77080ac780 con 0x7f77140c1130 2023-10-16T23:27:43.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.852+0000 7f77127fc640 1 -- 172.21.15.12:0/3465237017 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77080acb10 con 0x7f77140c1130 2023-10-16T23:27:43.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.852+0000 7f7719b6f640 1 -- 172.21.15.12:0/3465237017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77140c1130 msgr2=0x7f77140b8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:43.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.852+0000 7f7719b6f640 1 --2- 172.21.15.12:0/3465237017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77140c1130 0x7f77140b8630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f77140b7820 tx=0x7f770801c3e0 comp rx=0 tx=0).stop 2023-10-16T23:27:43.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.852+0000 7f7719b6f640 1 -- 172.21.15.12:0/3465237017 shutdown_connections 2023-10-16T23:27:43.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.852+0000 7f7719b6f640 1 --2- 172.21.15.12:0/3465237017 >> v2:172.21.15.31:3300/0 conn(0x7f771414cec0 0x7f77140b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:43.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.852+0000 7f7719b6f640 1 --2- 172.21.15.12:0/3465237017 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f771414c520 0x7f771414c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:43.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.852+0000 7f7719b6f640 1 --2- 172.21.15.12:0/3465237017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77140c1130 0x7f77140b8630 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:43.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.852+0000 7f7719b6f640 1 -- 172.21.15.12:0/3465237017 >> 172.21.15.12:0/3465237017 conn(0x7f771406ba20 msgr2=0x7f77140c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:43.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.852+0000 7f7719b6f640 1 -- 172.21.15.12:0/3465237017 shutdown_connections 2023-10-16T23:27:43.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.852+0000 7f7719b6f640 1 -- 172.21.15.12:0/3465237017 wait complete. 2023-10-16T23:27:43.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.856+0000 7f7719b6f640 1 Processor -- start 2023-10-16T23:27:43.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.856+0000 7f7719b6f640 1 -- start start 2023-10-16T23:27:43.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.856+0000 7f7719b6f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77140c1130 0x7f77140bb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:43.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.856+0000 7f7719b6f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f771414c520 0x7f77140c0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:43.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.856+0000 7f7719b6f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f771414cec0 0x7f7714144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:43.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.856+0000 7f7719b6f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77140bba80 con 0x7f77140c1130 2023-10-16T23:27:43.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.856+0000 7f7719b6f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7714070010 con 0x7f771414c520 2023-10-16T23:27:43.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.856+0000 7f7719b6f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7714070330 con 0x7f771414cec0 2023-10-16T23:27:43.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.856+0000 7f77137fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77140c1130 0x7f77140bb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:43.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.856+0000 7f77137fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77140c1130 0x7f77140bb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40818/0 (socket says 172.21.15.12:40818) 2023-10-16T23:27:43.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.856+0000 7f77137fe640 1 -- 172.21.15.12:0/287690495 learned_addr learned my addr 172.21.15.12:0/287690495 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:43.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.856+0000 7f7713fff640 1 --2- 172.21.15.12:0/287690495 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f771414cec0 0x7f7714144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:43.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.856+0000 7f7712ffd640 1 --2- 172.21.15.12:0/287690495 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f771414c520 0x7f77140c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:43.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.856+0000 7f77137fe640 1 -- 172.21.15.12:0/287690495 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f771414cec0 msgr2=0x7f7714144bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:43.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.856+0000 7f77137fe640 1 --2- 172.21.15.12:0/287690495 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f771414cec0 0x7f7714144bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:43.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.856+0000 7f77137fe640 1 -- 172.21.15.12:0/287690495 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f771414c520 msgr2=0x7f77140c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:43.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.856+0000 7f77137fe640 1 --2- 172.21.15.12:0/287690495 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f771414c520 0x7f77140c0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:43.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.856+0000 7f77137fe640 1 -- 172.21.15.12:0/287690495 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77080094d0 con 0x7f77140c1130 2023-10-16T23:27:43.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.856+0000 7f7712ffd640 1 --2- 172.21.15.12:0/287690495 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f771414c520 0x7f77140c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:43.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.856+0000 7f77137fe640 1 --2- 172.21.15.12:0/287690495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77140c1130 0x7f77140bb540 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f770801aa90 tx=0x7f7708019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:43.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.856+0000 7f76fbfff640 1 -- 172.21.15.12:0/287690495 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77080b5640 con 0x7f77140c1130 2023-10-16T23:27:43.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.856+0000 7f76fbfff640 1 -- 172.21.15.12:0/287690495 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77080b57a0 con 0x7f77140c1130 2023-10-16T23:27:43.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.856+0000 7f76fbfff640 1 -- 172.21.15.12:0/287690495 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77080b5b50 con 0x7f77140c1130 2023-10-16T23:27:43.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.856+0000 7f7719b6f640 1 -- 172.21.15.12:0/287690495 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f771406e9c0 con 0x7f77140c1130 2023-10-16T23:27:43.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.856+0000 7f7719b6f640 1 -- 172.21.15.12:0/287690495 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f771406ed50 con 0x7f77140c1130 2023-10-16T23:27:43.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.856+0000 7f7719b6f640 1 -- 172.21.15.12:0/287690495 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f771406eee0 con 0x7f77140c1130 2023-10-16T23:27:43.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.860+0000 7f76fbfff640 1 -- 172.21.15.12:0/287690495 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f77080b3070 con 0x7f77140c1130 2023-10-16T23:27:43.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.860+0000 7f76fbfff640 1 --2- 172.21.15.12:0/287690495 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7700065e90 0x7f7700068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:43.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.860+0000 7f76fbfff640 1 -- 172.21.15.12:0/287690495 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f770811d710 con 0x7f77140c1130 2023-10-16T23:27:43.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.860+0000 7f7712ffd640 1 --2- 172.21.15.12:0/287690495 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7700065e90 0x7f7700068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:43.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.860+0000 7f7712ffd640 1 --2- 172.21.15.12:0/287690495 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7700065e90 0x7f7700068350 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f77140beb10 tx=0x7f7704008510 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:43.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:43.864+0000 7f76fbfff640 1 -- 172.21.15.12:0/287690495 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f77080eadf0 con 0x7f77140c1130 2023-10-16T23:27:44.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.044+0000 7f7719b6f640 1 -- 172.21.15.12:0/287690495 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77140b7aa0 con 0x7f77140c1130 2023-10-16T23:27:44.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.044+0000 7f76fbfff640 1 -- 172.21.15.12:0/287690495 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3127 (secure 0 0 0) 0x7f77080b1c50 con 0x7f77140c1130 2023-10-16T23:27:44.048 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:44.048 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3365013557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3365013557},{"type":"v1","addr":"172.21.15.31:6835","nonce":3365013557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T23:27:40.686789+0000","modified":"2023-10-16T23:27:43.696789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6833/593938276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":593938276},{"type":"v1","addr":"172.21.15.12:6833","nonce":593938276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T23:27:44.049 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2023-10-16T23:27:44.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.044+0000 7f7719b6f640 1 -- 172.21.15.12:0/287690495 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7700065e90 msgr2=0x7f7700068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:44.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.044+0000 7f7719b6f640 1 --2- 172.21.15.12:0/287690495 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7700065e90 0x7f7700068350 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f77140beb10 tx=0x7f7704008510 comp rx=0 tx=0).stop 2023-10-16T23:27:44.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.044+0000 7f7719b6f640 1 -- 172.21.15.12:0/287690495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77140c1130 msgr2=0x7f77140bb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:44.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.044+0000 7f7719b6f640 1 --2- 172.21.15.12:0/287690495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77140c1130 0x7f77140bb540 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f770801aa90 tx=0x7f7708019180 comp rx=0 tx=0).stop 2023-10-16T23:27:44.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.044+0000 7f7719b6f640 1 -- 172.21.15.12:0/287690495 shutdown_connections 2023-10-16T23:27:44.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.044+0000 7f7719b6f640 1 --2- 172.21.15.12:0/287690495 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7700065e90 0x7f7700068350 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.044+0000 7f7719b6f640 1 --2- 172.21.15.12:0/287690495 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f771414cec0 0x7f7714144bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.044+0000 7f7719b6f640 1 --2- 172.21.15.12:0/287690495 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f771414c520 0x7f77140c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.044+0000 7f7719b6f640 1 --2- 172.21.15.12:0/287690495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77140c1130 0x7f77140bb540 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.044+0000 7f7719b6f640 1 -- 172.21.15.12:0/287690495 >> 172.21.15.12:0/287690495 conn(0x7f771406ba20 msgr2=0x7f771414ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:44.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.044+0000 7f7719b6f640 1 -- 172.21.15.12:0/287690495 shutdown_connections 2023-10-16T23:27:44.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.048+0000 7f7719b6f640 1 -- 172.21.15.12:0/287690495 wait complete. 2023-10-16T23:27:44.065 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T23:27:44.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.172+0000 7f608659b640 1 Processor -- start 2023-10-16T23:27:44.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.172+0000 7f608659b640 1 -- start start 2023-10-16T23:27:44.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.172+0000 7f608659b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f608006ebc0 0x7f608014c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.172+0000 7f608659b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f608014c760 0x7f608014ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.172+0000 7f608659b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60800bae10 con 0x7f608014eff0 2023-10-16T23:27:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.172+0000 7f608659b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60800b7710 con 0x7f608006ebc0 2023-10-16T23:27:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.172+0000 7f608659b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608014fb20 con 0x7f608014c760 2023-10-16T23:27:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.172+0000 7f607f7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f608006ebc0 0x7f608014c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.172+0000 7f607f7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f608006ebc0 0x7f608014c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40828/0 (socket says 172.21.15.12:40828) 2023-10-16T23:27:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.172+0000 7f607f7fe640 1 -- 172.21.15.12:0/1049587402 learned_addr learned my addr 172.21.15.12:0/1049587402 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.172+0000 7f6084b38640 1 --2- 172.21.15.12:0/1049587402 >> v2:172.21.15.31:3300/0 conn(0x7f608014c760 0x7f608014ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.172+0000 7f607f7fe640 1 -- 172.21.15.12:0/1049587402 >> v2:172.21.15.31:3300/0 conn(0x7f608014c760 msgr2=0x7f608014ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:44.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.172+0000 7f607f7fe640 1 --2- 172.21.15.12:0/1049587402 >> v2:172.21.15.31:3300/0 conn(0x7f608014c760 0x7f608014ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.172+0000 7f607f7fe640 1 -- 172.21.15.12:0/1049587402 >> v1:172.21.15.31:6789/0 conn(0x7f608014eff0 legacy=0x7f6080070b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:44.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.172+0000 7f607f7fe640 1 -- 172.21.15.12:0/1049587402 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60800b4000 con 0x7f608006ebc0 2023-10-16T23:27:44.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.176+0000 7f607f7fe640 1 --2- 172.21.15.12:0/1049587402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f608006ebc0 0x7f608014c220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6080071800 tx=0x7f607001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c8dafc941eda7c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:44.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.176+0000 7f607effd640 1 -- 172.21.15.12:0/1049587402 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60700ab600 con 0x7f608006ebc0 2023-10-16T23:27:44.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.176+0000 7f607effd640 1 -- 172.21.15.12:0/1049587402 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60700a7050 con 0x7f608006ebc0 2023-10-16T23:27:44.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.176+0000 7f607effd640 1 -- 172.21.15.12:0/1049587402 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60700ab980 con 0x7f608006ebc0 2023-10-16T23:27:44.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.176+0000 7f608659b640 1 -- 172.21.15.12:0/1049587402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f608006ebc0 msgr2=0x7f608014c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:44.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.176+0000 7f608659b640 1 --2- 172.21.15.12:0/1049587402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f608006ebc0 0x7f608014c220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6080071800 tx=0x7f607001c370 comp rx=0 tx=0).stop 2023-10-16T23:27:44.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.176+0000 7f608659b640 1 -- 172.21.15.12:0/1049587402 shutdown_connections 2023-10-16T23:27:44.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.176+0000 7f608659b640 1 --2- 172.21.15.12:0/1049587402 >> v2:172.21.15.31:3300/0 conn(0x7f608014c760 0x7f608014ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.176+0000 7f608659b640 1 --2- 172.21.15.12:0/1049587402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f608006ebc0 0x7f608014c220 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.176+0000 7f608659b640 1 -- 172.21.15.12:0/1049587402 >> 172.21.15.12:0/1049587402 conn(0x7f608006ba20 msgr2=0x7f60800c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:44.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.176+0000 7f608659b640 1 -- 172.21.15.12:0/1049587402 shutdown_connections 2023-10-16T23:27:44.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.176+0000 7f608659b640 1 -- 172.21.15.12:0/1049587402 wait complete. 2023-10-16T23:27:44.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.176+0000 7f608659b640 1 Processor -- start 2023-10-16T23:27:44.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.176+0000 7f608659b640 1 -- start start 2023-10-16T23:27:44.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f608659b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f608006ebc0 0x7f6080144890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:44.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f608659b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f608014c760 0x7f6080140e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:44.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f608659b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f608014eff0 0x7f6080141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:44.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f608659b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60800b54a0 con 0x7f608006ebc0 2023-10-16T23:27:44.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f608659b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6080146410 con 0x7f608014c760 2023-10-16T23:27:44.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f608659b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6080144dd0 con 0x7f608014eff0 2023-10-16T23:27:44.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f607ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f608006ebc0 0x7f6080144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:44.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f607ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f608006ebc0 0x7f6080144890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40830/0 (socket says 172.21.15.12:40830) 2023-10-16T23:27:44.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f607ffff640 1 -- 172.21.15.12:0/3754658951 learned_addr learned my addr 172.21.15.12:0/3754658951 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:44.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f6084b38640 1 --2- 172.21.15.12:0/3754658951 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f608014eff0 0x7f6080141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:44.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f607ffff640 1 -- 172.21.15.12:0/3754658951 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f608014eff0 msgr2=0x7f6080141360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:44.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f607f7fe640 1 --2- 172.21.15.12:0/3754658951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f608014c760 0x7f6080140e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:44.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f607ffff640 1 --2- 172.21.15.12:0/3754658951 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f608014eff0 0x7f6080141360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f607ffff640 1 -- 172.21.15.12:0/3754658951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f608014c760 msgr2=0x7f6080140e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:44.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f607ffff640 1 --2- 172.21.15.12:0/3754658951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f608014c760 0x7f6080140e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f607ffff640 1 -- 172.21.15.12:0/3754658951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60700094d0 con 0x7f608006ebc0 2023-10-16T23:27:44.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f607ffff640 1 --2- 172.21.15.12:0/3754658951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f608006ebc0 0x7f6080144890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f607400b410 tx=0x7f607400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:44.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f607cff9640 1 -- 172.21.15.12:0/3754658951 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074004020 con 0x7f608006ebc0 2023-10-16T23:27:44.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f607cff9640 1 -- 172.21.15.12:0/3754658951 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6074004180 con 0x7f608006ebc0 2023-10-16T23:27:44.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f608659b640 1 -- 172.21.15.12:0/3754658951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6080147920 con 0x7f608006ebc0 2023-10-16T23:27:44.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f607cff9640 1 -- 172.21.15.12:0/3754658951 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074011630 con 0x7f608006ebc0 2023-10-16T23:27:44.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f608659b640 1 -- 172.21.15.12:0/3754658951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60801475d0 con 0x7f608006ebc0 2023-10-16T23:27:44.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f608659b640 1 -- 172.21.15.12:0/3754658951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60800673a0 con 0x7f608006ebc0 2023-10-16T23:27:44.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f607cff9640 1 -- 172.21.15.12:0/3754658951 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f6074011790 con 0x7f608006ebc0 2023-10-16T23:27:44.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f607cff9640 1 --2- 172.21.15.12:0/3754658951 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f606c065e60 0x7f606c068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:44.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f607cff9640 1 -- 172.21.15.12:0/3754658951 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6074083510 con 0x7f608006ebc0 2023-10-16T23:27:44.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f607f7fe640 1 --2- 172.21.15.12:0/3754658951 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f606c065e60 0x7f606c068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:44.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.180+0000 7f607f7fe640 1 --2- 172.21.15.12:0/3754658951 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f606c065e60 0x7f606c068320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f60700ad000 tx=0x7f60700a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:44.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.184+0000 7f607cff9640 1 -- 172.21.15.12:0/3754658951 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f6074050bf0 con 0x7f608006ebc0 2023-10-16T23:27:44.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.340+0000 7f608659b640 1 -- 172.21.15.12:0/3754658951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6080145540 con 0x7f608006ebc0 2023-10-16T23:27:44.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.344+0000 7f607cff9640 1 -- 172.21.15.12:0/3754658951 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17763 (secure 0 0 0) 0x7f6074054210 con 0x7f608006ebc0 2023-10-16T23:27:44.354 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:44.354 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"fsid":"0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51","created":"2023-10-16T23:27:16.468087+0000","modified":"2023-10-16T23:27:41.690088+0000","last_up_change":"2023-10-16T23:27:28.136202+0000","last_in_change":"2023-10-16T23:27:18.793212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T23:27:27.354025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-16T23:27:34.786446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-16T23:27:39.130341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-16T23:27:39.674572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73e70f98-6f5e-4464-b34e-931faac41cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":38075},{"type":"v1","addr":"172.21.15.12:6814","nonce":38075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":38075},{"type":"v1","addr":"172.21.15.12:6819","nonce":38075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":38075},{"type":"v1","addr":"172.21.15.12:6827","nonce":38075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":38075},{"type":"v1","addr":"172.21.15.12:6823","nonce":38075}]},"public_addr":"172.21.15.12:6814/38075","cluster_addr":"172.21.15.12:6819/38075","heartbeat_back_addr":"172.21.15.12:6827/38075","heartbeat_front_addr":"172.21.15.12:6823/38075","state":["exists","up"]},{"osd":1,"uuid":"ff722efe-b3f9-4cc0-bbde-f4d4d8055a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":38076},{"type":"v1","addr":"172.21.15.12:6811","nonce":38076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":38076},{"type":"v1","addr":"172.21.15.12:6818","nonce":38076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":38076},{"type":"v1","addr":"172.21.15.12:6831","nonce":38076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":38076},{"type":"v1","addr":"172.21.15.12:6825","nonce":38076}]},"public_addr":"172.21.15.12:6811/38076","cluster_addr":"172.21.15.12:6818/38076","heartbeat_back_addr":"172.21.15.12:6831/38076","heartbeat_front_addr":"172.21.15.12:6825/38076","state":["exists","up"]},{"osd":2,"uuid":"9baf25db-dce0-4065-90d6-f35867286be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6809","nonce":38073},{"type":"v1","addr":"172.21.15.12:6810","nonce":38073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":38073},{"type":"v1","addr":"172.21.15.12:6817","nonce":38073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":38073},{"type":"v1","addr":"172.21.15.12:6830","nonce":38073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":38073},{"type":"v1","addr":"172.21.15.12:6826","nonce":38073}]},"public_addr":"172.21.15.12:6810/38073","cluster_addr":"172.21.15.12:6817/38073","heartbeat_back_addr":"172.21.15.12:6830/38073","heartbeat_front_addr":"172.21.15.12:6826/38073","state":["exists","up"]},{"osd":3,"uuid":"8a620ad3-2294-470d-8a8c-66f177f5fbe7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":38074},{"type":"v1","addr":"172.21.15.12:6801","nonce":38074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":38074},{"type":"v1","addr":"172.21.15.12:6803","nonce":38074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":38074},{"type":"v1","addr":"172.21.15.12:6807","nonce":38074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":38074},{"type":"v1","addr":"172.21.15.12:6805","nonce":38074}]},"public_addr":"172.21.15.12:6801/38074","cluster_addr":"172.21.15.12:6803/38074","heartbeat_back_addr":"172.21.15.12:6807/38074","heartbeat_front_addr":"172.21.15.12:6805/38074","state":["exists","up"]},{"osd":4,"uuid":"a8824d77-7405-40f5-9234-60889802b184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":38266},{"type":"v1","addr":"172.21.15.31:6817","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":38266},{"type":"v1","addr":"172.21.15.31:6819","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":38266},{"type":"v1","addr":"172.21.15.31:6823","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":38266},{"type":"v1","addr":"172.21.15.31:6821","nonce":38266}]},"public_addr":"172.21.15.31:6817/38266","cluster_addr":"172.21.15.31:6819/38266","heartbeat_back_addr":"172.21.15.31:6823/38266","heartbeat_front_addr":"172.21.15.31:6821/38266","state":["exists","up"]},{"osd":5,"uuid":"3bb01192-a47c-48e9-9662-285e3f6f4b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":38264},{"type":"v1","addr":"172.21.15.31:6807","nonce":38264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":38264},{"type":"v1","addr":"172.21.15.31:6811","nonce":38264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":38264},{"type":"v1","addr":"172.21.15.31:6815","nonce":38264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":38264},{"type":"v1","addr":"172.21.15.31:6813","nonce":38264}]},"public_addr":"172.21.15.31:6807/38264","cluster_addr":"172.21.15.31:6811/38264","heartbeat_back_addr":"172.21.15.31:6815/38264","heartbeat_front_addr":"172.21.15.31:6813/38264","state":["exists","up"]},{"osd":6,"uuid":"1e2d18e4-73e6-4a37-826c-35eca4d96935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":38263},{"type":"v1","addr":"172.21.15.31:6825","nonce":38263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":38263},{"type":"v1","addr":"172.21.15.31:6827","nonce":38263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":38263},{"type":"v1","addr":"172.21.15.31:6831","nonce":38263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":38263},{"type":"v1","addr":"172.21.15.31:6829","nonce":38263}]},"public_addr":"172.21.15.31:6825/38263","cluster_addr":"172.21.15.31:6827/38263","heartbeat_back_addr":"172.21.15.31:6831/38263","heartbeat_front_addr":"172.21.15.31:6829/38263","state":["exists","up"]},{"osd":7,"uuid":"e0f369c0-562b-4440-a5aa-12275c29412b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":38265},{"type":"v1","addr":"172.21.15.31:6801","nonce":38265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":38265},{"type":"v1","addr":"172.21.15.31:6803","nonce":38265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":38265},{"type":"v1","addr":"172.21.15.31:6810","nonce":38265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":38265},{"type":"v1","addr":"172.21.15.31:6806","nonce":38265}]},"public_addr":"172.21.15.31:6801/38265","cluster_addr":"172.21.15.31:6803/38265","heartbeat_back_addr":"172.21.15.31:6810/38265","heartbeat_front_addr":"172.21.15.31:6806/38265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.411815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.372565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.209700+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.414619+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.316843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.300348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.359800+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.219854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T23:27:44.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.344+0000 7f608659b640 1 -- 172.21.15.12:0/3754658951 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f606c065e60 msgr2=0x7f606c068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:44.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.344+0000 7f608659b640 1 --2- 172.21.15.12:0/3754658951 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f606c065e60 0x7f606c068320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f60700ad000 tx=0x7f60700a6000 comp rx=0 tx=0).stop 2023-10-16T23:27:44.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.344+0000 7f608659b640 1 -- 172.21.15.12:0/3754658951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f608006ebc0 msgr2=0x7f6080144890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:44.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.344+0000 7f608659b640 1 --2- 172.21.15.12:0/3754658951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f608006ebc0 0x7f6080144890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f607400b410 tx=0x7f607400b8d0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.344+0000 7f608659b640 1 -- 172.21.15.12:0/3754658951 shutdown_connections 2023-10-16T23:27:44.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.344+0000 7f608659b640 1 --2- 172.21.15.12:0/3754658951 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f606c065e60 0x7f606c068320 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.344+0000 7f608659b640 1 --2- 172.21.15.12:0/3754658951 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f608014eff0 0x7f6080141360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.344+0000 7f608659b640 1 --2- 172.21.15.12:0/3754658951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f608014c760 0x7f6080140e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.344+0000 7f608659b640 1 --2- 172.21.15.12:0/3754658951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f608006ebc0 0x7f6080144890 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.344+0000 7f608659b640 1 -- 172.21.15.12:0/3754658951 >> 172.21.15.12:0/3754658951 conn(0x7f608006ba20 msgr2=0x7f608006f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:44.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.344+0000 7f608659b640 1 -- 172.21.15.12:0/3754658951 shutdown_connections 2023-10-16T23:27:44.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.344+0000 7f608659b640 1 -- 172.21.15.12:0/3754658951 wait complete. 2023-10-16T23:27:44.365 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-16T23:27:44.365 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T23:27:44.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.472+0000 7f3de5330640 1 Processor -- start 2023-10-16T23:27:44.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.476+0000 7f3de5330640 1 -- start start 2023-10-16T23:27:44.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.476+0000 7f3de5330640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3de00715f0 0x7f3de006c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:44.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.476+0000 7f3de5330640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3de006b400 0x7f3de0159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:44.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.476+0000 7f3de5330640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de006cde0 con 0x7f3de0150070 2023-10-16T23:27:44.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.476+0000 7f3de5330640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de00bf910 con 0x7f3de00715f0 2023-10-16T23:27:44.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.476+0000 7f3de5330640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de00c03b0 con 0x7f3de006b400 2023-10-16T23:27:44.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.476+0000 7f3dde7fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3de00715f0 0x7f3de006c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:44.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.476+0000 7f3dde7fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3de00715f0 0x7f3de006c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40836/0 (socket says 172.21.15.12:40836) 2023-10-16T23:27:44.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.476+0000 7f3dde7fc640 1 -- 172.21.15.12:0/398255365 learned_addr learned my addr 172.21.15.12:0/398255365 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:44.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.476+0000 7f3ddf7fe640 1 --2- 172.21.15.12:0/398255365 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3de006b400 0x7f3de0159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:44.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.476+0000 7f3dde7fc640 1 -- 172.21.15.12:0/398255365 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3de006b400 msgr2=0x7f3de0159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:44.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.476+0000 7f3dde7fc640 1 --2- 172.21.15.12:0/398255365 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3de006b400 0x7f3de0159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.476+0000 7f3dde7fc640 1 -- 172.21.15.12:0/398255365 >> v1:172.21.15.31:6789/0 conn(0x7f3de0150070 legacy=0x7f3de00beae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:44.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.476+0000 7f3dde7fc640 1 -- 172.21.15.12:0/398255365 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de00bfb20 con 0x7f3de00715f0 2023-10-16T23:27:44.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.476+0000 7f3dde7fc640 1 --2- 172.21.15.12:0/398255365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3de00715f0 0x7f3de006c8a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4009870 tx=0x7f3dd401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e634a7ab7ef2c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:44.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.476+0000 7f3dddffb640 1 -- 172.21.15.12:0/398255365 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd40ab600 con 0x7f3de00715f0 2023-10-16T23:27:44.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.476+0000 7f3dddffb640 1 -- 172.21.15.12:0/398255365 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd40a7050 con 0x7f3de00715f0 2023-10-16T23:27:44.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.476+0000 7f3dddffb640 1 -- 172.21.15.12:0/398255365 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd40ab980 con 0x7f3de00715f0 2023-10-16T23:27:44.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3de5330640 1 -- 172.21.15.12:0/398255365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3de00715f0 msgr2=0x7f3de006c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:44.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3de5330640 1 --2- 172.21.15.12:0/398255365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3de00715f0 0x7f3de006c8a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4009870 tx=0x7f3dd401c470 comp rx=0 tx=0).stop 2023-10-16T23:27:44.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3de5330640 1 -- 172.21.15.12:0/398255365 shutdown_connections 2023-10-16T23:27:44.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3de5330640 1 --2- 172.21.15.12:0/398255365 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3de006b400 0x7f3de0159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3de5330640 1 --2- 172.21.15.12:0/398255365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3de00715f0 0x7f3de006c8a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3de5330640 1 -- 172.21.15.12:0/398255365 >> 172.21.15.12:0/398255365 conn(0x7f3de00a3f20 msgr2=0x7f3de00c1880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:44.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3de5330640 1 -- 172.21.15.12:0/398255365 shutdown_connections 2023-10-16T23:27:44.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3de5330640 1 -- 172.21.15.12:0/398255365 wait complete. 2023-10-16T23:27:44.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3de5330640 1 Processor -- start 2023-10-16T23:27:44.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3de5330640 1 -- start start 2023-10-16T23:27:44.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3de5330640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3de006b400 0x7f3de00bd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:44.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3de5330640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3de0150070 0x7f3de0149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:44.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3de5330640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3de00bb470 0x7f3de014a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:44.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3de5330640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de00bcb80 con 0x7f3de006b400 2023-10-16T23:27:44.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3de5330640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de00bce60 con 0x7f3de0150070 2023-10-16T23:27:44.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3de5330640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de014b980 con 0x7f3de00bb470 2023-10-16T23:27:44.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3ddeffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3de006b400 0x7f3de00bd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:44.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3ddeffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3de006b400 0x7f3de00bd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40850/0 (socket says 172.21.15.12:40850) 2023-10-16T23:27:44.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3ddeffd640 1 -- 172.21.15.12:0/1832004613 learned_addr learned my addr 172.21.15.12:0/1832004613 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:44.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3ddf7fe640 1 --2- 172.21.15.12:0/1832004613 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3de00bb470 0x7f3de014a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:44.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3dde7fc640 1 --2- 172.21.15.12:0/1832004613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3de0150070 0x7f3de0149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:44.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3ddeffd640 1 -- 172.21.15.12:0/1832004613 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3de00bb470 msgr2=0x7f3de014a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:44.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3ddeffd640 1 --2- 172.21.15.12:0/1832004613 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3de00bb470 0x7f3de014a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3ddeffd640 1 -- 172.21.15.12:0/1832004613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3de0150070 msgr2=0x7f3de0149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:44.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3ddeffd640 1 --2- 172.21.15.12:0/1832004613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3de0150070 0x7f3de0149fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3ddeffd640 1 -- 172.21.15.12:0/1832004613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd40094d0 con 0x7f3de006b400 2023-10-16T23:27:44.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3ddf7fe640 1 --2- 172.21.15.12:0/1832004613 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3de00bb470 0x7f3de014a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:44.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3ddeffd640 1 --2- 172.21.15.12:0/1832004613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3de006b400 0x7f3de00bd580 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000b410 tx=0x7f3dd000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:44.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3dc77fe640 1 -- 172.21.15.12:0/1832004613 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0004020 con 0x7f3de006b400 2023-10-16T23:27:44.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3dc77fe640 1 -- 172.21.15.12:0/1832004613 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd0004180 con 0x7f3de006b400 2023-10-16T23:27:44.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3de5330640 1 -- 172.21.15.12:0/1832004613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de00bdac0 con 0x7f3de006b400 2023-10-16T23:27:44.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3dc77fe640 1 -- 172.21.15.12:0/1832004613 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0011630 con 0x7f3de006b400 2023-10-16T23:27:44.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3de5330640 1 -- 172.21.15.12:0/1832004613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de014aa50 con 0x7f3de006b400 2023-10-16T23:27:44.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.480+0000 7f3de5330640 1 -- 172.21.15.12:0/1832004613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de00a1270 con 0x7f3de006b400 2023-10-16T23:27:44.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.484+0000 7f3dc77fe640 1 -- 172.21.15.12:0/1832004613 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f3dd0011790 con 0x7f3de006b400 2023-10-16T23:27:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.484+0000 7f3dc77fe640 1 --2- 172.21.15.12:0/1832004613 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3dcc065e90 0x7f3dcc068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.484+0000 7f3dc77fe640 1 -- 172.21.15.12:0/1832004613 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3dd00834c0 con 0x7f3de006b400 2023-10-16T23:27:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.484+0000 7f3dde7fc640 1 --2- 172.21.15.12:0/1832004613 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3dcc065e90 0x7f3dcc068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.484+0000 7f3dde7fc640 1 --2- 172.21.15.12:0/1832004613 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3dcc065e90 0x7f3dcc068350 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3de00bf340 tx=0x7f3dd4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.488+0000 7f3dc77fe640 1 -- 172.21.15.12:0/1832004613 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f3dd0050ba0 con 0x7f3de006b400 2023-10-16T23:27:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.640+0000 7f3de5330640 1 -- 172.21.15.12:0/1832004613 --> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3de00bcfd0 con 0x7f3dcc065e90 2023-10-16T23:27:44.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.660+0000 7f3dc77fe640 1 -- 172.21.15.12:0/1832004613 <== mgr.4108 v2:172.21.15.31:6832/37949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274588 (secure 0 0 0) 0x7f3de00bcfd0 con 0x7f3dcc065e90 2023-10-16T23:27:44.668 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:44.670 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-16T23:27:44.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.664+0000 7f3de5330640 1 -- 172.21.15.12:0/1832004613 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3dcc065e90 msgr2=0x7f3dcc068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:44.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.664+0000 7f3de5330640 1 --2- 172.21.15.12:0/1832004613 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3dcc065e90 0x7f3dcc068350 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3de00bf340 tx=0x7f3dd4008040 comp rx=0 tx=0).stop 2023-10-16T23:27:44.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.664+0000 7f3de5330640 1 -- 172.21.15.12:0/1832004613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3de006b400 msgr2=0x7f3de00bd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:44.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.664+0000 7f3de5330640 1 --2- 172.21.15.12:0/1832004613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3de006b400 0x7f3de00bd580 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000b410 tx=0x7f3dd000b8d0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.664+0000 7f3de5330640 1 -- 172.21.15.12:0/1832004613 shutdown_connections 2023-10-16T23:27:44.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.664+0000 7f3de5330640 1 --2- 172.21.15.12:0/1832004613 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3dcc065e90 0x7f3dcc068350 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.664+0000 7f3de5330640 1 --2- 172.21.15.12:0/1832004613 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3de00bb470 0x7f3de014a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.664+0000 7f3de5330640 1 --2- 172.21.15.12:0/1832004613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3de0150070 0x7f3de0149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.664+0000 7f3de5330640 1 --2- 172.21.15.12:0/1832004613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3de006b400 0x7f3de00bd580 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.664+0000 7f3de5330640 1 -- 172.21.15.12:0/1832004613 >> 172.21.15.12:0/1832004613 conn(0x7f3de00a3f20 msgr2=0x7f3de006fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:44.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.664+0000 7f3de5330640 1 -- 172.21.15.12:0/1832004613 shutdown_connections 2023-10-16T23:27:44.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.664+0000 7f3de5330640 1 -- 172.21.15.12:0/1832004613 wait complete. 2023-10-16T23:27:44.685 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-16T23:27:43.284319+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":222496,"kb_used_data":2784,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754752224,"statfs":{"total":773094113280,"available":772866277376,"internally_reserved":0,"allocated":2850816,"data_stored":1730788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001263"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.731840+0000","last_change":"2023-10-16T23:27:40.706600+0000","last_active":"2023-10-16T23:27:40.731840+0000","last_peered":"2023-10-16T23:27:40.731840+0000","last_clean":"2023-10-16T23:27:40.731840+0000","last_became_active":"2023-10-16T23:27:40.706320+0000","last_became_peered":"2023-10-16T23:27:40.706320+0000","last_unstale":"2023-10-16T23:27:40.731840+0000","last_undegraded":"2023-10-16T23:27:40.731840+0000","last_fullsized":"2023-10-16T23:27:40.731840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:48:20.356964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.768298+0000","last_change":"2023-10-16T23:27:40.762253+0000","last_active":"2023-10-16T23:27:40.768298+0000","last_peered":"2023-10-16T23:27:40.768298+0000","last_clean":"2023-10-16T23:27:40.768298+0000","last_became_active":"2023-10-16T23:27:40.760726+0000","last_became_peered":"2023-10-16T23:27:40.760726+0000","last_unstale":"2023-10-16T23:27:40.768298+0000","last_undegraded":"2023-10-16T23:27:40.768298+0000","last_fullsized":"2023-10-16T23:27:40.768298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:50:08.569961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.732838+0000","last_change":"2023-10-16T23:27:40.724453+0000","last_active":"2023-10-16T23:27:40.732838+0000","last_peered":"2023-10-16T23:27:40.732838+0000","last_clean":"2023-10-16T23:27:40.732838+0000","last_became_active":"2023-10-16T23:27:40.724099+0000","last_became_peered":"2023-10-16T23:27:40.724099+0000","last_unstale":"2023-10-16T23:27:40.732838+0000","last_undegraded":"2023-10-16T23:27:40.732838+0000","last_fullsized":"2023-10-16T23:27:40.732838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:01:05.350517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.727237+0000","last_change":"2023-10-16T23:27:40.704484+0000","last_active":"2023-10-16T23:27:40.727237+0000","last_peered":"2023-10-16T23:27:40.727237+0000","last_clean":"2023-10-16T23:27:40.727237+0000","last_became_active":"2023-10-16T23:27:40.704162+0000","last_became_peered":"2023-10-16T23:27:40.704162+0000","last_unstale":"2023-10-16T23:27:40.727237+0000","last_undegraded":"2023-10-16T23:27:40.727237+0000","last_fullsized":"2023-10-16T23:27:40.727237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:15:16.646850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.768324+0000","last_change":"2023-10-16T23:27:40.762529+0000","last_active":"2023-10-16T23:27:40.768324+0000","last_peered":"2023-10-16T23:27:40.768324+0000","last_clean":"2023-10-16T23:27:40.768324+0000","last_became_active":"2023-10-16T23:27:40.761570+0000","last_became_peered":"2023-10-16T23:27:40.761570+0000","last_unstale":"2023-10-16T23:27:40.768324+0000","last_undegraded":"2023-10-16T23:27:40.768324+0000","last_fullsized":"2023-10-16T23:27:40.768324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:46.449264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.738111+0000","last_change":"2023-10-16T23:27:40.728920+0000","last_active":"2023-10-16T23:27:40.738111+0000","last_peered":"2023-10-16T23:27:40.738111+0000","last_clean":"2023-10-16T23:27:40.738111+0000","last_became_active":"2023-10-16T23:27:40.728298+0000","last_became_peered":"2023-10-16T23:27:40.728298+0000","last_unstale":"2023-10-16T23:27:40.738111+0000","last_undegraded":"2023-10-16T23:27:40.738111+0000","last_fullsized":"2023-10-16T23:27:40.738111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:28:33.509782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.768568+0000","last_change":"2023-10-16T23:27:40.761480+0000","last_active":"2023-10-16T23:27:40.768568+0000","last_peered":"2023-10-16T23:27:40.768568+0000","last_clean":"2023-10-16T23:27:40.768568+0000","last_became_active":"2023-10-16T23:27:40.760882+0000","last_became_peered":"2023-10-16T23:27:40.760882+0000","last_unstale":"2023-10-16T23:27:40.768568+0000","last_undegraded":"2023-10-16T23:27:40.768568+0000","last_fullsized":"2023-10-16T23:27:40.768568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:37:38.843931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.767849+0000","last_change":"2023-10-16T23:27:40.761323+0000","last_active":"2023-10-16T23:27:40.767849+0000","last_peered":"2023-10-16T23:27:40.767849+0000","last_clean":"2023-10-16T23:27:40.767849+0000","last_became_active":"2023-10-16T23:27:40.760659+0000","last_became_peered":"2023-10-16T23:27:40.760659+0000","last_unstale":"2023-10-16T23:27:40.767849+0000","last_undegraded":"2023-10-16T23:27:40.767849+0000","last_fullsized":"2023-10-16T23:27:40.767849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:09:55.835429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.765681+0000","last_change":"2023-10-16T23:27:40.353567+0000","last_active":"2023-10-16T23:27:40.765681+0000","last_peered":"2023-10-16T23:27:40.765681+0000","last_clean":"2023-10-16T23:27:40.765681+0000","last_became_active":"2023-10-16T23:27:40.352775+0000","last_became_peered":"2023-10-16T23:27:40.352775+0000","last_unstale":"2023-10-16T23:27:40.765681+0000","last_undegraded":"2023-10-16T23:27:40.765681+0000","last_fullsized":"2023-10-16T23:27:40.765681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:52:58.351406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.733515+0000","last_change":"2023-10-16T23:27:40.357620+0000","last_active":"2023-10-16T23:27:40.733515+0000","last_peered":"2023-10-16T23:27:40.733515+0000","last_clean":"2023-10-16T23:27:40.733515+0000","last_became_active":"2023-10-16T23:27:40.357009+0000","last_became_peered":"2023-10-16T23:27:40.357009+0000","last_unstale":"2023-10-16T23:27:40.733515+0000","last_undegraded":"2023-10-16T23:27:40.733515+0000","last_fullsized":"2023-10-16T23:27:40.733515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:07:50.847519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.765866+0000","last_change":"2023-10-16T23:27:40.357691+0000","last_active":"2023-10-16T23:27:40.765866+0000","last_peered":"2023-10-16T23:27:40.765866+0000","last_clean":"2023-10-16T23:27:40.765866+0000","last_became_active":"2023-10-16T23:27:40.357047+0000","last_became_peered":"2023-10-16T23:27:40.357047+0000","last_unstale":"2023-10-16T23:27:40.765866+0000","last_undegraded":"2023-10-16T23:27:40.765866+0000","last_fullsized":"2023-10-16T23:27:40.765866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:00:00.805564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.765162+0000","last_change":"2023-10-16T23:27:40.347016+0000","last_active":"2023-10-16T23:27:40.765162+0000","last_peered":"2023-10-16T23:27:40.765162+0000","last_clean":"2023-10-16T23:27:40.765162+0000","last_became_active":"2023-10-16T23:27:40.346439+0000","last_became_peered":"2023-10-16T23:27:40.346439+0000","last_unstale":"2023-10-16T23:27:40.765162+0000","last_undegraded":"2023-10-16T23:27:40.765162+0000","last_fullsized":"2023-10-16T23:27:40.765162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:08:40.047699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.765964+0000","last_change":"2023-10-16T23:27:40.340462+0000","last_active":"2023-10-16T23:27:40.765964+0000","last_peered":"2023-10-16T23:27:40.765964+0000","last_clean":"2023-10-16T23:27:40.765964+0000","last_became_active":"2023-10-16T23:27:40.339531+0000","last_became_peered":"2023-10-16T23:27:40.339531+0000","last_unstale":"2023-10-16T23:27:40.765964+0000","last_undegraded":"2023-10-16T23:27:40.765964+0000","last_fullsized":"2023-10-16T23:27:40.765964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:33:50.768168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.321613+0000","last_change":"2023-10-16T23:27:29.356842+0000","last_active":"2023-10-16T23:27:40.321613+0000","last_peered":"2023-10-16T23:27:40.321613+0000","last_clean":"2023-10-16T23:27:40.321613+0000","last_became_active":"2023-10-16T23:27:29.353846+0000","last_became_peered":"2023-10-16T23:27:29.353846+0000","last_unstale":"2023-10-16T23:27:40.321613+0000","last_undegraded":"2023-10-16T23:27:40.321613+0000","last_fullsized":"2023-10-16T23:27:40.321613+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:28.136202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:28.136202+0000","last_clean_scrub_stamp":"2023-10-16T23:27:28.136202+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:34:30.590360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T23:27:37.339484+0000","last_change":"2023-10-16T23:27:36.278001+0000","last_active":"2023-10-16T23:27:37.339484+0000","last_peered":"2023-10-16T23:27:37.339484+0000","last_clean":"2023-10-16T23:27:37.339484+0000","last_became_active":"2023-10-16T23:27:36.277096+0000","last_became_peered":"2023-10-16T23:27:36.277096+0000","last_unstale":"2023-10-16T23:27:37.339484+0000","last_undegraded":"2023-10-16T23:27:37.339484+0000","last_fullsized":"2023-10-16T23:27:37.339484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:38:00.468059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.321352+0000","last_change":"2023-10-16T23:27:36.278865+0000","last_active":"2023-10-16T23:27:40.321352+0000","last_peered":"2023-10-16T23:27:40.321352+0000","last_clean":"2023-10-16T23:27:40.321352+0000","last_became_active":"2023-10-16T23:27:36.277974+0000","last_became_peered":"2023-10-16T23:27:36.277974+0000","last_unstale":"2023-10-16T23:27:40.321352+0000","last_undegraded":"2023-10-16T23:27:40.321352+0000","last_fullsized":"2023-10-16T23:27:40.321352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:31:09.411975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.326535+0000","last_change":"2023-10-16T23:27:36.294967+0000","last_active":"2023-10-16T23:27:40.326535+0000","last_peered":"2023-10-16T23:27:40.326535+0000","last_clean":"2023-10-16T23:27:40.326535+0000","last_became_active":"2023-10-16T23:27:36.294489+0000","last_became_peered":"2023-10-16T23:27:36.294489+0000","last_unstale":"2023-10-16T23:27:40.326535+0000","last_undegraded":"2023-10-16T23:27:40.326535+0000","last_fullsized":"2023-10-16T23:27:40.326535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:43:01.777197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T23:27:37.339483+0000","last_change":"2023-10-16T23:27:36.279013+0000","last_active":"2023-10-16T23:27:37.339483+0000","last_peered":"2023-10-16T23:27:37.339483+0000","last_clean":"2023-10-16T23:27:37.339483+0000","last_became_active":"2023-10-16T23:27:36.278134+0000","last_became_peered":"2023-10-16T23:27:36.278134+0000","last_unstale":"2023-10-16T23:27:37.339483+0000","last_undegraded":"2023-10-16T23:27:37.339483+0000","last_fullsized":"2023-10-16T23:27:37.339483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:13:01.266310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T23:27:37.267856+0000","last_change":"2023-10-16T23:27:36.434134+0000","last_active":"2023-10-16T23:27:37.267856+0000","last_peered":"2023-10-16T23:27:37.267856+0000","last_clean":"2023-10-16T23:27:37.267856+0000","last_became_active":"2023-10-16T23:27:36.433808+0000","last_became_peered":"2023-10-16T23:27:36.433808+0000","last_unstale":"2023-10-16T23:27:37.267856+0000","last_undegraded":"2023-10-16T23:27:37.267856+0000","last_fullsized":"2023-10-16T23:27:37.267856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:58:44.833474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.316621+0000","last_change":"2023-10-16T23:27:36.434231+0000","last_active":"2023-10-16T23:27:40.316621+0000","last_peered":"2023-10-16T23:27:40.316621+0000","last_clean":"2023-10-16T23:27:40.316621+0000","last_became_active":"2023-10-16T23:27:36.433923+0000","last_became_peered":"2023-10-16T23:27:36.433923+0000","last_unstale":"2023-10-16T23:27:40.316621+0000","last_undegraded":"2023-10-16T23:27:40.316621+0000","last_fullsized":"2023-10-16T23:27:40.316621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:59.590093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T23:27:37.267870+0000","last_change":"2023-10-16T23:27:36.278805+0000","last_active":"2023-10-16T23:27:37.267870+0000","last_peered":"2023-10-16T23:27:37.267870+0000","last_clean":"2023-10-16T23:27:37.267870+0000","last_became_active":"2023-10-16T23:27:36.278209+0000","last_became_peered":"2023-10-16T23:27:36.278209+0000","last_unstale":"2023-10-16T23:27:37.267870+0000","last_undegraded":"2023-10-16T23:27:37.267870+0000","last_fullsized":"2023-10-16T23:27:37.267870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:38:00.468059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T23:27:37.269696+0000","last_change":"2023-10-16T23:27:36.281494+0000","last_active":"2023-10-16T23:27:37.269696+0000","last_peered":"2023-10-16T23:27:37.269696+0000","last_clean":"2023-10-16T23:27:37.269696+0000","last_became_active":"2023-10-16T23:27:36.280600+0000","last_became_peered":"2023-10-16T23:27:36.280600+0000","last_unstale":"2023-10-16T23:27:37.269696+0000","last_undegraded":"2023-10-16T23:27:37.269696+0000","last_fullsized":"2023-10-16T23:27:37.269696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:42:59.057101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.766029+0000","last_change":"2023-10-16T23:27:40.332379+0000","last_active":"2023-10-16T23:27:40.766029+0000","last_peered":"2023-10-16T23:27:40.766029+0000","last_clean":"2023-10-16T23:27:40.766029+0000","last_became_active":"2023-10-16T23:27:40.331517+0000","last_became_peered":"2023-10-16T23:27:40.331517+0000","last_unstale":"2023-10-16T23:27:40.766029+0000","last_undegraded":"2023-10-16T23:27:40.766029+0000","last_fullsized":"2023-10-16T23:27:40.766029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:55.534068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.732815+0000","last_change":"2023-10-16T23:27:40.713594+0000","last_active":"2023-10-16T23:27:40.732815+0000","last_peered":"2023-10-16T23:27:40.732815+0000","last_clean":"2023-10-16T23:27:40.732815+0000","last_became_active":"2023-10-16T23:27:40.712632+0000","last_became_peered":"2023-10-16T23:27:40.712632+0000","last_unstale":"2023-10-16T23:27:40.732815+0000","last_undegraded":"2023-10-16T23:27:40.732815+0000","last_fullsized":"2023-10-16T23:27:40.732815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:52.368847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":12,"acting":12,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":196608,"data_stored":64273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3460000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":196608,"data_stored":64273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.427}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3939999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27144,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":196608,"data_stored":64273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27132,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344708,"statfs":{"total":96636764160,"available":96608980992,"internally_reserved":0,"allocated":184320,"data_stored":58525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":196608,"data_stored":64273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.323}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]}]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":790528,"data_stored":654641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]}]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":856064,"data_stored":676339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31276,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340564,"statfs":{"total":96636764160,"available":96604737536,"internally_reserved":0,"allocated":233472,"data_stored":84191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T23:27:44.692 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T23:27:44.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.840+0000 7f953b3bf640 1 Processor -- start 2023-10-16T23:27:44.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.840+0000 7f953b3bf640 1 -- start start 2023-10-16T23:27:44.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.844+0000 7f953b3bf640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95340a85e0 0x7f95340b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:44.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.844+0000 7f953b3bf640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f95340b9290 0x7f9534136080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:44.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.844+0000 7f953b3bf640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95340a7470 con 0x7f95340bf740 2023-10-16T23:27:44.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.844+0000 7f953b3bf640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95340b9980 con 0x7f95340b9290 2023-10-16T23:27:44.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.844+0000 7f953b3bf640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953414d750 con 0x7f95340a85e0 2023-10-16T23:27:44.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.844+0000 7f953915b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f95340bf740 0x7f953414dbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46594/0 (socket says 172.21.15.12:46594) 2023-10-16T23:27:44.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.844+0000 7f953915b640 1 -- 172.21.15.12:0/2277057327 learned_addr learned my addr 172.21.15.12:0/2277057327 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:44.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.844+0000 7f953895a640 1 --2- 172.21.15.12:0/2277057327 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95340a85e0 0x7f95340b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:44.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.844+0000 7f953995c640 1 --2- 172.21.15.12:0/2277057327 >> v2:172.21.15.31:3300/0 conn(0x7f95340b9290 0x7f9534136080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:44.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.844+0000 7f952bfff640 1 -- 172.21.15.12:0/2277057327 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3113248067 0 0) 0x7f95340a7470 con 0x7f95340bf740 2023-10-16T23:27:44.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.844+0000 7f952bfff640 1 -- 172.21.15.12:0/2277057327 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9520003530 con 0x7f95340bf740 2023-10-16T23:27:44.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.844+0000 7f953895a640 1 -- 172.21.15.12:0/2277057327 >> v2:172.21.15.31:3300/0 conn(0x7f95340b9290 msgr2=0x7f9534136080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:44.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.844+0000 7f953895a640 1 --2- 172.21.15.12:0/2277057327 >> v2:172.21.15.31:3300/0 conn(0x7f95340b9290 0x7f9534136080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.844+0000 7f953895a640 1 -- 172.21.15.12:0/2277057327 >> v1:172.21.15.12:6789/0 conn(0x7f95340bf740 legacy=0x7f953414dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:44.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.844+0000 7f952bfff640 1 -- 172.21.15.12:0/2277057327 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 108477676 0 0) 0x7f9520003530 con 0x7f95340bf740 2023-10-16T23:27:44.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.844+0000 7f953895a640 1 -- 172.21.15.12:0/2277057327 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95340b7ff0 con 0x7f95340a85e0 2023-10-16T23:27:44.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.844+0000 7f953895a640 1 --2- 172.21.15.12:0/2277057327 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95340a85e0 0x7f95340b7ab0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f95240097c0 tx=0x7f952401c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81d1cb6461bb479c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:44.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.844+0000 7f952bfff640 1 -- 172.21.15.12:0/2277057327 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9530001a00 con 0x7f95340a85e0 2023-10-16T23:27:44.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f952bfff640 1 -- 172.21.15.12:0/2277057327 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95240a7050 con 0x7f95340a85e0 2023-10-16T23:27:44.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f952bfff640 1 -- 172.21.15.12:0/2277057327 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95240ab600 con 0x7f95340a85e0 2023-10-16T23:27:44.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953b3bf640 1 -- 172.21.15.12:0/2277057327 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95340a85e0 msgr2=0x7f95340b7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:44.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953b3bf640 1 --2- 172.21.15.12:0/2277057327 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95340a85e0 0x7f95340b7ab0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f95240097c0 tx=0x7f952401c3a0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953b3bf640 1 -- 172.21.15.12:0/2277057327 shutdown_connections 2023-10-16T23:27:44.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953b3bf640 1 --2- 172.21.15.12:0/2277057327 >> v2:172.21.15.31:3300/0 conn(0x7f95340b9290 0x7f9534136080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953b3bf640 1 --2- 172.21.15.12:0/2277057327 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95340a85e0 0x7f95340b7ab0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953b3bf640 1 -- 172.21.15.12:0/2277057327 >> 172.21.15.12:0/2277057327 conn(0x7f95340c2b50 msgr2=0x7f95340c2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:44.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953b3bf640 1 -- 172.21.15.12:0/2277057327 shutdown_connections 2023-10-16T23:27:44.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953b3bf640 1 -- 172.21.15.12:0/2277057327 wait complete. 2023-10-16T23:27:44.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953b3bf640 1 Processor -- start 2023-10-16T23:27:44.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953b3bf640 1 -- start start 2023-10-16T23:27:44.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953b3bf640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95340a85e0 0x7f9534157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:44.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953b3bf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95340b9290 0x7f953414ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:44.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953b3bf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95340bf740 0x7f953414a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:44.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953b3bf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9534131610 con 0x7f95340bf740 2023-10-16T23:27:44.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953b3bf640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95340be850 con 0x7f95340b9290 2023-10-16T23:27:44.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953b3bf640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9534157660 con 0x7f95340a85e0 2023-10-16T23:27:44.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953995c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95340bf740 0x7f953414a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:44.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953995c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95340bf740 0x7f953414a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40858/0 (socket says 172.21.15.12:40858) 2023-10-16T23:27:44.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953995c640 1 -- 172.21.15.12:0/4107572700 learned_addr learned my addr 172.21.15.12:0/4107572700 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:44.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953915b640 1 --2- 172.21.15.12:0/4107572700 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95340a85e0 0x7f9534157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:44.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953895a640 1 --2- 172.21.15.12:0/4107572700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95340b9290 0x7f953414ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:44.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953995c640 1 -- 172.21.15.12:0/4107572700 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95340a85e0 msgr2=0x7f9534157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:44.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953995c640 1 --2- 172.21.15.12:0/4107572700 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95340a85e0 0x7f9534157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953995c640 1 -- 172.21.15.12:0/4107572700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95340b9290 msgr2=0x7f953414ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:44.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953995c640 1 --2- 172.21.15.12:0/4107572700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95340b9290 0x7f953414ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:44.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953995c640 1 -- 172.21.15.12:0/4107572700 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9524009420 con 0x7f95340bf740 2023-10-16T23:27:44.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953995c640 1 --2- 172.21.15.12:0/4107572700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95340bf740 0x7f953414a2b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f952c00e990 tx=0x7f952c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:44.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f9529ffb640 1 -- 172.21.15.12:0/4107572700 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952c0096b0 con 0x7f95340bf740 2023-10-16T23:27:44.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f9529ffb640 1 -- 172.21.15.12:0/4107572700 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952c00c980 con 0x7f95340bf740 2023-10-16T23:27:44.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953b3bf640 1 -- 172.21.15.12:0/4107572700 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95340be4e0 con 0x7f95340bf740 2023-10-16T23:27:44.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f9529ffb640 1 -- 172.21.15.12:0/4107572700 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952c00cd10 con 0x7f95340bf740 2023-10-16T23:27:44.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.848+0000 7f953b3bf640 1 -- 172.21.15.12:0/4107572700 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f953414bfb0 con 0x7f95340bf740 2023-10-16T23:27:44.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.852+0000 7f953b3bf640 1 -- 172.21.15.12:0/4107572700 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95340673a0 con 0x7f95340bf740 2023-10-16T23:27:44.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.852+0000 7f9529ffb640 1 -- 172.21.15.12:0/4107572700 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f952c013470 con 0x7f95340bf740 2023-10-16T23:27:44.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.852+0000 7f9529ffb640 1 --2- 172.21.15.12:0/4107572700 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9518065e60 0x7f9518068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:44.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.852+0000 7f9529ffb640 1 -- 172.21.15.12:0/4107572700 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f952c0839b0 con 0x7f95340bf740 2023-10-16T23:27:44.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.852+0000 7f953915b640 1 --2- 172.21.15.12:0/4107572700 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9518065e60 0x7f9518068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:44.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.852+0000 7f953915b640 1 --2- 172.21.15.12:0/4107572700 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9518065e60 0x7f9518068320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9530001570 tx=0x7f9530009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:44.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:44.856+0000 7f9529ffb640 1 -- 172.21.15.12:0/4107572700 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f952c051090 con 0x7f95340bf740 2023-10-16T23:27:45.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.000+0000 7f953b3bf640 1 -- 172.21.15.12:0/4107572700 --> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9534131490 con 0x7f9518065e60 2023-10-16T23:27:45.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.020+0000 7f9529ffb640 1 -- 172.21.15.12:0/4107572700 <== mgr.4108 v2:172.21.15.31:6832/37949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274588 (secure 0 0 0) 0x7f9530001ee0 con 0x7f9518065e60 2023-10-16T23:27:45.027 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:45.028 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-16T23:27:45.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.024+0000 7f953b3bf640 1 -- 172.21.15.12:0/4107572700 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9518065e60 msgr2=0x7f9518068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:45.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.024+0000 7f953b3bf640 1 --2- 172.21.15.12:0/4107572700 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9518065e60 0x7f9518068320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9530001570 tx=0x7f9530009040 comp rx=0 tx=0).stop 2023-10-16T23:27:45.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.024+0000 7f953b3bf640 1 -- 172.21.15.12:0/4107572700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95340bf740 msgr2=0x7f953414a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:45.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.024+0000 7f953b3bf640 1 --2- 172.21.15.12:0/4107572700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95340bf740 0x7f953414a2b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f952c00e990 tx=0x7f952c00ee50 comp rx=0 tx=0).stop 2023-10-16T23:27:45.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.024+0000 7f953b3bf640 1 -- 172.21.15.12:0/4107572700 shutdown_connections 2023-10-16T23:27:45.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.024+0000 7f953b3bf640 1 --2- 172.21.15.12:0/4107572700 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9518065e60 0x7f9518068320 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.024+0000 7f953b3bf640 1 --2- 172.21.15.12:0/4107572700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95340bf740 0x7f953414a2b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.024+0000 7f953b3bf640 1 --2- 172.21.15.12:0/4107572700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95340b9290 0x7f953414ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.024+0000 7f953b3bf640 1 --2- 172.21.15.12:0/4107572700 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95340a85e0 0x7f9534157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.024+0000 7f953b3bf640 1 -- 172.21.15.12:0/4107572700 >> 172.21.15.12:0/4107572700 conn(0x7f95340c2b50 msgr2=0x7f953414dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:45.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.024+0000 7f953b3bf640 1 -- 172.21.15.12:0/4107572700 shutdown_connections 2023-10-16T23:27:45.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.024+0000 7f953b3bf640 1 -- 172.21.15.12:0/4107572700 wait complete. 2023-10-16T23:27:45.043 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-16T23:27:43.284319+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":222496,"kb_used_data":2784,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754752224,"statfs":{"total":773094113280,"available":772866277376,"internally_reserved":0,"allocated":2850816,"data_stored":1730788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001263"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.731840+0000","last_change":"2023-10-16T23:27:40.706600+0000","last_active":"2023-10-16T23:27:40.731840+0000","last_peered":"2023-10-16T23:27:40.731840+0000","last_clean":"2023-10-16T23:27:40.731840+0000","last_became_active":"2023-10-16T23:27:40.706320+0000","last_became_peered":"2023-10-16T23:27:40.706320+0000","last_unstale":"2023-10-16T23:27:40.731840+0000","last_undegraded":"2023-10-16T23:27:40.731840+0000","last_fullsized":"2023-10-16T23:27:40.731840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:48:20.356964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.768298+0000","last_change":"2023-10-16T23:27:40.762253+0000","last_active":"2023-10-16T23:27:40.768298+0000","last_peered":"2023-10-16T23:27:40.768298+0000","last_clean":"2023-10-16T23:27:40.768298+0000","last_became_active":"2023-10-16T23:27:40.760726+0000","last_became_peered":"2023-10-16T23:27:40.760726+0000","last_unstale":"2023-10-16T23:27:40.768298+0000","last_undegraded":"2023-10-16T23:27:40.768298+0000","last_fullsized":"2023-10-16T23:27:40.768298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:50:08.569961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.732838+0000","last_change":"2023-10-16T23:27:40.724453+0000","last_active":"2023-10-16T23:27:40.732838+0000","last_peered":"2023-10-16T23:27:40.732838+0000","last_clean":"2023-10-16T23:27:40.732838+0000","last_became_active":"2023-10-16T23:27:40.724099+0000","last_became_peered":"2023-10-16T23:27:40.724099+0000","last_unstale":"2023-10-16T23:27:40.732838+0000","last_undegraded":"2023-10-16T23:27:40.732838+0000","last_fullsized":"2023-10-16T23:27:40.732838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:01:05.350517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.727237+0000","last_change":"2023-10-16T23:27:40.704484+0000","last_active":"2023-10-16T23:27:40.727237+0000","last_peered":"2023-10-16T23:27:40.727237+0000","last_clean":"2023-10-16T23:27:40.727237+0000","last_became_active":"2023-10-16T23:27:40.704162+0000","last_became_peered":"2023-10-16T23:27:40.704162+0000","last_unstale":"2023-10-16T23:27:40.727237+0000","last_undegraded":"2023-10-16T23:27:40.727237+0000","last_fullsized":"2023-10-16T23:27:40.727237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:15:16.646850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.768324+0000","last_change":"2023-10-16T23:27:40.762529+0000","last_active":"2023-10-16T23:27:40.768324+0000","last_peered":"2023-10-16T23:27:40.768324+0000","last_clean":"2023-10-16T23:27:40.768324+0000","last_became_active":"2023-10-16T23:27:40.761570+0000","last_became_peered":"2023-10-16T23:27:40.761570+0000","last_unstale":"2023-10-16T23:27:40.768324+0000","last_undegraded":"2023-10-16T23:27:40.768324+0000","last_fullsized":"2023-10-16T23:27:40.768324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:46.449264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.738111+0000","last_change":"2023-10-16T23:27:40.728920+0000","last_active":"2023-10-16T23:27:40.738111+0000","last_peered":"2023-10-16T23:27:40.738111+0000","last_clean":"2023-10-16T23:27:40.738111+0000","last_became_active":"2023-10-16T23:27:40.728298+0000","last_became_peered":"2023-10-16T23:27:40.728298+0000","last_unstale":"2023-10-16T23:27:40.738111+0000","last_undegraded":"2023-10-16T23:27:40.738111+0000","last_fullsized":"2023-10-16T23:27:40.738111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:28:33.509782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.768568+0000","last_change":"2023-10-16T23:27:40.761480+0000","last_active":"2023-10-16T23:27:40.768568+0000","last_peered":"2023-10-16T23:27:40.768568+0000","last_clean":"2023-10-16T23:27:40.768568+0000","last_became_active":"2023-10-16T23:27:40.760882+0000","last_became_peered":"2023-10-16T23:27:40.760882+0000","last_unstale":"2023-10-16T23:27:40.768568+0000","last_undegraded":"2023-10-16T23:27:40.768568+0000","last_fullsized":"2023-10-16T23:27:40.768568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:37:38.843931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.767849+0000","last_change":"2023-10-16T23:27:40.761323+0000","last_active":"2023-10-16T23:27:40.767849+0000","last_peered":"2023-10-16T23:27:40.767849+0000","last_clean":"2023-10-16T23:27:40.767849+0000","last_became_active":"2023-10-16T23:27:40.760659+0000","last_became_peered":"2023-10-16T23:27:40.760659+0000","last_unstale":"2023-10-16T23:27:40.767849+0000","last_undegraded":"2023-10-16T23:27:40.767849+0000","last_fullsized":"2023-10-16T23:27:40.767849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:09:55.835429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.765681+0000","last_change":"2023-10-16T23:27:40.353567+0000","last_active":"2023-10-16T23:27:40.765681+0000","last_peered":"2023-10-16T23:27:40.765681+0000","last_clean":"2023-10-16T23:27:40.765681+0000","last_became_active":"2023-10-16T23:27:40.352775+0000","last_became_peered":"2023-10-16T23:27:40.352775+0000","last_unstale":"2023-10-16T23:27:40.765681+0000","last_undegraded":"2023-10-16T23:27:40.765681+0000","last_fullsized":"2023-10-16T23:27:40.765681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:52:58.351406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.733515+0000","last_change":"2023-10-16T23:27:40.357620+0000","last_active":"2023-10-16T23:27:40.733515+0000","last_peered":"2023-10-16T23:27:40.733515+0000","last_clean":"2023-10-16T23:27:40.733515+0000","last_became_active":"2023-10-16T23:27:40.357009+0000","last_became_peered":"2023-10-16T23:27:40.357009+0000","last_unstale":"2023-10-16T23:27:40.733515+0000","last_undegraded":"2023-10-16T23:27:40.733515+0000","last_fullsized":"2023-10-16T23:27:40.733515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:07:50.847519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.765866+0000","last_change":"2023-10-16T23:27:40.357691+0000","last_active":"2023-10-16T23:27:40.765866+0000","last_peered":"2023-10-16T23:27:40.765866+0000","last_clean":"2023-10-16T23:27:40.765866+0000","last_became_active":"2023-10-16T23:27:40.357047+0000","last_became_peered":"2023-10-16T23:27:40.357047+0000","last_unstale":"2023-10-16T23:27:40.765866+0000","last_undegraded":"2023-10-16T23:27:40.765866+0000","last_fullsized":"2023-10-16T23:27:40.765866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:00:00.805564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.765162+0000","last_change":"2023-10-16T23:27:40.347016+0000","last_active":"2023-10-16T23:27:40.765162+0000","last_peered":"2023-10-16T23:27:40.765162+0000","last_clean":"2023-10-16T23:27:40.765162+0000","last_became_active":"2023-10-16T23:27:40.346439+0000","last_became_peered":"2023-10-16T23:27:40.346439+0000","last_unstale":"2023-10-16T23:27:40.765162+0000","last_undegraded":"2023-10-16T23:27:40.765162+0000","last_fullsized":"2023-10-16T23:27:40.765162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:08:40.047699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.765964+0000","last_change":"2023-10-16T23:27:40.340462+0000","last_active":"2023-10-16T23:27:40.765964+0000","last_peered":"2023-10-16T23:27:40.765964+0000","last_clean":"2023-10-16T23:27:40.765964+0000","last_became_active":"2023-10-16T23:27:40.339531+0000","last_became_peered":"2023-10-16T23:27:40.339531+0000","last_unstale":"2023-10-16T23:27:40.765964+0000","last_undegraded":"2023-10-16T23:27:40.765964+0000","last_fullsized":"2023-10-16T23:27:40.765964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:33:50.768168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.321613+0000","last_change":"2023-10-16T23:27:29.356842+0000","last_active":"2023-10-16T23:27:40.321613+0000","last_peered":"2023-10-16T23:27:40.321613+0000","last_clean":"2023-10-16T23:27:40.321613+0000","last_became_active":"2023-10-16T23:27:29.353846+0000","last_became_peered":"2023-10-16T23:27:29.353846+0000","last_unstale":"2023-10-16T23:27:40.321613+0000","last_undegraded":"2023-10-16T23:27:40.321613+0000","last_fullsized":"2023-10-16T23:27:40.321613+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:28.136202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:28.136202+0000","last_clean_scrub_stamp":"2023-10-16T23:27:28.136202+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:34:30.590360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T23:27:37.339484+0000","last_change":"2023-10-16T23:27:36.278001+0000","last_active":"2023-10-16T23:27:37.339484+0000","last_peered":"2023-10-16T23:27:37.339484+0000","last_clean":"2023-10-16T23:27:37.339484+0000","last_became_active":"2023-10-16T23:27:36.277096+0000","last_became_peered":"2023-10-16T23:27:36.277096+0000","last_unstale":"2023-10-16T23:27:37.339484+0000","last_undegraded":"2023-10-16T23:27:37.339484+0000","last_fullsized":"2023-10-16T23:27:37.339484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:38:00.468059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.321352+0000","last_change":"2023-10-16T23:27:36.278865+0000","last_active":"2023-10-16T23:27:40.321352+0000","last_peered":"2023-10-16T23:27:40.321352+0000","last_clean":"2023-10-16T23:27:40.321352+0000","last_became_active":"2023-10-16T23:27:36.277974+0000","last_became_peered":"2023-10-16T23:27:36.277974+0000","last_unstale":"2023-10-16T23:27:40.321352+0000","last_undegraded":"2023-10-16T23:27:40.321352+0000","last_fullsized":"2023-10-16T23:27:40.321352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:31:09.411975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.326535+0000","last_change":"2023-10-16T23:27:36.294967+0000","last_active":"2023-10-16T23:27:40.326535+0000","last_peered":"2023-10-16T23:27:40.326535+0000","last_clean":"2023-10-16T23:27:40.326535+0000","last_became_active":"2023-10-16T23:27:36.294489+0000","last_became_peered":"2023-10-16T23:27:36.294489+0000","last_unstale":"2023-10-16T23:27:40.326535+0000","last_undegraded":"2023-10-16T23:27:40.326535+0000","last_fullsized":"2023-10-16T23:27:40.326535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:43:01.777197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T23:27:37.339483+0000","last_change":"2023-10-16T23:27:36.279013+0000","last_active":"2023-10-16T23:27:37.339483+0000","last_peered":"2023-10-16T23:27:37.339483+0000","last_clean":"2023-10-16T23:27:37.339483+0000","last_became_active":"2023-10-16T23:27:36.278134+0000","last_became_peered":"2023-10-16T23:27:36.278134+0000","last_unstale":"2023-10-16T23:27:37.339483+0000","last_undegraded":"2023-10-16T23:27:37.339483+0000","last_fullsized":"2023-10-16T23:27:37.339483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:13:01.266310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T23:27:37.267856+0000","last_change":"2023-10-16T23:27:36.434134+0000","last_active":"2023-10-16T23:27:37.267856+0000","last_peered":"2023-10-16T23:27:37.267856+0000","last_clean":"2023-10-16T23:27:37.267856+0000","last_became_active":"2023-10-16T23:27:36.433808+0000","last_became_peered":"2023-10-16T23:27:36.433808+0000","last_unstale":"2023-10-16T23:27:37.267856+0000","last_undegraded":"2023-10-16T23:27:37.267856+0000","last_fullsized":"2023-10-16T23:27:37.267856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:58:44.833474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.316621+0000","last_change":"2023-10-16T23:27:36.434231+0000","last_active":"2023-10-16T23:27:40.316621+0000","last_peered":"2023-10-16T23:27:40.316621+0000","last_clean":"2023-10-16T23:27:40.316621+0000","last_became_active":"2023-10-16T23:27:36.433923+0000","last_became_peered":"2023-10-16T23:27:36.433923+0000","last_unstale":"2023-10-16T23:27:40.316621+0000","last_undegraded":"2023-10-16T23:27:40.316621+0000","last_fullsized":"2023-10-16T23:27:40.316621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:59.590093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T23:27:37.267870+0000","last_change":"2023-10-16T23:27:36.278805+0000","last_active":"2023-10-16T23:27:37.267870+0000","last_peered":"2023-10-16T23:27:37.267870+0000","last_clean":"2023-10-16T23:27:37.267870+0000","last_became_active":"2023-10-16T23:27:36.278209+0000","last_became_peered":"2023-10-16T23:27:36.278209+0000","last_unstale":"2023-10-16T23:27:37.267870+0000","last_undegraded":"2023-10-16T23:27:37.267870+0000","last_fullsized":"2023-10-16T23:27:37.267870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:38:00.468059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-16T23:27:37.269696+0000","last_change":"2023-10-16T23:27:36.281494+0000","last_active":"2023-10-16T23:27:37.269696+0000","last_peered":"2023-10-16T23:27:37.269696+0000","last_clean":"2023-10-16T23:27:37.269696+0000","last_became_active":"2023-10-16T23:27:36.280600+0000","last_became_peered":"2023-10-16T23:27:36.280600+0000","last_unstale":"2023-10-16T23:27:37.269696+0000","last_undegraded":"2023-10-16T23:27:37.269696+0000","last_fullsized":"2023-10-16T23:27:37.269696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:42:59.057101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.766029+0000","last_change":"2023-10-16T23:27:40.332379+0000","last_active":"2023-10-16T23:27:40.766029+0000","last_peered":"2023-10-16T23:27:40.766029+0000","last_clean":"2023-10-16T23:27:40.766029+0000","last_became_active":"2023-10-16T23:27:40.331517+0000","last_became_peered":"2023-10-16T23:27:40.331517+0000","last_unstale":"2023-10-16T23:27:40.766029+0000","last_undegraded":"2023-10-16T23:27:40.766029+0000","last_fullsized":"2023-10-16T23:27:40.766029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:55.534068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.732815+0000","last_change":"2023-10-16T23:27:40.713594+0000","last_active":"2023-10-16T23:27:40.732815+0000","last_peered":"2023-10-16T23:27:40.732815+0000","last_clean":"2023-10-16T23:27:40.732815+0000","last_became_active":"2023-10-16T23:27:40.712632+0000","last_became_peered":"2023-10-16T23:27:40.712632+0000","last_unstale":"2023-10-16T23:27:40.732815+0000","last_undegraded":"2023-10-16T23:27:40.732815+0000","last_fullsized":"2023-10-16T23:27:40.732815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:52.368847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:40.287248+0000","last_change":"2023-10-16T23:27:40.287248+0000","last_active":"2023-10-16T23:27:40.287248+0000","last_peered":"2023-10-16T23:27:40.287248+0000","last_clean":"2023-10-16T23:27:40.287248+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:40.287248+0000","last_undegraded":"2023-10-16T23:27:40.287248+0000","last_fullsized":"2023-10-16T23:27:40.287248+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T23:27:39.283245+0000","last_change":"2023-10-16T23:27:39.283245+0000","last_active":"2023-10-16T23:27:39.283245+0000","last_peered":"2023-10-16T23:27:39.283245+0000","last_clean":"2023-10-16T23:27:39.283245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T23:27:39.283245+0000","last_undegraded":"2023-10-16T23:27:39.283245+0000","last_fullsized":"2023-10-16T23:27:39.283245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":12,"acting":12,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":196608,"data_stored":64273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3460000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":196608,"data_stored":64273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.427}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3939999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27144,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":196608,"data_stored":64273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27132,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344708,"statfs":{"total":96636764160,"available":96608980992,"internally_reserved":0,"allocated":184320,"data_stored":58525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":196608,"data_stored":64273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.323}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]}]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":790528,"data_stored":654641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]}]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":856064,"data_stored":676339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31276,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340564,"statfs":{"total":96636764160,"available":96604737536,"internally_reserved":0,"allocated":233472,"data_stored":84191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T23:27:45.049 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T23:27:45.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.208+0000 7f97da58e640 1 Processor -- start 2023-10-16T23:27:45.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.208+0000 7f97da58e640 1 -- start start 2023-10-16T23:27:45.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.212+0000 7f97da58e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f97d4150240 0x7f97d414bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:45.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.212+0000 7f97da58e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d406f350 con 0x7f97d4071510 2023-10-16T23:27:45.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.212+0000 7f97da58e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d406f630 con 0x7f97d40c1130 2023-10-16T23:27:45.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.212+0000 7f97da58e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d414f610 con 0x7f97d4150240 2023-10-16T23:27:45.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.212+0000 7f97d8b2b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f97d4150240 0x7f97d414bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:45.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.212+0000 7f97d37fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f97d4071510 0x7f97d414b630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46608/0 (socket says 172.21.15.12:46608) 2023-10-16T23:27:45.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.212+0000 7f97d37fe640 1 -- 172.21.15.12:0/2654692862 learned_addr learned my addr 172.21.15.12:0/2654692862 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:45.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.212+0000 7f97d8b2b640 1 -- 172.21.15.12:0/2654692862 >> v1:172.21.15.31:6789/0 conn(0x7f97d40c1130 legacy=0x7f97d414fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:45.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.212+0000 7f97d8b2b640 1 -- 172.21.15.12:0/2654692862 >> v1:172.21.15.12:6789/0 conn(0x7f97d4071510 legacy=0x7f97d414b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:45.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.212+0000 7f97d2ffd640 1 -- 172.21.15.12:0/2654692862 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617539292 0 0) 0x7f97d406f350 con 0x7f97d4071510 2023-10-16T23:27:45.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.212+0000 7f97d8b2b640 1 -- 172.21.15.12:0/2654692862 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d40baac0 con 0x7f97d4150240 2023-10-16T23:27:45.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.212+0000 7f97d8b2b640 1 --2- 172.21.15.12:0/2654692862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97d4150240 0x7f97d414bd40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009d90 tx=0x7f97cc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b33c89f3cdeb07 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:45.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.212+0000 7f97d2ffd640 1 -- 172.21.15.12:0/2654692862 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc0a59f0 con 0x7f97d4150240 2023-10-16T23:27:45.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.212+0000 7f97d2ffd640 1 -- 172.21.15.12:0/2654692862 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97cc0a5b50 con 0x7f97d4150240 2023-10-16T23:27:45.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.212+0000 7f97d2ffd640 1 -- 172.21.15.12:0/2654692862 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc0ad440 con 0x7f97d4150240 2023-10-16T23:27:45.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97da58e640 1 -- 172.21.15.12:0/2654692862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97d4150240 msgr2=0x7f97d414bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:45.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97da58e640 1 --2- 172.21.15.12:0/2654692862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97d4150240 0x7f97d414bd40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009d90 tx=0x7f97cc01c910 comp rx=0 tx=0).stop 2023-10-16T23:27:45.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97da58e640 1 -- 172.21.15.12:0/2654692862 shutdown_connections 2023-10-16T23:27:45.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97da58e640 1 --2- 172.21.15.12:0/2654692862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97d4150240 0x7f97d414bd40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97da58e640 1 -- 172.21.15.12:0/2654692862 >> 172.21.15.12:0/2654692862 conn(0x7f97d406ba20 msgr2=0x7f97d40c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:45.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97da58e640 1 -- 172.21.15.12:0/2654692862 shutdown_connections 2023-10-16T23:27:45.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97da58e640 1 -- 172.21.15.12:0/2654692862 wait complete. 2023-10-16T23:27:45.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97da58e640 1 Processor -- start 2023-10-16T23:27:45.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97da58e640 1 -- start start 2023-10-16T23:27:45.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97da58e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97d4071510 0x7f97d414df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:45.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97da58e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97d40c1130 0x7f97d4141b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:45.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97da58e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97d4150240 0x7f97d41420c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:45.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97da58e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d414e4d0 con 0x7f97d4150240 2023-10-16T23:27:45.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97da58e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d4142cb0 con 0x7f97d40c1130 2023-10-16T23:27:45.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97da58e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d41427b0 con 0x7f97d4071510 2023-10-16T23:27:45.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97d8b2b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97d4150240 0x7f97d41420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:45.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97d8b2b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97d4150240 0x7f97d41420c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40876/0 (socket says 172.21.15.12:40876) 2023-10-16T23:27:45.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97d8b2b640 1 -- 172.21.15.12:0/2214329719 learned_addr learned my addr 172.21.15.12:0/2214329719 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:45.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97d3fff640 1 --2- 172.21.15.12:0/2214329719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97d4071510 0x7f97d414df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:45.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97d37fe640 1 --2- 172.21.15.12:0/2214329719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97d40c1130 0x7f97d4141b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:45.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97d8b2b640 1 -- 172.21.15.12:0/2214329719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97d4071510 msgr2=0x7f97d414df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:45.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97d8b2b640 1 --2- 172.21.15.12:0/2214329719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97d4071510 0x7f97d414df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97d8b2b640 1 -- 172.21.15.12:0/2214329719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97d40c1130 msgr2=0x7f97d4141b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:45.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97d8b2b640 1 --2- 172.21.15.12:0/2214329719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97d40c1130 0x7f97d4141b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97d8b2b640 1 -- 172.21.15.12:0/2214329719 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97cc009a70 con 0x7f97d4150240 2023-10-16T23:27:45.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97d3fff640 1 --2- 172.21.15.12:0/2214329719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97d4071510 0x7f97d414df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:27:45.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97d8b2b640 1 --2- 172.21.15.12:0/2214329719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97d4150240 0x7f97d41420c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f97cc0b0040 tx=0x7f97cc0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:45.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97d0ff9640 1 -- 172.21.15.12:0/2214329719 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc0ade40 con 0x7f97d4150240 2023-10-16T23:27:45.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97d0ff9640 1 -- 172.21.15.12:0/2214329719 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97cc0b7410 con 0x7f97d4150240 2023-10-16T23:27:45.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97da58e640 1 -- 172.21.15.12:0/2214329719 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d41476a0 con 0x7f97d4150240 2023-10-16T23:27:45.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97d0ff9640 1 -- 172.21.15.12:0/2214329719 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc0b7800 con 0x7f97d4150240 2023-10-16T23:27:45.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.216+0000 7f97da58e640 1 -- 172.21.15.12:0/2214329719 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d414ebc0 con 0x7f97d4150240 2023-10-16T23:27:45.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.220+0000 7f97da58e640 1 -- 172.21.15.12:0/2214329719 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d4147830 con 0x7f97d4150240 2023-10-16T23:27:45.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.220+0000 7f97d0ff9640 1 -- 172.21.15.12:0/2214329719 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f97cc0b4050 con 0x7f97d4150240 2023-10-16T23:27:45.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.220+0000 7f97d0ff9640 1 --2- 172.21.15.12:0/2214329719 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f97b4065e90 0x7f97b4068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:45.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.220+0000 7f97d0ff9640 1 -- 172.21.15.12:0/2214329719 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f97cc11e520 con 0x7f97d4150240 2023-10-16T23:27:45.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.220+0000 7f97d3fff640 1 --2- 172.21.15.12:0/2214329719 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f97b4065e90 0x7f97b4068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:45.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.220+0000 7f97d3fff640 1 --2- 172.21.15.12:0/2214329719 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f97b4065e90 0x7f97b4068350 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f97d414c250 tx=0x7f97bc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:45.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.224+0000 7f97d0ff9640 1 -- 172.21.15.12:0/2214329719 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f97cc0ebc30 con 0x7f97d4150240 2023-10-16T23:27:45.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.376+0000 7f97da58e640 1 -- 172.21.15.12:0/2214329719 --> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f97d4142630 con 0x7f97b4065e90 2023-10-16T23:27:45.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.396+0000 7f97d0ff9640 1 -- 172.21.15.12:0/2214329719 <== mgr.4108 v2:172.21.15.31:6832/37949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286683 (secure 0 0 0) 0x7f97bc003ad0 con 0x7f97b4065e90 2023-10-16T23:27:45.403 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:45.405 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-16T23:27:45.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.400+0000 7f97da58e640 1 -- 172.21.15.12:0/2214329719 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f97b4065e90 msgr2=0x7f97b4068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:45.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.400+0000 7f97da58e640 1 --2- 172.21.15.12:0/2214329719 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f97b4065e90 0x7f97b4068350 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f97d414c250 tx=0x7f97bc009040 comp rx=0 tx=0).stop 2023-10-16T23:27:45.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.400+0000 7f97da58e640 1 -- 172.21.15.12:0/2214329719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97d4150240 msgr2=0x7f97d41420c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:45.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.400+0000 7f97da58e640 1 --2- 172.21.15.12:0/2214329719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97d4150240 0x7f97d41420c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f97cc0b0040 tx=0x7f97cc0196b0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.400+0000 7f97da58e640 1 -- 172.21.15.12:0/2214329719 shutdown_connections 2023-10-16T23:27:45.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.400+0000 7f97da58e640 1 --2- 172.21.15.12:0/2214329719 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f97b4065e90 0x7f97b4068350 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.400+0000 7f97da58e640 1 --2- 172.21.15.12:0/2214329719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97d4150240 0x7f97d41420c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.400+0000 7f97da58e640 1 --2- 172.21.15.12:0/2214329719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97d40c1130 0x7f97d4141b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.400+0000 7f97da58e640 1 --2- 172.21.15.12:0/2214329719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97d4071510 0x7f97d414df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.400+0000 7f97da58e640 1 -- 172.21.15.12:0/2214329719 >> 172.21.15.12:0/2214329719 conn(0x7f97d406ba20 msgr2=0x7f97d41438e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:45.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.400+0000 7f97da58e640 1 -- 172.21.15.12:0/2214329719 shutdown_connections 2023-10-16T23:27:45.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.400+0000 7f97da58e640 1 -- 172.21.15.12:0/2214329719 wait complete. 2023-10-16T23:27:45.424 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-16T23:27:45.285022+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222808,"kb_used_data":3096,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751912,"statfs":{"total":773094113280,"available":772865957888,"internally_reserved":0,"allocated":3170304,"data_stored":1885600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":66,"apply_latency_ms":66,"commit_latency_ns":66000000,"apply_latency_ns":66000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.993952"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.731840+0000","last_change":"2023-10-16T23:27:40.706600+0000","last_active":"2023-10-16T23:27:40.731840+0000","last_peered":"2023-10-16T23:27:40.731840+0000","last_clean":"2023-10-16T23:27:40.731840+0000","last_became_active":"2023-10-16T23:27:40.706320+0000","last_became_peered":"2023-10-16T23:27:40.706320+0000","last_unstale":"2023-10-16T23:27:40.731840+0000","last_undegraded":"2023-10-16T23:27:40.731840+0000","last_fullsized":"2023-10-16T23:27:40.731840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:48:20.356964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952090+0000","last_change":"2023-10-16T23:27:40.756555+0000","last_active":"2023-10-16T23:27:41.952090+0000","last_peered":"2023-10-16T23:27:41.952090+0000","last_clean":"2023-10-16T23:27:41.952090+0000","last_became_active":"2023-10-16T23:27:40.754736+0000","last_became_peered":"2023-10-16T23:27:40.754736+0000","last_unstale":"2023-10-16T23:27:41.952090+0000","last_undegraded":"2023-10-16T23:27:41.952090+0000","last_fullsized":"2023-10-16T23:27:41.952090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:45.642622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704753+0000","last_change":"2023-10-16T23:27:40.726586+0000","last_active":"2023-10-16T23:27:41.704753+0000","last_peered":"2023-10-16T23:27:41.704753+0000","last_clean":"2023-10-16T23:27:41.704753+0000","last_became_active":"2023-10-16T23:27:40.725731+0000","last_became_peered":"2023-10-16T23:27:40.725731+0000","last_unstale":"2023-10-16T23:27:41.704753+0000","last_undegraded":"2023-10-16T23:27:41.704753+0000","last_fullsized":"2023-10-16T23:27:41.704753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:04:22.434372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702719+0000","last_change":"2023-10-16T23:27:40.715543+0000","last_active":"2023-10-16T23:27:41.702719+0000","last_peered":"2023-10-16T23:27:41.702719+0000","last_clean":"2023-10-16T23:27:41.702719+0000","last_became_active":"2023-10-16T23:27:40.714592+0000","last_became_peered":"2023-10-16T23:27:40.714592+0000","last_unstale":"2023-10-16T23:27:41.702719+0000","last_undegraded":"2023-10-16T23:27:41.702719+0000","last_fullsized":"2023-10-16T23:27:41.702719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:42:37.696897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642193+0000","last_change":"2023-10-16T23:27:40.722734+0000","last_active":"2023-10-16T23:27:42.642193+0000","last_peered":"2023-10-16T23:27:42.642193+0000","last_clean":"2023-10-16T23:27:42.642193+0000","last_became_active":"2023-10-16T23:27:40.722399+0000","last_became_peered":"2023-10-16T23:27:40.722399+0000","last_unstale":"2023-10-16T23:27:42.642193+0000","last_undegraded":"2023-10-16T23:27:42.642193+0000","last_fullsized":"2023-10-16T23:27:42.642193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:19:17.463284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702182+0000","last_change":"2023-10-16T23:27:40.716139+0000","last_active":"2023-10-16T23:27:41.702182+0000","last_peered":"2023-10-16T23:27:41.702182+0000","last_clean":"2023-10-16T23:27:41.702182+0000","last_became_active":"2023-10-16T23:27:40.715294+0000","last_became_peered":"2023-10-16T23:27:40.715294+0000","last_unstale":"2023-10-16T23:27:41.702182+0000","last_undegraded":"2023-10-16T23:27:41.702182+0000","last_fullsized":"2023-10-16T23:27:41.702182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:19:17.463284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.768298+0000","last_change":"2023-10-16T23:27:40.762253+0000","last_active":"2023-10-16T23:27:40.768298+0000","last_peered":"2023-10-16T23:27:40.768298+0000","last_clean":"2023-10-16T23:27:40.768298+0000","last_became_active":"2023-10-16T23:27:40.760726+0000","last_became_peered":"2023-10-16T23:27:40.760726+0000","last_unstale":"2023-10-16T23:27:40.768298+0000","last_undegraded":"2023-10-16T23:27:40.768298+0000","last_fullsized":"2023-10-16T23:27:40.768298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:50:08.569961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.951568+0000","last_change":"2023-10-16T23:27:40.756184+0000","last_active":"2023-10-16T23:27:41.951568+0000","last_peered":"2023-10-16T23:27:41.951568+0000","last_clean":"2023-10-16T23:27:41.951568+0000","last_became_active":"2023-10-16T23:27:40.755276+0000","last_became_peered":"2023-10-16T23:27:40.755276+0000","last_unstale":"2023-10-16T23:27:41.951568+0000","last_undegraded":"2023-10-16T23:27:41.951568+0000","last_fullsized":"2023-10-16T23:27:41.951568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642253+0000","last_change":"2023-10-16T23:27:40.724060+0000","last_active":"2023-10-16T23:27:42.642253+0000","last_peered":"2023-10-16T23:27:42.642253+0000","last_clean":"2023-10-16T23:27:42.642253+0000","last_became_active":"2023-10-16T23:27:40.723701+0000","last_became_peered":"2023-10-16T23:27:40.723701+0000","last_unstale":"2023-10-16T23:27:42.642253+0000","last_undegraded":"2023-10-16T23:27:42.642253+0000","last_fullsized":"2023-10-16T23:27:42.642253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:04.722168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952181+0000","last_change":"2023-10-16T23:27:40.756783+0000","last_active":"2023-10-16T23:27:41.952181+0000","last_peered":"2023-10-16T23:27:41.952181+0000","last_clean":"2023-10-16T23:27:41.952181+0000","last_became_active":"2023-10-16T23:27:40.755772+0000","last_became_peered":"2023-10-16T23:27:40.755772+0000","last_unstale":"2023-10-16T23:27:41.952181+0000","last_undegraded":"2023-10-16T23:27:41.952181+0000","last_fullsized":"2023-10-16T23:27:41.952181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704832+0000","last_change":"2023-10-16T23:27:40.724754+0000","last_active":"2023-10-16T23:27:41.704832+0000","last_peered":"2023-10-16T23:27:41.704832+0000","last_clean":"2023-10-16T23:27:41.704832+0000","last_became_active":"2023-10-16T23:27:40.724031+0000","last_became_peered":"2023-10-16T23:27:40.724031+0000","last_unstale":"2023-10-16T23:27:41.704832+0000","last_undegraded":"2023-10-16T23:27:41.704832+0000","last_fullsized":"2023-10-16T23:27:41.704832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:04.722168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.732838+0000","last_change":"2023-10-16T23:27:40.724453+0000","last_active":"2023-10-16T23:27:40.732838+0000","last_peered":"2023-10-16T23:27:40.732838+0000","last_clean":"2023-10-16T23:27:40.732838+0000","last_became_active":"2023-10-16T23:27:40.724099+0000","last_became_peered":"2023-10-16T23:27:40.724099+0000","last_unstale":"2023-10-16T23:27:40.732838+0000","last_undegraded":"2023-10-16T23:27:40.732838+0000","last_fullsized":"2023-10-16T23:27:40.732838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:01:05.350517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.727237+0000","last_change":"2023-10-16T23:27:40.704484+0000","last_active":"2023-10-16T23:27:40.727237+0000","last_peered":"2023-10-16T23:27:40.727237+0000","last_clean":"2023-10-16T23:27:40.727237+0000","last_became_active":"2023-10-16T23:27:40.704162+0000","last_became_peered":"2023-10-16T23:27:40.704162+0000","last_unstale":"2023-10-16T23:27:40.727237+0000","last_undegraded":"2023-10-16T23:27:40.727237+0000","last_fullsized":"2023-10-16T23:27:40.727237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:15:16.646850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.951790+0000","last_change":"2023-10-16T23:27:40.738913+0000","last_active":"2023-10-16T23:27:41.951790+0000","last_peered":"2023-10-16T23:27:41.951790+0000","last_clean":"2023-10-16T23:27:41.951790+0000","last_became_active":"2023-10-16T23:27:40.738070+0000","last_became_peered":"2023-10-16T23:27:40.738070+0000","last_unstale":"2023-10-16T23:27:41.951790+0000","last_undegraded":"2023-10-16T23:27:41.951790+0000","last_fullsized":"2023-10-16T23:27:41.951790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:56:41.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.768324+0000","last_change":"2023-10-16T23:27:40.762529+0000","last_active":"2023-10-16T23:27:40.768324+0000","last_peered":"2023-10-16T23:27:40.768324+0000","last_clean":"2023-10-16T23:27:40.768324+0000","last_became_active":"2023-10-16T23:27:40.761570+0000","last_became_peered":"2023-10-16T23:27:40.761570+0000","last_unstale":"2023-10-16T23:27:40.768324+0000","last_undegraded":"2023-10-16T23:27:40.768324+0000","last_fullsized":"2023-10-16T23:27:40.768324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:46.449264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702044+0000","last_change":"2023-10-16T23:27:40.719227+0000","last_active":"2023-10-16T23:27:41.702044+0000","last_peered":"2023-10-16T23:27:41.702044+0000","last_clean":"2023-10-16T23:27:41.702044+0000","last_became_active":"2023-10-16T23:27:40.718276+0000","last_became_peered":"2023-10-16T23:27:40.718276+0000","last_unstale":"2023-10-16T23:27:41.702044+0000","last_undegraded":"2023-10-16T23:27:41.702044+0000","last_fullsized":"2023-10-16T23:27:41.702044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642387+0000","last_change":"2023-10-16T23:27:40.719723+0000","last_active":"2023-10-16T23:27:42.642387+0000","last_peered":"2023-10-16T23:27:42.642387+0000","last_clean":"2023-10-16T23:27:42.642387+0000","last_became_active":"2023-10-16T23:27:40.719402+0000","last_became_peered":"2023-10-16T23:27:40.719402+0000","last_unstale":"2023-10-16T23:27:42.642387+0000","last_undegraded":"2023-10-16T23:27:42.642387+0000","last_fullsized":"2023-10-16T23:27:42.642387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:04:22.434372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704498+0000","last_change":"2023-10-16T23:27:40.732931+0000","last_active":"2023-10-16T23:27:41.704498+0000","last_peered":"2023-10-16T23:27:41.704498+0000","last_clean":"2023-10-16T23:27:41.704498+0000","last_became_active":"2023-10-16T23:27:40.732102+0000","last_became_peered":"2023-10-16T23:27:40.732102+0000","last_unstale":"2023-10-16T23:27:41.704498+0000","last_undegraded":"2023-10-16T23:27:41.704498+0000","last_fullsized":"2023-10-16T23:27:41.704498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:14.359461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.738111+0000","last_change":"2023-10-16T23:27:40.728920+0000","last_active":"2023-10-16T23:27:40.738111+0000","last_peered":"2023-10-16T23:27:40.738111+0000","last_clean":"2023-10-16T23:27:40.738111+0000","last_became_active":"2023-10-16T23:27:40.728298+0000","last_became_peered":"2023-10-16T23:27:40.728298+0000","last_unstale":"2023-10-16T23:27:40.738111+0000","last_undegraded":"2023-10-16T23:27:40.738111+0000","last_fullsized":"2023-10-16T23:27:40.738111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:28:33.509782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704201+0000","last_change":"2023-10-16T23:27:40.745270+0000","last_active":"2023-10-16T23:27:41.704201+0000","last_peered":"2023-10-16T23:27:41.704201+0000","last_clean":"2023-10-16T23:27:41.704201+0000","last_became_active":"2023-10-16T23:27:40.744483+0000","last_became_peered":"2023-10-16T23:27:40.744483+0000","last_unstale":"2023-10-16T23:27:41.704201+0000","last_undegraded":"2023-10-16T23:27:41.704201+0000","last_fullsized":"2023-10-16T23:27:41.704201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:24:33.998070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.768568+0000","last_change":"2023-10-16T23:27:40.761480+0000","last_active":"2023-10-16T23:27:40.768568+0000","last_peered":"2023-10-16T23:27:40.768568+0000","last_clean":"2023-10-16T23:27:40.768568+0000","last_became_active":"2023-10-16T23:27:40.760882+0000","last_became_peered":"2023-10-16T23:27:40.760882+0000","last_unstale":"2023-10-16T23:27:40.768568+0000","last_undegraded":"2023-10-16T23:27:40.768568+0000","last_fullsized":"2023-10-16T23:27:40.768568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:37:38.843931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.640893+0000","last_change":"2023-10-16T23:27:40.722620+0000","last_active":"2023-10-16T23:27:42.640893+0000","last_peered":"2023-10-16T23:27:42.640893+0000","last_clean":"2023-10-16T23:27:42.640893+0000","last_became_active":"2023-10-16T23:27:40.722302+0000","last_became_peered":"2023-10-16T23:27:40.722302+0000","last_unstale":"2023-10-16T23:27:42.640893+0000","last_undegraded":"2023-10-16T23:27:42.640893+0000","last_fullsized":"2023-10-16T23:27:42.640893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697349+0000","last_change":"2023-10-16T23:27:40.716578+0000","last_active":"2023-10-16T23:27:41.697349+0000","last_peered":"2023-10-16T23:27:41.697349+0000","last_clean":"2023-10-16T23:27:41.697349+0000","last_became_active":"2023-10-16T23:27:40.716228+0000","last_became_peered":"2023-10-16T23:27:40.716228+0000","last_unstale":"2023-10-16T23:27:41.697349+0000","last_undegraded":"2023-10-16T23:27:41.697349+0000","last_fullsized":"2023-10-16T23:27:41.697349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:27:29.534374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.767849+0000","last_change":"2023-10-16T23:27:40.761323+0000","last_active":"2023-10-16T23:27:40.767849+0000","last_peered":"2023-10-16T23:27:40.767849+0000","last_clean":"2023-10-16T23:27:40.767849+0000","last_became_active":"2023-10-16T23:27:40.760659+0000","last_became_peered":"2023-10-16T23:27:40.760659+0000","last_unstale":"2023-10-16T23:27:40.767849+0000","last_undegraded":"2023-10-16T23:27:40.767849+0000","last_fullsized":"2023-10-16T23:27:40.767849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:09:55.835429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478936+0000","last_change":"2023-10-16T23:27:40.727629+0000","last_active":"2023-10-16T23:27:42.478936+0000","last_peered":"2023-10-16T23:27:42.478936+0000","last_clean":"2023-10-16T23:27:42.478936+0000","last_became_active":"2023-10-16T23:27:40.727334+0000","last_became_peered":"2023-10-16T23:27:40.727334+0000","last_unstale":"2023-10-16T23:27:42.478936+0000","last_undegraded":"2023-10-16T23:27:42.478936+0000","last_fullsized":"2023-10-16T23:27:42.478936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:38:33.383867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.479296+0000","last_change":"2023-10-16T23:27:40.704775+0000","last_active":"2023-10-16T23:27:42.479296+0000","last_peered":"2023-10-16T23:27:42.479296+0000","last_clean":"2023-10-16T23:27:42.479296+0000","last_became_active":"2023-10-16T23:27:40.704536+0000","last_became_peered":"2023-10-16T23:27:40.704536+0000","last_unstale":"2023-10-16T23:27:42.479296+0000","last_undegraded":"2023-10-16T23:27:42.479296+0000","last_fullsized":"2023-10-16T23:27:42.479296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952175+0000","last_change":"2023-10-16T23:27:40.764351+0000","last_active":"2023-10-16T23:27:41.952175+0000","last_peered":"2023-10-16T23:27:41.952175+0000","last_clean":"2023-10-16T23:27:41.952175+0000","last_became_active":"2023-10-16T23:27:40.763592+0000","last_became_peered":"2023-10-16T23:27:40.763592+0000","last_unstale":"2023-10-16T23:27:41.952175+0000","last_undegraded":"2023-10-16T23:27:41.952175+0000","last_fullsized":"2023-10-16T23:27:41.952175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.479026+0000","last_change":"2023-10-16T23:27:40.760989+0000","last_active":"2023-10-16T23:27:42.479026+0000","last_peered":"2023-10-16T23:27:42.479026+0000","last_clean":"2023-10-16T23:27:42.479026+0000","last_became_active":"2023-10-16T23:27:40.760615+0000","last_became_peered":"2023-10-16T23:27:40.760615+0000","last_unstale":"2023-10-16T23:27:42.479026+0000","last_undegraded":"2023-10-16T23:27:42.479026+0000","last_fullsized":"2023-10-16T23:27:42.479026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698072+0000","last_change":"2023-10-16T23:27:40.760762+0000","last_active":"2023-10-16T23:27:41.698072+0000","last_peered":"2023-10-16T23:27:41.698072+0000","last_clean":"2023-10-16T23:27:41.698072+0000","last_became_active":"2023-10-16T23:27:40.760437+0000","last_became_peered":"2023-10-16T23:27:40.760437+0000","last_unstale":"2023-10-16T23:27:41.698072+0000","last_undegraded":"2023-10-16T23:27:41.698072+0000","last_fullsized":"2023-10-16T23:27:41.698072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:55:29.771781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.703806+0000","last_change":"2023-10-16T23:27:40.745197+0000","last_active":"2023-10-16T23:27:41.703806+0000","last_peered":"2023-10-16T23:27:41.703806+0000","last_clean":"2023-10-16T23:27:41.703806+0000","last_became_active":"2023-10-16T23:27:40.744458+0000","last_became_peered":"2023-10-16T23:27:40.744458+0000","last_unstale":"2023-10-16T23:27:41.703806+0000","last_undegraded":"2023-10-16T23:27:41.703806+0000","last_fullsized":"2023-10-16T23:27:41.703806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697368+0000","last_change":"2023-10-16T23:27:40.711795+0000","last_active":"2023-10-16T23:27:41.697368+0000","last_peered":"2023-10-16T23:27:41.697368+0000","last_clean":"2023-10-16T23:27:41.697368+0000","last_became_active":"2023-10-16T23:27:40.711492+0000","last_became_peered":"2023-10-16T23:27:40.711492+0000","last_unstale":"2023-10-16T23:27:41.697368+0000","last_undegraded":"2023-10-16T23:27:41.697368+0000","last_fullsized":"2023-10-16T23:27:41.697368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:04:22.434372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702060+0000","last_change":"2023-10-16T23:27:40.710149+0000","last_active":"2023-10-16T23:27:41.702060+0000","last_peered":"2023-10-16T23:27:41.702060+0000","last_clean":"2023-10-16T23:27:41.702060+0000","last_became_active":"2023-10-16T23:27:40.709286+0000","last_became_peered":"2023-10-16T23:27:40.709286+0000","last_unstale":"2023-10-16T23:27:41.702060+0000","last_undegraded":"2023-10-16T23:27:41.702060+0000","last_fullsized":"2023-10-16T23:27:41.702060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:22:41.708468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698461+0000","last_change":"2023-10-16T23:27:40.707271+0000","last_active":"2023-10-16T23:27:41.698461+0000","last_peered":"2023-10-16T23:27:41.698461+0000","last_clean":"2023-10-16T23:27:41.698461+0000","last_became_active":"2023-10-16T23:27:40.706864+0000","last_became_peered":"2023-10-16T23:27:40.706864+0000","last_unstale":"2023-10-16T23:27:41.698461+0000","last_undegraded":"2023-10-16T23:27:41.698461+0000","last_fullsized":"2023-10-16T23:27:41.698461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.765681+0000","last_change":"2023-10-16T23:27:40.353567+0000","last_active":"2023-10-16T23:27:40.765681+0000","last_peered":"2023-10-16T23:27:40.765681+0000","last_clean":"2023-10-16T23:27:40.765681+0000","last_became_active":"2023-10-16T23:27:40.352775+0000","last_became_peered":"2023-10-16T23:27:40.352775+0000","last_unstale":"2023-10-16T23:27:40.765681+0000","last_undegraded":"2023-10-16T23:27:40.765681+0000","last_fullsized":"2023-10-16T23:27:40.765681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:52:58.351406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952358+0000","last_change":"2023-10-16T23:27:40.765398+0000","last_active":"2023-10-16T23:27:41.952358+0000","last_peered":"2023-10-16T23:27:41.952358+0000","last_clean":"2023-10-16T23:27:41.952358+0000","last_became_active":"2023-10-16T23:27:40.764517+0000","last_became_peered":"2023-10-16T23:27:40.764517+0000","last_unstale":"2023-10-16T23:27:41.952358+0000","last_undegraded":"2023-10-16T23:27:41.952358+0000","last_fullsized":"2023-10-16T23:27:41.952358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:31.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641131+0000","last_change":"2023-10-16T23:27:40.335221+0000","last_active":"2023-10-16T23:27:42.641131+0000","last_peered":"2023-10-16T23:27:42.641131+0000","last_clean":"2023-10-16T23:27:42.641131+0000","last_became_active":"2023-10-16T23:27:40.334885+0000","last_became_peered":"2023-10-16T23:27:40.334885+0000","last_unstale":"2023-10-16T23:27:42.641131+0000","last_undegraded":"2023-10-16T23:27:42.641131+0000","last_fullsized":"2023-10-16T23:27:42.641131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641719+0000","last_change":"2023-10-16T23:27:40.719997+0000","last_active":"2023-10-16T23:27:42.641719+0000","last_peered":"2023-10-16T23:27:42.641719+0000","last_clean":"2023-10-16T23:27:42.641719+0000","last_became_active":"2023-10-16T23:27:40.719811+0000","last_became_peered":"2023-10-16T23:27:40.719811+0000","last_unstale":"2023-10-16T23:27:42.641719+0000","last_undegraded":"2023-10-16T23:27:42.641719+0000","last_fullsized":"2023-10-16T23:27:42.641719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:13.934735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.733515+0000","last_change":"2023-10-16T23:27:40.357620+0000","last_active":"2023-10-16T23:27:40.733515+0000","last_peered":"2023-10-16T23:27:40.733515+0000","last_clean":"2023-10-16T23:27:40.733515+0000","last_became_active":"2023-10-16T23:27:40.357009+0000","last_became_peered":"2023-10-16T23:27:40.357009+0000","last_unstale":"2023-10-16T23:27:40.733515+0000","last_undegraded":"2023-10-16T23:27:40.733515+0000","last_fullsized":"2023-10-16T23:27:40.733515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:07:50.847519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698809+0000","last_change":"2023-10-16T23:27:40.760925+0000","last_active":"2023-10-16T23:27:41.698809+0000","last_peered":"2023-10-16T23:27:41.698809+0000","last_clean":"2023-10-16T23:27:41.698809+0000","last_became_active":"2023-10-16T23:27:40.760365+0000","last_became_peered":"2023-10-16T23:27:40.760365+0000","last_unstale":"2023-10-16T23:27:41.698809+0000","last_undegraded":"2023-10-16T23:27:41.698809+0000","last_fullsized":"2023-10-16T23:27:41.698809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:13.934735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702299+0000","last_change":"2023-10-16T23:27:40.331826+0000","last_active":"2023-10-16T23:27:41.702299+0000","last_peered":"2023-10-16T23:27:41.702299+0000","last_clean":"2023-10-16T23:27:41.702299+0000","last_became_active":"2023-10-16T23:27:40.330857+0000","last_became_peered":"2023-10-16T23:27:40.330857+0000","last_unstale":"2023-10-16T23:27:41.702299+0000","last_undegraded":"2023-10-16T23:27:41.702299+0000","last_fullsized":"2023-10-16T23:27:41.702299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:42:46.614672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.765866+0000","last_change":"2023-10-16T23:27:40.357691+0000","last_active":"2023-10-16T23:27:40.765866+0000","last_peered":"2023-10-16T23:27:40.765866+0000","last_clean":"2023-10-16T23:27:40.765866+0000","last_became_active":"2023-10-16T23:27:40.357047+0000","last_became_peered":"2023-10-16T23:27:40.357047+0000","last_unstale":"2023-10-16T23:27:40.765866+0000","last_undegraded":"2023-10-16T23:27:40.765866+0000","last_fullsized":"2023-10-16T23:27:40.765866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:00:00.805564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.951579+0000","last_change":"2023-10-16T23:27:40.763848+0000","last_active":"2023-10-16T23:27:41.951579+0000","last_peered":"2023-10-16T23:27:41.951579+0000","last_clean":"2023-10-16T23:27:41.951579+0000","last_became_active":"2023-10-16T23:27:40.763116+0000","last_became_peered":"2023-10-16T23:27:40.763116+0000","last_unstale":"2023-10-16T23:27:41.951579+0000","last_undegraded":"2023-10-16T23:27:41.951579+0000","last_fullsized":"2023-10-16T23:27:41.951579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.765162+0000","last_change":"2023-10-16T23:27:40.347016+0000","last_active":"2023-10-16T23:27:40.765162+0000","last_peered":"2023-10-16T23:27:40.765162+0000","last_clean":"2023-10-16T23:27:40.765162+0000","last_became_active":"2023-10-16T23:27:40.346439+0000","last_became_peered":"2023-10-16T23:27:40.346439+0000","last_unstale":"2023-10-16T23:27:40.765162+0000","last_undegraded":"2023-10-16T23:27:40.765162+0000","last_fullsized":"2023-10-16T23:27:40.765162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:08:40.047699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702083+0000","last_change":"2023-10-16T23:27:40.714905+0000","last_active":"2023-10-16T23:27:41.702083+0000","last_peered":"2023-10-16T23:27:41.702083+0000","last_clean":"2023-10-16T23:27:41.702083+0000","last_became_active":"2023-10-16T23:27:40.714098+0000","last_became_peered":"2023-10-16T23:27:40.714098+0000","last_unstale":"2023-10-16T23:27:41.702083+0000","last_undegraded":"2023-10-16T23:27:41.702083+0000","last_fullsized":"2023-10-16T23:27:41.702083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:13.934735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.765964+0000","last_change":"2023-10-16T23:27:40.340462+0000","last_active":"2023-10-16T23:27:40.765964+0000","last_peered":"2023-10-16T23:27:40.765964+0000","last_clean":"2023-10-16T23:27:40.765964+0000","last_became_active":"2023-10-16T23:27:40.339531+0000","last_became_peered":"2023-10-16T23:27:40.339531+0000","last_unstale":"2023-10-16T23:27:40.765964+0000","last_undegraded":"2023-10-16T23:27:40.765964+0000","last_fullsized":"2023-10-16T23:27:40.765964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:33:50.768168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702961+0000","last_change":"2023-10-16T23:27:40.713930+0000","last_active":"2023-10-16T23:27:41.702961+0000","last_peered":"2023-10-16T23:27:41.702961+0000","last_clean":"2023-10-16T23:27:41.702961+0000","last_became_active":"2023-10-16T23:27:40.713087+0000","last_became_peered":"2023-10-16T23:27:40.713087+0000","last_unstale":"2023-10-16T23:27:41.702961+0000","last_undegraded":"2023-10-16T23:27:41.702961+0000","last_fullsized":"2023-10-16T23:27:41.702961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:15:24.177529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.951911+0000","last_change":"2023-10-16T23:27:40.320848+0000","last_active":"2023-10-16T23:27:41.951911+0000","last_peered":"2023-10-16T23:27:41.951911+0000","last_clean":"2023-10-16T23:27:41.951911+0000","last_became_active":"2023-10-16T23:27:40.319887+0000","last_became_peered":"2023-10-16T23:27:40.319887+0000","last_unstale":"2023-10-16T23:27:41.951911+0000","last_undegraded":"2023-10-16T23:27:41.951911+0000","last_fullsized":"2023-10-16T23:27:41.951911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:33:08.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641867+0000","last_change":"2023-10-16T23:27:40.726405+0000","last_active":"2023-10-16T23:27:42.641867+0000","last_peered":"2023-10-16T23:27:42.641867+0000","last_clean":"2023-10-16T23:27:42.641867+0000","last_became_active":"2023-10-16T23:27:40.725724+0000","last_became_peered":"2023-10-16T23:27:40.725724+0000","last_unstale":"2023-10-16T23:27:42.641867+0000","last_undegraded":"2023-10-16T23:27:42.641867+0000","last_fullsized":"2023-10-16T23:27:42.641867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698263+0000","last_change":"2023-10-16T23:27:40.337756+0000","last_active":"2023-10-16T23:27:41.698263+0000","last_peered":"2023-10-16T23:27:41.698263+0000","last_clean":"2023-10-16T23:27:41.698263+0000","last_became_active":"2023-10-16T23:27:40.337405+0000","last_became_peered":"2023-10-16T23:27:40.337405+0000","last_unstale":"2023-10-16T23:27:41.698263+0000","last_undegraded":"2023-10-16T23:27:41.698263+0000","last_fullsized":"2023-10-16T23:27:41.698263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:42.154580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704502+0000","last_change":"2023-10-16T23:27:40.722911+0000","last_active":"2023-10-16T23:27:41.704502+0000","last_peered":"2023-10-16T23:27:41.704502+0000","last_clean":"2023-10-16T23:27:41.704502+0000","last_became_active":"2023-10-16T23:27:40.722091+0000","last_became_peered":"2023-10-16T23:27:40.722091+0000","last_unstale":"2023-10-16T23:27:41.704502+0000","last_undegraded":"2023-10-16T23:27:41.704502+0000","last_fullsized":"2023-10-16T23:27:41.704502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.703208+0000","last_change":"2023-10-16T23:27:40.343242+0000","last_active":"2023-10-16T23:27:41.703208+0000","last_peered":"2023-10-16T23:27:41.703208+0000","last_clean":"2023-10-16T23:27:41.703208+0000","last_became_active":"2023-10-16T23:27:40.342213+0000","last_became_peered":"2023-10-16T23:27:40.342213+0000","last_unstale":"2023-10-16T23:27:41.703208+0000","last_undegraded":"2023-10-16T23:27:41.703208+0000","last_fullsized":"2023-10-16T23:27:41.703208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:04.095452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704900+0000","last_change":"2023-10-16T23:27:40.733845+0000","last_active":"2023-10-16T23:27:41.704900+0000","last_peered":"2023-10-16T23:27:41.704900+0000","last_clean":"2023-10-16T23:27:41.704900+0000","last_became_active":"2023-10-16T23:27:40.732996+0000","last_became_peered":"2023-10-16T23:27:40.732996+0000","last_unstale":"2023-10-16T23:27:41.704900+0000","last_undegraded":"2023-10-16T23:27:41.704900+0000","last_fullsized":"2023-10-16T23:27:41.704900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:06:04.512089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702852+0000","last_change":"2023-10-16T23:27:40.347984+0000","last_active":"2023-10-16T23:27:41.702852+0000","last_peered":"2023-10-16T23:27:41.702852+0000","last_clean":"2023-10-16T23:27:41.702852+0000","last_became_active":"2023-10-16T23:27:40.347253+0000","last_became_peered":"2023-10-16T23:27:40.347253+0000","last_unstale":"2023-10-16T23:27:41.702852+0000","last_undegraded":"2023-10-16T23:27:41.702852+0000","last_fullsized":"2023-10-16T23:27:41.702852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:42:46.614672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704750+0000","last_change":"2023-10-16T23:27:40.745245+0000","last_active":"2023-10-16T23:27:41.704750+0000","last_peered":"2023-10-16T23:27:41.704750+0000","last_clean":"2023-10-16T23:27:41.704750+0000","last_became_active":"2023-10-16T23:27:40.744571+0000","last_became_peered":"2023-10-16T23:27:40.744571+0000","last_unstale":"2023-10-16T23:27:41.704750+0000","last_undegraded":"2023-10-16T23:27:41.704750+0000","last_fullsized":"2023-10-16T23:27:41.704750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:10:39.974563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697473+0000","last_change":"2023-10-16T23:27:40.314767+0000","last_active":"2023-10-16T23:27:41.697473+0000","last_peered":"2023-10-16T23:27:41.697473+0000","last_clean":"2023-10-16T23:27:41.697473+0000","last_became_active":"2023-10-16T23:27:40.314242+0000","last_became_peered":"2023-10-16T23:27:40.314242+0000","last_unstale":"2023-10-16T23:27:41.697473+0000","last_undegraded":"2023-10-16T23:27:41.697473+0000","last_fullsized":"2023-10-16T23:27:41.697473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.479126+0000","last_change":"2023-10-16T23:27:40.709591+0000","last_active":"2023-10-16T23:27:42.479126+0000","last_peered":"2023-10-16T23:27:42.479126+0000","last_clean":"2023-10-16T23:27:42.479126+0000","last_became_active":"2023-10-16T23:27:40.709174+0000","last_became_peered":"2023-10-16T23:27:40.709174+0000","last_unstale":"2023-10-16T23:27:42.479126+0000","last_undegraded":"2023-10-16T23:27:42.479126+0000","last_fullsized":"2023-10-16T23:27:42.479126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:31.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.321613+0000","last_change":"2023-10-16T23:27:29.356842+0000","last_active":"2023-10-16T23:27:40.321613+0000","last_peered":"2023-10-16T23:27:40.321613+0000","last_clean":"2023-10-16T23:27:40.321613+0000","last_became_active":"2023-10-16T23:27:29.353846+0000","last_became_peered":"2023-10-16T23:27:29.353846+0000","last_unstale":"2023-10-16T23:27:40.321613+0000","last_undegraded":"2023-10-16T23:27:40.321613+0000","last_fullsized":"2023-10-16T23:27:40.321613+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:28.136202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:28.136202+0000","last_clean_scrub_stamp":"2023-10-16T23:27:28.136202+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:34:30.590360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.706470+0000","last_change":"2023-10-16T23:27:36.278001+0000","last_active":"2023-10-16T23:27:40.706470+0000","last_peered":"2023-10-16T23:27:40.706470+0000","last_clean":"2023-10-16T23:27:40.706470+0000","last_became_active":"2023-10-16T23:27:36.277096+0000","last_became_peered":"2023-10-16T23:27:36.277096+0000","last_unstale":"2023-10-16T23:27:40.706470+0000","last_undegraded":"2023-10-16T23:27:40.706470+0000","last_fullsized":"2023-10-16T23:27:40.706470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:38:00.468059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697647+0000","last_change":"2023-10-16T23:27:40.331268+0000","last_active":"2023-10-16T23:27:41.697647+0000","last_peered":"2023-10-16T23:27:41.697647+0000","last_clean":"2023-10-16T23:27:41.697647+0000","last_became_active":"2023-10-16T23:27:40.330989+0000","last_became_peered":"2023-10-16T23:27:40.330989+0000","last_unstale":"2023-10-16T23:27:41.697647+0000","last_undegraded":"2023-10-16T23:27:41.697647+0000","last_fullsized":"2023-10-16T23:27:41.697647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:55.630817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702608+0000","last_change":"2023-10-16T23:27:40.726429+0000","last_active":"2023-10-16T23:27:41.702608+0000","last_peered":"2023-10-16T23:27:41.702608+0000","last_clean":"2023-10-16T23:27:41.702608+0000","last_became_active":"2023-10-16T23:27:40.725490+0000","last_became_peered":"2023-10-16T23:27:40.725490+0000","last_unstale":"2023-10-16T23:27:41.702608+0000","last_undegraded":"2023-10-16T23:27:41.702608+0000","last_fullsized":"2023-10-16T23:27:41.702608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:52:41.884757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.321352+0000","last_change":"2023-10-16T23:27:36.278865+0000","last_active":"2023-10-16T23:27:40.321352+0000","last_peered":"2023-10-16T23:27:40.321352+0000","last_clean":"2023-10-16T23:27:40.321352+0000","last_became_active":"2023-10-16T23:27:36.277974+0000","last_became_peered":"2023-10-16T23:27:36.277974+0000","last_unstale":"2023-10-16T23:27:40.321352+0000","last_undegraded":"2023-10-16T23:27:40.321352+0000","last_fullsized":"2023-10-16T23:27:40.321352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:31:09.411975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641255+0000","last_change":"2023-10-16T23:27:40.340025+0000","last_active":"2023-10-16T23:27:42.641255+0000","last_peered":"2023-10-16T23:27:42.641255+0000","last_clean":"2023-10-16T23:27:42.641255+0000","last_became_active":"2023-10-16T23:27:40.339569+0000","last_became_peered":"2023-10-16T23:27:40.339569+0000","last_unstale":"2023-10-16T23:27:42.641255+0000","last_undegraded":"2023-10-16T23:27:42.641255+0000","last_fullsized":"2023-10-16T23:27:42.641255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:42.154580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641378+0000","last_change":"2023-10-16T23:27:40.727415+0000","last_active":"2023-10-16T23:27:42.641378+0000","last_peered":"2023-10-16T23:27:42.641378+0000","last_clean":"2023-10-16T23:27:42.641378+0000","last_became_active":"2023-10-16T23:27:40.726813+0000","last_became_peered":"2023-10-16T23:27:40.726813+0000","last_unstale":"2023-10-16T23:27:42.641378+0000","last_undegraded":"2023-10-16T23:27:42.641378+0000","last_fullsized":"2023-10-16T23:27:42.641378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.326535+0000","last_change":"2023-10-16T23:27:36.294967+0000","last_active":"2023-10-16T23:27:40.326535+0000","last_peered":"2023-10-16T23:27:40.326535+0000","last_clean":"2023-10-16T23:27:40.326535+0000","last_became_active":"2023-10-16T23:27:36.294489+0000","last_became_peered":"2023-10-16T23:27:36.294489+0000","last_unstale":"2023-10-16T23:27:40.326535+0000","last_undegraded":"2023-10-16T23:27:40.326535+0000","last_fullsized":"2023-10-16T23:27:40.326535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:43:01.777197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478192+0000","last_change":"2023-10-16T23:27:40.327194+0000","last_active":"2023-10-16T23:27:42.478192+0000","last_peered":"2023-10-16T23:27:42.478192+0000","last_clean":"2023-10-16T23:27:42.478192+0000","last_became_active":"2023-10-16T23:27:40.326396+0000","last_became_peered":"2023-10-16T23:27:40.326396+0000","last_unstale":"2023-10-16T23:27:42.478192+0000","last_undegraded":"2023-10-16T23:27:42.478192+0000","last_fullsized":"2023-10-16T23:27:42.478192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:42.154580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.479151+0000","last_change":"2023-10-16T23:27:40.755777+0000","last_active":"2023-10-16T23:27:42.479151+0000","last_peered":"2023-10-16T23:27:42.479151+0000","last_clean":"2023-10-16T23:27:42.479151+0000","last_became_active":"2023-10-16T23:27:40.755489+0000","last_became_peered":"2023-10-16T23:27:40.755489+0000","last_unstale":"2023-10-16T23:27:42.479151+0000","last_undegraded":"2023-10-16T23:27:42.479151+0000","last_fullsized":"2023-10-16T23:27:42.479151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:06.148922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.720703+0000","last_change":"2023-10-16T23:27:36.279013+0000","last_active":"2023-10-16T23:27:40.720703+0000","last_peered":"2023-10-16T23:27:40.720703+0000","last_clean":"2023-10-16T23:27:40.720703+0000","last_became_active":"2023-10-16T23:27:36.278134+0000","last_became_peered":"2023-10-16T23:27:36.278134+0000","last_unstale":"2023-10-16T23:27:40.720703+0000","last_undegraded":"2023-10-16T23:27:40.720703+0000","last_fullsized":"2023-10-16T23:27:40.720703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:13:01.266310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704433+0000","last_change":"2023-10-16T23:27:40.342715+0000","last_active":"2023-10-16T23:27:41.704433+0000","last_peered":"2023-10-16T23:27:41.704433+0000","last_clean":"2023-10-16T23:27:41.704433+0000","last_became_active":"2023-10-16T23:27:40.341951+0000","last_became_peered":"2023-10-16T23:27:40.341951+0000","last_unstale":"2023-10-16T23:27:41.704433+0000","last_undegraded":"2023-10-16T23:27:41.704433+0000","last_fullsized":"2023-10-16T23:27:41.704433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:59.765109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478850+0000","last_change":"2023-10-16T23:27:40.731557+0000","last_active":"2023-10-16T23:27:42.478850+0000","last_peered":"2023-10-16T23:27:42.478850+0000","last_clean":"2023-10-16T23:27:42.478850+0000","last_became_active":"2023-10-16T23:27:40.731150+0000","last_became_peered":"2023-10-16T23:27:40.731150+0000","last_unstale":"2023-10-16T23:27:42.478850+0000","last_undegraded":"2023-10-16T23:27:42.478850+0000","last_fullsized":"2023-10-16T23:27:42.478850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952480+0000","last_change":"2023-10-16T23:27:40.320403+0000","last_active":"2023-10-16T23:27:41.952480+0000","last_peered":"2023-10-16T23:27:41.952480+0000","last_clean":"2023-10-16T23:27:41.952480+0000","last_became_active":"2023-10-16T23:27:40.319571+0000","last_became_peered":"2023-10-16T23:27:40.319571+0000","last_unstale":"2023-10-16T23:27:41.952480+0000","last_undegraded":"2023-10-16T23:27:41.952480+0000","last_fullsized":"2023-10-16T23:27:41.952480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.699523+0000","last_change":"2023-10-16T23:27:36.434134+0000","last_active":"2023-10-16T23:27:40.699523+0000","last_peered":"2023-10-16T23:27:40.699523+0000","last_clean":"2023-10-16T23:27:40.699523+0000","last_became_active":"2023-10-16T23:27:36.433808+0000","last_became_peered":"2023-10-16T23:27:36.433808+0000","last_unstale":"2023-10-16T23:27:40.699523+0000","last_undegraded":"2023-10-16T23:27:40.699523+0000","last_fullsized":"2023-10-16T23:27:40.699523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:58:44.833474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478822+0000","last_change":"2023-10-16T23:27:40.757932+0000","last_active":"2023-10-16T23:27:42.478822+0000","last_peered":"2023-10-16T23:27:42.478822+0000","last_clean":"2023-10-16T23:27:42.478822+0000","last_became_active":"2023-10-16T23:27:40.757670+0000","last_became_peered":"2023-10-16T23:27:40.757670+0000","last_unstale":"2023-10-16T23:27:42.478822+0000","last_undegraded":"2023-10-16T23:27:42.478822+0000","last_fullsized":"2023-10-16T23:27:42.478822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:25:31.037309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478894+0000","last_change":"2023-10-16T23:27:40.328161+0000","last_active":"2023-10-16T23:27:42.478894+0000","last_peered":"2023-10-16T23:27:42.478894+0000","last_clean":"2023-10-16T23:27:42.478894+0000","last_became_active":"2023-10-16T23:27:40.327804+0000","last_became_peered":"2023-10-16T23:27:40.327804+0000","last_unstale":"2023-10-16T23:27:42.478894+0000","last_undegraded":"2023-10-16T23:27:42.478894+0000","last_fullsized":"2023-10-16T23:27:42.478894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.316621+0000","last_change":"2023-10-16T23:27:36.434231+0000","last_active":"2023-10-16T23:27:40.316621+0000","last_peered":"2023-10-16T23:27:40.316621+0000","last_clean":"2023-10-16T23:27:40.316621+0000","last_became_active":"2023-10-16T23:27:36.433923+0000","last_became_peered":"2023-10-16T23:27:36.433923+0000","last_unstale":"2023-10-16T23:27:40.316621+0000","last_undegraded":"2023-10-16T23:27:40.316621+0000","last_fullsized":"2023-10-16T23:27:40.316621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:59.590093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642126+0000","last_change":"2023-10-16T23:27:40.756257+0000","last_active":"2023-10-16T23:27:42.642126+0000","last_peered":"2023-10-16T23:27:42.642126+0000","last_clean":"2023-10-16T23:27:42.642126+0000","last_became_active":"2023-10-16T23:27:40.755822+0000","last_became_peered":"2023-10-16T23:27:40.755822+0000","last_unstale":"2023-10-16T23:27:42.642126+0000","last_undegraded":"2023-10-16T23:27:42.642126+0000","last_fullsized":"2023-10-16T23:27:42.642126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698868+0000","last_change":"2023-10-16T23:27:40.333672+0000","last_active":"2023-10-16T23:27:41.698868+0000","last_peered":"2023-10-16T23:27:41.698868+0000","last_clean":"2023-10-16T23:27:41.698868+0000","last_became_active":"2023-10-16T23:27:40.333290+0000","last_became_peered":"2023-10-16T23:27:40.333290+0000","last_unstale":"2023-10-16T23:27:41.698868+0000","last_undegraded":"2023-10-16T23:27:41.698868+0000","last_fullsized":"2023-10-16T23:27:41.698868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:15:23.173526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.698124+0000","last_change":"2023-10-16T23:27:36.278805+0000","last_active":"2023-10-16T23:27:40.698124+0000","last_peered":"2023-10-16T23:27:40.698124+0000","last_clean":"2023-10-16T23:27:40.698124+0000","last_became_active":"2023-10-16T23:27:36.278209+0000","last_became_peered":"2023-10-16T23:27:36.278209+0000","last_unstale":"2023-10-16T23:27:40.698124+0000","last_undegraded":"2023-10-16T23:27:40.698124+0000","last_fullsized":"2023-10-16T23:27:40.698124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:38:00.468059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697202+0000","last_change":"2023-10-16T23:27:40.743576+0000","last_active":"2023-10-16T23:27:41.697202+0000","last_peered":"2023-10-16T23:27:41.697202+0000","last_clean":"2023-10-16T23:27:41.697202+0000","last_became_active":"2023-10-16T23:27:40.743293+0000","last_became_peered":"2023-10-16T23:27:40.743293+0000","last_unstale":"2023-10-16T23:27:41.697202+0000","last_undegraded":"2023-10-16T23:27:41.697202+0000","last_fullsized":"2023-10-16T23:27:41.697202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:14.359461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641711+0000","last_change":"2023-10-16T23:27:40.332668+0000","last_active":"2023-10-16T23:27:42.641711+0000","last_peered":"2023-10-16T23:27:42.641711+0000","last_clean":"2023-10-16T23:27:42.641711+0000","last_became_active":"2023-10-16T23:27:40.332084+0000","last_became_peered":"2023-10-16T23:27:40.332084+0000","last_unstale":"2023-10-16T23:27:42.641711+0000","last_undegraded":"2023-10-16T23:27:42.641711+0000","last_fullsized":"2023-10-16T23:27:42.641711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:14.260980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.698418+0000","last_change":"2023-10-16T23:27:36.281494+0000","last_active":"2023-10-16T23:27:40.698418+0000","last_peered":"2023-10-16T23:27:40.698418+0000","last_clean":"2023-10-16T23:27:40.698418+0000","last_became_active":"2023-10-16T23:27:36.280600+0000","last_became_peered":"2023-10-16T23:27:36.280600+0000","last_unstale":"2023-10-16T23:27:40.698418+0000","last_undegraded":"2023-10-16T23:27:40.698418+0000","last_fullsized":"2023-10-16T23:27:40.698418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:42:59.057101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702504+0000","last_change":"2023-10-16T23:27:40.756574+0000","last_active":"2023-10-16T23:27:41.702504+0000","last_peered":"2023-10-16T23:27:41.702504+0000","last_clean":"2023-10-16T23:27:41.702504+0000","last_became_active":"2023-10-16T23:27:40.755830+0000","last_became_peered":"2023-10-16T23:27:40.755830+0000","last_unstale":"2023-10-16T23:27:41.702504+0000","last_undegraded":"2023-10-16T23:27:41.702504+0000","last_fullsized":"2023-10-16T23:27:41.702504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:55:29.771781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704462+0000","last_change":"2023-10-16T23:27:40.745793+0000","last_active":"2023-10-16T23:27:41.704462+0000","last_peered":"2023-10-16T23:27:41.704462+0000","last_clean":"2023-10-16T23:27:41.704462+0000","last_became_active":"2023-10-16T23:27:40.745143+0000","last_became_peered":"2023-10-16T23:27:40.745143+0000","last_unstale":"2023-10-16T23:27:41.704462+0000","last_undegraded":"2023-10-16T23:27:41.704462+0000","last_fullsized":"2023-10-16T23:27:41.704462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:10:37.103208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704642+0000","last_change":"2023-10-16T23:27:40.352546+0000","last_active":"2023-10-16T23:27:41.704642+0000","last_peered":"2023-10-16T23:27:41.704642+0000","last_clean":"2023-10-16T23:27:41.704642+0000","last_became_active":"2023-10-16T23:27:40.351687+0000","last_became_peered":"2023-10-16T23:27:40.351687+0000","last_unstale":"2023-10-16T23:27:41.704642+0000","last_undegraded":"2023-10-16T23:27:41.704642+0000","last_fullsized":"2023-10-16T23:27:41.704642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:14.260980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478618+0000","last_change":"2023-10-16T23:27:40.727602+0000","last_active":"2023-10-16T23:27:42.478618+0000","last_peered":"2023-10-16T23:27:42.478618+0000","last_clean":"2023-10-16T23:27:42.478618+0000","last_became_active":"2023-10-16T23:27:40.727288+0000","last_became_peered":"2023-10-16T23:27:40.727288+0000","last_unstale":"2023-10-16T23:27:42.478618+0000","last_undegraded":"2023-10-16T23:27:42.478618+0000","last_fullsized":"2023-10-16T23:27:42.478618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:56:41.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.766029+0000","last_change":"2023-10-16T23:27:40.332379+0000","last_active":"2023-10-16T23:27:40.766029+0000","last_peered":"2023-10-16T23:27:40.766029+0000","last_clean":"2023-10-16T23:27:40.766029+0000","last_became_active":"2023-10-16T23:27:40.331517+0000","last_became_peered":"2023-10-16T23:27:40.331517+0000","last_unstale":"2023-10-16T23:27:40.766029+0000","last_undegraded":"2023-10-16T23:27:40.766029+0000","last_fullsized":"2023-10-16T23:27:40.766029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:55.534068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952318+0000","last_change":"2023-10-16T23:27:40.336300+0000","last_active":"2023-10-16T23:27:41.952318+0000","last_peered":"2023-10-16T23:27:41.952318+0000","last_clean":"2023-10-16T23:27:41.952318+0000","last_became_active":"2023-10-16T23:27:40.333012+0000","last_became_peered":"2023-10-16T23:27:40.333012+0000","last_unstale":"2023-10-16T23:27:41.952318+0000","last_undegraded":"2023-10-16T23:27:41.952318+0000","last_fullsized":"2023-10-16T23:27:41.952318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697630+0000","last_change":"2023-10-16T23:27:40.760984+0000","last_active":"2023-10-16T23:27:41.697630+0000","last_peered":"2023-10-16T23:27:41.697630+0000","last_clean":"2023-10-16T23:27:41.697630+0000","last_became_active":"2023-10-16T23:27:40.760680+0000","last_became_peered":"2023-10-16T23:27:40.760680+0000","last_unstale":"2023-10-16T23:27:41.697630+0000","last_undegraded":"2023-10-16T23:27:41.697630+0000","last_fullsized":"2023-10-16T23:27:41.697630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:04.722168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642505+0000","last_change":"2023-10-16T23:27:40.339159+0000","last_active":"2023-10-16T23:27:42.642505+0000","last_peered":"2023-10-16T23:27:42.642505+0000","last_clean":"2023-10-16T23:27:42.642505+0000","last_became_active":"2023-10-16T23:27:40.338706+0000","last_became_peered":"2023-10-16T23:27:40.338706+0000","last_unstale":"2023-10-16T23:27:42.642505+0000","last_undegraded":"2023-10-16T23:27:42.642505+0000","last_fullsized":"2023-10-16T23:27:42.642505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:33:08.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697208+0000","last_change":"2023-10-16T23:27:40.713138+0000","last_active":"2023-10-16T23:27:41.697208+0000","last_peered":"2023-10-16T23:27:41.697208+0000","last_clean":"2023-10-16T23:27:41.697208+0000","last_became_active":"2023-10-16T23:27:40.712756+0000","last_became_peered":"2023-10-16T23:27:40.712756+0000","last_unstale":"2023-10-16T23:27:41.697208+0000","last_undegraded":"2023-10-16T23:27:41.697208+0000","last_fullsized":"2023-10-16T23:27:41.697208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:19:17.463284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.703371+0000","last_change":"2023-10-16T23:27:40.756418+0000","last_active":"2023-10-16T23:27:41.703371+0000","last_peered":"2023-10-16T23:27:41.703371+0000","last_clean":"2023-10-16T23:27:41.703371+0000","last_became_active":"2023-10-16T23:27:40.755714+0000","last_became_peered":"2023-10-16T23:27:40.755714+0000","last_unstale":"2023-10-16T23:27:41.703371+0000","last_undegraded":"2023-10-16T23:27:41.703371+0000","last_fullsized":"2023-10-16T23:27:41.703371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:56.634821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697319+0000","last_change":"2023-10-16T23:27:40.332275+0000","last_active":"2023-10-16T23:27:41.697319+0000","last_peered":"2023-10-16T23:27:41.697319+0000","last_clean":"2023-10-16T23:27:41.697319+0000","last_became_active":"2023-10-16T23:27:40.331428+0000","last_became_peered":"2023-10-16T23:27:40.331428+0000","last_unstale":"2023-10-16T23:27:41.697319+0000","last_undegraded":"2023-10-16T23:27:41.697319+0000","last_fullsized":"2023-10-16T23:27:41.697319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641125+0000","last_change":"2023-10-16T23:27:40.761081+0000","last_active":"2023-10-16T23:27:42.641125+0000","last_peered":"2023-10-16T23:27:42.641125+0000","last_clean":"2023-10-16T23:27:42.641125+0000","last_became_active":"2023-10-16T23:27:40.760779+0000","last_became_peered":"2023-10-16T23:27:40.760779+0000","last_unstale":"2023-10-16T23:27:42.641125+0000","last_undegraded":"2023-10-16T23:27:42.641125+0000","last_fullsized":"2023-10-16T23:27:42.641125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:31.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478605+0000","last_change":"2023-10-16T23:27:40.318419+0000","last_active":"2023-10-16T23:27:42.478605+0000","last_peered":"2023-10-16T23:27:42.478605+0000","last_clean":"2023-10-16T23:27:42.478605+0000","last_became_active":"2023-10-16T23:27:40.317622+0000","last_became_peered":"2023-10-16T23:27:40.317622+0000","last_unstale":"2023-10-16T23:27:42.478605+0000","last_undegraded":"2023-10-16T23:27:42.478605+0000","last_fullsized":"2023-10-16T23:27:42.478605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698467+0000","last_change":"2023-10-16T23:27:40.706263+0000","last_active":"2023-10-16T23:27:41.698467+0000","last_peered":"2023-10-16T23:27:41.698467+0000","last_clean":"2023-10-16T23:27:41.698467+0000","last_became_active":"2023-10-16T23:27:40.705956+0000","last_became_peered":"2023-10-16T23:27:40.705956+0000","last_unstale":"2023-10-16T23:27:41.698467+0000","last_undegraded":"2023-10-16T23:27:41.698467+0000","last_fullsized":"2023-10-16T23:27:41.698467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.703994+0000","last_change":"2023-10-16T23:27:40.344965+0000","last_active":"2023-10-16T23:27:41.703994+0000","last_peered":"2023-10-16T23:27:41.703994+0000","last_clean":"2023-10-16T23:27:41.703994+0000","last_became_active":"2023-10-16T23:27:40.344158+0000","last_became_peered":"2023-10-16T23:27:40.344158+0000","last_unstale":"2023-10-16T23:27:41.703994+0000","last_undegraded":"2023-10-16T23:27:41.703994+0000","last_fullsized":"2023-10-16T23:27:41.703994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:04.095452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.732815+0000","last_change":"2023-10-16T23:27:40.713594+0000","last_active":"2023-10-16T23:27:40.732815+0000","last_peered":"2023-10-16T23:27:40.732815+0000","last_clean":"2023-10-16T23:27:40.732815+0000","last_became_active":"2023-10-16T23:27:40.712632+0000","last_became_peered":"2023-10-16T23:27:40.712632+0000","last_unstale":"2023-10-16T23:27:40.732815+0000","last_undegraded":"2023-10-16T23:27:40.732815+0000","last_fullsized":"2023-10-16T23:27:40.732815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:52.368847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642366+0000","last_change":"2023-10-16T23:27:40.357300+0000","last_active":"2023-10-16T23:27:42.642366+0000","last_peered":"2023-10-16T23:27:42.642366+0000","last_clean":"2023-10-16T23:27:42.642366+0000","last_became_active":"2023-10-16T23:27:40.356809+0000","last_became_peered":"2023-10-16T23:27:40.356809+0000","last_unstale":"2023-10-16T23:27:42.642366+0000","last_undegraded":"2023-10-16T23:27:42.642366+0000","last_fullsized":"2023-10-16T23:27:42.642366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704165+0000","last_change":"2023-10-16T23:27:40.726018+0000","last_active":"2023-10-16T23:27:41.704165+0000","last_peered":"2023-10-16T23:27:41.704165+0000","last_clean":"2023-10-16T23:27:41.704165+0000","last_became_active":"2023-10-16T23:27:40.724910+0000","last_became_peered":"2023-10-16T23:27:40.724910+0000","last_unstale":"2023-10-16T23:27:41.704165+0000","last_undegraded":"2023-10-16T23:27:41.704165+0000","last_fullsized":"2023-10-16T23:27:41.704165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:25:34.841325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.951808+0000","last_change":"2023-10-16T23:27:40.345785+0000","last_active":"2023-10-16T23:27:41.951808+0000","last_peered":"2023-10-16T23:27:41.951808+0000","last_clean":"2023-10-16T23:27:41.951808+0000","last_became_active":"2023-10-16T23:27:40.344531+0000","last_became_peered":"2023-10-16T23:27:40.344531+0000","last_unstale":"2023-10-16T23:27:41.951808+0000","last_undegraded":"2023-10-16T23:27:41.951808+0000","last_fullsized":"2023-10-16T23:27:41.951808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:55.630817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702429+0000","last_change":"2023-10-16T23:27:40.720573+0000","last_active":"2023-10-16T23:27:41.702429+0000","last_peered":"2023-10-16T23:27:41.702429+0000","last_clean":"2023-10-16T23:27:41.702429+0000","last_became_active":"2023-10-16T23:27:40.719758+0000","last_became_peered":"2023-10-16T23:27:40.719758+0000","last_unstale":"2023-10-16T23:27:41.702429+0000","last_undegraded":"2023-10-16T23:27:41.702429+0000","last_fullsized":"2023-10-16T23:27:41.702429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:27:29.534374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952407+0000","last_change":"2023-10-16T23:27:40.345400+0000","last_active":"2023-10-16T23:27:41.952407+0000","last_peered":"2023-10-16T23:27:41.952407+0000","last_clean":"2023-10-16T23:27:41.952407+0000","last_became_active":"2023-10-16T23:27:40.344589+0000","last_became_peered":"2023-10-16T23:27:40.344589+0000","last_unstale":"2023-10-16T23:27:41.952407+0000","last_undegraded":"2023-10-16T23:27:41.952407+0000","last_fullsized":"2023-10-16T23:27:41.952407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:15:23.173526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697731+0000","last_change":"2023-10-16T23:27:40.711211+0000","last_active":"2023-10-16T23:27:41.697731+0000","last_peered":"2023-10-16T23:27:41.697731+0000","last_clean":"2023-10-16T23:27:41.697731+0000","last_became_active":"2023-10-16T23:27:40.705936+0000","last_became_peered":"2023-10-16T23:27:40.705936+0000","last_unstale":"2023-10-16T23:27:41.697731+0000","last_undegraded":"2023-10-16T23:27:41.697731+0000","last_fullsized":"2023-10-16T23:27:41.697731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.699046+0000","last_change":"2023-10-16T23:27:40.323626+0000","last_active":"2023-10-16T23:27:41.699046+0000","last_peered":"2023-10-16T23:27:41.699046+0000","last_clean":"2023-10-16T23:27:41.699046+0000","last_became_active":"2023-10-16T23:27:40.323352+0000","last_became_peered":"2023-10-16T23:27:40.323352+0000","last_unstale":"2023-10-16T23:27:41.699046+0000","last_undegraded":"2023-10-16T23:27:41.699046+0000","last_fullsized":"2023-10-16T23:27:41.699046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:33:08.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702217+0000","last_change":"2023-10-16T23:27:40.749109+0000","last_active":"2023-10-16T23:27:41.702217+0000","last_peered":"2023-10-16T23:27:41.702217+0000","last_clean":"2023-10-16T23:27:41.702217+0000","last_became_active":"2023-10-16T23:27:40.748525+0000","last_became_peered":"2023-10-16T23:27:40.748525+0000","last_unstale":"2023-10-16T23:27:41.702217+0000","last_undegraded":"2023-10-16T23:27:41.702217+0000","last_fullsized":"2023-10-16T23:27:41.702217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:10:38.468420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642507+0000","last_change":"2023-10-16T23:27:40.338946+0000","last_active":"2023-10-16T23:27:42.642507+0000","last_peered":"2023-10-16T23:27:42.642507+0000","last_clean":"2023-10-16T23:27:42.642507+0000","last_became_active":"2023-10-16T23:27:40.338565+0000","last_became_peered":"2023-10-16T23:27:40.338565+0000","last_unstale":"2023-10-16T23:27:42.642507+0000","last_undegraded":"2023-10-16T23:27:42.642507+0000","last_fullsized":"2023-10-16T23:27:42.642507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:55.630817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":90844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.381}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":91496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3919999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.635}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4930000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":92464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":249856,"data_stored":90934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":233472,"data_stored":84191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3120000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.502}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":831488,"data_stored":675141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]}]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":856064,"data_stored":676339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31276,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340564,"statfs":{"total":96636764160,"available":96604737536,"internally_reserved":0,"allocated":233472,"data_stored":84191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T23:27:45.429 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-16T23:27:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.584+0000 7fc982d7e640 1 Processor -- start 2023-10-16T23:27:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.584+0000 7fc982d7e640 1 -- start start 2023-10-16T23:27:45.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.588+0000 7fc982d7e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc97c0bf780 0x7fc97c14f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:45.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.588+0000 7fc982d7e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc97c0a6aa0 0x7fc97c14fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:45.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.588+0000 7fc982d7e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97c0c14d0 con 0x7fc97c1499a0 2023-10-16T23:27:45.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.588+0000 7fc982d7e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc97c0a65f0 con 0x7fc97c0bf780 2023-10-16T23:27:45.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.588+0000 7fc982d7e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc97c0a6860 con 0x7fc97c0a6aa0 2023-10-16T23:27:45.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.588+0000 7fc980b1a640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc97c1499a0 0x7fc97c070e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46614/0 (socket says 172.21.15.12:46614) 2023-10-16T23:27:45.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.588+0000 7fc980b1a640 1 -- 172.21.15.12:0/2884231863 learned_addr learned my addr 172.21.15.12:0/2884231863 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:45.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.588+0000 7fc97bfff640 1 --2- 172.21.15.12:0/2884231863 >> v2:172.21.15.12:3300/0 conn(0x7fc97c0bf780 0x7fc97c14f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:45.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.588+0000 7fc98131b640 1 --2- 172.21.15.12:0/2884231863 >> v2:172.21.15.31:3300/0 conn(0x7fc97c0a6aa0 0x7fc97c14fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:45.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.588+0000 7fc97b7fe640 1 -- 172.21.15.12:0/2884231863 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2726604455 0 0) 0x7fc97c0c14d0 con 0x7fc97c1499a0 2023-10-16T23:27:45.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.588+0000 7fc97b7fe640 1 -- 172.21.15.12:0/2884231863 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc96c003530 con 0x7fc97c1499a0 2023-10-16T23:27:45.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.588+0000 7fc97bfff640 1 -- 172.21.15.12:0/2884231863 >> v2:172.21.15.31:3300/0 conn(0x7fc97c0a6aa0 msgr2=0x7fc97c14fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:45.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.588+0000 7fc97bfff640 1 --2- 172.21.15.12:0/2884231863 >> v2:172.21.15.31:3300/0 conn(0x7fc97c0a6aa0 0x7fc97c14fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.588+0000 7fc97bfff640 1 -- 172.21.15.12:0/2884231863 >> v1:172.21.15.12:6789/0 conn(0x7fc97c1499a0 legacy=0x7fc97c070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:45.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.588+0000 7fc97bfff640 1 -- 172.21.15.12:0/2884231863 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c14ff90 con 0x7fc97c0bf780 2023-10-16T23:27:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.588+0000 7fc97bfff640 1 --2- 172.21.15.12:0/2884231863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97c0bf780 0x7fc97c14f510 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc97c0c24a0 tx=0x7fc96801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a93df501a0684c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:45.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.588+0000 7fc97b7fe640 1 -- 172.21.15.12:0/2884231863 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9680ab600 con 0x7fc97c0bf780 2023-10-16T23:27:45.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.588+0000 7fc97b7fe640 1 -- 172.21.15.12:0/2884231863 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9680a7050 con 0x7fc97c0bf780 2023-10-16T23:27:45.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.588+0000 7fc97b7fe640 1 -- 172.21.15.12:0/2884231863 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9680ab980 con 0x7fc97c0bf780 2023-10-16T23:27:45.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.588+0000 7fc982d7e640 1 -- 172.21.15.12:0/2884231863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97c0bf780 msgr2=0x7fc97c14f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:45.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.588+0000 7fc982d7e640 1 --2- 172.21.15.12:0/2884231863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97c0bf780 0x7fc97c14f510 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc97c0c24a0 tx=0x7fc96801c3d0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.588+0000 7fc982d7e640 1 -- 172.21.15.12:0/2884231863 shutdown_connections 2023-10-16T23:27:45.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.588+0000 7fc982d7e640 1 --2- 172.21.15.12:0/2884231863 >> v2:172.21.15.31:3300/0 conn(0x7fc97c0a6aa0 0x7fc97c14fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.588+0000 7fc982d7e640 1 --2- 172.21.15.12:0/2884231863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97c0bf780 0x7fc97c14f510 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.588+0000 7fc982d7e640 1 -- 172.21.15.12:0/2884231863 >> 172.21.15.12:0/2884231863 conn(0x7fc97c0a3f20 msgr2=0x7fc97c0c1880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:45.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc982d7e640 1 -- 172.21.15.12:0/2884231863 shutdown_connections 2023-10-16T23:27:45.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc982d7e640 1 -- 172.21.15.12:0/2884231863 wait complete. 2023-10-16T23:27:45.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc982d7e640 1 Processor -- start 2023-10-16T23:27:45.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc982d7e640 1 -- start start 2023-10-16T23:27:45.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc982d7e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc97c0a6aa0 0x7fc97c14a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:45.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc982d7e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc97c0bf780 0x7fc97c1429f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:45.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc982d7e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97c1499a0 0x7fc97c142f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:45.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc982d7e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c143dc0 con 0x7fc97c1499a0 2023-10-16T23:27:45.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc982d7e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c0a2e50 con 0x7fc97c0bf780 2023-10-16T23:27:45.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc982d7e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c14a6b0 con 0x7fc97c0a6aa0 2023-10-16T23:27:45.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc98131b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97c1499a0 0x7fc97c142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:45.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc98131b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97c1499a0 0x7fc97c142f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40900/0 (socket says 172.21.15.12:40900) 2023-10-16T23:27:45.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc98131b640 1 -- 172.21.15.12:0/2324550888 learned_addr learned my addr 172.21.15.12:0/2324550888 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:45.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc980b1a640 1 --2- 172.21.15.12:0/2324550888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc97c0a6aa0 0x7fc97c14a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:45.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc97bfff640 1 --2- 172.21.15.12:0/2324550888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc97c0bf780 0x7fc97c1429f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:45.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc98131b640 1 -- 172.21.15.12:0/2324550888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc97c0a6aa0 msgr2=0x7fc97c14a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:45.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc98131b640 1 --2- 172.21.15.12:0/2324550888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc97c0a6aa0 0x7fc97c14a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc98131b640 1 -- 172.21.15.12:0/2324550888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc97c0bf780 msgr2=0x7fc97c1429f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:45.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc98131b640 1 --2- 172.21.15.12:0/2324550888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc97c0bf780 0x7fc97c1429f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc98131b640 1 -- 172.21.15.12:0/2324550888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc968009420 con 0x7fc97c1499a0 2023-10-16T23:27:45.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc97bfff640 1 --2- 172.21.15.12:0/2324550888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc97c0bf780 0x7fc97c1429f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:45.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc98131b640 1 --2- 172.21.15.12:0/2324550888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97c1499a0 0x7fc97c142f30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc974007e60 tx=0x7fc97400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:45.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc9797fa640 1 -- 172.21.15.12:0/2324550888 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc974014420 con 0x7fc97c1499a0 2023-10-16T23:27:45.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc9797fa640 1 -- 172.21.15.12:0/2324550888 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9740145a0 con 0x7fc97c1499a0 2023-10-16T23:27:45.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc9797fa640 1 -- 172.21.15.12:0/2324550888 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc974014950 con 0x7fc97c1499a0 2023-10-16T23:27:45.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc982d7e640 1 -- 172.21.15.12:0/2324550888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc97c14b900 con 0x7fc97c1499a0 2023-10-16T23:27:45.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc982d7e640 1 -- 172.21.15.12:0/2324550888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc97c13e810 con 0x7fc97c1499a0 2023-10-16T23:27:45.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.592+0000 7fc982d7e640 1 -- 172.21.15.12:0/2324550888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc97c143f00 con 0x7fc97c1499a0 2023-10-16T23:27:45.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.596+0000 7fc9797fa640 1 -- 172.21.15.12:0/2324550888 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fc974014ab0 con 0x7fc97c1499a0 2023-10-16T23:27:45.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.596+0000 7fc9797fa640 1 --2- 172.21.15.12:0/2324550888 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fc960065e60 0x7fc960068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:45.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.596+0000 7fc9797fa640 1 -- 172.21.15.12:0/2324550888 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc974084200 con 0x7fc97c1499a0 2023-10-16T23:27:45.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.596+0000 7fc980b1a640 1 --2- 172.21.15.12:0/2324550888 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fc960065e60 0x7fc960068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:45.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.596+0000 7fc980b1a640 1 --2- 172.21.15.12:0/2324550888 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fc960065e60 0x7fc960068320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc9700011f0 tx=0x7fc970009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:45.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.600+0000 7fc9797fa640 1 -- 172.21.15.12:0/2324550888 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fc97c143f00 con 0x7fc97c1499a0 2023-10-16T23:27:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.816+0000 7fc982d7e640 1 -- 172.21.15.12:0/2324550888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc97c143f00 con 0x7fc97c1499a0 2023-10-16T23:27:45.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.816+0000 7fc9797fa640 1 -- 172.21.15.12:0/2324550888 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1012 (secure 0 0 0) 0x7fc97c143f00 con 0x7fc97c1499a0 2023-10-16T23:27:45.819 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:45.819 INFO:teuthology.orchestra.run.smithi012.stdout:{"fsid":"0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":24,"num_osds":8,"num_up_osds":8,"osd_up_since":1697498848,"num_in_osds":8,"osd_in_since":1697498838,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592730,"bytes_used":228155392,"bytes_avail":772865957888,"bytes_total":773094113280,"write_bytes_sec":2391,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4281}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-16T23:27:16.471354+0000","services":{}},"progress_events":{}} 2023-10-16T23:27:45.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.816+0000 7fc982d7e640 1 -- 172.21.15.12:0/2324550888 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fc960065e60 msgr2=0x7fc960068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:45.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.816+0000 7fc982d7e640 1 --2- 172.21.15.12:0/2324550888 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fc960065e60 0x7fc960068320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc9700011f0 tx=0x7fc970009040 comp rx=0 tx=0).stop 2023-10-16T23:27:45.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.816+0000 7fc982d7e640 1 -- 172.21.15.12:0/2324550888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97c1499a0 msgr2=0x7fc97c142f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:45.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.816+0000 7fc982d7e640 1 --2- 172.21.15.12:0/2324550888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97c1499a0 0x7fc97c142f30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc974007e60 tx=0x7fc97400e4b0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.816+0000 7fc982d7e640 1 -- 172.21.15.12:0/2324550888 shutdown_connections 2023-10-16T23:27:45.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.816+0000 7fc982d7e640 1 --2- 172.21.15.12:0/2324550888 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fc960065e60 0x7fc960068320 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.816+0000 7fc982d7e640 1 --2- 172.21.15.12:0/2324550888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97c1499a0 0x7fc97c142f30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.816+0000 7fc982d7e640 1 --2- 172.21.15.12:0/2324550888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc97c0bf780 0x7fc97c1429f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.816+0000 7fc982d7e640 1 --2- 172.21.15.12:0/2324550888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc97c0a6aa0 0x7fc97c14a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.816+0000 7fc982d7e640 1 -- 172.21.15.12:0/2324550888 >> 172.21.15.12:0/2324550888 conn(0x7fc97c0a3f20 msgr2=0x7fc97c1465a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:45.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.816+0000 7fc982d7e640 1 -- 172.21.15.12:0/2324550888 shutdown_connections 2023-10-16T23:27:45.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.816+0000 7fc982d7e640 1 -- 172.21.15.12:0/2324550888 wait complete. 2023-10-16T23:27:45.838 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-16T23:27:45.838 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T23:27:45.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.952+0000 7f1086ae3640 1 Processor -- start 2023-10-16T23:27:45.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.952+0000 7f1086ae3640 1 -- start start 2023-10-16T23:27:45.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.956+0000 7f1086ae3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10800a85e0 0x7f10800b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:45.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.956+0000 7f1086ae3640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f10800b9290 0x7f1080136080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:45.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.956+0000 7f1086ae3640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10800a7470 con 0x7f10800bf740 2023-10-16T23:27:45.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.956+0000 7f1086ae3640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10800b9980 con 0x7f10800b9290 2023-10-16T23:27:45.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.956+0000 7f1086ae3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108014d750 con 0x7f10800a85e0 2023-10-16T23:27:45.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.956+0000 7f1085080640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f10800b9290 0x7f1080136080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:45.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.956+0000 7f1085080640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f10800b9290 0x7f1080136080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40912/0 (socket says 172.21.15.12:40912) 2023-10-16T23:27:45.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.956+0000 7f1085080640 1 -- 172.21.15.12:0/452774960 learned_addr learned my addr 172.21.15.12:0/452774960 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:45.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.956+0000 7f107ffff640 1 --2- 172.21.15.12:0/452774960 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10800a85e0 0x7f10800b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:45.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.956+0000 7f1085080640 1 -- 172.21.15.12:0/452774960 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10800a85e0 msgr2=0x7f10800b7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:45.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.956+0000 7f1085080640 1 --2- 172.21.15.12:0/452774960 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10800a85e0 0x7f10800b7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.956+0000 7f1085080640 1 -- 172.21.15.12:0/452774960 >> v1:172.21.15.31:6789/0 conn(0x7f10800bf740 legacy=0x7f108014dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:45.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.956+0000 7f1085080640 1 -- 172.21.15.12:0/452774960 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10800b7ff0 con 0x7f10800b9290 2023-10-16T23:27:45.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.956+0000 7f1085080640 1 --2- 172.21.15.12:0/452774960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10800b9290 0x7f1080136080 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1078009e50 tx=0x7f107801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19573d0cf775a867 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:45.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.956+0000 7f107f7fe640 1 -- 172.21.15.12:0/452774960 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10780a57f0 con 0x7f10800b9290 2023-10-16T23:27:45.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.956+0000 7f107f7fe640 1 -- 172.21.15.12:0/452774960 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10780a5950 con 0x7f10800b9290 2023-10-16T23:27:45.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.956+0000 7f107f7fe640 1 -- 172.21.15.12:0/452774960 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10780a5ce0 con 0x7f10800b9290 2023-10-16T23:27:45.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f1086ae3640 1 -- 172.21.15.12:0/452774960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10800b9290 msgr2=0x7f1080136080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:45.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f1086ae3640 1 --2- 172.21.15.12:0/452774960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10800b9290 0x7f1080136080 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1078009e50 tx=0x7f107801ca10 comp rx=0 tx=0).stop 2023-10-16T23:27:45.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f1086ae3640 1 -- 172.21.15.12:0/452774960 shutdown_connections 2023-10-16T23:27:45.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f1086ae3640 1 --2- 172.21.15.12:0/452774960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10800b9290 0x7f1080136080 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f1086ae3640 1 --2- 172.21.15.12:0/452774960 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10800a85e0 0x7f10800b7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f1086ae3640 1 -- 172.21.15.12:0/452774960 >> 172.21.15.12:0/452774960 conn(0x7f10800c2b50 msgr2=0x7f10800c2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:45.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f1086ae3640 1 -- 172.21.15.12:0/452774960 shutdown_connections 2023-10-16T23:27:45.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f1086ae3640 1 -- 172.21.15.12:0/452774960 wait complete. 2023-10-16T23:27:45.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f1086ae3640 1 Processor -- start 2023-10-16T23:27:45.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f1086ae3640 1 -- start start 2023-10-16T23:27:45.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f1086ae3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10800a85e0 0x7f108006fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:45.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f1086ae3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10800b9290 0x7f10801ec180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:45.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f1086ae3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10800bf740 0x7f108014c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:45.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f1086ae3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10800be8c0 con 0x7f10800a85e0 2023-10-16T23:27:45.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f1086ae3640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1080070350 con 0x7f10800bf740 2023-10-16T23:27:45.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f1086ae3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10800be200 con 0x7f10800b9290 2023-10-16T23:27:45.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f108487f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10800a85e0 0x7f108006fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:45.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f108487f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10800a85e0 0x7f108006fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40928/0 (socket says 172.21.15.12:40928) 2023-10-16T23:27:45.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f108487f640 1 -- 172.21.15.12:0/3719861263 learned_addr learned my addr 172.21.15.12:0/3719861263 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:45.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f1085080640 1 --2- 172.21.15.12:0/3719861263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10800bf740 0x7f108014c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:45.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f107ffff640 1 --2- 172.21.15.12:0/3719861263 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10800b9290 0x7f10801ec180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:45.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f108487f640 1 -- 172.21.15.12:0/3719861263 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10800b9290 msgr2=0x7f10801ec180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:45.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f108487f640 1 --2- 172.21.15.12:0/3719861263 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10800b9290 0x7f10801ec180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f108487f640 1 -- 172.21.15.12:0/3719861263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10800bf740 msgr2=0x7f108014c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:45.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f108487f640 1 --2- 172.21.15.12:0/3719861263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10800bf740 0x7f108014c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:45.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f108487f640 1 -- 172.21.15.12:0/3719861263 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1078009b30 con 0x7f10800a85e0 2023-10-16T23:27:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f108487f640 1 --2- 172.21.15.12:0/3719861263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10800a85e0 0x7f108006fe10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f107000c3a0 tx=0x7f107000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f107d7fa640 1 -- 172.21.15.12:0/3719861263 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10700052d0 con 0x7f10800a85e0 2023-10-16T23:27:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f107d7fa640 1 -- 172.21.15.12:0/3719861263 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1070005430 con 0x7f10800a85e0 2023-10-16T23:27:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f1086ae3640 1 -- 172.21.15.12:0/3719861263 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10800be4e0 con 0x7f10800a85e0 2023-10-16T23:27:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f107d7fa640 1 -- 172.21.15.12:0/3719861263 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1070007260 con 0x7f10800a85e0 2023-10-16T23:27:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.960+0000 7f1086ae3640 1 -- 172.21.15.12:0/3719861263 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f108012e0c0 con 0x7f10800a85e0 2023-10-16T23:27:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.964+0000 7f1086ae3640 1 -- 172.21.15.12:0/3719861263 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10800bea00 con 0x7f10800a85e0 2023-10-16T23:27:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.964+0000 7f107d7fa640 1 -- 172.21.15.12:0/3719861263 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f10700073c0 con 0x7f10800a85e0 2023-10-16T23:27:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.964+0000 7f107d7fa640 1 --2- 172.21.15.12:0/3719861263 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f106c065e60 0x7f106c068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.964+0000 7f107d7fa640 1 -- 172.21.15.12:0/3719861263 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1070082ab0 con 0x7f10800a85e0 2023-10-16T23:27:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.964+0000 7f107ffff640 1 --2- 172.21.15.12:0/3719861263 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f106c065e60 0x7f106c068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:45.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.964+0000 7f107ffff640 1 --2- 172.21.15.12:0/3719861263 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f106c065e60 0x7f106c068320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f108014d1d0 tx=0x7f1074008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:45.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:45.968+0000 7f107d7fa640 1 -- 172.21.15.12:0/3719861263 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f10800bea00 con 0x7f10800a85e0 2023-10-16T23:27:46.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:46.120+0000 7f1086ae3640 1 -- 172.21.15.12:0/3719861263 --> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f10801369d0 con 0x7f106c065e60 2023-10-16T23:27:46.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:46.140+0000 7f107d7fa640 1 -- 172.21.15.12:0/3719861263 <== mgr.4108 v2:172.21.15.31:6832/37949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286683 (secure 0 0 0) 0x7f1074004030 con 0x7f106c065e60 2023-10-16T23:27:46.147 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:46.149 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-16T23:27:46.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:46.144+0000 7f1086ae3640 1 -- 172.21.15.12:0/3719861263 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f106c065e60 msgr2=0x7f106c068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:46.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:46.144+0000 7f1086ae3640 1 --2- 172.21.15.12:0/3719861263 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f106c065e60 0x7f106c068320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f108014d1d0 tx=0x7f1074008040 comp rx=0 tx=0).stop 2023-10-16T23:27:46.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:46.144+0000 7f1086ae3640 1 -- 172.21.15.12:0/3719861263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10800a85e0 msgr2=0x7f108006fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:46.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:46.144+0000 7f1086ae3640 1 --2- 172.21.15.12:0/3719861263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10800a85e0 0x7f108006fe10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f107000c3a0 tx=0x7f107000c860 comp rx=0 tx=0).stop 2023-10-16T23:27:46.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:46.144+0000 7f1086ae3640 1 -- 172.21.15.12:0/3719861263 shutdown_connections 2023-10-16T23:27:46.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:46.144+0000 7f1086ae3640 1 --2- 172.21.15.12:0/3719861263 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f106c065e60 0x7f106c068320 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:46.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:46.144+0000 7f1086ae3640 1 --2- 172.21.15.12:0/3719861263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10800bf740 0x7f108014c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:46.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:46.144+0000 7f1086ae3640 1 --2- 172.21.15.12:0/3719861263 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f10800b9290 0x7f10801ec180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:46.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:46.144+0000 7f1086ae3640 1 --2- 172.21.15.12:0/3719861263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10800a85e0 0x7f108006fe10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:46.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:46.144+0000 7f1086ae3640 1 -- 172.21.15.12:0/3719861263 >> 172.21.15.12:0/3719861263 conn(0x7f10800c2b50 msgr2=0x7f1080135540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:46.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:46.148+0000 7f1086ae3640 1 -- 172.21.15.12:0/3719861263 shutdown_connections 2023-10-16T23:27:46.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:46.148+0000 7f1086ae3640 1 -- 172.21.15.12:0/3719861263 wait complete. 2023-10-16T23:27:46.167 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-16T23:27:45.285022+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222808,"kb_used_data":3096,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751912,"statfs":{"total":773094113280,"available":772865957888,"internally_reserved":0,"allocated":3170304,"data_stored":1885600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":66,"apply_latency_ms":66,"commit_latency_ns":66000000,"apply_latency_ns":66000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.993952"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.731840+0000","last_change":"2023-10-16T23:27:40.706600+0000","last_active":"2023-10-16T23:27:40.731840+0000","last_peered":"2023-10-16T23:27:40.731840+0000","last_clean":"2023-10-16T23:27:40.731840+0000","last_became_active":"2023-10-16T23:27:40.706320+0000","last_became_peered":"2023-10-16T23:27:40.706320+0000","last_unstale":"2023-10-16T23:27:40.731840+0000","last_undegraded":"2023-10-16T23:27:40.731840+0000","last_fullsized":"2023-10-16T23:27:40.731840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:48:20.356964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952090+0000","last_change":"2023-10-16T23:27:40.756555+0000","last_active":"2023-10-16T23:27:41.952090+0000","last_peered":"2023-10-16T23:27:41.952090+0000","last_clean":"2023-10-16T23:27:41.952090+0000","last_became_active":"2023-10-16T23:27:40.754736+0000","last_became_peered":"2023-10-16T23:27:40.754736+0000","last_unstale":"2023-10-16T23:27:41.952090+0000","last_undegraded":"2023-10-16T23:27:41.952090+0000","last_fullsized":"2023-10-16T23:27:41.952090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:45.642622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704753+0000","last_change":"2023-10-16T23:27:40.726586+0000","last_active":"2023-10-16T23:27:41.704753+0000","last_peered":"2023-10-16T23:27:41.704753+0000","last_clean":"2023-10-16T23:27:41.704753+0000","last_became_active":"2023-10-16T23:27:40.725731+0000","last_became_peered":"2023-10-16T23:27:40.725731+0000","last_unstale":"2023-10-16T23:27:41.704753+0000","last_undegraded":"2023-10-16T23:27:41.704753+0000","last_fullsized":"2023-10-16T23:27:41.704753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:04:22.434372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702719+0000","last_change":"2023-10-16T23:27:40.715543+0000","last_active":"2023-10-16T23:27:41.702719+0000","last_peered":"2023-10-16T23:27:41.702719+0000","last_clean":"2023-10-16T23:27:41.702719+0000","last_became_active":"2023-10-16T23:27:40.714592+0000","last_became_peered":"2023-10-16T23:27:40.714592+0000","last_unstale":"2023-10-16T23:27:41.702719+0000","last_undegraded":"2023-10-16T23:27:41.702719+0000","last_fullsized":"2023-10-16T23:27:41.702719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:42:37.696897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642193+0000","last_change":"2023-10-16T23:27:40.722734+0000","last_active":"2023-10-16T23:27:42.642193+0000","last_peered":"2023-10-16T23:27:42.642193+0000","last_clean":"2023-10-16T23:27:42.642193+0000","last_became_active":"2023-10-16T23:27:40.722399+0000","last_became_peered":"2023-10-16T23:27:40.722399+0000","last_unstale":"2023-10-16T23:27:42.642193+0000","last_undegraded":"2023-10-16T23:27:42.642193+0000","last_fullsized":"2023-10-16T23:27:42.642193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:19:17.463284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702182+0000","last_change":"2023-10-16T23:27:40.716139+0000","last_active":"2023-10-16T23:27:41.702182+0000","last_peered":"2023-10-16T23:27:41.702182+0000","last_clean":"2023-10-16T23:27:41.702182+0000","last_became_active":"2023-10-16T23:27:40.715294+0000","last_became_peered":"2023-10-16T23:27:40.715294+0000","last_unstale":"2023-10-16T23:27:41.702182+0000","last_undegraded":"2023-10-16T23:27:41.702182+0000","last_fullsized":"2023-10-16T23:27:41.702182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:19:17.463284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.768298+0000","last_change":"2023-10-16T23:27:40.762253+0000","last_active":"2023-10-16T23:27:40.768298+0000","last_peered":"2023-10-16T23:27:40.768298+0000","last_clean":"2023-10-16T23:27:40.768298+0000","last_became_active":"2023-10-16T23:27:40.760726+0000","last_became_peered":"2023-10-16T23:27:40.760726+0000","last_unstale":"2023-10-16T23:27:40.768298+0000","last_undegraded":"2023-10-16T23:27:40.768298+0000","last_fullsized":"2023-10-16T23:27:40.768298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:50:08.569961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.951568+0000","last_change":"2023-10-16T23:27:40.756184+0000","last_active":"2023-10-16T23:27:41.951568+0000","last_peered":"2023-10-16T23:27:41.951568+0000","last_clean":"2023-10-16T23:27:41.951568+0000","last_became_active":"2023-10-16T23:27:40.755276+0000","last_became_peered":"2023-10-16T23:27:40.755276+0000","last_unstale":"2023-10-16T23:27:41.951568+0000","last_undegraded":"2023-10-16T23:27:41.951568+0000","last_fullsized":"2023-10-16T23:27:41.951568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642253+0000","last_change":"2023-10-16T23:27:40.724060+0000","last_active":"2023-10-16T23:27:42.642253+0000","last_peered":"2023-10-16T23:27:42.642253+0000","last_clean":"2023-10-16T23:27:42.642253+0000","last_became_active":"2023-10-16T23:27:40.723701+0000","last_became_peered":"2023-10-16T23:27:40.723701+0000","last_unstale":"2023-10-16T23:27:42.642253+0000","last_undegraded":"2023-10-16T23:27:42.642253+0000","last_fullsized":"2023-10-16T23:27:42.642253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:04.722168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952181+0000","last_change":"2023-10-16T23:27:40.756783+0000","last_active":"2023-10-16T23:27:41.952181+0000","last_peered":"2023-10-16T23:27:41.952181+0000","last_clean":"2023-10-16T23:27:41.952181+0000","last_became_active":"2023-10-16T23:27:40.755772+0000","last_became_peered":"2023-10-16T23:27:40.755772+0000","last_unstale":"2023-10-16T23:27:41.952181+0000","last_undegraded":"2023-10-16T23:27:41.952181+0000","last_fullsized":"2023-10-16T23:27:41.952181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704832+0000","last_change":"2023-10-16T23:27:40.724754+0000","last_active":"2023-10-16T23:27:41.704832+0000","last_peered":"2023-10-16T23:27:41.704832+0000","last_clean":"2023-10-16T23:27:41.704832+0000","last_became_active":"2023-10-16T23:27:40.724031+0000","last_became_peered":"2023-10-16T23:27:40.724031+0000","last_unstale":"2023-10-16T23:27:41.704832+0000","last_undegraded":"2023-10-16T23:27:41.704832+0000","last_fullsized":"2023-10-16T23:27:41.704832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:04.722168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.732838+0000","last_change":"2023-10-16T23:27:40.724453+0000","last_active":"2023-10-16T23:27:40.732838+0000","last_peered":"2023-10-16T23:27:40.732838+0000","last_clean":"2023-10-16T23:27:40.732838+0000","last_became_active":"2023-10-16T23:27:40.724099+0000","last_became_peered":"2023-10-16T23:27:40.724099+0000","last_unstale":"2023-10-16T23:27:40.732838+0000","last_undegraded":"2023-10-16T23:27:40.732838+0000","last_fullsized":"2023-10-16T23:27:40.732838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:01:05.350517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.727237+0000","last_change":"2023-10-16T23:27:40.704484+0000","last_active":"2023-10-16T23:27:40.727237+0000","last_peered":"2023-10-16T23:27:40.727237+0000","last_clean":"2023-10-16T23:27:40.727237+0000","last_became_active":"2023-10-16T23:27:40.704162+0000","last_became_peered":"2023-10-16T23:27:40.704162+0000","last_unstale":"2023-10-16T23:27:40.727237+0000","last_undegraded":"2023-10-16T23:27:40.727237+0000","last_fullsized":"2023-10-16T23:27:40.727237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:15:16.646850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.951790+0000","last_change":"2023-10-16T23:27:40.738913+0000","last_active":"2023-10-16T23:27:41.951790+0000","last_peered":"2023-10-16T23:27:41.951790+0000","last_clean":"2023-10-16T23:27:41.951790+0000","last_became_active":"2023-10-16T23:27:40.738070+0000","last_became_peered":"2023-10-16T23:27:40.738070+0000","last_unstale":"2023-10-16T23:27:41.951790+0000","last_undegraded":"2023-10-16T23:27:41.951790+0000","last_fullsized":"2023-10-16T23:27:41.951790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:56:41.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.768324+0000","last_change":"2023-10-16T23:27:40.762529+0000","last_active":"2023-10-16T23:27:40.768324+0000","last_peered":"2023-10-16T23:27:40.768324+0000","last_clean":"2023-10-16T23:27:40.768324+0000","last_became_active":"2023-10-16T23:27:40.761570+0000","last_became_peered":"2023-10-16T23:27:40.761570+0000","last_unstale":"2023-10-16T23:27:40.768324+0000","last_undegraded":"2023-10-16T23:27:40.768324+0000","last_fullsized":"2023-10-16T23:27:40.768324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:46.449264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702044+0000","last_change":"2023-10-16T23:27:40.719227+0000","last_active":"2023-10-16T23:27:41.702044+0000","last_peered":"2023-10-16T23:27:41.702044+0000","last_clean":"2023-10-16T23:27:41.702044+0000","last_became_active":"2023-10-16T23:27:40.718276+0000","last_became_peered":"2023-10-16T23:27:40.718276+0000","last_unstale":"2023-10-16T23:27:41.702044+0000","last_undegraded":"2023-10-16T23:27:41.702044+0000","last_fullsized":"2023-10-16T23:27:41.702044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642387+0000","last_change":"2023-10-16T23:27:40.719723+0000","last_active":"2023-10-16T23:27:42.642387+0000","last_peered":"2023-10-16T23:27:42.642387+0000","last_clean":"2023-10-16T23:27:42.642387+0000","last_became_active":"2023-10-16T23:27:40.719402+0000","last_became_peered":"2023-10-16T23:27:40.719402+0000","last_unstale":"2023-10-16T23:27:42.642387+0000","last_undegraded":"2023-10-16T23:27:42.642387+0000","last_fullsized":"2023-10-16T23:27:42.642387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:04:22.434372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704498+0000","last_change":"2023-10-16T23:27:40.732931+0000","last_active":"2023-10-16T23:27:41.704498+0000","last_peered":"2023-10-16T23:27:41.704498+0000","last_clean":"2023-10-16T23:27:41.704498+0000","last_became_active":"2023-10-16T23:27:40.732102+0000","last_became_peered":"2023-10-16T23:27:40.732102+0000","last_unstale":"2023-10-16T23:27:41.704498+0000","last_undegraded":"2023-10-16T23:27:41.704498+0000","last_fullsized":"2023-10-16T23:27:41.704498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:14.359461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.738111+0000","last_change":"2023-10-16T23:27:40.728920+0000","last_active":"2023-10-16T23:27:40.738111+0000","last_peered":"2023-10-16T23:27:40.738111+0000","last_clean":"2023-10-16T23:27:40.738111+0000","last_became_active":"2023-10-16T23:27:40.728298+0000","last_became_peered":"2023-10-16T23:27:40.728298+0000","last_unstale":"2023-10-16T23:27:40.738111+0000","last_undegraded":"2023-10-16T23:27:40.738111+0000","last_fullsized":"2023-10-16T23:27:40.738111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:28:33.509782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704201+0000","last_change":"2023-10-16T23:27:40.745270+0000","last_active":"2023-10-16T23:27:41.704201+0000","last_peered":"2023-10-16T23:27:41.704201+0000","last_clean":"2023-10-16T23:27:41.704201+0000","last_became_active":"2023-10-16T23:27:40.744483+0000","last_became_peered":"2023-10-16T23:27:40.744483+0000","last_unstale":"2023-10-16T23:27:41.704201+0000","last_undegraded":"2023-10-16T23:27:41.704201+0000","last_fullsized":"2023-10-16T23:27:41.704201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:24:33.998070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.768568+0000","last_change":"2023-10-16T23:27:40.761480+0000","last_active":"2023-10-16T23:27:40.768568+0000","last_peered":"2023-10-16T23:27:40.768568+0000","last_clean":"2023-10-16T23:27:40.768568+0000","last_became_active":"2023-10-16T23:27:40.760882+0000","last_became_peered":"2023-10-16T23:27:40.760882+0000","last_unstale":"2023-10-16T23:27:40.768568+0000","last_undegraded":"2023-10-16T23:27:40.768568+0000","last_fullsized":"2023-10-16T23:27:40.768568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:37:38.843931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.640893+0000","last_change":"2023-10-16T23:27:40.722620+0000","last_active":"2023-10-16T23:27:42.640893+0000","last_peered":"2023-10-16T23:27:42.640893+0000","last_clean":"2023-10-16T23:27:42.640893+0000","last_became_active":"2023-10-16T23:27:40.722302+0000","last_became_peered":"2023-10-16T23:27:40.722302+0000","last_unstale":"2023-10-16T23:27:42.640893+0000","last_undegraded":"2023-10-16T23:27:42.640893+0000","last_fullsized":"2023-10-16T23:27:42.640893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697349+0000","last_change":"2023-10-16T23:27:40.716578+0000","last_active":"2023-10-16T23:27:41.697349+0000","last_peered":"2023-10-16T23:27:41.697349+0000","last_clean":"2023-10-16T23:27:41.697349+0000","last_became_active":"2023-10-16T23:27:40.716228+0000","last_became_peered":"2023-10-16T23:27:40.716228+0000","last_unstale":"2023-10-16T23:27:41.697349+0000","last_undegraded":"2023-10-16T23:27:41.697349+0000","last_fullsized":"2023-10-16T23:27:41.697349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:27:29.534374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.767849+0000","last_change":"2023-10-16T23:27:40.761323+0000","last_active":"2023-10-16T23:27:40.767849+0000","last_peered":"2023-10-16T23:27:40.767849+0000","last_clean":"2023-10-16T23:27:40.767849+0000","last_became_active":"2023-10-16T23:27:40.760659+0000","last_became_peered":"2023-10-16T23:27:40.760659+0000","last_unstale":"2023-10-16T23:27:40.767849+0000","last_undegraded":"2023-10-16T23:27:40.767849+0000","last_fullsized":"2023-10-16T23:27:40.767849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:09:55.835429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478936+0000","last_change":"2023-10-16T23:27:40.727629+0000","last_active":"2023-10-16T23:27:42.478936+0000","last_peered":"2023-10-16T23:27:42.478936+0000","last_clean":"2023-10-16T23:27:42.478936+0000","last_became_active":"2023-10-16T23:27:40.727334+0000","last_became_peered":"2023-10-16T23:27:40.727334+0000","last_unstale":"2023-10-16T23:27:42.478936+0000","last_undegraded":"2023-10-16T23:27:42.478936+0000","last_fullsized":"2023-10-16T23:27:42.478936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:38:33.383867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.479296+0000","last_change":"2023-10-16T23:27:40.704775+0000","last_active":"2023-10-16T23:27:42.479296+0000","last_peered":"2023-10-16T23:27:42.479296+0000","last_clean":"2023-10-16T23:27:42.479296+0000","last_became_active":"2023-10-16T23:27:40.704536+0000","last_became_peered":"2023-10-16T23:27:40.704536+0000","last_unstale":"2023-10-16T23:27:42.479296+0000","last_undegraded":"2023-10-16T23:27:42.479296+0000","last_fullsized":"2023-10-16T23:27:42.479296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952175+0000","last_change":"2023-10-16T23:27:40.764351+0000","last_active":"2023-10-16T23:27:41.952175+0000","last_peered":"2023-10-16T23:27:41.952175+0000","last_clean":"2023-10-16T23:27:41.952175+0000","last_became_active":"2023-10-16T23:27:40.763592+0000","last_became_peered":"2023-10-16T23:27:40.763592+0000","last_unstale":"2023-10-16T23:27:41.952175+0000","last_undegraded":"2023-10-16T23:27:41.952175+0000","last_fullsized":"2023-10-16T23:27:41.952175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.479026+0000","last_change":"2023-10-16T23:27:40.760989+0000","last_active":"2023-10-16T23:27:42.479026+0000","last_peered":"2023-10-16T23:27:42.479026+0000","last_clean":"2023-10-16T23:27:42.479026+0000","last_became_active":"2023-10-16T23:27:40.760615+0000","last_became_peered":"2023-10-16T23:27:40.760615+0000","last_unstale":"2023-10-16T23:27:42.479026+0000","last_undegraded":"2023-10-16T23:27:42.479026+0000","last_fullsized":"2023-10-16T23:27:42.479026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698072+0000","last_change":"2023-10-16T23:27:40.760762+0000","last_active":"2023-10-16T23:27:41.698072+0000","last_peered":"2023-10-16T23:27:41.698072+0000","last_clean":"2023-10-16T23:27:41.698072+0000","last_became_active":"2023-10-16T23:27:40.760437+0000","last_became_peered":"2023-10-16T23:27:40.760437+0000","last_unstale":"2023-10-16T23:27:41.698072+0000","last_undegraded":"2023-10-16T23:27:41.698072+0000","last_fullsized":"2023-10-16T23:27:41.698072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:55:29.771781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.703806+0000","last_change":"2023-10-16T23:27:40.745197+0000","last_active":"2023-10-16T23:27:41.703806+0000","last_peered":"2023-10-16T23:27:41.703806+0000","last_clean":"2023-10-16T23:27:41.703806+0000","last_became_active":"2023-10-16T23:27:40.744458+0000","last_became_peered":"2023-10-16T23:27:40.744458+0000","last_unstale":"2023-10-16T23:27:41.703806+0000","last_undegraded":"2023-10-16T23:27:41.703806+0000","last_fullsized":"2023-10-16T23:27:41.703806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697368+0000","last_change":"2023-10-16T23:27:40.711795+0000","last_active":"2023-10-16T23:27:41.697368+0000","last_peered":"2023-10-16T23:27:41.697368+0000","last_clean":"2023-10-16T23:27:41.697368+0000","last_became_active":"2023-10-16T23:27:40.711492+0000","last_became_peered":"2023-10-16T23:27:40.711492+0000","last_unstale":"2023-10-16T23:27:41.697368+0000","last_undegraded":"2023-10-16T23:27:41.697368+0000","last_fullsized":"2023-10-16T23:27:41.697368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:04:22.434372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702060+0000","last_change":"2023-10-16T23:27:40.710149+0000","last_active":"2023-10-16T23:27:41.702060+0000","last_peered":"2023-10-16T23:27:41.702060+0000","last_clean":"2023-10-16T23:27:41.702060+0000","last_became_active":"2023-10-16T23:27:40.709286+0000","last_became_peered":"2023-10-16T23:27:40.709286+0000","last_unstale":"2023-10-16T23:27:41.702060+0000","last_undegraded":"2023-10-16T23:27:41.702060+0000","last_fullsized":"2023-10-16T23:27:41.702060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:22:41.708468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698461+0000","last_change":"2023-10-16T23:27:40.707271+0000","last_active":"2023-10-16T23:27:41.698461+0000","last_peered":"2023-10-16T23:27:41.698461+0000","last_clean":"2023-10-16T23:27:41.698461+0000","last_became_active":"2023-10-16T23:27:40.706864+0000","last_became_peered":"2023-10-16T23:27:40.706864+0000","last_unstale":"2023-10-16T23:27:41.698461+0000","last_undegraded":"2023-10-16T23:27:41.698461+0000","last_fullsized":"2023-10-16T23:27:41.698461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.765681+0000","last_change":"2023-10-16T23:27:40.353567+0000","last_active":"2023-10-16T23:27:40.765681+0000","last_peered":"2023-10-16T23:27:40.765681+0000","last_clean":"2023-10-16T23:27:40.765681+0000","last_became_active":"2023-10-16T23:27:40.352775+0000","last_became_peered":"2023-10-16T23:27:40.352775+0000","last_unstale":"2023-10-16T23:27:40.765681+0000","last_undegraded":"2023-10-16T23:27:40.765681+0000","last_fullsized":"2023-10-16T23:27:40.765681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:52:58.351406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952358+0000","last_change":"2023-10-16T23:27:40.765398+0000","last_active":"2023-10-16T23:27:41.952358+0000","last_peered":"2023-10-16T23:27:41.952358+0000","last_clean":"2023-10-16T23:27:41.952358+0000","last_became_active":"2023-10-16T23:27:40.764517+0000","last_became_peered":"2023-10-16T23:27:40.764517+0000","last_unstale":"2023-10-16T23:27:41.952358+0000","last_undegraded":"2023-10-16T23:27:41.952358+0000","last_fullsized":"2023-10-16T23:27:41.952358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:31.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641131+0000","last_change":"2023-10-16T23:27:40.335221+0000","last_active":"2023-10-16T23:27:42.641131+0000","last_peered":"2023-10-16T23:27:42.641131+0000","last_clean":"2023-10-16T23:27:42.641131+0000","last_became_active":"2023-10-16T23:27:40.334885+0000","last_became_peered":"2023-10-16T23:27:40.334885+0000","last_unstale":"2023-10-16T23:27:42.641131+0000","last_undegraded":"2023-10-16T23:27:42.641131+0000","last_fullsized":"2023-10-16T23:27:42.641131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641719+0000","last_change":"2023-10-16T23:27:40.719997+0000","last_active":"2023-10-16T23:27:42.641719+0000","last_peered":"2023-10-16T23:27:42.641719+0000","last_clean":"2023-10-16T23:27:42.641719+0000","last_became_active":"2023-10-16T23:27:40.719811+0000","last_became_peered":"2023-10-16T23:27:40.719811+0000","last_unstale":"2023-10-16T23:27:42.641719+0000","last_undegraded":"2023-10-16T23:27:42.641719+0000","last_fullsized":"2023-10-16T23:27:42.641719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:13.934735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.733515+0000","last_change":"2023-10-16T23:27:40.357620+0000","last_active":"2023-10-16T23:27:40.733515+0000","last_peered":"2023-10-16T23:27:40.733515+0000","last_clean":"2023-10-16T23:27:40.733515+0000","last_became_active":"2023-10-16T23:27:40.357009+0000","last_became_peered":"2023-10-16T23:27:40.357009+0000","last_unstale":"2023-10-16T23:27:40.733515+0000","last_undegraded":"2023-10-16T23:27:40.733515+0000","last_fullsized":"2023-10-16T23:27:40.733515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:07:50.847519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698809+0000","last_change":"2023-10-16T23:27:40.760925+0000","last_active":"2023-10-16T23:27:41.698809+0000","last_peered":"2023-10-16T23:27:41.698809+0000","last_clean":"2023-10-16T23:27:41.698809+0000","last_became_active":"2023-10-16T23:27:40.760365+0000","last_became_peered":"2023-10-16T23:27:40.760365+0000","last_unstale":"2023-10-16T23:27:41.698809+0000","last_undegraded":"2023-10-16T23:27:41.698809+0000","last_fullsized":"2023-10-16T23:27:41.698809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:13.934735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702299+0000","last_change":"2023-10-16T23:27:40.331826+0000","last_active":"2023-10-16T23:27:41.702299+0000","last_peered":"2023-10-16T23:27:41.702299+0000","last_clean":"2023-10-16T23:27:41.702299+0000","last_became_active":"2023-10-16T23:27:40.330857+0000","last_became_peered":"2023-10-16T23:27:40.330857+0000","last_unstale":"2023-10-16T23:27:41.702299+0000","last_undegraded":"2023-10-16T23:27:41.702299+0000","last_fullsized":"2023-10-16T23:27:41.702299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:42:46.614672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.765866+0000","last_change":"2023-10-16T23:27:40.357691+0000","last_active":"2023-10-16T23:27:40.765866+0000","last_peered":"2023-10-16T23:27:40.765866+0000","last_clean":"2023-10-16T23:27:40.765866+0000","last_became_active":"2023-10-16T23:27:40.357047+0000","last_became_peered":"2023-10-16T23:27:40.357047+0000","last_unstale":"2023-10-16T23:27:40.765866+0000","last_undegraded":"2023-10-16T23:27:40.765866+0000","last_fullsized":"2023-10-16T23:27:40.765866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:00:00.805564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.951579+0000","last_change":"2023-10-16T23:27:40.763848+0000","last_active":"2023-10-16T23:27:41.951579+0000","last_peered":"2023-10-16T23:27:41.951579+0000","last_clean":"2023-10-16T23:27:41.951579+0000","last_became_active":"2023-10-16T23:27:40.763116+0000","last_became_peered":"2023-10-16T23:27:40.763116+0000","last_unstale":"2023-10-16T23:27:41.951579+0000","last_undegraded":"2023-10-16T23:27:41.951579+0000","last_fullsized":"2023-10-16T23:27:41.951579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.765162+0000","last_change":"2023-10-16T23:27:40.347016+0000","last_active":"2023-10-16T23:27:40.765162+0000","last_peered":"2023-10-16T23:27:40.765162+0000","last_clean":"2023-10-16T23:27:40.765162+0000","last_became_active":"2023-10-16T23:27:40.346439+0000","last_became_peered":"2023-10-16T23:27:40.346439+0000","last_unstale":"2023-10-16T23:27:40.765162+0000","last_undegraded":"2023-10-16T23:27:40.765162+0000","last_fullsized":"2023-10-16T23:27:40.765162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:08:40.047699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702083+0000","last_change":"2023-10-16T23:27:40.714905+0000","last_active":"2023-10-16T23:27:41.702083+0000","last_peered":"2023-10-16T23:27:41.702083+0000","last_clean":"2023-10-16T23:27:41.702083+0000","last_became_active":"2023-10-16T23:27:40.714098+0000","last_became_peered":"2023-10-16T23:27:40.714098+0000","last_unstale":"2023-10-16T23:27:41.702083+0000","last_undegraded":"2023-10-16T23:27:41.702083+0000","last_fullsized":"2023-10-16T23:27:41.702083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:13.934735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.765964+0000","last_change":"2023-10-16T23:27:40.340462+0000","last_active":"2023-10-16T23:27:40.765964+0000","last_peered":"2023-10-16T23:27:40.765964+0000","last_clean":"2023-10-16T23:27:40.765964+0000","last_became_active":"2023-10-16T23:27:40.339531+0000","last_became_peered":"2023-10-16T23:27:40.339531+0000","last_unstale":"2023-10-16T23:27:40.765964+0000","last_undegraded":"2023-10-16T23:27:40.765964+0000","last_fullsized":"2023-10-16T23:27:40.765964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:33:50.768168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702961+0000","last_change":"2023-10-16T23:27:40.713930+0000","last_active":"2023-10-16T23:27:41.702961+0000","last_peered":"2023-10-16T23:27:41.702961+0000","last_clean":"2023-10-16T23:27:41.702961+0000","last_became_active":"2023-10-16T23:27:40.713087+0000","last_became_peered":"2023-10-16T23:27:40.713087+0000","last_unstale":"2023-10-16T23:27:41.702961+0000","last_undegraded":"2023-10-16T23:27:41.702961+0000","last_fullsized":"2023-10-16T23:27:41.702961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:15:24.177529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.951911+0000","last_change":"2023-10-16T23:27:40.320848+0000","last_active":"2023-10-16T23:27:41.951911+0000","last_peered":"2023-10-16T23:27:41.951911+0000","last_clean":"2023-10-16T23:27:41.951911+0000","last_became_active":"2023-10-16T23:27:40.319887+0000","last_became_peered":"2023-10-16T23:27:40.319887+0000","last_unstale":"2023-10-16T23:27:41.951911+0000","last_undegraded":"2023-10-16T23:27:41.951911+0000","last_fullsized":"2023-10-16T23:27:41.951911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:33:08.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641867+0000","last_change":"2023-10-16T23:27:40.726405+0000","last_active":"2023-10-16T23:27:42.641867+0000","last_peered":"2023-10-16T23:27:42.641867+0000","last_clean":"2023-10-16T23:27:42.641867+0000","last_became_active":"2023-10-16T23:27:40.725724+0000","last_became_peered":"2023-10-16T23:27:40.725724+0000","last_unstale":"2023-10-16T23:27:42.641867+0000","last_undegraded":"2023-10-16T23:27:42.641867+0000","last_fullsized":"2023-10-16T23:27:42.641867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698263+0000","last_change":"2023-10-16T23:27:40.337756+0000","last_active":"2023-10-16T23:27:41.698263+0000","last_peered":"2023-10-16T23:27:41.698263+0000","last_clean":"2023-10-16T23:27:41.698263+0000","last_became_active":"2023-10-16T23:27:40.337405+0000","last_became_peered":"2023-10-16T23:27:40.337405+0000","last_unstale":"2023-10-16T23:27:41.698263+0000","last_undegraded":"2023-10-16T23:27:41.698263+0000","last_fullsized":"2023-10-16T23:27:41.698263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:42.154580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704502+0000","last_change":"2023-10-16T23:27:40.722911+0000","last_active":"2023-10-16T23:27:41.704502+0000","last_peered":"2023-10-16T23:27:41.704502+0000","last_clean":"2023-10-16T23:27:41.704502+0000","last_became_active":"2023-10-16T23:27:40.722091+0000","last_became_peered":"2023-10-16T23:27:40.722091+0000","last_unstale":"2023-10-16T23:27:41.704502+0000","last_undegraded":"2023-10-16T23:27:41.704502+0000","last_fullsized":"2023-10-16T23:27:41.704502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.703208+0000","last_change":"2023-10-16T23:27:40.343242+0000","last_active":"2023-10-16T23:27:41.703208+0000","last_peered":"2023-10-16T23:27:41.703208+0000","last_clean":"2023-10-16T23:27:41.703208+0000","last_became_active":"2023-10-16T23:27:40.342213+0000","last_became_peered":"2023-10-16T23:27:40.342213+0000","last_unstale":"2023-10-16T23:27:41.703208+0000","last_undegraded":"2023-10-16T23:27:41.703208+0000","last_fullsized":"2023-10-16T23:27:41.703208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:04.095452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704900+0000","last_change":"2023-10-16T23:27:40.733845+0000","last_active":"2023-10-16T23:27:41.704900+0000","last_peered":"2023-10-16T23:27:41.704900+0000","last_clean":"2023-10-16T23:27:41.704900+0000","last_became_active":"2023-10-16T23:27:40.732996+0000","last_became_peered":"2023-10-16T23:27:40.732996+0000","last_unstale":"2023-10-16T23:27:41.704900+0000","last_undegraded":"2023-10-16T23:27:41.704900+0000","last_fullsized":"2023-10-16T23:27:41.704900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:06:04.512089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702852+0000","last_change":"2023-10-16T23:27:40.347984+0000","last_active":"2023-10-16T23:27:41.702852+0000","last_peered":"2023-10-16T23:27:41.702852+0000","last_clean":"2023-10-16T23:27:41.702852+0000","last_became_active":"2023-10-16T23:27:40.347253+0000","last_became_peered":"2023-10-16T23:27:40.347253+0000","last_unstale":"2023-10-16T23:27:41.702852+0000","last_undegraded":"2023-10-16T23:27:41.702852+0000","last_fullsized":"2023-10-16T23:27:41.702852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:42:46.614672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704750+0000","last_change":"2023-10-16T23:27:40.745245+0000","last_active":"2023-10-16T23:27:41.704750+0000","last_peered":"2023-10-16T23:27:41.704750+0000","last_clean":"2023-10-16T23:27:41.704750+0000","last_became_active":"2023-10-16T23:27:40.744571+0000","last_became_peered":"2023-10-16T23:27:40.744571+0000","last_unstale":"2023-10-16T23:27:41.704750+0000","last_undegraded":"2023-10-16T23:27:41.704750+0000","last_fullsized":"2023-10-16T23:27:41.704750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:10:39.974563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697473+0000","last_change":"2023-10-16T23:27:40.314767+0000","last_active":"2023-10-16T23:27:41.697473+0000","last_peered":"2023-10-16T23:27:41.697473+0000","last_clean":"2023-10-16T23:27:41.697473+0000","last_became_active":"2023-10-16T23:27:40.314242+0000","last_became_peered":"2023-10-16T23:27:40.314242+0000","last_unstale":"2023-10-16T23:27:41.697473+0000","last_undegraded":"2023-10-16T23:27:41.697473+0000","last_fullsized":"2023-10-16T23:27:41.697473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.479126+0000","last_change":"2023-10-16T23:27:40.709591+0000","last_active":"2023-10-16T23:27:42.479126+0000","last_peered":"2023-10-16T23:27:42.479126+0000","last_clean":"2023-10-16T23:27:42.479126+0000","last_became_active":"2023-10-16T23:27:40.709174+0000","last_became_peered":"2023-10-16T23:27:40.709174+0000","last_unstale":"2023-10-16T23:27:42.479126+0000","last_undegraded":"2023-10-16T23:27:42.479126+0000","last_fullsized":"2023-10-16T23:27:42.479126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:31.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.321613+0000","last_change":"2023-10-16T23:27:29.356842+0000","last_active":"2023-10-16T23:27:40.321613+0000","last_peered":"2023-10-16T23:27:40.321613+0000","last_clean":"2023-10-16T23:27:40.321613+0000","last_became_active":"2023-10-16T23:27:29.353846+0000","last_became_peered":"2023-10-16T23:27:29.353846+0000","last_unstale":"2023-10-16T23:27:40.321613+0000","last_undegraded":"2023-10-16T23:27:40.321613+0000","last_fullsized":"2023-10-16T23:27:40.321613+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:28.136202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:28.136202+0000","last_clean_scrub_stamp":"2023-10-16T23:27:28.136202+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:34:30.590360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.706470+0000","last_change":"2023-10-16T23:27:36.278001+0000","last_active":"2023-10-16T23:27:40.706470+0000","last_peered":"2023-10-16T23:27:40.706470+0000","last_clean":"2023-10-16T23:27:40.706470+0000","last_became_active":"2023-10-16T23:27:36.277096+0000","last_became_peered":"2023-10-16T23:27:36.277096+0000","last_unstale":"2023-10-16T23:27:40.706470+0000","last_undegraded":"2023-10-16T23:27:40.706470+0000","last_fullsized":"2023-10-16T23:27:40.706470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:38:00.468059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697647+0000","last_change":"2023-10-16T23:27:40.331268+0000","last_active":"2023-10-16T23:27:41.697647+0000","last_peered":"2023-10-16T23:27:41.697647+0000","last_clean":"2023-10-16T23:27:41.697647+0000","last_became_active":"2023-10-16T23:27:40.330989+0000","last_became_peered":"2023-10-16T23:27:40.330989+0000","last_unstale":"2023-10-16T23:27:41.697647+0000","last_undegraded":"2023-10-16T23:27:41.697647+0000","last_fullsized":"2023-10-16T23:27:41.697647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:55.630817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702608+0000","last_change":"2023-10-16T23:27:40.726429+0000","last_active":"2023-10-16T23:27:41.702608+0000","last_peered":"2023-10-16T23:27:41.702608+0000","last_clean":"2023-10-16T23:27:41.702608+0000","last_became_active":"2023-10-16T23:27:40.725490+0000","last_became_peered":"2023-10-16T23:27:40.725490+0000","last_unstale":"2023-10-16T23:27:41.702608+0000","last_undegraded":"2023-10-16T23:27:41.702608+0000","last_fullsized":"2023-10-16T23:27:41.702608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:52:41.884757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.321352+0000","last_change":"2023-10-16T23:27:36.278865+0000","last_active":"2023-10-16T23:27:40.321352+0000","last_peered":"2023-10-16T23:27:40.321352+0000","last_clean":"2023-10-16T23:27:40.321352+0000","last_became_active":"2023-10-16T23:27:36.277974+0000","last_became_peered":"2023-10-16T23:27:36.277974+0000","last_unstale":"2023-10-16T23:27:40.321352+0000","last_undegraded":"2023-10-16T23:27:40.321352+0000","last_fullsized":"2023-10-16T23:27:40.321352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:31:09.411975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641255+0000","last_change":"2023-10-16T23:27:40.340025+0000","last_active":"2023-10-16T23:27:42.641255+0000","last_peered":"2023-10-16T23:27:42.641255+0000","last_clean":"2023-10-16T23:27:42.641255+0000","last_became_active":"2023-10-16T23:27:40.339569+0000","last_became_peered":"2023-10-16T23:27:40.339569+0000","last_unstale":"2023-10-16T23:27:42.641255+0000","last_undegraded":"2023-10-16T23:27:42.641255+0000","last_fullsized":"2023-10-16T23:27:42.641255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:42.154580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641378+0000","last_change":"2023-10-16T23:27:40.727415+0000","last_active":"2023-10-16T23:27:42.641378+0000","last_peered":"2023-10-16T23:27:42.641378+0000","last_clean":"2023-10-16T23:27:42.641378+0000","last_became_active":"2023-10-16T23:27:40.726813+0000","last_became_peered":"2023-10-16T23:27:40.726813+0000","last_unstale":"2023-10-16T23:27:42.641378+0000","last_undegraded":"2023-10-16T23:27:42.641378+0000","last_fullsized":"2023-10-16T23:27:42.641378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.326535+0000","last_change":"2023-10-16T23:27:36.294967+0000","last_active":"2023-10-16T23:27:40.326535+0000","last_peered":"2023-10-16T23:27:40.326535+0000","last_clean":"2023-10-16T23:27:40.326535+0000","last_became_active":"2023-10-16T23:27:36.294489+0000","last_became_peered":"2023-10-16T23:27:36.294489+0000","last_unstale":"2023-10-16T23:27:40.326535+0000","last_undegraded":"2023-10-16T23:27:40.326535+0000","last_fullsized":"2023-10-16T23:27:40.326535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:43:01.777197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478192+0000","last_change":"2023-10-16T23:27:40.327194+0000","last_active":"2023-10-16T23:27:42.478192+0000","last_peered":"2023-10-16T23:27:42.478192+0000","last_clean":"2023-10-16T23:27:42.478192+0000","last_became_active":"2023-10-16T23:27:40.326396+0000","last_became_peered":"2023-10-16T23:27:40.326396+0000","last_unstale":"2023-10-16T23:27:42.478192+0000","last_undegraded":"2023-10-16T23:27:42.478192+0000","last_fullsized":"2023-10-16T23:27:42.478192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:42.154580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.479151+0000","last_change":"2023-10-16T23:27:40.755777+0000","last_active":"2023-10-16T23:27:42.479151+0000","last_peered":"2023-10-16T23:27:42.479151+0000","last_clean":"2023-10-16T23:27:42.479151+0000","last_became_active":"2023-10-16T23:27:40.755489+0000","last_became_peered":"2023-10-16T23:27:40.755489+0000","last_unstale":"2023-10-16T23:27:42.479151+0000","last_undegraded":"2023-10-16T23:27:42.479151+0000","last_fullsized":"2023-10-16T23:27:42.479151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:06.148922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.720703+0000","last_change":"2023-10-16T23:27:36.279013+0000","last_active":"2023-10-16T23:27:40.720703+0000","last_peered":"2023-10-16T23:27:40.720703+0000","last_clean":"2023-10-16T23:27:40.720703+0000","last_became_active":"2023-10-16T23:27:36.278134+0000","last_became_peered":"2023-10-16T23:27:36.278134+0000","last_unstale":"2023-10-16T23:27:40.720703+0000","last_undegraded":"2023-10-16T23:27:40.720703+0000","last_fullsized":"2023-10-16T23:27:40.720703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:13:01.266310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704433+0000","last_change":"2023-10-16T23:27:40.342715+0000","last_active":"2023-10-16T23:27:41.704433+0000","last_peered":"2023-10-16T23:27:41.704433+0000","last_clean":"2023-10-16T23:27:41.704433+0000","last_became_active":"2023-10-16T23:27:40.341951+0000","last_became_peered":"2023-10-16T23:27:40.341951+0000","last_unstale":"2023-10-16T23:27:41.704433+0000","last_undegraded":"2023-10-16T23:27:41.704433+0000","last_fullsized":"2023-10-16T23:27:41.704433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:59.765109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478850+0000","last_change":"2023-10-16T23:27:40.731557+0000","last_active":"2023-10-16T23:27:42.478850+0000","last_peered":"2023-10-16T23:27:42.478850+0000","last_clean":"2023-10-16T23:27:42.478850+0000","last_became_active":"2023-10-16T23:27:40.731150+0000","last_became_peered":"2023-10-16T23:27:40.731150+0000","last_unstale":"2023-10-16T23:27:42.478850+0000","last_undegraded":"2023-10-16T23:27:42.478850+0000","last_fullsized":"2023-10-16T23:27:42.478850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952480+0000","last_change":"2023-10-16T23:27:40.320403+0000","last_active":"2023-10-16T23:27:41.952480+0000","last_peered":"2023-10-16T23:27:41.952480+0000","last_clean":"2023-10-16T23:27:41.952480+0000","last_became_active":"2023-10-16T23:27:40.319571+0000","last_became_peered":"2023-10-16T23:27:40.319571+0000","last_unstale":"2023-10-16T23:27:41.952480+0000","last_undegraded":"2023-10-16T23:27:41.952480+0000","last_fullsized":"2023-10-16T23:27:41.952480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.699523+0000","last_change":"2023-10-16T23:27:36.434134+0000","last_active":"2023-10-16T23:27:40.699523+0000","last_peered":"2023-10-16T23:27:40.699523+0000","last_clean":"2023-10-16T23:27:40.699523+0000","last_became_active":"2023-10-16T23:27:36.433808+0000","last_became_peered":"2023-10-16T23:27:36.433808+0000","last_unstale":"2023-10-16T23:27:40.699523+0000","last_undegraded":"2023-10-16T23:27:40.699523+0000","last_fullsized":"2023-10-16T23:27:40.699523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:58:44.833474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478822+0000","last_change":"2023-10-16T23:27:40.757932+0000","last_active":"2023-10-16T23:27:42.478822+0000","last_peered":"2023-10-16T23:27:42.478822+0000","last_clean":"2023-10-16T23:27:42.478822+0000","last_became_active":"2023-10-16T23:27:40.757670+0000","last_became_peered":"2023-10-16T23:27:40.757670+0000","last_unstale":"2023-10-16T23:27:42.478822+0000","last_undegraded":"2023-10-16T23:27:42.478822+0000","last_fullsized":"2023-10-16T23:27:42.478822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:25:31.037309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478894+0000","last_change":"2023-10-16T23:27:40.328161+0000","last_active":"2023-10-16T23:27:42.478894+0000","last_peered":"2023-10-16T23:27:42.478894+0000","last_clean":"2023-10-16T23:27:42.478894+0000","last_became_active":"2023-10-16T23:27:40.327804+0000","last_became_peered":"2023-10-16T23:27:40.327804+0000","last_unstale":"2023-10-16T23:27:42.478894+0000","last_undegraded":"2023-10-16T23:27:42.478894+0000","last_fullsized":"2023-10-16T23:27:42.478894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.316621+0000","last_change":"2023-10-16T23:27:36.434231+0000","last_active":"2023-10-16T23:27:40.316621+0000","last_peered":"2023-10-16T23:27:40.316621+0000","last_clean":"2023-10-16T23:27:40.316621+0000","last_became_active":"2023-10-16T23:27:36.433923+0000","last_became_peered":"2023-10-16T23:27:36.433923+0000","last_unstale":"2023-10-16T23:27:40.316621+0000","last_undegraded":"2023-10-16T23:27:40.316621+0000","last_fullsized":"2023-10-16T23:27:40.316621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:59.590093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642126+0000","last_change":"2023-10-16T23:27:40.756257+0000","last_active":"2023-10-16T23:27:42.642126+0000","last_peered":"2023-10-16T23:27:42.642126+0000","last_clean":"2023-10-16T23:27:42.642126+0000","last_became_active":"2023-10-16T23:27:40.755822+0000","last_became_peered":"2023-10-16T23:27:40.755822+0000","last_unstale":"2023-10-16T23:27:42.642126+0000","last_undegraded":"2023-10-16T23:27:42.642126+0000","last_fullsized":"2023-10-16T23:27:42.642126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698868+0000","last_change":"2023-10-16T23:27:40.333672+0000","last_active":"2023-10-16T23:27:41.698868+0000","last_peered":"2023-10-16T23:27:41.698868+0000","last_clean":"2023-10-16T23:27:41.698868+0000","last_became_active":"2023-10-16T23:27:40.333290+0000","last_became_peered":"2023-10-16T23:27:40.333290+0000","last_unstale":"2023-10-16T23:27:41.698868+0000","last_undegraded":"2023-10-16T23:27:41.698868+0000","last_fullsized":"2023-10-16T23:27:41.698868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:15:23.173526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.698124+0000","last_change":"2023-10-16T23:27:36.278805+0000","last_active":"2023-10-16T23:27:40.698124+0000","last_peered":"2023-10-16T23:27:40.698124+0000","last_clean":"2023-10-16T23:27:40.698124+0000","last_became_active":"2023-10-16T23:27:36.278209+0000","last_became_peered":"2023-10-16T23:27:36.278209+0000","last_unstale":"2023-10-16T23:27:40.698124+0000","last_undegraded":"2023-10-16T23:27:40.698124+0000","last_fullsized":"2023-10-16T23:27:40.698124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:38:00.468059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697202+0000","last_change":"2023-10-16T23:27:40.743576+0000","last_active":"2023-10-16T23:27:41.697202+0000","last_peered":"2023-10-16T23:27:41.697202+0000","last_clean":"2023-10-16T23:27:41.697202+0000","last_became_active":"2023-10-16T23:27:40.743293+0000","last_became_peered":"2023-10-16T23:27:40.743293+0000","last_unstale":"2023-10-16T23:27:41.697202+0000","last_undegraded":"2023-10-16T23:27:41.697202+0000","last_fullsized":"2023-10-16T23:27:41.697202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:14.359461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641711+0000","last_change":"2023-10-16T23:27:40.332668+0000","last_active":"2023-10-16T23:27:42.641711+0000","last_peered":"2023-10-16T23:27:42.641711+0000","last_clean":"2023-10-16T23:27:42.641711+0000","last_became_active":"2023-10-16T23:27:40.332084+0000","last_became_peered":"2023-10-16T23:27:40.332084+0000","last_unstale":"2023-10-16T23:27:42.641711+0000","last_undegraded":"2023-10-16T23:27:42.641711+0000","last_fullsized":"2023-10-16T23:27:42.641711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:14.260980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.698418+0000","last_change":"2023-10-16T23:27:36.281494+0000","last_active":"2023-10-16T23:27:40.698418+0000","last_peered":"2023-10-16T23:27:40.698418+0000","last_clean":"2023-10-16T23:27:40.698418+0000","last_became_active":"2023-10-16T23:27:36.280600+0000","last_became_peered":"2023-10-16T23:27:36.280600+0000","last_unstale":"2023-10-16T23:27:40.698418+0000","last_undegraded":"2023-10-16T23:27:40.698418+0000","last_fullsized":"2023-10-16T23:27:40.698418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:42:59.057101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702504+0000","last_change":"2023-10-16T23:27:40.756574+0000","last_active":"2023-10-16T23:27:41.702504+0000","last_peered":"2023-10-16T23:27:41.702504+0000","last_clean":"2023-10-16T23:27:41.702504+0000","last_became_active":"2023-10-16T23:27:40.755830+0000","last_became_peered":"2023-10-16T23:27:40.755830+0000","last_unstale":"2023-10-16T23:27:41.702504+0000","last_undegraded":"2023-10-16T23:27:41.702504+0000","last_fullsized":"2023-10-16T23:27:41.702504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:55:29.771781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704462+0000","last_change":"2023-10-16T23:27:40.745793+0000","last_active":"2023-10-16T23:27:41.704462+0000","last_peered":"2023-10-16T23:27:41.704462+0000","last_clean":"2023-10-16T23:27:41.704462+0000","last_became_active":"2023-10-16T23:27:40.745143+0000","last_became_peered":"2023-10-16T23:27:40.745143+0000","last_unstale":"2023-10-16T23:27:41.704462+0000","last_undegraded":"2023-10-16T23:27:41.704462+0000","last_fullsized":"2023-10-16T23:27:41.704462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:10:37.103208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704642+0000","last_change":"2023-10-16T23:27:40.352546+0000","last_active":"2023-10-16T23:27:41.704642+0000","last_peered":"2023-10-16T23:27:41.704642+0000","last_clean":"2023-10-16T23:27:41.704642+0000","last_became_active":"2023-10-16T23:27:40.351687+0000","last_became_peered":"2023-10-16T23:27:40.351687+0000","last_unstale":"2023-10-16T23:27:41.704642+0000","last_undegraded":"2023-10-16T23:27:41.704642+0000","last_fullsized":"2023-10-16T23:27:41.704642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:14.260980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478618+0000","last_change":"2023-10-16T23:27:40.727602+0000","last_active":"2023-10-16T23:27:42.478618+0000","last_peered":"2023-10-16T23:27:42.478618+0000","last_clean":"2023-10-16T23:27:42.478618+0000","last_became_active":"2023-10-16T23:27:40.727288+0000","last_became_peered":"2023-10-16T23:27:40.727288+0000","last_unstale":"2023-10-16T23:27:42.478618+0000","last_undegraded":"2023-10-16T23:27:42.478618+0000","last_fullsized":"2023-10-16T23:27:42.478618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:56:41.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.766029+0000","last_change":"2023-10-16T23:27:40.332379+0000","last_active":"2023-10-16T23:27:40.766029+0000","last_peered":"2023-10-16T23:27:40.766029+0000","last_clean":"2023-10-16T23:27:40.766029+0000","last_became_active":"2023-10-16T23:27:40.331517+0000","last_became_peered":"2023-10-16T23:27:40.331517+0000","last_unstale":"2023-10-16T23:27:40.766029+0000","last_undegraded":"2023-10-16T23:27:40.766029+0000","last_fullsized":"2023-10-16T23:27:40.766029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:55.534068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952318+0000","last_change":"2023-10-16T23:27:40.336300+0000","last_active":"2023-10-16T23:27:41.952318+0000","last_peered":"2023-10-16T23:27:41.952318+0000","last_clean":"2023-10-16T23:27:41.952318+0000","last_became_active":"2023-10-16T23:27:40.333012+0000","last_became_peered":"2023-10-16T23:27:40.333012+0000","last_unstale":"2023-10-16T23:27:41.952318+0000","last_undegraded":"2023-10-16T23:27:41.952318+0000","last_fullsized":"2023-10-16T23:27:41.952318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697630+0000","last_change":"2023-10-16T23:27:40.760984+0000","last_active":"2023-10-16T23:27:41.697630+0000","last_peered":"2023-10-16T23:27:41.697630+0000","last_clean":"2023-10-16T23:27:41.697630+0000","last_became_active":"2023-10-16T23:27:40.760680+0000","last_became_peered":"2023-10-16T23:27:40.760680+0000","last_unstale":"2023-10-16T23:27:41.697630+0000","last_undegraded":"2023-10-16T23:27:41.697630+0000","last_fullsized":"2023-10-16T23:27:41.697630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:04.722168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642505+0000","last_change":"2023-10-16T23:27:40.339159+0000","last_active":"2023-10-16T23:27:42.642505+0000","last_peered":"2023-10-16T23:27:42.642505+0000","last_clean":"2023-10-16T23:27:42.642505+0000","last_became_active":"2023-10-16T23:27:40.338706+0000","last_became_peered":"2023-10-16T23:27:40.338706+0000","last_unstale":"2023-10-16T23:27:42.642505+0000","last_undegraded":"2023-10-16T23:27:42.642505+0000","last_fullsized":"2023-10-16T23:27:42.642505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:33:08.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697208+0000","last_change":"2023-10-16T23:27:40.713138+0000","last_active":"2023-10-16T23:27:41.697208+0000","last_peered":"2023-10-16T23:27:41.697208+0000","last_clean":"2023-10-16T23:27:41.697208+0000","last_became_active":"2023-10-16T23:27:40.712756+0000","last_became_peered":"2023-10-16T23:27:40.712756+0000","last_unstale":"2023-10-16T23:27:41.697208+0000","last_undegraded":"2023-10-16T23:27:41.697208+0000","last_fullsized":"2023-10-16T23:27:41.697208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:19:17.463284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.703371+0000","last_change":"2023-10-16T23:27:40.756418+0000","last_active":"2023-10-16T23:27:41.703371+0000","last_peered":"2023-10-16T23:27:41.703371+0000","last_clean":"2023-10-16T23:27:41.703371+0000","last_became_active":"2023-10-16T23:27:40.755714+0000","last_became_peered":"2023-10-16T23:27:40.755714+0000","last_unstale":"2023-10-16T23:27:41.703371+0000","last_undegraded":"2023-10-16T23:27:41.703371+0000","last_fullsized":"2023-10-16T23:27:41.703371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:56.634821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697319+0000","last_change":"2023-10-16T23:27:40.332275+0000","last_active":"2023-10-16T23:27:41.697319+0000","last_peered":"2023-10-16T23:27:41.697319+0000","last_clean":"2023-10-16T23:27:41.697319+0000","last_became_active":"2023-10-16T23:27:40.331428+0000","last_became_peered":"2023-10-16T23:27:40.331428+0000","last_unstale":"2023-10-16T23:27:41.697319+0000","last_undegraded":"2023-10-16T23:27:41.697319+0000","last_fullsized":"2023-10-16T23:27:41.697319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641125+0000","last_change":"2023-10-16T23:27:40.761081+0000","last_active":"2023-10-16T23:27:42.641125+0000","last_peered":"2023-10-16T23:27:42.641125+0000","last_clean":"2023-10-16T23:27:42.641125+0000","last_became_active":"2023-10-16T23:27:40.760779+0000","last_became_peered":"2023-10-16T23:27:40.760779+0000","last_unstale":"2023-10-16T23:27:42.641125+0000","last_undegraded":"2023-10-16T23:27:42.641125+0000","last_fullsized":"2023-10-16T23:27:42.641125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:31.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478605+0000","last_change":"2023-10-16T23:27:40.318419+0000","last_active":"2023-10-16T23:27:42.478605+0000","last_peered":"2023-10-16T23:27:42.478605+0000","last_clean":"2023-10-16T23:27:42.478605+0000","last_became_active":"2023-10-16T23:27:40.317622+0000","last_became_peered":"2023-10-16T23:27:40.317622+0000","last_unstale":"2023-10-16T23:27:42.478605+0000","last_undegraded":"2023-10-16T23:27:42.478605+0000","last_fullsized":"2023-10-16T23:27:42.478605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698467+0000","last_change":"2023-10-16T23:27:40.706263+0000","last_active":"2023-10-16T23:27:41.698467+0000","last_peered":"2023-10-16T23:27:41.698467+0000","last_clean":"2023-10-16T23:27:41.698467+0000","last_became_active":"2023-10-16T23:27:40.705956+0000","last_became_peered":"2023-10-16T23:27:40.705956+0000","last_unstale":"2023-10-16T23:27:41.698467+0000","last_undegraded":"2023-10-16T23:27:41.698467+0000","last_fullsized":"2023-10-16T23:27:41.698467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.703994+0000","last_change":"2023-10-16T23:27:40.344965+0000","last_active":"2023-10-16T23:27:41.703994+0000","last_peered":"2023-10-16T23:27:41.703994+0000","last_clean":"2023-10-16T23:27:41.703994+0000","last_became_active":"2023-10-16T23:27:40.344158+0000","last_became_peered":"2023-10-16T23:27:40.344158+0000","last_unstale":"2023-10-16T23:27:41.703994+0000","last_undegraded":"2023-10-16T23:27:41.703994+0000","last_fullsized":"2023-10-16T23:27:41.703994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:04.095452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.732815+0000","last_change":"2023-10-16T23:27:40.713594+0000","last_active":"2023-10-16T23:27:40.732815+0000","last_peered":"2023-10-16T23:27:40.732815+0000","last_clean":"2023-10-16T23:27:40.732815+0000","last_became_active":"2023-10-16T23:27:40.712632+0000","last_became_peered":"2023-10-16T23:27:40.712632+0000","last_unstale":"2023-10-16T23:27:40.732815+0000","last_undegraded":"2023-10-16T23:27:40.732815+0000","last_fullsized":"2023-10-16T23:27:40.732815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:52.368847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642366+0000","last_change":"2023-10-16T23:27:40.357300+0000","last_active":"2023-10-16T23:27:42.642366+0000","last_peered":"2023-10-16T23:27:42.642366+0000","last_clean":"2023-10-16T23:27:42.642366+0000","last_became_active":"2023-10-16T23:27:40.356809+0000","last_became_peered":"2023-10-16T23:27:40.356809+0000","last_unstale":"2023-10-16T23:27:42.642366+0000","last_undegraded":"2023-10-16T23:27:42.642366+0000","last_fullsized":"2023-10-16T23:27:42.642366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704165+0000","last_change":"2023-10-16T23:27:40.726018+0000","last_active":"2023-10-16T23:27:41.704165+0000","last_peered":"2023-10-16T23:27:41.704165+0000","last_clean":"2023-10-16T23:27:41.704165+0000","last_became_active":"2023-10-16T23:27:40.724910+0000","last_became_peered":"2023-10-16T23:27:40.724910+0000","last_unstale":"2023-10-16T23:27:41.704165+0000","last_undegraded":"2023-10-16T23:27:41.704165+0000","last_fullsized":"2023-10-16T23:27:41.704165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:25:34.841325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.951808+0000","last_change":"2023-10-16T23:27:40.345785+0000","last_active":"2023-10-16T23:27:41.951808+0000","last_peered":"2023-10-16T23:27:41.951808+0000","last_clean":"2023-10-16T23:27:41.951808+0000","last_became_active":"2023-10-16T23:27:40.344531+0000","last_became_peered":"2023-10-16T23:27:40.344531+0000","last_unstale":"2023-10-16T23:27:41.951808+0000","last_undegraded":"2023-10-16T23:27:41.951808+0000","last_fullsized":"2023-10-16T23:27:41.951808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:55.630817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702429+0000","last_change":"2023-10-16T23:27:40.720573+0000","last_active":"2023-10-16T23:27:41.702429+0000","last_peered":"2023-10-16T23:27:41.702429+0000","last_clean":"2023-10-16T23:27:41.702429+0000","last_became_active":"2023-10-16T23:27:40.719758+0000","last_became_peered":"2023-10-16T23:27:40.719758+0000","last_unstale":"2023-10-16T23:27:41.702429+0000","last_undegraded":"2023-10-16T23:27:41.702429+0000","last_fullsized":"2023-10-16T23:27:41.702429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:27:29.534374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952407+0000","last_change":"2023-10-16T23:27:40.345400+0000","last_active":"2023-10-16T23:27:41.952407+0000","last_peered":"2023-10-16T23:27:41.952407+0000","last_clean":"2023-10-16T23:27:41.952407+0000","last_became_active":"2023-10-16T23:27:40.344589+0000","last_became_peered":"2023-10-16T23:27:40.344589+0000","last_unstale":"2023-10-16T23:27:41.952407+0000","last_undegraded":"2023-10-16T23:27:41.952407+0000","last_fullsized":"2023-10-16T23:27:41.952407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:15:23.173526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697731+0000","last_change":"2023-10-16T23:27:40.711211+0000","last_active":"2023-10-16T23:27:41.697731+0000","last_peered":"2023-10-16T23:27:41.697731+0000","last_clean":"2023-10-16T23:27:41.697731+0000","last_became_active":"2023-10-16T23:27:40.705936+0000","last_became_peered":"2023-10-16T23:27:40.705936+0000","last_unstale":"2023-10-16T23:27:41.697731+0000","last_undegraded":"2023-10-16T23:27:41.697731+0000","last_fullsized":"2023-10-16T23:27:41.697731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.699046+0000","last_change":"2023-10-16T23:27:40.323626+0000","last_active":"2023-10-16T23:27:41.699046+0000","last_peered":"2023-10-16T23:27:41.699046+0000","last_clean":"2023-10-16T23:27:41.699046+0000","last_became_active":"2023-10-16T23:27:40.323352+0000","last_became_peered":"2023-10-16T23:27:40.323352+0000","last_unstale":"2023-10-16T23:27:41.699046+0000","last_undegraded":"2023-10-16T23:27:41.699046+0000","last_fullsized":"2023-10-16T23:27:41.699046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:33:08.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702217+0000","last_change":"2023-10-16T23:27:40.749109+0000","last_active":"2023-10-16T23:27:41.702217+0000","last_peered":"2023-10-16T23:27:41.702217+0000","last_clean":"2023-10-16T23:27:41.702217+0000","last_became_active":"2023-10-16T23:27:40.748525+0000","last_became_peered":"2023-10-16T23:27:40.748525+0000","last_unstale":"2023-10-16T23:27:41.702217+0000","last_undegraded":"2023-10-16T23:27:41.702217+0000","last_fullsized":"2023-10-16T23:27:41.702217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:10:38.468420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642507+0000","last_change":"2023-10-16T23:27:40.338946+0000","last_active":"2023-10-16T23:27:42.642507+0000","last_peered":"2023-10-16T23:27:42.642507+0000","last_clean":"2023-10-16T23:27:42.642507+0000","last_became_active":"2023-10-16T23:27:40.338565+0000","last_became_peered":"2023-10-16T23:27:40.338565+0000","last_unstale":"2023-10-16T23:27:42.642507+0000","last_undegraded":"2023-10-16T23:27:42.642507+0000","last_fullsized":"2023-10-16T23:27:42.642507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:55.630817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":90844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.381}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":91496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3919999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.635}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4930000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":92464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":249856,"data_stored":90934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":233472,"data_stored":84191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3120000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.502}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":831488,"data_stored":675141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]}]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":856064,"data_stored":676339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31276,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340564,"statfs":{"total":96636764160,"available":96604737536,"internally_reserved":0,"allocated":233472,"data_stored":84191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T23:27:49.173 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T23:27:49.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.304+0000 7f549f61d640 1 Processor -- start 2023-10-16T23:27:49.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.304+0000 7f549f61d640 1 -- start start 2023-10-16T23:27:49.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f549f61d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f54980c1130 0x7f54980b8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:49.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f549f61d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54980b9f40 0x7f54980ba390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:49.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f549f61d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f549814d0c0 con 0x7f549814c520 2023-10-16T23:27:49.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f549f61d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54980b3ca0 con 0x7f54980c1130 2023-10-16T23:27:49.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f549f61d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54980b40c0 con 0x7f54980b9f40 2023-10-16T23:27:49.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f549cbb8640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f549814c520 0x7f549814c9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38110/0 (socket says 172.21.15.12:38110) 2023-10-16T23:27:49.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f549cbb8640 1 -- 172.21.15.12:0/301232287 learned_addr learned my addr 172.21.15.12:0/301232287 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:49.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f549dbba640 1 --2- 172.21.15.12:0/301232287 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54980b9f40 0x7f54980ba390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:49.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f549d3b9640 1 --2- 172.21.15.12:0/301232287 >> v2:172.21.15.31:3300/0 conn(0x7f54980c1130 0x7f54980b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:49.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f5497fff640 1 -- 172.21.15.12:0/301232287 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531356550 0 0) 0x7f549814d0c0 con 0x7f549814c520 2023-10-16T23:27:49.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f5497fff640 1 -- 172.21.15.12:0/301232287 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5484003530 con 0x7f549814c520 2023-10-16T23:27:49.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f5497fff640 1 -- 172.21.15.12:0/301232287 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3165328123 0 0) 0x7f5484003530 con 0x7f549814c520 2023-10-16T23:27:49.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f5497fff640 1 -- 172.21.15.12:0/301232287 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54980b9f40 msgr2=0x7f54980ba390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:49.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f5497fff640 1 --2- 172.21.15.12:0/301232287 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54980b9f40 0x7f54980ba390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:49.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f5497fff640 1 -- 172.21.15.12:0/301232287 >> v2:172.21.15.31:3300/0 conn(0x7f54980c1130 msgr2=0x7f54980b8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:49.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f5497fff640 1 --2- 172.21.15.12:0/301232287 >> v2:172.21.15.31:3300/0 conn(0x7f54980c1130 0x7f54980b8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:49.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f5497fff640 1 -- 172.21.15.12:0/301232287 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54980b7ce0 con 0x7f549814c520 2023-10-16T23:27:49.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f5497fff640 1 -- 172.21.15.12:0/301232287 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7f5488001a00 con 0x7f549814c520 2023-10-16T23:27:49.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f5497fff640 1 -- 172.21.15.12:0/301232287 >> v1:172.21.15.12:6789/0 conn(0x7f549814c520 legacy=0x7f549814c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:49.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f5497fff640 1 --2- 172.21.15.12:0/301232287 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5484003980 0x7f5484003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:49.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f5497fff640 1 --2- 172.21.15.12:0/301232287 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54980b9f40 0x7f54840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:49.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f5497fff640 1 --2- 172.21.15.12:0/301232287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5484004d10 0x7f5484005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:49.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f5497fff640 1 -- 172.21.15.12:0/301232287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54980b3ca0 con 0x7f5484004d10 2023-10-16T23:27:49.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f5497fff640 1 -- 172.21.15.12:0/301232287 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54980b40c0 con 0x7f5484003980 2023-10-16T23:27:49.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f5497fff640 1 -- 172.21.15.12:0/301232287 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548400ba10 con 0x7f54980b9f40 2023-10-16T23:27:49.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f549dbba640 1 --2- 172.21.15.12:0/301232287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5484004d10 0x7f5484005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:49.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f549cbb8640 1 --2- 172.21.15.12:0/301232287 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54980b9f40 0x7f54840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:49.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f549d3b9640 1 --2- 172.21.15.12:0/301232287 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5484003980 0x7f5484003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:49.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f549dbba640 1 -- 172.21.15.12:0/301232287 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54980b9f40 msgr2=0x7f54840047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:49.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f549dbba640 1 --2- 172.21.15.12:0/301232287 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54980b9f40 0x7f54840047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:49.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f549dbba640 1 -- 172.21.15.12:0/301232287 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5484003980 msgr2=0x7f5484003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:49.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f549dbba640 1 --2- 172.21.15.12:0/301232287 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5484003980 0x7f5484003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:49.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f549dbba640 1 -- 172.21.15.12:0/301232287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5484003530 con 0x7f5484004d10 2023-10-16T23:27:49.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f549cbb8640 1 --2- 172.21.15.12:0/301232287 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f54980b9f40 0x7f54840047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:27:49.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.308+0000 7f549d3b9640 1 --2- 172.21.15.12:0/301232287 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5484003980 0x7f5484003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:27:49.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549dbba640 1 --2- 172.21.15.12:0/301232287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5484004d10 0x7f5484005190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5490009ae0 tx=0x7f549001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733d641739f8b3bf server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:49.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f5497fff640 1 -- 172.21.15.12:0/301232287 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54900a5640 con 0x7f5484004d10 2023-10-16T23:27:49.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f5497fff640 1 -- 172.21.15.12:0/301232287 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54900a57a0 con 0x7f5484004d10 2023-10-16T23:27:49.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f5497fff640 1 -- 172.21.15.12:0/301232287 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54900a5b50 con 0x7f5484004d10 2023-10-16T23:27:49.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549f61d640 1 -- 172.21.15.12:0/301232287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5484004d10 msgr2=0x7f5484005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:49.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549f61d640 1 --2- 172.21.15.12:0/301232287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5484004d10 0x7f5484005190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5490009ae0 tx=0x7f549001ca50 comp rx=0 tx=0).stop 2023-10-16T23:27:49.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549dbba640 1 -- 172.21.15.12:0/301232287 reap_dead start 2023-10-16T23:27:49.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549f61d640 1 -- 172.21.15.12:0/301232287 shutdown_connections 2023-10-16T23:27:49.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549f61d640 1 -- 172.21.15.12:0/301232287 >> 172.21.15.12:0/301232287 conn(0x7f549806ba20 msgr2=0x7f54980c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:49.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549f61d640 1 -- 172.21.15.12:0/301232287 shutdown_connections 2023-10-16T23:27:49.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549f61d640 1 -- 172.21.15.12:0/301232287 wait complete. 2023-10-16T23:27:49.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549f61d640 1 Processor -- start 2023-10-16T23:27:49.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549f61d640 1 -- start start 2023-10-16T23:27:49.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549f61d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5484004d10 0x7f549813eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:49.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549f61d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f549813f070 0x7f5498141a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:49.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549f61d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5498141f70 0x7f54980b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:49.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549f61d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54981e8dc0 con 0x7f5498141f70 2023-10-16T23:27:49.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549f61d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54981e90a0 con 0x7f5484004d10 2023-10-16T23:27:49.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549f61d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54981e4d70 con 0x7f549813f070 2023-10-16T23:27:49.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549dbba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5498141f70 0x7f54980b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:49.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549dbba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5498141f70 0x7f54980b6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55560/0 (socket says 172.21.15.12:55560) 2023-10-16T23:27:49.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549dbba640 1 -- 172.21.15.12:0/3689652862 learned_addr learned my addr 172.21.15.12:0/3689652862 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:49.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549cbb8640 1 --2- 172.21.15.12:0/3689652862 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f549813f070 0x7f5498141a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:49.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549d3b9640 1 --2- 172.21.15.12:0/3689652862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5484004d10 0x7f549813eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:49.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549dbba640 1 -- 172.21.15.12:0/3689652862 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f549813f070 msgr2=0x7f5498141a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:49.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549dbba640 1 --2- 172.21.15.12:0/3689652862 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f549813f070 0x7f5498141a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:49.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549dbba640 1 -- 172.21.15.12:0/3689652862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5484004d10 msgr2=0x7f549813eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:49.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549dbba640 1 --2- 172.21.15.12:0/3689652862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5484004d10 0x7f549813eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:49.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549dbba640 1 -- 172.21.15.12:0/3689652862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5498148740 con 0x7f5498141f70 2023-10-16T23:27:49.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.312+0000 7f549d3b9640 1 --2- 172.21.15.12:0/3689652862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5484004d10 0x7f549813eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:49.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.316+0000 7f549dbba640 1 --2- 172.21.15.12:0/3689652862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5498141f70 0x7f54980b6d80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5490009ae0 tx=0x7f5484005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:49.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.316+0000 7f5495ffb640 1 -- 172.21.15.12:0/3689652862 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54900ba070 con 0x7f5498141f70 2023-10-16T23:27:49.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.316+0000 7f5495ffb640 1 -- 172.21.15.12:0/3689652862 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549000f000 con 0x7f5498141f70 2023-10-16T23:27:49.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.316+0000 7f549f61d640 1 -- 172.21.15.12:0/3689652862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5498146800 con 0x7f5498141f70 2023-10-16T23:27:49.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.316+0000 7f5495ffb640 1 -- 172.21.15.12:0/3689652862 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5490004260 con 0x7f5498141f70 2023-10-16T23:27:49.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.316+0000 7f549f61d640 1 -- 172.21.15.12:0/3689652862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54980b7490 con 0x7f5498141f70 2023-10-16T23:27:49.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.316+0000 7f549f61d640 1 -- 172.21.15.12:0/3689652862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54981469f0 con 0x7f5498141f70 2023-10-16T23:27:49.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.316+0000 7f5495ffb640 1 -- 172.21.15.12:0/3689652862 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f54900b4070 con 0x7f5498141f70 2023-10-16T23:27:49.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.316+0000 7f5495ffb640 1 --2- 172.21.15.12:0/3689652862 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5478065e60 0x7f5478068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:49.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.316+0000 7f5495ffb640 1 -- 172.21.15.12:0/3689652862 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f549011d2d0 con 0x7f5498141f70 2023-10-16T23:27:49.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.316+0000 7f549d3b9640 1 --2- 172.21.15.12:0/3689652862 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5478065e60 0x7f5478068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:49.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.316+0000 7f549d3b9640 1 --2- 172.21.15.12:0/3689652862 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5478065e60 0x7f5478068320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5480009a20 tx=0x7f5480008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:49.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.320+0000 7f5495ffb640 1 -- 172.21.15.12:0/3689652862 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f54900eaad0 con 0x7f5498141f70 2023-10-16T23:27:49.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.476+0000 7f549f61d640 1 -- 172.21.15.12:0/3689652862 --> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5498157aa0 con 0x7f5478065e60 2023-10-16T23:27:49.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.496+0000 7f5495ffb640 1 -- 172.21.15.12:0/3689652862 <== mgr.4108 v2:172.21.15.31:6832/37949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286553 (secure 0 0 0) 0x7f5480012950 con 0x7f5478065e60 2023-10-16T23:27:49.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:49.505 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-16T23:27:49.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.500+0000 7f549f61d640 1 -- 172.21.15.12:0/3689652862 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5478065e60 msgr2=0x7f5478068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:49.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.500+0000 7f549f61d640 1 --2- 172.21.15.12:0/3689652862 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5478065e60 0x7f5478068320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5480009a20 tx=0x7f5480008040 comp rx=0 tx=0).stop 2023-10-16T23:27:49.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.500+0000 7f549f61d640 1 -- 172.21.15.12:0/3689652862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5498141f70 msgr2=0x7f54980b6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:49.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.500+0000 7f549f61d640 1 --2- 172.21.15.12:0/3689652862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5498141f70 0x7f54980b6d80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5490009ae0 tx=0x7f5484005800 comp rx=0 tx=0).stop 2023-10-16T23:27:49.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.500+0000 7f549f61d640 1 -- 172.21.15.12:0/3689652862 shutdown_connections 2023-10-16T23:27:49.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.500+0000 7f549f61d640 1 --2- 172.21.15.12:0/3689652862 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5478065e60 0x7f5478068320 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:49.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.500+0000 7f549f61d640 1 --2- 172.21.15.12:0/3689652862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5498141f70 0x7f54980b6d80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:49.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.500+0000 7f549f61d640 1 --2- 172.21.15.12:0/3689652862 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f549813f070 0x7f5498141a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:49.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.500+0000 7f549f61d640 1 --2- 172.21.15.12:0/3689652862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5484004d10 0x7f549813eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:49.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.500+0000 7f549f61d640 1 -- 172.21.15.12:0/3689652862 >> 172.21.15.12:0/3689652862 conn(0x7f549806ba20 msgr2=0x7f5498145b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:49.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.500+0000 7f549f61d640 1 -- 172.21.15.12:0/3689652862 shutdown_connections 2023-10-16T23:27:49.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.500+0000 7f549f61d640 1 -- 172.21.15.12:0/3689652862 wait complete. 2023-10-16T23:27:49.521 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-10-16T23:27:49.286404+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222856,"kb_used_data":3144,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751864,"statfs":{"total":773094113280,"available":772865908736,"internally_reserved":0,"allocated":3219456,"data_stored":1912212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.593467"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302132+0000","last_change":"2023-10-16T23:27:40.706600+0000","last_active":"2023-10-16T23:27:42.302132+0000","last_peered":"2023-10-16T23:27:42.302132+0000","last_clean":"2023-10-16T23:27:42.302132+0000","last_became_active":"2023-10-16T23:27:40.706320+0000","last_became_peered":"2023-10-16T23:27:40.706320+0000","last_unstale":"2023-10-16T23:27:42.302132+0000","last_undegraded":"2023-10-16T23:27:42.302132+0000","last_fullsized":"2023-10-16T23:27:42.302132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:48:20.356964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952090+0000","last_change":"2023-10-16T23:27:40.756555+0000","last_active":"2023-10-16T23:27:41.952090+0000","last_peered":"2023-10-16T23:27:41.952090+0000","last_clean":"2023-10-16T23:27:41.952090+0000","last_became_active":"2023-10-16T23:27:40.754736+0000","last_became_peered":"2023-10-16T23:27:40.754736+0000","last_unstale":"2023-10-16T23:27:41.952090+0000","last_undegraded":"2023-10-16T23:27:41.952090+0000","last_fullsized":"2023-10-16T23:27:41.952090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:45.642622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704753+0000","last_change":"2023-10-16T23:27:40.726586+0000","last_active":"2023-10-16T23:27:41.704753+0000","last_peered":"2023-10-16T23:27:41.704753+0000","last_clean":"2023-10-16T23:27:41.704753+0000","last_became_active":"2023-10-16T23:27:40.725731+0000","last_became_peered":"2023-10-16T23:27:40.725731+0000","last_unstale":"2023-10-16T23:27:41.704753+0000","last_undegraded":"2023-10-16T23:27:41.704753+0000","last_fullsized":"2023-10-16T23:27:41.704753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:04:22.434372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702719+0000","last_change":"2023-10-16T23:27:40.715543+0000","last_active":"2023-10-16T23:27:41.702719+0000","last_peered":"2023-10-16T23:27:41.702719+0000","last_clean":"2023-10-16T23:27:41.702719+0000","last_became_active":"2023-10-16T23:27:40.714592+0000","last_became_peered":"2023-10-16T23:27:40.714592+0000","last_unstale":"2023-10-16T23:27:41.702719+0000","last_undegraded":"2023-10-16T23:27:41.702719+0000","last_fullsized":"2023-10-16T23:27:41.702719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:42:37.696897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642193+0000","last_change":"2023-10-16T23:27:40.722734+0000","last_active":"2023-10-16T23:27:42.642193+0000","last_peered":"2023-10-16T23:27:42.642193+0000","last_clean":"2023-10-16T23:27:42.642193+0000","last_became_active":"2023-10-16T23:27:40.722399+0000","last_became_peered":"2023-10-16T23:27:40.722399+0000","last_unstale":"2023-10-16T23:27:42.642193+0000","last_undegraded":"2023-10-16T23:27:42.642193+0000","last_fullsized":"2023-10-16T23:27:42.642193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:19:17.463284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702182+0000","last_change":"2023-10-16T23:27:40.716139+0000","last_active":"2023-10-16T23:27:41.702182+0000","last_peered":"2023-10-16T23:27:41.702182+0000","last_clean":"2023-10-16T23:27:41.702182+0000","last_became_active":"2023-10-16T23:27:40.715294+0000","last_became_peered":"2023-10-16T23:27:40.715294+0000","last_unstale":"2023-10-16T23:27:41.702182+0000","last_undegraded":"2023-10-16T23:27:41.702182+0000","last_fullsized":"2023-10-16T23:27:41.702182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:19:17.463284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302587+0000","last_change":"2023-10-16T23:27:40.762253+0000","last_active":"2023-10-16T23:27:42.302587+0000","last_peered":"2023-10-16T23:27:42.302587+0000","last_clean":"2023-10-16T23:27:42.302587+0000","last_became_active":"2023-10-16T23:27:40.760726+0000","last_became_peered":"2023-10-16T23:27:40.760726+0000","last_unstale":"2023-10-16T23:27:42.302587+0000","last_undegraded":"2023-10-16T23:27:42.302587+0000","last_fullsized":"2023-10-16T23:27:42.302587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:50:08.569961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.951568+0000","last_change":"2023-10-16T23:27:40.756184+0000","last_active":"2023-10-16T23:27:41.951568+0000","last_peered":"2023-10-16T23:27:41.951568+0000","last_clean":"2023-10-16T23:27:41.951568+0000","last_became_active":"2023-10-16T23:27:40.755276+0000","last_became_peered":"2023-10-16T23:27:40.755276+0000","last_unstale":"2023-10-16T23:27:41.951568+0000","last_undegraded":"2023-10-16T23:27:41.951568+0000","last_fullsized":"2023-10-16T23:27:41.951568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642253+0000","last_change":"2023-10-16T23:27:40.724060+0000","last_active":"2023-10-16T23:27:42.642253+0000","last_peered":"2023-10-16T23:27:42.642253+0000","last_clean":"2023-10-16T23:27:42.642253+0000","last_became_active":"2023-10-16T23:27:40.723701+0000","last_became_peered":"2023-10-16T23:27:40.723701+0000","last_unstale":"2023-10-16T23:27:42.642253+0000","last_undegraded":"2023-10-16T23:27:42.642253+0000","last_fullsized":"2023-10-16T23:27:42.642253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:04.722168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952181+0000","last_change":"2023-10-16T23:27:40.756783+0000","last_active":"2023-10-16T23:27:41.952181+0000","last_peered":"2023-10-16T23:27:41.952181+0000","last_clean":"2023-10-16T23:27:41.952181+0000","last_became_active":"2023-10-16T23:27:40.755772+0000","last_became_peered":"2023-10-16T23:27:40.755772+0000","last_unstale":"2023-10-16T23:27:41.952181+0000","last_undegraded":"2023-10-16T23:27:41.952181+0000","last_fullsized":"2023-10-16T23:27:41.952181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704832+0000","last_change":"2023-10-16T23:27:40.724754+0000","last_active":"2023-10-16T23:27:41.704832+0000","last_peered":"2023-10-16T23:27:41.704832+0000","last_clean":"2023-10-16T23:27:41.704832+0000","last_became_active":"2023-10-16T23:27:40.724031+0000","last_became_peered":"2023-10-16T23:27:40.724031+0000","last_unstale":"2023-10-16T23:27:41.704832+0000","last_undegraded":"2023-10-16T23:27:41.704832+0000","last_fullsized":"2023-10-16T23:27:41.704832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:04.722168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302045+0000","last_change":"2023-10-16T23:27:40.724453+0000","last_active":"2023-10-16T23:27:42.302045+0000","last_peered":"2023-10-16T23:27:42.302045+0000","last_clean":"2023-10-16T23:27:42.302045+0000","last_became_active":"2023-10-16T23:27:40.724099+0000","last_became_peered":"2023-10-16T23:27:40.724099+0000","last_unstale":"2023-10-16T23:27:42.302045+0000","last_undegraded":"2023-10-16T23:27:42.302045+0000","last_fullsized":"2023-10-16T23:27:42.302045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:01:05.350517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302015+0000","last_change":"2023-10-16T23:27:40.704484+0000","last_active":"2023-10-16T23:27:42.302015+0000","last_peered":"2023-10-16T23:27:42.302015+0000","last_clean":"2023-10-16T23:27:42.302015+0000","last_became_active":"2023-10-16T23:27:40.704162+0000","last_became_peered":"2023-10-16T23:27:40.704162+0000","last_unstale":"2023-10-16T23:27:42.302015+0000","last_undegraded":"2023-10-16T23:27:42.302015+0000","last_fullsized":"2023-10-16T23:27:42.302015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:15:16.646850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.951790+0000","last_change":"2023-10-16T23:27:40.738913+0000","last_active":"2023-10-16T23:27:41.951790+0000","last_peered":"2023-10-16T23:27:41.951790+0000","last_clean":"2023-10-16T23:27:41.951790+0000","last_became_active":"2023-10-16T23:27:40.738070+0000","last_became_peered":"2023-10-16T23:27:40.738070+0000","last_unstale":"2023-10-16T23:27:41.951790+0000","last_undegraded":"2023-10-16T23:27:41.951790+0000","last_fullsized":"2023-10-16T23:27:41.951790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:56:41.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302643+0000","last_change":"2023-10-16T23:27:40.762529+0000","last_active":"2023-10-16T23:27:42.302643+0000","last_peered":"2023-10-16T23:27:42.302643+0000","last_clean":"2023-10-16T23:27:42.302643+0000","last_became_active":"2023-10-16T23:27:40.761570+0000","last_became_peered":"2023-10-16T23:27:40.761570+0000","last_unstale":"2023-10-16T23:27:42.302643+0000","last_undegraded":"2023-10-16T23:27:42.302643+0000","last_fullsized":"2023-10-16T23:27:42.302643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:46.449264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702044+0000","last_change":"2023-10-16T23:27:40.719227+0000","last_active":"2023-10-16T23:27:41.702044+0000","last_peered":"2023-10-16T23:27:41.702044+0000","last_clean":"2023-10-16T23:27:41.702044+0000","last_became_active":"2023-10-16T23:27:40.718276+0000","last_became_peered":"2023-10-16T23:27:40.718276+0000","last_unstale":"2023-10-16T23:27:41.702044+0000","last_undegraded":"2023-10-16T23:27:41.702044+0000","last_fullsized":"2023-10-16T23:27:41.702044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642387+0000","last_change":"2023-10-16T23:27:40.719723+0000","last_active":"2023-10-16T23:27:42.642387+0000","last_peered":"2023-10-16T23:27:42.642387+0000","last_clean":"2023-10-16T23:27:42.642387+0000","last_became_active":"2023-10-16T23:27:40.719402+0000","last_became_peered":"2023-10-16T23:27:40.719402+0000","last_unstale":"2023-10-16T23:27:42.642387+0000","last_undegraded":"2023-10-16T23:27:42.642387+0000","last_fullsized":"2023-10-16T23:27:42.642387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:04:22.434372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704498+0000","last_change":"2023-10-16T23:27:40.732931+0000","last_active":"2023-10-16T23:27:41.704498+0000","last_peered":"2023-10-16T23:27:41.704498+0000","last_clean":"2023-10-16T23:27:41.704498+0000","last_became_active":"2023-10-16T23:27:40.732102+0000","last_became_peered":"2023-10-16T23:27:40.732102+0000","last_unstale":"2023-10-16T23:27:41.704498+0000","last_undegraded":"2023-10-16T23:27:41.704498+0000","last_fullsized":"2023-10-16T23:27:41.704498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:14.359461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302105+0000","last_change":"2023-10-16T23:27:40.728920+0000","last_active":"2023-10-16T23:27:42.302105+0000","last_peered":"2023-10-16T23:27:42.302105+0000","last_clean":"2023-10-16T23:27:42.302105+0000","last_became_active":"2023-10-16T23:27:40.728298+0000","last_became_peered":"2023-10-16T23:27:40.728298+0000","last_unstale":"2023-10-16T23:27:42.302105+0000","last_undegraded":"2023-10-16T23:27:42.302105+0000","last_fullsized":"2023-10-16T23:27:42.302105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:28:33.509782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704201+0000","last_change":"2023-10-16T23:27:40.745270+0000","last_active":"2023-10-16T23:27:41.704201+0000","last_peered":"2023-10-16T23:27:41.704201+0000","last_clean":"2023-10-16T23:27:41.704201+0000","last_became_active":"2023-10-16T23:27:40.744483+0000","last_became_peered":"2023-10-16T23:27:40.744483+0000","last_unstale":"2023-10-16T23:27:41.704201+0000","last_undegraded":"2023-10-16T23:27:41.704201+0000","last_fullsized":"2023-10-16T23:27:41.704201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:24:33.998070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302748+0000","last_change":"2023-10-16T23:27:40.761480+0000","last_active":"2023-10-16T23:27:42.302748+0000","last_peered":"2023-10-16T23:27:42.302748+0000","last_clean":"2023-10-16T23:27:42.302748+0000","last_became_active":"2023-10-16T23:27:40.760882+0000","last_became_peered":"2023-10-16T23:27:40.760882+0000","last_unstale":"2023-10-16T23:27:42.302748+0000","last_undegraded":"2023-10-16T23:27:42.302748+0000","last_fullsized":"2023-10-16T23:27:42.302748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:37:38.843931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.640893+0000","last_change":"2023-10-16T23:27:40.722620+0000","last_active":"2023-10-16T23:27:42.640893+0000","last_peered":"2023-10-16T23:27:42.640893+0000","last_clean":"2023-10-16T23:27:42.640893+0000","last_became_active":"2023-10-16T23:27:40.722302+0000","last_became_peered":"2023-10-16T23:27:40.722302+0000","last_unstale":"2023-10-16T23:27:42.640893+0000","last_undegraded":"2023-10-16T23:27:42.640893+0000","last_fullsized":"2023-10-16T23:27:42.640893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697349+0000","last_change":"2023-10-16T23:27:40.716578+0000","last_active":"2023-10-16T23:27:41.697349+0000","last_peered":"2023-10-16T23:27:41.697349+0000","last_clean":"2023-10-16T23:27:41.697349+0000","last_became_active":"2023-10-16T23:27:40.716228+0000","last_became_peered":"2023-10-16T23:27:40.716228+0000","last_unstale":"2023-10-16T23:27:41.697349+0000","last_undegraded":"2023-10-16T23:27:41.697349+0000","last_fullsized":"2023-10-16T23:27:41.697349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:27:29.534374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302466+0000","last_change":"2023-10-16T23:27:40.761323+0000","last_active":"2023-10-16T23:27:42.302466+0000","last_peered":"2023-10-16T23:27:42.302466+0000","last_clean":"2023-10-16T23:27:42.302466+0000","last_became_active":"2023-10-16T23:27:40.760659+0000","last_became_peered":"2023-10-16T23:27:40.760659+0000","last_unstale":"2023-10-16T23:27:42.302466+0000","last_undegraded":"2023-10-16T23:27:42.302466+0000","last_fullsized":"2023-10-16T23:27:42.302466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:09:55.835429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478936+0000","last_change":"2023-10-16T23:27:40.727629+0000","last_active":"2023-10-16T23:27:42.478936+0000","last_peered":"2023-10-16T23:27:42.478936+0000","last_clean":"2023-10-16T23:27:42.478936+0000","last_became_active":"2023-10-16T23:27:40.727334+0000","last_became_peered":"2023-10-16T23:27:40.727334+0000","last_unstale":"2023-10-16T23:27:42.478936+0000","last_undegraded":"2023-10-16T23:27:42.478936+0000","last_fullsized":"2023-10-16T23:27:42.478936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:38:33.383867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.479296+0000","last_change":"2023-10-16T23:27:40.704775+0000","last_active":"2023-10-16T23:27:42.479296+0000","last_peered":"2023-10-16T23:27:42.479296+0000","last_clean":"2023-10-16T23:27:42.479296+0000","last_became_active":"2023-10-16T23:27:40.704536+0000","last_became_peered":"2023-10-16T23:27:40.704536+0000","last_unstale":"2023-10-16T23:27:42.479296+0000","last_undegraded":"2023-10-16T23:27:42.479296+0000","last_fullsized":"2023-10-16T23:27:42.479296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952175+0000","last_change":"2023-10-16T23:27:40.764351+0000","last_active":"2023-10-16T23:27:41.952175+0000","last_peered":"2023-10-16T23:27:41.952175+0000","last_clean":"2023-10-16T23:27:41.952175+0000","last_became_active":"2023-10-16T23:27:40.763592+0000","last_became_peered":"2023-10-16T23:27:40.763592+0000","last_unstale":"2023-10-16T23:27:41.952175+0000","last_undegraded":"2023-10-16T23:27:41.952175+0000","last_fullsized":"2023-10-16T23:27:41.952175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.479026+0000","last_change":"2023-10-16T23:27:40.760989+0000","last_active":"2023-10-16T23:27:42.479026+0000","last_peered":"2023-10-16T23:27:42.479026+0000","last_clean":"2023-10-16T23:27:42.479026+0000","last_became_active":"2023-10-16T23:27:40.760615+0000","last_became_peered":"2023-10-16T23:27:40.760615+0000","last_unstale":"2023-10-16T23:27:42.479026+0000","last_undegraded":"2023-10-16T23:27:42.479026+0000","last_fullsized":"2023-10-16T23:27:42.479026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698072+0000","last_change":"2023-10-16T23:27:40.760762+0000","last_active":"2023-10-16T23:27:41.698072+0000","last_peered":"2023-10-16T23:27:41.698072+0000","last_clean":"2023-10-16T23:27:41.698072+0000","last_became_active":"2023-10-16T23:27:40.760437+0000","last_became_peered":"2023-10-16T23:27:40.760437+0000","last_unstale":"2023-10-16T23:27:41.698072+0000","last_undegraded":"2023-10-16T23:27:41.698072+0000","last_fullsized":"2023-10-16T23:27:41.698072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:55:29.771781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.703806+0000","last_change":"2023-10-16T23:27:40.745197+0000","last_active":"2023-10-16T23:27:41.703806+0000","last_peered":"2023-10-16T23:27:41.703806+0000","last_clean":"2023-10-16T23:27:41.703806+0000","last_became_active":"2023-10-16T23:27:40.744458+0000","last_became_peered":"2023-10-16T23:27:40.744458+0000","last_unstale":"2023-10-16T23:27:41.703806+0000","last_undegraded":"2023-10-16T23:27:41.703806+0000","last_fullsized":"2023-10-16T23:27:41.703806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697368+0000","last_change":"2023-10-16T23:27:40.711795+0000","last_active":"2023-10-16T23:27:41.697368+0000","last_peered":"2023-10-16T23:27:41.697368+0000","last_clean":"2023-10-16T23:27:41.697368+0000","last_became_active":"2023-10-16T23:27:40.711492+0000","last_became_peered":"2023-10-16T23:27:40.711492+0000","last_unstale":"2023-10-16T23:27:41.697368+0000","last_undegraded":"2023-10-16T23:27:41.697368+0000","last_fullsized":"2023-10-16T23:27:41.697368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:04:22.434372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702060+0000","last_change":"2023-10-16T23:27:40.710149+0000","last_active":"2023-10-16T23:27:41.702060+0000","last_peered":"2023-10-16T23:27:41.702060+0000","last_clean":"2023-10-16T23:27:41.702060+0000","last_became_active":"2023-10-16T23:27:40.709286+0000","last_became_peered":"2023-10-16T23:27:40.709286+0000","last_unstale":"2023-10-16T23:27:41.702060+0000","last_undegraded":"2023-10-16T23:27:41.702060+0000","last_fullsized":"2023-10-16T23:27:41.702060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:22:41.708468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698461+0000","last_change":"2023-10-16T23:27:40.707271+0000","last_active":"2023-10-16T23:27:41.698461+0000","last_peered":"2023-10-16T23:27:41.698461+0000","last_clean":"2023-10-16T23:27:41.698461+0000","last_became_active":"2023-10-16T23:27:40.706864+0000","last_became_peered":"2023-10-16T23:27:40.706864+0000","last_unstale":"2023-10-16T23:27:41.698461+0000","last_undegraded":"2023-10-16T23:27:41.698461+0000","last_fullsized":"2023-10-16T23:27:41.698461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302796+0000","last_change":"2023-10-16T23:27:40.353567+0000","last_active":"2023-10-16T23:27:42.302796+0000","last_peered":"2023-10-16T23:27:42.302796+0000","last_clean":"2023-10-16T23:27:42.302796+0000","last_became_active":"2023-10-16T23:27:40.352775+0000","last_became_peered":"2023-10-16T23:27:40.352775+0000","last_unstale":"2023-10-16T23:27:42.302796+0000","last_undegraded":"2023-10-16T23:27:42.302796+0000","last_fullsized":"2023-10-16T23:27:42.302796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:52:58.351406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952358+0000","last_change":"2023-10-16T23:27:40.765398+0000","last_active":"2023-10-16T23:27:41.952358+0000","last_peered":"2023-10-16T23:27:41.952358+0000","last_clean":"2023-10-16T23:27:41.952358+0000","last_became_active":"2023-10-16T23:27:40.764517+0000","last_became_peered":"2023-10-16T23:27:40.764517+0000","last_unstale":"2023-10-16T23:27:41.952358+0000","last_undegraded":"2023-10-16T23:27:41.952358+0000","last_fullsized":"2023-10-16T23:27:41.952358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:31.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641131+0000","last_change":"2023-10-16T23:27:40.335221+0000","last_active":"2023-10-16T23:27:42.641131+0000","last_peered":"2023-10-16T23:27:42.641131+0000","last_clean":"2023-10-16T23:27:42.641131+0000","last_became_active":"2023-10-16T23:27:40.334885+0000","last_became_peered":"2023-10-16T23:27:40.334885+0000","last_unstale":"2023-10-16T23:27:42.641131+0000","last_undegraded":"2023-10-16T23:27:42.641131+0000","last_fullsized":"2023-10-16T23:27:42.641131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641719+0000","last_change":"2023-10-16T23:27:40.719997+0000","last_active":"2023-10-16T23:27:42.641719+0000","last_peered":"2023-10-16T23:27:42.641719+0000","last_clean":"2023-10-16T23:27:42.641719+0000","last_became_active":"2023-10-16T23:27:40.719811+0000","last_became_peered":"2023-10-16T23:27:40.719811+0000","last_unstale":"2023-10-16T23:27:42.641719+0000","last_undegraded":"2023-10-16T23:27:42.641719+0000","last_fullsized":"2023-10-16T23:27:42.641719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:13.934735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302695+0000","last_change":"2023-10-16T23:27:40.357620+0000","last_active":"2023-10-16T23:27:42.302695+0000","last_peered":"2023-10-16T23:27:42.302695+0000","last_clean":"2023-10-16T23:27:42.302695+0000","last_became_active":"2023-10-16T23:27:40.357009+0000","last_became_peered":"2023-10-16T23:27:40.357009+0000","last_unstale":"2023-10-16T23:27:42.302695+0000","last_undegraded":"2023-10-16T23:27:42.302695+0000","last_fullsized":"2023-10-16T23:27:42.302695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:07:50.847519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698809+0000","last_change":"2023-10-16T23:27:40.760925+0000","last_active":"2023-10-16T23:27:41.698809+0000","last_peered":"2023-10-16T23:27:41.698809+0000","last_clean":"2023-10-16T23:27:41.698809+0000","last_became_active":"2023-10-16T23:27:40.760365+0000","last_became_peered":"2023-10-16T23:27:40.760365+0000","last_unstale":"2023-10-16T23:27:41.698809+0000","last_undegraded":"2023-10-16T23:27:41.698809+0000","last_fullsized":"2023-10-16T23:27:41.698809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:13.934735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702299+0000","last_change":"2023-10-16T23:27:40.331826+0000","last_active":"2023-10-16T23:27:41.702299+0000","last_peered":"2023-10-16T23:27:41.702299+0000","last_clean":"2023-10-16T23:27:41.702299+0000","last_became_active":"2023-10-16T23:27:40.330857+0000","last_became_peered":"2023-10-16T23:27:40.330857+0000","last_unstale":"2023-10-16T23:27:41.702299+0000","last_undegraded":"2023-10-16T23:27:41.702299+0000","last_fullsized":"2023-10-16T23:27:41.702299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:42:46.614672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.303087+0000","last_change":"2023-10-16T23:27:40.357691+0000","last_active":"2023-10-16T23:27:42.303087+0000","last_peered":"2023-10-16T23:27:42.303087+0000","last_clean":"2023-10-16T23:27:42.303087+0000","last_became_active":"2023-10-16T23:27:40.357047+0000","last_became_peered":"2023-10-16T23:27:40.357047+0000","last_unstale":"2023-10-16T23:27:42.303087+0000","last_undegraded":"2023-10-16T23:27:42.303087+0000","last_fullsized":"2023-10-16T23:27:42.303087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:00:00.805564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.951579+0000","last_change":"2023-10-16T23:27:40.763848+0000","last_active":"2023-10-16T23:27:41.951579+0000","last_peered":"2023-10-16T23:27:41.951579+0000","last_clean":"2023-10-16T23:27:41.951579+0000","last_became_active":"2023-10-16T23:27:40.763116+0000","last_became_peered":"2023-10-16T23:27:40.763116+0000","last_unstale":"2023-10-16T23:27:41.951579+0000","last_undegraded":"2023-10-16T23:27:41.951579+0000","last_fullsized":"2023-10-16T23:27:41.951579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.303028+0000","last_change":"2023-10-16T23:27:40.347016+0000","last_active":"2023-10-16T23:27:42.303028+0000","last_peered":"2023-10-16T23:27:42.303028+0000","last_clean":"2023-10-16T23:27:42.303028+0000","last_became_active":"2023-10-16T23:27:40.346439+0000","last_became_peered":"2023-10-16T23:27:40.346439+0000","last_unstale":"2023-10-16T23:27:42.303028+0000","last_undegraded":"2023-10-16T23:27:42.303028+0000","last_fullsized":"2023-10-16T23:27:42.303028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:08:40.047699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702083+0000","last_change":"2023-10-16T23:27:40.714905+0000","last_active":"2023-10-16T23:27:41.702083+0000","last_peered":"2023-10-16T23:27:41.702083+0000","last_clean":"2023-10-16T23:27:41.702083+0000","last_became_active":"2023-10-16T23:27:40.714098+0000","last_became_peered":"2023-10-16T23:27:40.714098+0000","last_unstale":"2023-10-16T23:27:41.702083+0000","last_undegraded":"2023-10-16T23:27:41.702083+0000","last_fullsized":"2023-10-16T23:27:41.702083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:13.934735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302935+0000","last_change":"2023-10-16T23:27:40.340462+0000","last_active":"2023-10-16T23:27:42.302935+0000","last_peered":"2023-10-16T23:27:42.302935+0000","last_clean":"2023-10-16T23:27:42.302935+0000","last_became_active":"2023-10-16T23:27:40.339531+0000","last_became_peered":"2023-10-16T23:27:40.339531+0000","last_unstale":"2023-10-16T23:27:42.302935+0000","last_undegraded":"2023-10-16T23:27:42.302935+0000","last_fullsized":"2023-10-16T23:27:42.302935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:33:50.768168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702961+0000","last_change":"2023-10-16T23:27:40.713930+0000","last_active":"2023-10-16T23:27:41.702961+0000","last_peered":"2023-10-16T23:27:41.702961+0000","last_clean":"2023-10-16T23:27:41.702961+0000","last_became_active":"2023-10-16T23:27:40.713087+0000","last_became_peered":"2023-10-16T23:27:40.713087+0000","last_unstale":"2023-10-16T23:27:41.702961+0000","last_undegraded":"2023-10-16T23:27:41.702961+0000","last_fullsized":"2023-10-16T23:27:41.702961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:15:24.177529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.951911+0000","last_change":"2023-10-16T23:27:40.320848+0000","last_active":"2023-10-16T23:27:41.951911+0000","last_peered":"2023-10-16T23:27:41.951911+0000","last_clean":"2023-10-16T23:27:41.951911+0000","last_became_active":"2023-10-16T23:27:40.319887+0000","last_became_peered":"2023-10-16T23:27:40.319887+0000","last_unstale":"2023-10-16T23:27:41.951911+0000","last_undegraded":"2023-10-16T23:27:41.951911+0000","last_fullsized":"2023-10-16T23:27:41.951911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:33:08.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641867+0000","last_change":"2023-10-16T23:27:40.726405+0000","last_active":"2023-10-16T23:27:42.641867+0000","last_peered":"2023-10-16T23:27:42.641867+0000","last_clean":"2023-10-16T23:27:42.641867+0000","last_became_active":"2023-10-16T23:27:40.725724+0000","last_became_peered":"2023-10-16T23:27:40.725724+0000","last_unstale":"2023-10-16T23:27:42.641867+0000","last_undegraded":"2023-10-16T23:27:42.641867+0000","last_fullsized":"2023-10-16T23:27:42.641867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698263+0000","last_change":"2023-10-16T23:27:40.337756+0000","last_active":"2023-10-16T23:27:41.698263+0000","last_peered":"2023-10-16T23:27:41.698263+0000","last_clean":"2023-10-16T23:27:41.698263+0000","last_became_active":"2023-10-16T23:27:40.337405+0000","last_became_peered":"2023-10-16T23:27:40.337405+0000","last_unstale":"2023-10-16T23:27:41.698263+0000","last_undegraded":"2023-10-16T23:27:41.698263+0000","last_fullsized":"2023-10-16T23:27:41.698263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:42.154580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704502+0000","last_change":"2023-10-16T23:27:40.722911+0000","last_active":"2023-10-16T23:27:41.704502+0000","last_peered":"2023-10-16T23:27:41.704502+0000","last_clean":"2023-10-16T23:27:41.704502+0000","last_became_active":"2023-10-16T23:27:40.722091+0000","last_became_peered":"2023-10-16T23:27:40.722091+0000","last_unstale":"2023-10-16T23:27:41.704502+0000","last_undegraded":"2023-10-16T23:27:41.704502+0000","last_fullsized":"2023-10-16T23:27:41.704502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.703208+0000","last_change":"2023-10-16T23:27:40.343242+0000","last_active":"2023-10-16T23:27:41.703208+0000","last_peered":"2023-10-16T23:27:41.703208+0000","last_clean":"2023-10-16T23:27:41.703208+0000","last_became_active":"2023-10-16T23:27:40.342213+0000","last_became_peered":"2023-10-16T23:27:40.342213+0000","last_unstale":"2023-10-16T23:27:41.703208+0000","last_undegraded":"2023-10-16T23:27:41.703208+0000","last_fullsized":"2023-10-16T23:27:41.703208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:04.095452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704900+0000","last_change":"2023-10-16T23:27:40.733845+0000","last_active":"2023-10-16T23:27:41.704900+0000","last_peered":"2023-10-16T23:27:41.704900+0000","last_clean":"2023-10-16T23:27:41.704900+0000","last_became_active":"2023-10-16T23:27:40.732996+0000","last_became_peered":"2023-10-16T23:27:40.732996+0000","last_unstale":"2023-10-16T23:27:41.704900+0000","last_undegraded":"2023-10-16T23:27:41.704900+0000","last_fullsized":"2023-10-16T23:27:41.704900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:06:04.512089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702852+0000","last_change":"2023-10-16T23:27:40.347984+0000","last_active":"2023-10-16T23:27:41.702852+0000","last_peered":"2023-10-16T23:27:41.702852+0000","last_clean":"2023-10-16T23:27:41.702852+0000","last_became_active":"2023-10-16T23:27:40.347253+0000","last_became_peered":"2023-10-16T23:27:40.347253+0000","last_unstale":"2023-10-16T23:27:41.702852+0000","last_undegraded":"2023-10-16T23:27:41.702852+0000","last_fullsized":"2023-10-16T23:27:41.702852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:42:46.614672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704750+0000","last_change":"2023-10-16T23:27:40.745245+0000","last_active":"2023-10-16T23:27:41.704750+0000","last_peered":"2023-10-16T23:27:41.704750+0000","last_clean":"2023-10-16T23:27:41.704750+0000","last_became_active":"2023-10-16T23:27:40.744571+0000","last_became_peered":"2023-10-16T23:27:40.744571+0000","last_unstale":"2023-10-16T23:27:41.704750+0000","last_undegraded":"2023-10-16T23:27:41.704750+0000","last_fullsized":"2023-10-16T23:27:41.704750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:10:39.974563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697473+0000","last_change":"2023-10-16T23:27:40.314767+0000","last_active":"2023-10-16T23:27:41.697473+0000","last_peered":"2023-10-16T23:27:41.697473+0000","last_clean":"2023-10-16T23:27:41.697473+0000","last_became_active":"2023-10-16T23:27:40.314242+0000","last_became_peered":"2023-10-16T23:27:40.314242+0000","last_unstale":"2023-10-16T23:27:41.697473+0000","last_undegraded":"2023-10-16T23:27:41.697473+0000","last_fullsized":"2023-10-16T23:27:41.697473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.479126+0000","last_change":"2023-10-16T23:27:40.709591+0000","last_active":"2023-10-16T23:27:42.479126+0000","last_peered":"2023-10-16T23:27:42.479126+0000","last_clean":"2023-10-16T23:27:42.479126+0000","last_became_active":"2023-10-16T23:27:40.709174+0000","last_became_peered":"2023-10-16T23:27:40.709174+0000","last_unstale":"2023-10-16T23:27:42.479126+0000","last_undegraded":"2023-10-16T23:27:42.479126+0000","last_fullsized":"2023-10-16T23:27:42.479126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:31.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.732645+0000","last_change":"2023-10-16T23:27:29.356842+0000","last_active":"2023-10-16T23:27:40.732645+0000","last_peered":"2023-10-16T23:27:40.732645+0000","last_clean":"2023-10-16T23:27:40.732645+0000","last_became_active":"2023-10-16T23:27:29.353846+0000","last_became_peered":"2023-10-16T23:27:29.353846+0000","last_unstale":"2023-10-16T23:27:40.732645+0000","last_undegraded":"2023-10-16T23:27:40.732645+0000","last_fullsized":"2023-10-16T23:27:40.732645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:28.136202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:28.136202+0000","last_clean_scrub_stamp":"2023-10-16T23:27:28.136202+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:34:30.590360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.706470+0000","last_change":"2023-10-16T23:27:36.278001+0000","last_active":"2023-10-16T23:27:40.706470+0000","last_peered":"2023-10-16T23:27:40.706470+0000","last_clean":"2023-10-16T23:27:40.706470+0000","last_became_active":"2023-10-16T23:27:36.277096+0000","last_became_peered":"2023-10-16T23:27:36.277096+0000","last_unstale":"2023-10-16T23:27:40.706470+0000","last_undegraded":"2023-10-16T23:27:40.706470+0000","last_fullsized":"2023-10-16T23:27:40.706470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:38:00.468059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697647+0000","last_change":"2023-10-16T23:27:40.331268+0000","last_active":"2023-10-16T23:27:41.697647+0000","last_peered":"2023-10-16T23:27:41.697647+0000","last_clean":"2023-10-16T23:27:41.697647+0000","last_became_active":"2023-10-16T23:27:40.330989+0000","last_became_peered":"2023-10-16T23:27:40.330989+0000","last_unstale":"2023-10-16T23:27:41.697647+0000","last_undegraded":"2023-10-16T23:27:41.697647+0000","last_fullsized":"2023-10-16T23:27:41.697647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:55.630817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702608+0000","last_change":"2023-10-16T23:27:40.726429+0000","last_active":"2023-10-16T23:27:41.702608+0000","last_peered":"2023-10-16T23:27:41.702608+0000","last_clean":"2023-10-16T23:27:41.702608+0000","last_became_active":"2023-10-16T23:27:40.725490+0000","last_became_peered":"2023-10-16T23:27:40.725490+0000","last_unstale":"2023-10-16T23:27:41.702608+0000","last_undegraded":"2023-10-16T23:27:41.702608+0000","last_fullsized":"2023-10-16T23:27:41.702608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:52:41.884757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.734075+0000","last_change":"2023-10-16T23:27:36.278865+0000","last_active":"2023-10-16T23:27:40.734075+0000","last_peered":"2023-10-16T23:27:40.734075+0000","last_clean":"2023-10-16T23:27:40.734075+0000","last_became_active":"2023-10-16T23:27:36.277974+0000","last_became_peered":"2023-10-16T23:27:36.277974+0000","last_unstale":"2023-10-16T23:27:40.734075+0000","last_undegraded":"2023-10-16T23:27:40.734075+0000","last_fullsized":"2023-10-16T23:27:40.734075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:31:09.411975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641255+0000","last_change":"2023-10-16T23:27:40.340025+0000","last_active":"2023-10-16T23:27:42.641255+0000","last_peered":"2023-10-16T23:27:42.641255+0000","last_clean":"2023-10-16T23:27:42.641255+0000","last_became_active":"2023-10-16T23:27:40.339569+0000","last_became_peered":"2023-10-16T23:27:40.339569+0000","last_unstale":"2023-10-16T23:27:42.641255+0000","last_undegraded":"2023-10-16T23:27:42.641255+0000","last_fullsized":"2023-10-16T23:27:42.641255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:42.154580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641378+0000","last_change":"2023-10-16T23:27:40.727415+0000","last_active":"2023-10-16T23:27:42.641378+0000","last_peered":"2023-10-16T23:27:42.641378+0000","last_clean":"2023-10-16T23:27:42.641378+0000","last_became_active":"2023-10-16T23:27:40.726813+0000","last_became_peered":"2023-10-16T23:27:40.726813+0000","last_unstale":"2023-10-16T23:27:42.641378+0000","last_undegraded":"2023-10-16T23:27:42.641378+0000","last_fullsized":"2023-10-16T23:27:42.641378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.694106+0000","last_change":"2023-10-16T23:27:36.294967+0000","last_active":"2023-10-16T23:27:40.694106+0000","last_peered":"2023-10-16T23:27:40.694106+0000","last_clean":"2023-10-16T23:27:40.694106+0000","last_became_active":"2023-10-16T23:27:36.294489+0000","last_became_peered":"2023-10-16T23:27:36.294489+0000","last_unstale":"2023-10-16T23:27:40.694106+0000","last_undegraded":"2023-10-16T23:27:40.694106+0000","last_fullsized":"2023-10-16T23:27:40.694106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:43:01.777197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478192+0000","last_change":"2023-10-16T23:27:40.327194+0000","last_active":"2023-10-16T23:27:42.478192+0000","last_peered":"2023-10-16T23:27:42.478192+0000","last_clean":"2023-10-16T23:27:42.478192+0000","last_became_active":"2023-10-16T23:27:40.326396+0000","last_became_peered":"2023-10-16T23:27:40.326396+0000","last_unstale":"2023-10-16T23:27:42.478192+0000","last_undegraded":"2023-10-16T23:27:42.478192+0000","last_fullsized":"2023-10-16T23:27:42.478192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:42.154580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.479151+0000","last_change":"2023-10-16T23:27:40.755777+0000","last_active":"2023-10-16T23:27:42.479151+0000","last_peered":"2023-10-16T23:27:42.479151+0000","last_clean":"2023-10-16T23:27:42.479151+0000","last_became_active":"2023-10-16T23:27:40.755489+0000","last_became_peered":"2023-10-16T23:27:40.755489+0000","last_unstale":"2023-10-16T23:27:42.479151+0000","last_undegraded":"2023-10-16T23:27:42.479151+0000","last_fullsized":"2023-10-16T23:27:42.479151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:06.148922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.720703+0000","last_change":"2023-10-16T23:27:36.279013+0000","last_active":"2023-10-16T23:27:40.720703+0000","last_peered":"2023-10-16T23:27:40.720703+0000","last_clean":"2023-10-16T23:27:40.720703+0000","last_became_active":"2023-10-16T23:27:36.278134+0000","last_became_peered":"2023-10-16T23:27:36.278134+0000","last_unstale":"2023-10-16T23:27:40.720703+0000","last_undegraded":"2023-10-16T23:27:40.720703+0000","last_fullsized":"2023-10-16T23:27:40.720703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:13:01.266310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704433+0000","last_change":"2023-10-16T23:27:40.342715+0000","last_active":"2023-10-16T23:27:41.704433+0000","last_peered":"2023-10-16T23:27:41.704433+0000","last_clean":"2023-10-16T23:27:41.704433+0000","last_became_active":"2023-10-16T23:27:40.341951+0000","last_became_peered":"2023-10-16T23:27:40.341951+0000","last_unstale":"2023-10-16T23:27:41.704433+0000","last_undegraded":"2023-10-16T23:27:41.704433+0000","last_fullsized":"2023-10-16T23:27:41.704433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:59.765109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478850+0000","last_change":"2023-10-16T23:27:40.731557+0000","last_active":"2023-10-16T23:27:42.478850+0000","last_peered":"2023-10-16T23:27:42.478850+0000","last_clean":"2023-10-16T23:27:42.478850+0000","last_became_active":"2023-10-16T23:27:40.731150+0000","last_became_peered":"2023-10-16T23:27:40.731150+0000","last_unstale":"2023-10-16T23:27:42.478850+0000","last_undegraded":"2023-10-16T23:27:42.478850+0000","last_fullsized":"2023-10-16T23:27:42.478850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952480+0000","last_change":"2023-10-16T23:27:40.320403+0000","last_active":"2023-10-16T23:27:41.952480+0000","last_peered":"2023-10-16T23:27:41.952480+0000","last_clean":"2023-10-16T23:27:41.952480+0000","last_became_active":"2023-10-16T23:27:40.319571+0000","last_became_peered":"2023-10-16T23:27:40.319571+0000","last_unstale":"2023-10-16T23:27:41.952480+0000","last_undegraded":"2023-10-16T23:27:41.952480+0000","last_fullsized":"2023-10-16T23:27:41.952480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.699523+0000","last_change":"2023-10-16T23:27:36.434134+0000","last_active":"2023-10-16T23:27:40.699523+0000","last_peered":"2023-10-16T23:27:40.699523+0000","last_clean":"2023-10-16T23:27:40.699523+0000","last_became_active":"2023-10-16T23:27:36.433808+0000","last_became_peered":"2023-10-16T23:27:36.433808+0000","last_unstale":"2023-10-16T23:27:40.699523+0000","last_undegraded":"2023-10-16T23:27:40.699523+0000","last_fullsized":"2023-10-16T23:27:40.699523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:58:44.833474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478822+0000","last_change":"2023-10-16T23:27:40.757932+0000","last_active":"2023-10-16T23:27:42.478822+0000","last_peered":"2023-10-16T23:27:42.478822+0000","last_clean":"2023-10-16T23:27:42.478822+0000","last_became_active":"2023-10-16T23:27:40.757670+0000","last_became_peered":"2023-10-16T23:27:40.757670+0000","last_unstale":"2023-10-16T23:27:42.478822+0000","last_undegraded":"2023-10-16T23:27:42.478822+0000","last_fullsized":"2023-10-16T23:27:42.478822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:25:31.037309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478894+0000","last_change":"2023-10-16T23:27:40.328161+0000","last_active":"2023-10-16T23:27:42.478894+0000","last_peered":"2023-10-16T23:27:42.478894+0000","last_clean":"2023-10-16T23:27:42.478894+0000","last_became_active":"2023-10-16T23:27:40.327804+0000","last_became_peered":"2023-10-16T23:27:40.327804+0000","last_unstale":"2023-10-16T23:27:42.478894+0000","last_undegraded":"2023-10-16T23:27:42.478894+0000","last_fullsized":"2023-10-16T23:27:42.478894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.734318+0000","last_change":"2023-10-16T23:27:36.434231+0000","last_active":"2023-10-16T23:27:40.734318+0000","last_peered":"2023-10-16T23:27:40.734318+0000","last_clean":"2023-10-16T23:27:40.734318+0000","last_became_active":"2023-10-16T23:27:36.433923+0000","last_became_peered":"2023-10-16T23:27:36.433923+0000","last_unstale":"2023-10-16T23:27:40.734318+0000","last_undegraded":"2023-10-16T23:27:40.734318+0000","last_fullsized":"2023-10-16T23:27:40.734318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:59.590093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642126+0000","last_change":"2023-10-16T23:27:40.756257+0000","last_active":"2023-10-16T23:27:42.642126+0000","last_peered":"2023-10-16T23:27:42.642126+0000","last_clean":"2023-10-16T23:27:42.642126+0000","last_became_active":"2023-10-16T23:27:40.755822+0000","last_became_peered":"2023-10-16T23:27:40.755822+0000","last_unstale":"2023-10-16T23:27:42.642126+0000","last_undegraded":"2023-10-16T23:27:42.642126+0000","last_fullsized":"2023-10-16T23:27:42.642126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698868+0000","last_change":"2023-10-16T23:27:40.333672+0000","last_active":"2023-10-16T23:27:41.698868+0000","last_peered":"2023-10-16T23:27:41.698868+0000","last_clean":"2023-10-16T23:27:41.698868+0000","last_became_active":"2023-10-16T23:27:40.333290+0000","last_became_peered":"2023-10-16T23:27:40.333290+0000","last_unstale":"2023-10-16T23:27:41.698868+0000","last_undegraded":"2023-10-16T23:27:41.698868+0000","last_fullsized":"2023-10-16T23:27:41.698868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:15:23.173526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.698124+0000","last_change":"2023-10-16T23:27:36.278805+0000","last_active":"2023-10-16T23:27:40.698124+0000","last_peered":"2023-10-16T23:27:40.698124+0000","last_clean":"2023-10-16T23:27:40.698124+0000","last_became_active":"2023-10-16T23:27:36.278209+0000","last_became_peered":"2023-10-16T23:27:36.278209+0000","last_unstale":"2023-10-16T23:27:40.698124+0000","last_undegraded":"2023-10-16T23:27:40.698124+0000","last_fullsized":"2023-10-16T23:27:40.698124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:38:00.468059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697202+0000","last_change":"2023-10-16T23:27:40.743576+0000","last_active":"2023-10-16T23:27:41.697202+0000","last_peered":"2023-10-16T23:27:41.697202+0000","last_clean":"2023-10-16T23:27:41.697202+0000","last_became_active":"2023-10-16T23:27:40.743293+0000","last_became_peered":"2023-10-16T23:27:40.743293+0000","last_unstale":"2023-10-16T23:27:41.697202+0000","last_undegraded":"2023-10-16T23:27:41.697202+0000","last_fullsized":"2023-10-16T23:27:41.697202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:14.359461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641711+0000","last_change":"2023-10-16T23:27:40.332668+0000","last_active":"2023-10-16T23:27:42.641711+0000","last_peered":"2023-10-16T23:27:42.641711+0000","last_clean":"2023-10-16T23:27:42.641711+0000","last_became_active":"2023-10-16T23:27:40.332084+0000","last_became_peered":"2023-10-16T23:27:40.332084+0000","last_unstale":"2023-10-16T23:27:42.641711+0000","last_undegraded":"2023-10-16T23:27:42.641711+0000","last_fullsized":"2023-10-16T23:27:42.641711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:14.260980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.698418+0000","last_change":"2023-10-16T23:27:36.281494+0000","last_active":"2023-10-16T23:27:40.698418+0000","last_peered":"2023-10-16T23:27:40.698418+0000","last_clean":"2023-10-16T23:27:40.698418+0000","last_became_active":"2023-10-16T23:27:36.280600+0000","last_became_peered":"2023-10-16T23:27:36.280600+0000","last_unstale":"2023-10-16T23:27:40.698418+0000","last_undegraded":"2023-10-16T23:27:40.698418+0000","last_fullsized":"2023-10-16T23:27:40.698418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:42:59.057101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702504+0000","last_change":"2023-10-16T23:27:40.756574+0000","last_active":"2023-10-16T23:27:41.702504+0000","last_peered":"2023-10-16T23:27:41.702504+0000","last_clean":"2023-10-16T23:27:41.702504+0000","last_became_active":"2023-10-16T23:27:40.755830+0000","last_became_peered":"2023-10-16T23:27:40.755830+0000","last_unstale":"2023-10-16T23:27:41.702504+0000","last_undegraded":"2023-10-16T23:27:41.702504+0000","last_fullsized":"2023-10-16T23:27:41.702504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:55:29.771781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704462+0000","last_change":"2023-10-16T23:27:40.745793+0000","last_active":"2023-10-16T23:27:41.704462+0000","last_peered":"2023-10-16T23:27:41.704462+0000","last_clean":"2023-10-16T23:27:41.704462+0000","last_became_active":"2023-10-16T23:27:40.745143+0000","last_became_peered":"2023-10-16T23:27:40.745143+0000","last_unstale":"2023-10-16T23:27:41.704462+0000","last_undegraded":"2023-10-16T23:27:41.704462+0000","last_fullsized":"2023-10-16T23:27:41.704462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:10:37.103208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704642+0000","last_change":"2023-10-16T23:27:40.352546+0000","last_active":"2023-10-16T23:27:41.704642+0000","last_peered":"2023-10-16T23:27:41.704642+0000","last_clean":"2023-10-16T23:27:41.704642+0000","last_became_active":"2023-10-16T23:27:40.351687+0000","last_became_peered":"2023-10-16T23:27:40.351687+0000","last_unstale":"2023-10-16T23:27:41.704642+0000","last_undegraded":"2023-10-16T23:27:41.704642+0000","last_fullsized":"2023-10-16T23:27:41.704642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:14.260980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478618+0000","last_change":"2023-10-16T23:27:40.727602+0000","last_active":"2023-10-16T23:27:42.478618+0000","last_peered":"2023-10-16T23:27:42.478618+0000","last_clean":"2023-10-16T23:27:42.478618+0000","last_became_active":"2023-10-16T23:27:40.727288+0000","last_became_peered":"2023-10-16T23:27:40.727288+0000","last_unstale":"2023-10-16T23:27:42.478618+0000","last_undegraded":"2023-10-16T23:27:42.478618+0000","last_fullsized":"2023-10-16T23:27:42.478618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:56:41.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302861+0000","last_change":"2023-10-16T23:27:40.332379+0000","last_active":"2023-10-16T23:27:42.302861+0000","last_peered":"2023-10-16T23:27:42.302861+0000","last_clean":"2023-10-16T23:27:42.302861+0000","last_became_active":"2023-10-16T23:27:40.331517+0000","last_became_peered":"2023-10-16T23:27:40.331517+0000","last_unstale":"2023-10-16T23:27:42.302861+0000","last_undegraded":"2023-10-16T23:27:42.302861+0000","last_fullsized":"2023-10-16T23:27:42.302861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:55.534068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952318+0000","last_change":"2023-10-16T23:27:40.336300+0000","last_active":"2023-10-16T23:27:41.952318+0000","last_peered":"2023-10-16T23:27:41.952318+0000","last_clean":"2023-10-16T23:27:41.952318+0000","last_became_active":"2023-10-16T23:27:40.333012+0000","last_became_peered":"2023-10-16T23:27:40.333012+0000","last_unstale":"2023-10-16T23:27:41.952318+0000","last_undegraded":"2023-10-16T23:27:41.952318+0000","last_fullsized":"2023-10-16T23:27:41.952318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697630+0000","last_change":"2023-10-16T23:27:40.760984+0000","last_active":"2023-10-16T23:27:41.697630+0000","last_peered":"2023-10-16T23:27:41.697630+0000","last_clean":"2023-10-16T23:27:41.697630+0000","last_became_active":"2023-10-16T23:27:40.760680+0000","last_became_peered":"2023-10-16T23:27:40.760680+0000","last_unstale":"2023-10-16T23:27:41.697630+0000","last_undegraded":"2023-10-16T23:27:41.697630+0000","last_fullsized":"2023-10-16T23:27:41.697630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:04.722168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642505+0000","last_change":"2023-10-16T23:27:40.339159+0000","last_active":"2023-10-16T23:27:42.642505+0000","last_peered":"2023-10-16T23:27:42.642505+0000","last_clean":"2023-10-16T23:27:42.642505+0000","last_became_active":"2023-10-16T23:27:40.338706+0000","last_became_peered":"2023-10-16T23:27:40.338706+0000","last_unstale":"2023-10-16T23:27:42.642505+0000","last_undegraded":"2023-10-16T23:27:42.642505+0000","last_fullsized":"2023-10-16T23:27:42.642505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:33:08.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697208+0000","last_change":"2023-10-16T23:27:40.713138+0000","last_active":"2023-10-16T23:27:41.697208+0000","last_peered":"2023-10-16T23:27:41.697208+0000","last_clean":"2023-10-16T23:27:41.697208+0000","last_became_active":"2023-10-16T23:27:40.712756+0000","last_became_peered":"2023-10-16T23:27:40.712756+0000","last_unstale":"2023-10-16T23:27:41.697208+0000","last_undegraded":"2023-10-16T23:27:41.697208+0000","last_fullsized":"2023-10-16T23:27:41.697208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:19:17.463284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.703371+0000","last_change":"2023-10-16T23:27:40.756418+0000","last_active":"2023-10-16T23:27:41.703371+0000","last_peered":"2023-10-16T23:27:41.703371+0000","last_clean":"2023-10-16T23:27:41.703371+0000","last_became_active":"2023-10-16T23:27:40.755714+0000","last_became_peered":"2023-10-16T23:27:40.755714+0000","last_unstale":"2023-10-16T23:27:41.703371+0000","last_undegraded":"2023-10-16T23:27:41.703371+0000","last_fullsized":"2023-10-16T23:27:41.703371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:56.634821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697319+0000","last_change":"2023-10-16T23:27:40.332275+0000","last_active":"2023-10-16T23:27:41.697319+0000","last_peered":"2023-10-16T23:27:41.697319+0000","last_clean":"2023-10-16T23:27:41.697319+0000","last_became_active":"2023-10-16T23:27:40.331428+0000","last_became_peered":"2023-10-16T23:27:40.331428+0000","last_unstale":"2023-10-16T23:27:41.697319+0000","last_undegraded":"2023-10-16T23:27:41.697319+0000","last_fullsized":"2023-10-16T23:27:41.697319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641125+0000","last_change":"2023-10-16T23:27:40.761081+0000","last_active":"2023-10-16T23:27:42.641125+0000","last_peered":"2023-10-16T23:27:42.641125+0000","last_clean":"2023-10-16T23:27:42.641125+0000","last_became_active":"2023-10-16T23:27:40.760779+0000","last_became_peered":"2023-10-16T23:27:40.760779+0000","last_unstale":"2023-10-16T23:27:42.641125+0000","last_undegraded":"2023-10-16T23:27:42.641125+0000","last_fullsized":"2023-10-16T23:27:42.641125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:31.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478605+0000","last_change":"2023-10-16T23:27:40.318419+0000","last_active":"2023-10-16T23:27:42.478605+0000","last_peered":"2023-10-16T23:27:42.478605+0000","last_clean":"2023-10-16T23:27:42.478605+0000","last_became_active":"2023-10-16T23:27:40.317622+0000","last_became_peered":"2023-10-16T23:27:40.317622+0000","last_unstale":"2023-10-16T23:27:42.478605+0000","last_undegraded":"2023-10-16T23:27:42.478605+0000","last_fullsized":"2023-10-16T23:27:42.478605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698467+0000","last_change":"2023-10-16T23:27:40.706263+0000","last_active":"2023-10-16T23:27:41.698467+0000","last_peered":"2023-10-16T23:27:41.698467+0000","last_clean":"2023-10-16T23:27:41.698467+0000","last_became_active":"2023-10-16T23:27:40.705956+0000","last_became_peered":"2023-10-16T23:27:40.705956+0000","last_unstale":"2023-10-16T23:27:41.698467+0000","last_undegraded":"2023-10-16T23:27:41.698467+0000","last_fullsized":"2023-10-16T23:27:41.698467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.703994+0000","last_change":"2023-10-16T23:27:40.344965+0000","last_active":"2023-10-16T23:27:41.703994+0000","last_peered":"2023-10-16T23:27:41.703994+0000","last_clean":"2023-10-16T23:27:41.703994+0000","last_became_active":"2023-10-16T23:27:40.344158+0000","last_became_peered":"2023-10-16T23:27:40.344158+0000","last_unstale":"2023-10-16T23:27:41.703994+0000","last_undegraded":"2023-10-16T23:27:41.703994+0000","last_fullsized":"2023-10-16T23:27:41.703994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:04.095452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302083+0000","last_change":"2023-10-16T23:27:40.713594+0000","last_active":"2023-10-16T23:27:42.302083+0000","last_peered":"2023-10-16T23:27:42.302083+0000","last_clean":"2023-10-16T23:27:42.302083+0000","last_became_active":"2023-10-16T23:27:40.712632+0000","last_became_peered":"2023-10-16T23:27:40.712632+0000","last_unstale":"2023-10-16T23:27:42.302083+0000","last_undegraded":"2023-10-16T23:27:42.302083+0000","last_fullsized":"2023-10-16T23:27:42.302083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:52.368847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642366+0000","last_change":"2023-10-16T23:27:40.357300+0000","last_active":"2023-10-16T23:27:42.642366+0000","last_peered":"2023-10-16T23:27:42.642366+0000","last_clean":"2023-10-16T23:27:42.642366+0000","last_became_active":"2023-10-16T23:27:40.356809+0000","last_became_peered":"2023-10-16T23:27:40.356809+0000","last_unstale":"2023-10-16T23:27:42.642366+0000","last_undegraded":"2023-10-16T23:27:42.642366+0000","last_fullsized":"2023-10-16T23:27:42.642366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704165+0000","last_change":"2023-10-16T23:27:40.726018+0000","last_active":"2023-10-16T23:27:41.704165+0000","last_peered":"2023-10-16T23:27:41.704165+0000","last_clean":"2023-10-16T23:27:41.704165+0000","last_became_active":"2023-10-16T23:27:40.724910+0000","last_became_peered":"2023-10-16T23:27:40.724910+0000","last_unstale":"2023-10-16T23:27:41.704165+0000","last_undegraded":"2023-10-16T23:27:41.704165+0000","last_fullsized":"2023-10-16T23:27:41.704165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:25:34.841325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.951808+0000","last_change":"2023-10-16T23:27:40.345785+0000","last_active":"2023-10-16T23:27:41.951808+0000","last_peered":"2023-10-16T23:27:41.951808+0000","last_clean":"2023-10-16T23:27:41.951808+0000","last_became_active":"2023-10-16T23:27:40.344531+0000","last_became_peered":"2023-10-16T23:27:40.344531+0000","last_unstale":"2023-10-16T23:27:41.951808+0000","last_undegraded":"2023-10-16T23:27:41.951808+0000","last_fullsized":"2023-10-16T23:27:41.951808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:55.630817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702429+0000","last_change":"2023-10-16T23:27:40.720573+0000","last_active":"2023-10-16T23:27:41.702429+0000","last_peered":"2023-10-16T23:27:41.702429+0000","last_clean":"2023-10-16T23:27:41.702429+0000","last_became_active":"2023-10-16T23:27:40.719758+0000","last_became_peered":"2023-10-16T23:27:40.719758+0000","last_unstale":"2023-10-16T23:27:41.702429+0000","last_undegraded":"2023-10-16T23:27:41.702429+0000","last_fullsized":"2023-10-16T23:27:41.702429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:27:29.534374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952407+0000","last_change":"2023-10-16T23:27:40.345400+0000","last_active":"2023-10-16T23:27:41.952407+0000","last_peered":"2023-10-16T23:27:41.952407+0000","last_clean":"2023-10-16T23:27:41.952407+0000","last_became_active":"2023-10-16T23:27:40.344589+0000","last_became_peered":"2023-10-16T23:27:40.344589+0000","last_unstale":"2023-10-16T23:27:41.952407+0000","last_undegraded":"2023-10-16T23:27:41.952407+0000","last_fullsized":"2023-10-16T23:27:41.952407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:15:23.173526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697731+0000","last_change":"2023-10-16T23:27:40.711211+0000","last_active":"2023-10-16T23:27:41.697731+0000","last_peered":"2023-10-16T23:27:41.697731+0000","last_clean":"2023-10-16T23:27:41.697731+0000","last_became_active":"2023-10-16T23:27:40.705936+0000","last_became_peered":"2023-10-16T23:27:40.705936+0000","last_unstale":"2023-10-16T23:27:41.697731+0000","last_undegraded":"2023-10-16T23:27:41.697731+0000","last_fullsized":"2023-10-16T23:27:41.697731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.699046+0000","last_change":"2023-10-16T23:27:40.323626+0000","last_active":"2023-10-16T23:27:41.699046+0000","last_peered":"2023-10-16T23:27:41.699046+0000","last_clean":"2023-10-16T23:27:41.699046+0000","last_became_active":"2023-10-16T23:27:40.323352+0000","last_became_peered":"2023-10-16T23:27:40.323352+0000","last_unstale":"2023-10-16T23:27:41.699046+0000","last_undegraded":"2023-10-16T23:27:41.699046+0000","last_fullsized":"2023-10-16T23:27:41.699046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:33:08.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702217+0000","last_change":"2023-10-16T23:27:40.749109+0000","last_active":"2023-10-16T23:27:41.702217+0000","last_peered":"2023-10-16T23:27:41.702217+0000","last_clean":"2023-10-16T23:27:41.702217+0000","last_became_active":"2023-10-16T23:27:40.748525+0000","last_became_peered":"2023-10-16T23:27:40.748525+0000","last_unstale":"2023-10-16T23:27:41.702217+0000","last_undegraded":"2023-10-16T23:27:41.702217+0000","last_fullsized":"2023-10-16T23:27:41.702217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:10:38.468420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642507+0000","last_change":"2023-10-16T23:27:40.338946+0000","last_active":"2023-10-16T23:27:42.642507+0000","last_peered":"2023-10-16T23:27:42.642507+0000","last_clean":"2023-10-16T23:27:42.642507+0000","last_became_active":"2023-10-16T23:27:40.338565+0000","last_became_peered":"2023-10-16T23:27:40.338565+0000","last_unstale":"2023-10-16T23:27:42.642507+0000","last_undegraded":"2023-10-16T23:27:42.642507+0000","last_fullsized":"2023-10-16T23:27:42.642507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:55.630817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":90844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3580000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":91496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":92464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":249856,"data_stored":90934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":90844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":824,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":843776,"data_stored":681794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.385}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]}]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":868352,"data_stored":682992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.331}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31288,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340552,"statfs":{"total":96636764160,"available":96604725248,"internally_reserved":0,"allocated":245760,"data_stored":90844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T23:27:49.528 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-16T23:27:49.528 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-16T23:27:49.529 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-16T23:27:49.529 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-16T23:27:49.530 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-16T23:27:49.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.684+0000 7f1841b55640 1 Processor -- start 2023-10-16T23:27:49.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.684+0000 7f1841b55640 1 -- start start 2023-10-16T23:27:49.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.684+0000 7f1841b55640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f183c0bfc30 0x7f183c0c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:49.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.684+0000 7f1841b55640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f183c0c01e0 con 0x7f183c06e770 2023-10-16T23:27:49.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.684+0000 7f1841b55640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f183c0b8120 con 0x7f183c0c1950 2023-10-16T23:27:49.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.684+0000 7f1841b55640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183c0b85b0 con 0x7f183c0bfc30 2023-10-16T23:27:49.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.684+0000 7f1833fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f183c06e770 0x7f183c153150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38122/0 (socket says 172.21.15.12:38122) 2023-10-16T23:27:49.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.684+0000 7f1833fff640 1 -- 172.21.15.12:0/2534339054 learned_addr learned my addr 172.21.15.12:0/2534339054 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:49.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.684+0000 7f183bfff640 1 --2- 172.21.15.12:0/2534339054 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f183c0bfc30 0x7f183c0c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:49.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.684+0000 7f183affd640 1 -- 172.21.15.12:0/2534339054 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1975753689 0 0) 0x7f183c0c01e0 con 0x7f183c06e770 2023-10-16T23:27:49.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.684+0000 7f183affd640 1 -- 172.21.15.12:0/2534339054 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1828003530 con 0x7f183c06e770 2023-10-16T23:27:49.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.688+0000 7f183bfff640 1 -- 172.21.15.12:0/2534339054 >> v1:172.21.15.31:6789/0 conn(0x7f183c0c1950 legacy=0x7f183c152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:49.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.688+0000 7f183bfff640 1 -- 172.21.15.12:0/2534339054 >> v1:172.21.15.12:6789/0 conn(0x7f183c06e770 legacy=0x7f183c153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:49.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.688+0000 7f183affd640 1 -- 172.21.15.12:0/2534339054 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2757163049 0 0) 0x7f183c0b8120 con 0x7f183c0c1950 2023-10-16T23:27:49.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.688+0000 7f183bfff640 1 -- 172.21.15.12:0/2534339054 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183c153860 con 0x7f183c0bfc30 2023-10-16T23:27:49.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.688+0000 7f183bfff640 1 --2- 172.21.15.12:0/2534339054 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f183c0bfc30 0x7f183c0c1d30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1834009dc0 tx=0x7f183401d310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bce138975912b13a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:49.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.688+0000 7f183affd640 1 -- 172.21.15.12:0/2534339054 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18340a5990 con 0x7f183c0bfc30 2023-10-16T23:27:49.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.688+0000 7f183affd640 1 -- 172.21.15.12:0/2534339054 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18340a5af0 con 0x7f183c0bfc30 2023-10-16T23:27:49.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.688+0000 7f183affd640 1 -- 172.21.15.12:0/2534339054 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18340a5e60 con 0x7f183c0bfc30 2023-10-16T23:27:49.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.688+0000 7f1841b55640 1 -- 172.21.15.12:0/2534339054 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f183c0bfc30 msgr2=0x7f183c0c1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:49.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.688+0000 7f1841b55640 1 --2- 172.21.15.12:0/2534339054 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f183c0bfc30 0x7f183c0c1d30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1834009dc0 tx=0x7f183401d310 comp rx=0 tx=0).stop 2023-10-16T23:27:49.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.688+0000 7f1841b55640 1 -- 172.21.15.12:0/2534339054 shutdown_connections 2023-10-16T23:27:49.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.688+0000 7f1841b55640 1 --2- 172.21.15.12:0/2534339054 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f183c0bfc30 0x7f183c0c1d30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:49.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.688+0000 7f1841b55640 1 -- 172.21.15.12:0/2534339054 >> 172.21.15.12:0/2534339054 conn(0x7f183c06b5d0 msgr2=0x7f183c06b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:49.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.688+0000 7f1841b55640 1 -- 172.21.15.12:0/2534339054 shutdown_connections 2023-10-16T23:27:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.688+0000 7f1841b55640 1 -- 172.21.15.12:0/2534339054 wait complete. 2023-10-16T23:27:49.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f1841b55640 1 Processor -- start 2023-10-16T23:27:49.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f1841b55640 1 -- start start 2023-10-16T23:27:49.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f1841b55640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f183c06e770 0x7f183c1e7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:49.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f1841b55640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f183c0bfc30 0x7f183c145830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:49.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f1841b55640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f183c0c1950 0x7f183c13fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:49.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f1841b55640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183c1eb780 con 0x7f183c0bfc30 2023-10-16T23:27:49.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f1841b55640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183c1e8480 con 0x7f183c0c1950 2023-10-16T23:27:49.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f1841b55640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183c1e77a0 con 0x7f183c06e770 2023-10-16T23:27:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f1833fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f183c0bfc30 0x7f183c145830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f1833fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f183c0bfc30 0x7f183c145830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55564/0 (socket says 172.21.15.12:55564) 2023-10-16T23:27:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f1833fff640 1 -- 172.21.15.12:0/2394542807 learned_addr learned my addr 172.21.15.12:0/2394542807 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f183b7fe640 1 --2- 172.21.15.12:0/2394542807 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f183c06e770 0x7f183c1e7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f183bfff640 1 --2- 172.21.15.12:0/2394542807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f183c0c1950 0x7f183c13fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f1833fff640 1 -- 172.21.15.12:0/2394542807 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f183c06e770 msgr2=0x7f183c1e7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f1833fff640 1 --2- 172.21.15.12:0/2394542807 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f183c06e770 0x7f183c1e7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f1833fff640 1 -- 172.21.15.12:0/2394542807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f183c0c1950 msgr2=0x7f183c13fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f1833fff640 1 --2- 172.21.15.12:0/2394542807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f183c0c1950 0x7f183c13fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f1833fff640 1 -- 172.21.15.12:0/2394542807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1834009a70 con 0x7f183c0bfc30 2023-10-16T23:27:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f183bfff640 1 --2- 172.21.15.12:0/2394542807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f183c0c1950 0x7f183c13fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:27:49.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f1833fff640 1 --2- 172.21.15.12:0/2394542807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f183c0bfc30 0x7f183c145830 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f182400c450 tx=0x7f182400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:49.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f1838ff9640 1 -- 172.21.15.12:0/2394542807 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1824005cf0 con 0x7f183c0bfc30 2023-10-16T23:27:49.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f1838ff9640 1 -- 172.21.15.12:0/2394542807 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1824005e50 con 0x7f183c0bfc30 2023-10-16T23:27:49.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f1838ff9640 1 -- 172.21.15.12:0/2394542807 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18240072d0 con 0x7f183c0bfc30 2023-10-16T23:27:49.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f1841b55640 1 -- 172.21.15.12:0/2394542807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f183c1e79a0 con 0x7f183c0bfc30 2023-10-16T23:27:49.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f1841b55640 1 -- 172.21.15.12:0/2394542807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f183c1e7f60 con 0x7f183c0bfc30 2023-10-16T23:27:49.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f1841b55640 1 -- 172.21.15.12:0/2394542807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f183c0673a0 con 0x7f183c0bfc30 2023-10-16T23:27:49.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.692+0000 7f1838ff9640 1 -- 172.21.15.12:0/2394542807 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f1824007430 con 0x7f183c0bfc30 2023-10-16T23:27:49.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.696+0000 7f1838ff9640 1 --2- 172.21.15.12:0/2394542807 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f181c065e30 0x7f181c0682f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:49.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.696+0000 7f1838ff9640 1 -- 172.21.15.12:0/2394542807 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1824082c40 con 0x7f183c0bfc30 2023-10-16T23:27:49.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.696+0000 7f183b7fe640 1 --2- 172.21.15.12:0/2394542807 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f181c065e30 0x7f181c0682f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:49.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.696+0000 7f183b7fe640 1 --2- 172.21.15.12:0/2394542807 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f181c065e30 0x7f181c0682f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f182c000f70 tx=0x7f182c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:49.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.700+0000 7f1838ff9640 1 -- 172.21.15.12:0/2394542807 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f18240503d0 con 0x7f183c0bfc30 2023-10-16T23:27:49.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.888+0000 7f1841b55640 1 -- 172.21.15.12:0/2394542807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f183c071560 con 0x7f183c0bfc30 2023-10-16T23:27:49.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.896+0000 7f1838ff9640 1 -- 172.21.15.12:0/2394542807 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163891 (secure 0 0 0) 0x7f18240539f0 con 0x7f183c0bfc30 2023-10-16T23:27:49.902 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:49.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.900+0000 7f1841b55640 1 -- 172.21.15.12:0/2394542807 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f181c065e30 msgr2=0x7f181c0682f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:49.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.900+0000 7f1841b55640 1 --2- 172.21.15.12:0/2394542807 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f181c065e30 0x7f181c0682f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f182c000f70 tx=0x7f182c009040 comp rx=0 tx=0).stop 2023-10-16T23:27:49.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.900+0000 7f1841b55640 1 -- 172.21.15.12:0/2394542807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f183c0bfc30 msgr2=0x7f183c145830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:49.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.900+0000 7f1841b55640 1 --2- 172.21.15.12:0/2394542807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f183c0bfc30 0x7f183c145830 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f182400c450 tx=0x7f182400c910 comp rx=0 tx=0).stop 2023-10-16T23:27:49.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.900+0000 7f1841b55640 1 -- 172.21.15.12:0/2394542807 shutdown_connections 2023-10-16T23:27:49.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.900+0000 7f1841b55640 1 --2- 172.21.15.12:0/2394542807 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f181c065e30 0x7f181c0682f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:49.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.900+0000 7f1841b55640 1 --2- 172.21.15.12:0/2394542807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f183c0c1950 0x7f183c13fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:49.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.900+0000 7f1841b55640 1 --2- 172.21.15.12:0/2394542807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f183c0bfc30 0x7f183c145830 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:49.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.900+0000 7f1841b55640 1 --2- 172.21.15.12:0/2394542807 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f183c06e770 0x7f183c1e7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:49.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.900+0000 7f1841b55640 1 -- 172.21.15.12:0/2394542807 >> 172.21.15.12:0/2394542807 conn(0x7f183c06b5d0 msgr2=0x7f183c144290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:49.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.900+0000 7f1841b55640 1 -- 172.21.15.12:0/2394542807 shutdown_connections 2023-10-16T23:27:49.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:49.900+0000 7f1841b55640 1 -- 172.21.15.12:0/2394542807 wait complete. 2023-10-16T23:27:49.918 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":5,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":37949},{"type":"v1","addr":"172.21.15.31:6833","nonce":37949}]},"active_addr":"172.21.15.31:6833/37949","active_change":"2023-10-16T23:27:21.270382+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4106,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":2016584812}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":3773103115}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":2664403613}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":2687366568}]}]} 2023-10-16T23:27:49.923 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-16T23:27:49.924 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-16T23:27:49.924 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T23:27:50.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.044+0000 7fd9ebc9d640 1 Processor -- start 2023-10-16T23:27:50.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.044+0000 7fd9ebc9d640 1 -- start start 2023-10-16T23:27:50.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9ebc9d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e4150310 0x7fd9e40bf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9ebc9d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e406d7c0 con 0x7fd9e406b660 2023-10-16T23:27:50.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9ebc9d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e4071690 con 0x7fd9e406c8a0 2023-10-16T23:27:50.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9ebc9d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e40bfcc0 con 0x7fd9e4150310 2023-10-16T23:27:50.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9e9a39640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd9e406b660 0x7fd9e414fc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38136/0 (socket says 172.21.15.12:38136) 2023-10-16T23:27:50.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9e9a39640 1 -- 172.21.15.12:0/3636210923 learned_addr learned my addr 172.21.15.12:0/3636210923 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:50.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9e9238640 1 --2- 172.21.15.12:0/3636210923 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e4150310 0x7fd9e40bf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9e8a37640 1 -- 172.21.15.12:0/3636210923 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2785095966 0 0) 0x7fd9e406d7c0 con 0x7fd9e406b660 2023-10-16T23:27:50.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9e8a37640 1 -- 172.21.15.12:0/3636210923 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9d0003530 con 0x7fd9e406b660 2023-10-16T23:27:50.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9e8a37640 1 -- 172.21.15.12:0/3636210923 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1199768417 0 0) 0x7fd9d0003530 con 0x7fd9e406b660 2023-10-16T23:27:50.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9e8a37640 1 -- 172.21.15.12:0/3636210923 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e4150310 msgr2=0x7fd9e40bf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:50.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9e8a37640 1 --2- 172.21.15.12:0/3636210923 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e4150310 0x7fd9e40bf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9e8a37640 1 -- 172.21.15.12:0/3636210923 >> v1:172.21.15.31:6789/0 conn(0x7fd9e406c8a0 legacy=0x7fd9e4157ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9e8a37640 1 -- 172.21.15.12:0/3636210923 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e406d2e0 con 0x7fd9e406b660 2023-10-16T23:27:50.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9e8a37640 1 -- 172.21.15.12:0/3636210923 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7fd9d8001a00 con 0x7fd9e406b660 2023-10-16T23:27:50.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9e8a37640 1 -- 172.21.15.12:0/3636210923 >> v1:172.21.15.12:6789/0 conn(0x7fd9e406b660 legacy=0x7fd9e414fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9e8a37640 1 --2- 172.21.15.12:0/3636210923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9d00039b0 0x7fd9d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9e8a37640 1 --2- 172.21.15.12:0/3636210923 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e4150310 0x7fd9d00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9e8a37640 1 --2- 172.21.15.12:0/3636210923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9d0004d10 0x7fd9d0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9e8a37640 1 -- 172.21.15.12:0/3636210923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d000ba40 con 0x7fd9d0004d10 2023-10-16T23:27:50.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9e8a37640 1 -- 172.21.15.12:0/3636210923 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d000bb80 con 0x7fd9d00039b0 2023-10-16T23:27:50.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9e8a37640 1 -- 172.21.15.12:0/3636210923 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d000bd40 con 0x7fd9e4150310 2023-10-16T23:27:50.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9ea23a640 1 --2- 172.21.15.12:0/3636210923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9d0004d10 0x7fd9d0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9e9238640 1 --2- 172.21.15.12:0/3636210923 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e4150310 0x7fd9d00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9e9a39640 1 --2- 172.21.15.12:0/3636210923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9d00039b0 0x7fd9d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9ea23a640 1 -- 172.21.15.12:0/3636210923 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e4150310 msgr2=0x7fd9d00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:50.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9ea23a640 1 --2- 172.21.15.12:0/3636210923 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e4150310 0x7fd9d00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9ea23a640 1 -- 172.21.15.12:0/3636210923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9d00039b0 msgr2=0x7fd9d0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:50.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9ea23a640 1 --2- 172.21.15.12:0/3636210923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9d00039b0 0x7fd9d0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.048+0000 7fd9ea23a640 1 -- 172.21.15.12:0/3636210923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d0003530 con 0x7fd9d0004d10 2023-10-16T23:27:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ea23a640 1 --2- 172.21.15.12:0/3636210923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9d0004d10 0x7fd9d0005190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd9e406cd30 tx=0x7fd9dc01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5ee79a61f4cd0e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9e8a37640 1 -- 172.21.15.12:0/3636210923 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc0052d0 con 0x7fd9d0004d10 2023-10-16T23:27:50.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9e8a37640 1 -- 172.21.15.12:0/3636210923 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc0a7050 con 0x7fd9d0004d10 2023-10-16T23:27:50.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9e8a37640 1 -- 172.21.15.12:0/3636210923 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc003600 con 0x7fd9d0004d10 2023-10-16T23:27:50.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ebc9d640 1 -- 172.21.15.12:0/3636210923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9d0004d10 msgr2=0x7fd9d0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ebc9d640 1 --2- 172.21.15.12:0/3636210923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9d0004d10 0x7fd9d0005190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd9e406cd30 tx=0x7fd9dc01c3a0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ea23a640 1 -- 172.21.15.12:0/3636210923 reap_dead start 2023-10-16T23:27:50.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ebc9d640 1 -- 172.21.15.12:0/3636210923 shutdown_connections 2023-10-16T23:27:50.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ebc9d640 1 -- 172.21.15.12:0/3636210923 >> 172.21.15.12:0/3636210923 conn(0x7fd9e40a3f20 msgr2=0x7fd9e40c1880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:50.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ebc9d640 1 -- 172.21.15.12:0/3636210923 shutdown_connections 2023-10-16T23:27:50.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ebc9d640 1 -- 172.21.15.12:0/3636210923 wait complete. 2023-10-16T23:27:50.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ebc9d640 1 Processor -- start 2023-10-16T23:27:50.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ebc9d640 1 -- start start 2023-10-16T23:27:50.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ebc9d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e4148170 0x7fd9e41e7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ebc9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9e40bd4c0 0x7fd9e41e8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ebc9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9e41e8590 0x7fd9e4143780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ebc9d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e41491e0 con 0x7fd9e41e8590 2023-10-16T23:27:50.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ebc9d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e40a2990 con 0x7fd9e40bd4c0 2023-10-16T23:27:50.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ebc9d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e40a2660 con 0x7fd9e4148170 2023-10-16T23:27:50.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ea23a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9e41e8590 0x7fd9e4143780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ea23a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9e41e8590 0x7fd9e4143780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55586/0 (socket says 172.21.15.12:55586) 2023-10-16T23:27:50.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ea23a640 1 -- 172.21.15.12:0/2046184707 learned_addr learned my addr 172.21.15.12:0/2046184707 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:50.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9e9238640 1 --2- 172.21.15.12:0/2046184707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9e40bd4c0 0x7fd9e41e8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9e9a39640 1 --2- 172.21.15.12:0/2046184707 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e4148170 0x7fd9e41e7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ea23a640 1 -- 172.21.15.12:0/2046184707 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e4148170 msgr2=0x7fd9e41e7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ea23a640 1 --2- 172.21.15.12:0/2046184707 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e4148170 0x7fd9e41e7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ea23a640 1 -- 172.21.15.12:0/2046184707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9e40bd4c0 msgr2=0x7fd9e41e8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ea23a640 1 --2- 172.21.15.12:0/2046184707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9e40bd4c0 0x7fd9e41e8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ea23a640 1 -- 172.21.15.12:0/2046184707 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e40a2f00 con 0x7fd9e41e8590 2023-10-16T23:27:50.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9e9238640 1 --2- 172.21.15.12:0/2046184707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9e40bd4c0 0x7fd9e41e8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:50.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ea23a640 1 --2- 172.21.15.12:0/2046184707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9e41e8590 0x7fd9e4143780 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc097db0 tx=0x7fd9d0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9d67fc640 1 -- 172.21.15.12:0/2046184707 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc007a40 con 0x7fd9e41e8590 2023-10-16T23:27:50.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9d67fc640 1 -- 172.21.15.12:0/2046184707 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc003ac0 con 0x7fd9e41e8590 2023-10-16T23:27:50.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ebc9d640 1 -- 172.21.15.12:0/2046184707 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e40a31e0 con 0x7fd9e41e8590 2023-10-16T23:27:50.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9d67fc640 1 -- 172.21.15.12:0/2046184707 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc003e50 con 0x7fd9e41e8590 2023-10-16T23:27:50.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.052+0000 7fd9ebc9d640 1 -- 172.21.15.12:0/2046184707 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e4148550 con 0x7fd9e41e8590 2023-10-16T23:27:50.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.056+0000 7fd9ebc9d640 1 -- 172.21.15.12:0/2046184707 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e40673a0 con 0x7fd9e41e8590 2023-10-16T23:27:50.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.056+0000 7fd9d67fc640 1 -- 172.21.15.12:0/2046184707 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fd9dc007030 con 0x7fd9e41e8590 2023-10-16T23:27:50.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.056+0000 7fd9d67fc640 1 --2- 172.21.15.12:0/2046184707 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd9c8065e90 0x7fd9c8068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.056+0000 7fd9d67fc640 1 -- 172.21.15.12:0/2046184707 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd9dc11d730 con 0x7fd9e41e8590 2023-10-16T23:27:50.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.056+0000 7fd9e9a39640 1 --2- 172.21.15.12:0/2046184707 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd9c8065e90 0x7fd9c8068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.056+0000 7fd9e9a39640 1 --2- 172.21.15.12:0/2046184707 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd9c8065e90 0x7fd9c8068350 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8001590 tx=0x7fd9d80014e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.060+0000 7fd9d67fc640 1 -- 172.21.15.12:0/2046184707 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fd9dc0eae10 con 0x7fd9e41e8590 2023-10-16T23:27:50.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.212+0000 7fd9ebc9d640 1 -- 172.21.15.12:0/2046184707 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9e40a2ad0 con 0x7fd9e41e8590 2023-10-16T23:27:50.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.216+0000 7fd9d67fc640 1 -- 172.21.15.12:0/2046184707 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17763 (secure 0 0 0) 0x7fd9dc0ee430 con 0x7fd9e41e8590 2023-10-16T23:27:50.218 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:50.218 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"fsid":"0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51","created":"2023-10-16T23:27:16.468087+0000","modified":"2023-10-16T23:27:41.690088+0000","last_up_change":"2023-10-16T23:27:28.136202+0000","last_in_change":"2023-10-16T23:27:18.793212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T23:27:27.354025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-16T23:27:34.786446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-16T23:27:39.130341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-16T23:27:39.674572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73e70f98-6f5e-4464-b34e-931faac41cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":38075},{"type":"v1","addr":"172.21.15.12:6814","nonce":38075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":38075},{"type":"v1","addr":"172.21.15.12:6819","nonce":38075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":38075},{"type":"v1","addr":"172.21.15.12:6827","nonce":38075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":38075},{"type":"v1","addr":"172.21.15.12:6823","nonce":38075}]},"public_addr":"172.21.15.12:6814/38075","cluster_addr":"172.21.15.12:6819/38075","heartbeat_back_addr":"172.21.15.12:6827/38075","heartbeat_front_addr":"172.21.15.12:6823/38075","state":["exists","up"]},{"osd":1,"uuid":"ff722efe-b3f9-4cc0-bbde-f4d4d8055a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":38076},{"type":"v1","addr":"172.21.15.12:6811","nonce":38076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":38076},{"type":"v1","addr":"172.21.15.12:6818","nonce":38076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":38076},{"type":"v1","addr":"172.21.15.12:6831","nonce":38076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":38076},{"type":"v1","addr":"172.21.15.12:6825","nonce":38076}]},"public_addr":"172.21.15.12:6811/38076","cluster_addr":"172.21.15.12:6818/38076","heartbeat_back_addr":"172.21.15.12:6831/38076","heartbeat_front_addr":"172.21.15.12:6825/38076","state":["exists","up"]},{"osd":2,"uuid":"9baf25db-dce0-4065-90d6-f35867286be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6809","nonce":38073},{"type":"v1","addr":"172.21.15.12:6810","nonce":38073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":38073},{"type":"v1","addr":"172.21.15.12:6817","nonce":38073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":38073},{"type":"v1","addr":"172.21.15.12:6830","nonce":38073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":38073},{"type":"v1","addr":"172.21.15.12:6826","nonce":38073}]},"public_addr":"172.21.15.12:6810/38073","cluster_addr":"172.21.15.12:6817/38073","heartbeat_back_addr":"172.21.15.12:6830/38073","heartbeat_front_addr":"172.21.15.12:6826/38073","state":["exists","up"]},{"osd":3,"uuid":"8a620ad3-2294-470d-8a8c-66f177f5fbe7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":38074},{"type":"v1","addr":"172.21.15.12:6801","nonce":38074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":38074},{"type":"v1","addr":"172.21.15.12:6803","nonce":38074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":38074},{"type":"v1","addr":"172.21.15.12:6807","nonce":38074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":38074},{"type":"v1","addr":"172.21.15.12:6805","nonce":38074}]},"public_addr":"172.21.15.12:6801/38074","cluster_addr":"172.21.15.12:6803/38074","heartbeat_back_addr":"172.21.15.12:6807/38074","heartbeat_front_addr":"172.21.15.12:6805/38074","state":["exists","up"]},{"osd":4,"uuid":"a8824d77-7405-40f5-9234-60889802b184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":38266},{"type":"v1","addr":"172.21.15.31:6817","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":38266},{"type":"v1","addr":"172.21.15.31:6819","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":38266},{"type":"v1","addr":"172.21.15.31:6823","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":38266},{"type":"v1","addr":"172.21.15.31:6821","nonce":38266}]},"public_addr":"172.21.15.31:6817/38266","cluster_addr":"172.21.15.31:6819/38266","heartbeat_back_addr":"172.21.15.31:6823/38266","heartbeat_front_addr":"172.21.15.31:6821/38266","state":["exists","up"]},{"osd":5,"uuid":"3bb01192-a47c-48e9-9662-285e3f6f4b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":38264},{"type":"v1","addr":"172.21.15.31:6807","nonce":38264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":38264},{"type":"v1","addr":"172.21.15.31:6811","nonce":38264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":38264},{"type":"v1","addr":"172.21.15.31:6815","nonce":38264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":38264},{"type":"v1","addr":"172.21.15.31:6813","nonce":38264}]},"public_addr":"172.21.15.31:6807/38264","cluster_addr":"172.21.15.31:6811/38264","heartbeat_back_addr":"172.21.15.31:6815/38264","heartbeat_front_addr":"172.21.15.31:6813/38264","state":["exists","up"]},{"osd":6,"uuid":"1e2d18e4-73e6-4a37-826c-35eca4d96935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":38263},{"type":"v1","addr":"172.21.15.31:6825","nonce":38263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":38263},{"type":"v1","addr":"172.21.15.31:6827","nonce":38263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":38263},{"type":"v1","addr":"172.21.15.31:6831","nonce":38263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":38263},{"type":"v1","addr":"172.21.15.31:6829","nonce":38263}]},"public_addr":"172.21.15.31:6825/38263","cluster_addr":"172.21.15.31:6827/38263","heartbeat_back_addr":"172.21.15.31:6831/38263","heartbeat_front_addr":"172.21.15.31:6829/38263","state":["exists","up"]},{"osd":7,"uuid":"e0f369c0-562b-4440-a5aa-12275c29412b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":38265},{"type":"v1","addr":"172.21.15.31:6801","nonce":38265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":38265},{"type":"v1","addr":"172.21.15.31:6803","nonce":38265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":38265},{"type":"v1","addr":"172.21.15.31:6810","nonce":38265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":38265},{"type":"v1","addr":"172.21.15.31:6806","nonce":38265}]},"public_addr":"172.21.15.31:6801/38265","cluster_addr":"172.21.15.31:6803/38265","heartbeat_back_addr":"172.21.15.31:6810/38265","heartbeat_front_addr":"172.21.15.31:6806/38265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.411815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.372565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.209700+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.414619+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.316843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.300348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.359800+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.219854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T23:27:50.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.216+0000 7fd9ebc9d640 1 -- 172.21.15.12:0/2046184707 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd9c8065e90 msgr2=0x7fd9c8068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.216+0000 7fd9ebc9d640 1 --2- 172.21.15.12:0/2046184707 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd9c8065e90 0x7fd9c8068350 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8001590 tx=0x7fd9d80014e0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.216+0000 7fd9ebc9d640 1 -- 172.21.15.12:0/2046184707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9e41e8590 msgr2=0x7fd9e4143780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.216+0000 7fd9ebc9d640 1 --2- 172.21.15.12:0/2046184707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9e41e8590 0x7fd9e4143780 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc097db0 tx=0x7fd9d0005800 comp rx=0 tx=0).stop 2023-10-16T23:27:50.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.216+0000 7fd9ebc9d640 1 -- 172.21.15.12:0/2046184707 shutdown_connections 2023-10-16T23:27:50.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.216+0000 7fd9ebc9d640 1 --2- 172.21.15.12:0/2046184707 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd9c8065e90 0x7fd9c8068350 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.216+0000 7fd9ebc9d640 1 --2- 172.21.15.12:0/2046184707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9e41e8590 0x7fd9e4143780 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.216+0000 7fd9ebc9d640 1 --2- 172.21.15.12:0/2046184707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9e40bd4c0 0x7fd9e41e8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.216+0000 7fd9ebc9d640 1 --2- 172.21.15.12:0/2046184707 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e4148170 0x7fd9e41e7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.216+0000 7fd9ebc9d640 1 -- 172.21.15.12:0/2046184707 >> 172.21.15.12:0/2046184707 conn(0x7fd9e40a3f20 msgr2=0x7fd9e414f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:50.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.216+0000 7fd9ebc9d640 1 -- 172.21.15.12:0/2046184707 shutdown_connections 2023-10-16T23:27:50.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.216+0000 7fd9ebc9d640 1 -- 172.21.15.12:0/2046184707 wait complete. 2023-10-16T23:27:50.236 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-16T23:27:50.236 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T23:27:50.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.364+0000 7efc15667640 1 Processor -- start 2023-10-16T23:27:50.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.364+0000 7efc15667640 1 -- start start 2023-10-16T23:27:50.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.364+0000 7efc15667640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc101499a0 0x7efc10070e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.364+0000 7efc15667640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efc100bf780 0x7efc1014f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.364+0000 7efc15667640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc100c14d0 con 0x7efc100713c0 2023-10-16T23:27:50.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.364+0000 7efc15667640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc100a65f0 con 0x7efc100bf780 2023-10-16T23:27:50.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.364+0000 7efc15667640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc100a6860 con 0x7efc101499a0 2023-10-16T23:27:50.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.364+0000 7efc07fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efc100bf780 0x7efc1014f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.364+0000 7efc0f7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efc100713c0 0x7efc1014fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38148/0 (socket says 172.21.15.12:38148) 2023-10-16T23:27:50.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.364+0000 7efc0f7fe640 1 -- 172.21.15.12:0/961899578 learned_addr learned my addr 172.21.15.12:0/961899578 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:50.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.364+0000 7efc0effd640 1 --2- 172.21.15.12:0/961899578 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc101499a0 0x7efc10070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.364+0000 7efc07fff640 1 -- 172.21.15.12:0/961899578 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc101499a0 msgr2=0x7efc10070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:50.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.364+0000 7efc07fff640 1 --2- 172.21.15.12:0/961899578 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc101499a0 0x7efc10070e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.364+0000 7efc07fff640 1 -- 172.21.15.12:0/961899578 >> v1:172.21.15.12:6789/0 conn(0x7efc100713c0 legacy=0x7efc1014fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.364+0000 7efc0e7fc640 1 -- 172.21.15.12:0/961899578 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3816658230 0 0) 0x7efc100c14d0 con 0x7efc100713c0 2023-10-16T23:27:50.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.364+0000 7efc07fff640 1 -- 172.21.15.12:0/961899578 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc100a10f0 con 0x7efc100bf780 2023-10-16T23:27:50.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc07fff640 1 --2- 172.21.15.12:0/961899578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc100bf780 0x7efc1014f510 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efbf80097c0 tx=0x7efbf801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e448288eea4066 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc0e7fc640 1 -- 172.21.15.12:0/961899578 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf80ab600 con 0x7efc100bf780 2023-10-16T23:27:50.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc0e7fc640 1 -- 172.21.15.12:0/961899578 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf80a7050 con 0x7efc100bf780 2023-10-16T23:27:50.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc0e7fc640 1 -- 172.21.15.12:0/961899578 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf80ab980 con 0x7efc100bf780 2023-10-16T23:27:50.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc15667640 1 -- 172.21.15.12:0/961899578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc100bf780 msgr2=0x7efc1014f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc15667640 1 --2- 172.21.15.12:0/961899578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc100bf780 0x7efc1014f510 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efbf80097c0 tx=0x7efbf801c3f0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc15667640 1 -- 172.21.15.12:0/961899578 shutdown_connections 2023-10-16T23:27:50.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc15667640 1 --2- 172.21.15.12:0/961899578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc100bf780 0x7efc1014f510 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc15667640 1 --2- 172.21.15.12:0/961899578 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc101499a0 0x7efc10070e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc15667640 1 -- 172.21.15.12:0/961899578 >> 172.21.15.12:0/961899578 conn(0x7efc100a3f20 msgr2=0x7efc100c1880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:50.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc15667640 1 -- 172.21.15.12:0/961899578 shutdown_connections 2023-10-16T23:27:50.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc15667640 1 -- 172.21.15.12:0/961899578 wait complete. 2023-10-16T23:27:50.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc15667640 1 Processor -- start 2023-10-16T23:27:50.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc15667640 1 -- start start 2023-10-16T23:27:50.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc15667640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc100713c0 0x7efc10144e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc15667640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc100bf780 0x7efc10141040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc15667640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc101499a0 0x7efc10141580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc15667640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc10145360 con 0x7efc101499a0 2023-10-16T23:27:50.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc15667640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1014bca0 con 0x7efc100bf780 2023-10-16T23:27:50.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc15667640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc101426e0 con 0x7efc100713c0 2023-10-16T23:27:50.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc0f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc101499a0 0x7efc10141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc0f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc101499a0 0x7efc10141580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55604/0 (socket says 172.21.15.12:55604) 2023-10-16T23:27:50.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc0f7fe640 1 -- 172.21.15.12:0/43646673 learned_addr learned my addr 172.21.15.12:0/43646673 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:50.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc0effd640 1 --2- 172.21.15.12:0/43646673 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc100713c0 0x7efc10144e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc07fff640 1 --2- 172.21.15.12:0/43646673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc100bf780 0x7efc10141040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc0f7fe640 1 -- 172.21.15.12:0/43646673 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc100713c0 msgr2=0x7efc10144e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc0f7fe640 1 --2- 172.21.15.12:0/43646673 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc100713c0 0x7efc10144e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc0f7fe640 1 -- 172.21.15.12:0/43646673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc100bf780 msgr2=0x7efc10141040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc0f7fe640 1 --2- 172.21.15.12:0/43646673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc100bf780 0x7efc10141040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc0f7fe640 1 -- 172.21.15.12:0/43646673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf8009420 con 0x7efc101499a0 2023-10-16T23:27:50.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc0f7fe640 1 --2- 172.21.15.12:0/43646673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc101499a0 0x7efc10141580 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efc08001570 tx=0x7efc0800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc077fe640 1 -- 172.21.15.12:0/43646673 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0800a640 con 0x7efc101499a0 2023-10-16T23:27:50.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc077fe640 1 -- 172.21.15.12:0/43646673 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0800a7c0 con 0x7efc101499a0 2023-10-16T23:27:50.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc15667640 1 -- 172.21.15.12:0/43646673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc101422c0 con 0x7efc101499a0 2023-10-16T23:27:50.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc077fe640 1 -- 172.21.15.12:0/43646673 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0800ab70 con 0x7efc101499a0 2023-10-16T23:27:50.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.368+0000 7efc15667640 1 -- 172.21.15.12:0/43646673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc10141fd0 con 0x7efc101499a0 2023-10-16T23:27:50.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.372+0000 7efc15667640 1 -- 172.21.15.12:0/43646673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc10141b20 con 0x7efc101499a0 2023-10-16T23:27:50.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.372+0000 7efc077fe640 1 -- 172.21.15.12:0/43646673 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7efc0800acd0 con 0x7efc101499a0 2023-10-16T23:27:50.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.372+0000 7efc077fe640 1 --2- 172.21.15.12:0/43646673 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efbf0065e90 0x7efbf0068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.372+0000 7efc077fe640 1 -- 172.21.15.12:0/43646673 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efc080831b0 con 0x7efc101499a0 2023-10-16T23:27:50.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.372+0000 7efc0effd640 1 --2- 172.21.15.12:0/43646673 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efbf0065e90 0x7efbf0068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.372+0000 7efc0effd640 1 --2- 172.21.15.12:0/43646673 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efbf0065e90 0x7efbf0068350 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efc00009990 tx=0x7efc00008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.376+0000 7efc077fe640 1 -- 172.21.15.12:0/43646673 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7efc08050870 con 0x7efc101499a0 2023-10-16T23:27:50.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.528+0000 7efc15667640 1 -- 172.21.15.12:0/43646673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc10141b20 con 0x7efc101499a0 2023-10-16T23:27:50.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.532+0000 7efc077fe640 1 -- 172.21.15.12:0/43646673 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17763 (secure 0 0 0) 0x7efc10141b20 con 0x7efc101499a0 2023-10-16T23:27:50.535 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:50.535 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"fsid":"0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51","created":"2023-10-16T23:27:16.468087+0000","modified":"2023-10-16T23:27:41.690088+0000","last_up_change":"2023-10-16T23:27:28.136202+0000","last_in_change":"2023-10-16T23:27:18.793212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T23:27:27.354025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-16T23:27:34.786446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-16T23:27:39.130341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-16T23:27:39.674572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73e70f98-6f5e-4464-b34e-931faac41cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":38075},{"type":"v1","addr":"172.21.15.12:6814","nonce":38075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":38075},{"type":"v1","addr":"172.21.15.12:6819","nonce":38075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":38075},{"type":"v1","addr":"172.21.15.12:6827","nonce":38075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":38075},{"type":"v1","addr":"172.21.15.12:6823","nonce":38075}]},"public_addr":"172.21.15.12:6814/38075","cluster_addr":"172.21.15.12:6819/38075","heartbeat_back_addr":"172.21.15.12:6827/38075","heartbeat_front_addr":"172.21.15.12:6823/38075","state":["exists","up"]},{"osd":1,"uuid":"ff722efe-b3f9-4cc0-bbde-f4d4d8055a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":38076},{"type":"v1","addr":"172.21.15.12:6811","nonce":38076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":38076},{"type":"v1","addr":"172.21.15.12:6818","nonce":38076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":38076},{"type":"v1","addr":"172.21.15.12:6831","nonce":38076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":38076},{"type":"v1","addr":"172.21.15.12:6825","nonce":38076}]},"public_addr":"172.21.15.12:6811/38076","cluster_addr":"172.21.15.12:6818/38076","heartbeat_back_addr":"172.21.15.12:6831/38076","heartbeat_front_addr":"172.21.15.12:6825/38076","state":["exists","up"]},{"osd":2,"uuid":"9baf25db-dce0-4065-90d6-f35867286be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6809","nonce":38073},{"type":"v1","addr":"172.21.15.12:6810","nonce":38073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":38073},{"type":"v1","addr":"172.21.15.12:6817","nonce":38073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":38073},{"type":"v1","addr":"172.21.15.12:6830","nonce":38073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":38073},{"type":"v1","addr":"172.21.15.12:6826","nonce":38073}]},"public_addr":"172.21.15.12:6810/38073","cluster_addr":"172.21.15.12:6817/38073","heartbeat_back_addr":"172.21.15.12:6830/38073","heartbeat_front_addr":"172.21.15.12:6826/38073","state":["exists","up"]},{"osd":3,"uuid":"8a620ad3-2294-470d-8a8c-66f177f5fbe7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":38074},{"type":"v1","addr":"172.21.15.12:6801","nonce":38074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":38074},{"type":"v1","addr":"172.21.15.12:6803","nonce":38074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":38074},{"type":"v1","addr":"172.21.15.12:6807","nonce":38074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":38074},{"type":"v1","addr":"172.21.15.12:6805","nonce":38074}]},"public_addr":"172.21.15.12:6801/38074","cluster_addr":"172.21.15.12:6803/38074","heartbeat_back_addr":"172.21.15.12:6807/38074","heartbeat_front_addr":"172.21.15.12:6805/38074","state":["exists","up"]},{"osd":4,"uuid":"a8824d77-7405-40f5-9234-60889802b184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":38266},{"type":"v1","addr":"172.21.15.31:6817","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":38266},{"type":"v1","addr":"172.21.15.31:6819","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":38266},{"type":"v1","addr":"172.21.15.31:6823","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":38266},{"type":"v1","addr":"172.21.15.31:6821","nonce":38266}]},"public_addr":"172.21.15.31:6817/38266","cluster_addr":"172.21.15.31:6819/38266","heartbeat_back_addr":"172.21.15.31:6823/38266","heartbeat_front_addr":"172.21.15.31:6821/38266","state":["exists","up"]},{"osd":5,"uuid":"3bb01192-a47c-48e9-9662-285e3f6f4b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":38264},{"type":"v1","addr":"172.21.15.31:6807","nonce":38264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":38264},{"type":"v1","addr":"172.21.15.31:6811","nonce":38264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":38264},{"type":"v1","addr":"172.21.15.31:6815","nonce":38264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":38264},{"type":"v1","addr":"172.21.15.31:6813","nonce":38264}]},"public_addr":"172.21.15.31:6807/38264","cluster_addr":"172.21.15.31:6811/38264","heartbeat_back_addr":"172.21.15.31:6815/38264","heartbeat_front_addr":"172.21.15.31:6813/38264","state":["exists","up"]},{"osd":6,"uuid":"1e2d18e4-73e6-4a37-826c-35eca4d96935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":38263},{"type":"v1","addr":"172.21.15.31:6825","nonce":38263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":38263},{"type":"v1","addr":"172.21.15.31:6827","nonce":38263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":38263},{"type":"v1","addr":"172.21.15.31:6831","nonce":38263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":38263},{"type":"v1","addr":"172.21.15.31:6829","nonce":38263}]},"public_addr":"172.21.15.31:6825/38263","cluster_addr":"172.21.15.31:6827/38263","heartbeat_back_addr":"172.21.15.31:6831/38263","heartbeat_front_addr":"172.21.15.31:6829/38263","state":["exists","up"]},{"osd":7,"uuid":"e0f369c0-562b-4440-a5aa-12275c29412b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":38265},{"type":"v1","addr":"172.21.15.31:6801","nonce":38265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":38265},{"type":"v1","addr":"172.21.15.31:6803","nonce":38265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":38265},{"type":"v1","addr":"172.21.15.31:6810","nonce":38265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":38265},{"type":"v1","addr":"172.21.15.31:6806","nonce":38265}]},"public_addr":"172.21.15.31:6801/38265","cluster_addr":"172.21.15.31:6803/38265","heartbeat_back_addr":"172.21.15.31:6810/38265","heartbeat_front_addr":"172.21.15.31:6806/38265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.411815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.372565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.209700+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.414619+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.316843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.300348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.359800+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.219854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T23:27:50.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.532+0000 7efc15667640 1 -- 172.21.15.12:0/43646673 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efbf0065e90 msgr2=0x7efbf0068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.532+0000 7efc15667640 1 --2- 172.21.15.12:0/43646673 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efbf0065e90 0x7efbf0068350 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efc00009990 tx=0x7efc00008040 comp rx=0 tx=0).stop 2023-10-16T23:27:50.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.532+0000 7efc15667640 1 -- 172.21.15.12:0/43646673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc101499a0 msgr2=0x7efc10141580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.532+0000 7efc15667640 1 --2- 172.21.15.12:0/43646673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc101499a0 0x7efc10141580 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efc08001570 tx=0x7efc0800cca0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.532+0000 7efc15667640 1 -- 172.21.15.12:0/43646673 shutdown_connections 2023-10-16T23:27:50.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.532+0000 7efc15667640 1 --2- 172.21.15.12:0/43646673 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efbf0065e90 0x7efbf0068350 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.532+0000 7efc15667640 1 --2- 172.21.15.12:0/43646673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc101499a0 0x7efc10141580 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.532+0000 7efc15667640 1 --2- 172.21.15.12:0/43646673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc100bf780 0x7efc10141040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.532+0000 7efc15667640 1 --2- 172.21.15.12:0/43646673 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc100713c0 0x7efc10144e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.532+0000 7efc15667640 1 -- 172.21.15.12:0/43646673 >> 172.21.15.12:0/43646673 conn(0x7efc100a3f20 msgr2=0x7efc1006a480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:50.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.532+0000 7efc15667640 1 -- 172.21.15.12:0/43646673 shutdown_connections 2023-10-16T23:27:50.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.532+0000 7efc15667640 1 -- 172.21.15.12:0/43646673 wait complete. 2023-10-16T23:27:50.552 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-16T23:27:50.553 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-16T23:27:50.553 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-16T23:27:50.554 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-16T23:27:50.554 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-16T23:27:50.555 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-16T23:27:50.555 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-16T23:27:50.556 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-16T23:27:50.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.724+0000 7f47ab0b3640 1 Processor -- start 2023-10-16T23:27:50.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.724+0000 7f47ab0b3640 1 -- start start 2023-10-16T23:27:50.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.724+0000 7f47ab0b3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f47a406fe50 0x7f47a4153880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.724+0000 7f47ab0b3640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f47a4153dc0 0x7f47a415deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.724+0000 7f47ab0b3640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a4157ab0 con 0x7f47a40bd680 2023-10-16T23:27:50.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.724+0000 7f47ab0b3640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a40bcaa0 con 0x7f47a4153dc0 2023-10-16T23:27:50.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.724+0000 7f47ab0b3640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a4071130 con 0x7f47a406fe50 2023-10-16T23:27:50.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.728+0000 7f47a8e4f640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f47a40bd680 0x7f47a4150780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38154/0 (socket says 172.21.15.12:38154) 2023-10-16T23:27:50.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.728+0000 7f47a8e4f640 1 -- 172.21.15.12:0/3683987022 learned_addr learned my addr 172.21.15.12:0/3683987022 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:50.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.728+0000 7f47a9650640 1 --2- 172.21.15.12:0/3683987022 >> v2:172.21.15.12:3300/0 conn(0x7f47a4153dc0 0x7f47a415deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.728+0000 7f47a3fff640 1 --2- 172.21.15.12:0/3683987022 >> v2:172.21.15.31:3300/0 conn(0x7f47a406fe50 0x7f47a4153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.728+0000 7f47a9650640 1 -- 172.21.15.12:0/3683987022 >> v2:172.21.15.31:3300/0 conn(0x7f47a406fe50 msgr2=0x7f47a4153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:50.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.728+0000 7f47a9650640 1 --2- 172.21.15.12:0/3683987022 >> v2:172.21.15.31:3300/0 conn(0x7f47a406fe50 0x7f47a4153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.728+0000 7f47a9650640 1 -- 172.21.15.12:0/3683987022 >> v1:172.21.15.12:6789/0 conn(0x7f47a40bd680 legacy=0x7f47a4150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.728+0000 7f47a37fe640 1 -- 172.21.15.12:0/3683987022 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3669715084 0 0) 0x7f479c0014f0 con 0x7f47a40bd680 2023-10-16T23:27:50.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.728+0000 7f47a9650640 1 -- 172.21.15.12:0/3683987022 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a4070290 con 0x7f47a4153dc0 2023-10-16T23:27:50.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.728+0000 7fe4593c3640 1 Processor -- start 2023-10-16T23:27:50.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.728+0000 7fe4593c3640 1 -- start start 2023-10-16T23:27:50.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.728+0000 7fe4593c3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe45406bf20 0x7fe45406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.728+0000 7fe4593c3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe4540b37e0 0x7fe45414a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.728+0000 7fe4593c3640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe45406f340 con 0x7fe4540ba7d0 2023-10-16T23:27:50.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.728+0000 7fe4593c3640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe454070b80 con 0x7fe4540b37e0 2023-10-16T23:27:50.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.728+0000 7fe4593c3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4540b7550 con 0x7fe45406bf20 2023-10-16T23:27:50.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.728+0000 7fe452ffd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe45406bf20 0x7fe45406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.728+0000 7fe4537fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe4540b37e0 0x7fe45414a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.728+0000 7fe452ffd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe45406bf20 0x7fe45406ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:50944/0 (socket says 172.21.15.12:50944) 2023-10-16T23:27:50.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.728+0000 7fe452ffd640 1 -- 172.21.15.12:0/1192311445 learned_addr learned my addr 172.21.15.12:0/1192311445 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:50.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f47a9650640 1 --2- 172.21.15.12:0/3683987022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47a4153dc0 0x7f47a415deb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f47a4070f60 tx=0x7f479801c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e260946adfb6c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7fe452ffd640 1 -- 172.21.15.12:0/1192311445 >> v2:172.21.15.31:3300/0 conn(0x7fe4540b37e0 msgr2=0x7fe45414a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:50.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7fe452ffd640 1 --2- 172.21.15.12:0/1192311445 >> v2:172.21.15.31:3300/0 conn(0x7fe4540b37e0 0x7fe45414a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f47a37fe640 1 -- 172.21.15.12:0/3683987022 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47980ab600 con 0x7f47a4153dc0 2023-10-16T23:27:50.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f47a37fe640 1 -- 172.21.15.12:0/3683987022 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47980a7050 con 0x7f47a4153dc0 2023-10-16T23:27:50.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f47a37fe640 1 -- 172.21.15.12:0/3683987022 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47980ab980 con 0x7f47a4153dc0 2023-10-16T23:27:50.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f47ab0b3640 1 -- 172.21.15.12:0/3683987022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47a4153dc0 msgr2=0x7f47a415deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f47ab0b3640 1 --2- 172.21.15.12:0/3683987022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47a4153dc0 0x7f47a415deb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f47a4070f60 tx=0x7f479801c310 comp rx=0 tx=0).stop 2023-10-16T23:27:50.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f9f7ffff640 1 Processor -- start 2023-10-16T23:27:50.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f9f7ffff640 1 -- start start 2023-10-16T23:27:50.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f47ab0b3640 1 -- 172.21.15.12:0/3683987022 shutdown_connections 2023-10-16T23:27:50.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f47ab0b3640 1 --2- 172.21.15.12:0/3683987022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47a4153dc0 0x7f47a415deb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f47ab0b3640 1 --2- 172.21.15.12:0/3683987022 >> v2:172.21.15.31:3300/0 conn(0x7f47a406fe50 0x7f47a4153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f9f7ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9f780bd700 0x7f9f7806e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f9f7ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f7814ede0 0x7f9f7814f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f9f7ffff640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f7814f420 con 0x7f9f780b3b20 2023-10-16T23:27:50.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f9f7ffff640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f780bba40 con 0x7f9f780bd700 2023-10-16T23:27:50.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f9f7ffff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f780bdae0 con 0x7f9f7814ede0 2023-10-16T23:27:50.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f47ab0b3640 1 -- 172.21.15.12:0/3683987022 >> 172.21.15.12:0/3683987022 conn(0x7f47a406b400 msgr2=0x7f47a406b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:50.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7fe452ffd640 1 -- 172.21.15.12:0/1192311445 >> v1:172.21.15.31:6789/0 conn(0x7fe4540ba7d0 legacy=0x7fe4540bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7fe452ffd640 1 -- 172.21.15.12:0/1192311445 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4540bcbb0 con 0x7fe45406bf20 2023-10-16T23:27:50.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.728+0000 7feb5d817640 1 Processor -- start 2023-10-16T23:27:50.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.728+0000 7feb5d817640 1 -- start start 2023-10-16T23:27:50.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb5d817640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feb580b39b0 0x7feb5815f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb5d817640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb5806ff00 0x7feb5815f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb5d817640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb580bb200 con 0x7feb580bac50 2023-10-16T23:27:50.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb5d817640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb58089c60 con 0x7feb580b39b0 2023-10-16T23:27:50.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb5d817640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb580bb4e0 con 0x7feb5806ff00 2023-10-16T23:27:50.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb577fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7feb580bac50 0x7feb5815b360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38170/0 (socket says 172.21.15.12:38170) 2023-10-16T23:27:50.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb577fe640 1 -- 172.21.15.12:0/1741112770 learned_addr learned my addr 172.21.15.12:0/1741112770 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:50.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb56ffd640 1 --2- 172.21.15.12:0/1741112770 >> v2:172.21.15.31:3300/0 conn(0x7feb580b39b0 0x7feb5815f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb567fc640 1 --2- 172.21.15.12:0/1741112770 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb5806ff00 0x7feb5815f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb55ffb640 1 -- 172.21.15.12:0/1741112770 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 627440241 0 0) 0x7feb580bb200 con 0x7feb580bac50 2023-10-16T23:27:50.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f9f7dd9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9f780bd700 0x7f9f7806e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f9f7dd9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9f780bd700 0x7f9f7806e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55614/0 (socket says 172.21.15.12:55614) 2023-10-16T23:27:50.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f9f7dd9b640 1 -- 172.21.15.12:0/631313504 learned_addr learned my addr 172.21.15.12:0/631313504 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:50.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb55ffb640 1 -- 172.21.15.12:0/1741112770 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb40003510 con 0x7feb580bac50 2023-10-16T23:27:50.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7fe194632640 1 Processor -- start 2023-10-16T23:27:50.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f9f7e59c640 1 --2- 172.21.15.12:0/631313504 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f7814ede0 0x7f9f7814f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb55ffb640 1 -- 172.21.15.12:0/1741112770 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3225623699 0 0) 0x7feb40003510 con 0x7feb580bac50 2023-10-16T23:27:50.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb55ffb640 1 -- 172.21.15.12:0/1741112770 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb5806ff00 msgr2=0x7feb5815f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:50.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb55ffb640 1 --2- 172.21.15.12:0/1741112770 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb5806ff00 0x7feb5815f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb55ffb640 1 -- 172.21.15.12:0/1741112770 >> v2:172.21.15.31:3300/0 conn(0x7feb580b39b0 msgr2=0x7feb5815f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:50.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb55ffb640 1 --2- 172.21.15.12:0/1741112770 >> v2:172.21.15.31:3300/0 conn(0x7feb580b39b0 0x7feb5815f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb55ffb640 1 -- 172.21.15.12:0/1741112770 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb580bb7c0 con 0x7feb580bac50 2023-10-16T23:27:50.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb55ffb640 1 -- 172.21.15.12:0/1741112770 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7feb4c001680 con 0x7feb580bac50 2023-10-16T23:27:50.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb56ffd640 1 --2- 172.21.15.12:0/1741112770 >> v2:172.21.15.31:3300/0 conn(0x7feb580b39b0 0x7feb5815f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:27:50.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb55ffb640 1 -- 172.21.15.12:0/1741112770 >> v1:172.21.15.12:6789/0 conn(0x7feb580bac50 legacy=0x7feb5815b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb55ffb640 1 --2- 172.21.15.12:0/1741112770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb40003b30 0x7feb40003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb55ffb640 1 --2- 172.21.15.12:0/1741112770 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb5806ff00 0x7feb40011180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb55ffb640 1 --2- 172.21.15.12:0/1741112770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb400116c0 0x7feb40013ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb55ffb640 1 -- 172.21.15.12:0/1741112770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb58089c60 con 0x7feb400116c0 2023-10-16T23:27:50.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb55ffb640 1 -- 172.21.15.12:0/1741112770 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb580bb4e0 con 0x7feb40003b30 2023-10-16T23:27:50.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb55ffb640 1 -- 172.21.15.12:0/1741112770 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb400142a0 con 0x7feb5806ff00 2023-10-16T23:27:50.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb577fe640 1 --2- 172.21.15.12:0/1741112770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb400116c0 0x7feb40013ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb56ffd640 1 --2- 172.21.15.12:0/1741112770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb40003b30 0x7feb40003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb567fc640 1 --2- 172.21.15.12:0/1741112770 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb5806ff00 0x7feb40011180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb577fe640 1 -- 172.21.15.12:0/1741112770 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb5806ff00 msgr2=0x7feb40011180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:50.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb577fe640 1 --2- 172.21.15.12:0/1741112770 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb5806ff00 0x7feb40011180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb577fe640 1 -- 172.21.15.12:0/1741112770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb40003b30 msgr2=0x7feb40003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:50.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb577fe640 1 --2- 172.21.15.12:0/1741112770 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb40003b30 0x7feb40003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7feb577fe640 1 -- 172.21.15.12:0/1741112770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb40003510 con 0x7feb400116c0 2023-10-16T23:27:50.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f47ab0b3640 1 -- 172.21.15.12:0/3683987022 shutdown_connections 2023-10-16T23:27:50.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f47ab0b3640 1 -- 172.21.15.12:0/3683987022 wait complete. 2023-10-16T23:27:50.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7fe194632640 1 -- start start 2023-10-16T23:27:50.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f9f7dd9b640 1 -- 172.21.15.12:0/631313504 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f7814ede0 msgr2=0x7f9f7814f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:50.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f9f7dd9b640 1 --2- 172.21.15.12:0/631313504 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f7814ede0 0x7f9f7814f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f9f7dd9b640 1 -- 172.21.15.12:0/631313504 >> v1:172.21.15.31:6789/0 conn(0x7f9f780b3b20 legacy=0x7f9f7814e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:50.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.732+0000 7f9f7dd9b640 1 -- 172.21.15.12:0/631313504 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f780bdc50 con 0x7f9f780bd700 2023-10-16T23:27:50.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f054ffff640 1 Processor -- start 2023-10-16T23:27:50.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f054ffff640 1 -- start start 2023-10-16T23:27:50.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe194632640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe18c0ba7d0 0x7fe18c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe194632640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe18c14a690 0x7fe18c14aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe194632640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe18c06f340 con 0x7fe18c0bd850 2023-10-16T23:27:50.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe194632640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe18c070b80 con 0x7fe18c14a690 2023-10-16T23:27:50.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe194632640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c0b7550 con 0x7fe18c0ba7d0 2023-10-16T23:27:50.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe192bcf640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe18c14a690 0x7fe18c14aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe191bcd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe18c0ba7d0 0x7fe18c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe191bcd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe18c0ba7d0 0x7fe18c06ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:50990/0 (socket says 172.21.15.12:50990) 2023-10-16T23:27:50.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe191bcd640 1 -- 172.21.15.12:0/2873246834 learned_addr learned my addr 172.21.15.12:0/2873246834 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:50.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f47ab0b3640 1 Processor -- start 2023-10-16T23:27:50.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe452ffd640 1 --2- 172.21.15.12:0/1192311445 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe45406bf20 0x7fe45406ee00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009ea0 tx=0x7fe44c01c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5856277f1f1f0a91 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe451ffb640 1 -- 172.21.15.12:0/1192311445 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c0a5700 con 0x7fe45406bf20 2023-10-16T23:27:50.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe451ffb640 1 -- 172.21.15.12:0/1192311445 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44c0a5860 con 0x7fe45406bf20 2023-10-16T23:27:50.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe451ffb640 1 -- 172.21.15.12:0/1192311445 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c0a5bf0 con 0x7fe45406bf20 2023-10-16T23:27:50.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f054ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f05500b3b80 0x7f055014ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f054ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0550143430 0x7f05501438a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f054ffff640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05500bcc60 con 0x7f0550070990 2023-10-16T23:27:50.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f054ffff640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055014d260 con 0x7f05500b3b80 2023-10-16T23:27:50.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f054ffff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05500bc6a0 con 0x7f0550143430 2023-10-16T23:27:50.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe1913cc640 1 -- 172.21.15.12:0/2873246834 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2376577169 0 0) 0x7fe18c06f340 con 0x7fe18c0bd850 2023-10-16T23:27:50.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe1913cc640 1 -- 172.21.15.12:0/2873246834 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe178003530 con 0x7fe18c0bd850 2023-10-16T23:27:50.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe192bcf640 1 -- 172.21.15.12:0/2873246834 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe18c0ba7d0 msgr2=0x7fe18c06ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:50.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe192bcf640 1 --2- 172.21.15.12:0/2873246834 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe18c0ba7d0 0x7fe18c06ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe192bcf640 1 -- 172.21.15.12:0/2873246834 >> v1:172.21.15.31:6789/0 conn(0x7fe18c0bd850 legacy=0x7fe18c0b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f054f7fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0550143430 0x7f05501438a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe4593c3640 1 -- 172.21.15.12:0/1192311445 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe45406bf20 msgr2=0x7fe45406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe4593c3640 1 --2- 172.21.15.12:0/1192311445 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe45406bf20 0x7fe45406ee00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009ea0 tx=0x7fe44c01c8e0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f054f7fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0550143430 0x7f05501438a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:51004/0 (socket says 172.21.15.12:51004) 2023-10-16T23:27:50.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f054f7fe640 1 -- 172.21.15.12:0/526861968 learned_addr learned my addr 172.21.15.12:0/526861968 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:50.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f47ab0b3640 1 -- start start 2023-10-16T23:27:50.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f47ab0b3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47a406fe50 0x7f47a4141cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f47ab0b3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47a40bd680 0x7f47a40aa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f47ab0b3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47a4153dc0 0x7f47a40aabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f47ab0b3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a40b6bc0 con 0x7f47a406fe50 2023-10-16T23:27:50.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f47ab0b3640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a40b68b0 con 0x7f47a40bd680 2023-10-16T23:27:50.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f47ab0b3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a413a590 con 0x7f47a4153dc0 2023-10-16T23:27:50.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe4593c3640 1 -- 172.21.15.12:0/1192311445 shutdown_connections 2023-10-16T23:27:50.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe4593c3640 1 --2- 172.21.15.12:0/1192311445 >> v2:172.21.15.31:3300/0 conn(0x7fe4540b37e0 0x7fe45414a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe4593c3640 1 --2- 172.21.15.12:0/1192311445 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe45406bf20 0x7fe45406ee00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe4593c3640 1 -- 172.21.15.12:0/1192311445 >> 172.21.15.12:0/1192311445 conn(0x7fe45406b400 msgr2=0x7fe45406b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:50.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe4593c3640 1 -- 172.21.15.12:0/1192311445 shutdown_connections 2023-10-16T23:27:50.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe4593c3640 1 -- 172.21.15.12:0/1192311445 wait complete. 2023-10-16T23:27:50.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f47a3fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47a40bd680 0x7f47a40aa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f47a9650640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47a4153dc0 0x7f47a40aabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f47a3fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47a40bd680 0x7f47a40aa670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:36328/0 (socket says 172.21.15.12:36328) 2023-10-16T23:27:50.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f47a3fff640 1 -- 172.21.15.12:0/3025745241 learned_addr learned my addr 172.21.15.12:0/3025745241 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:50.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f47a8e4f640 1 --2- 172.21.15.12:0/3025745241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47a406fe50 0x7f47a4141cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f9f7dd9b640 1 --2- 172.21.15.12:0/631313504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f780bd700 0x7f9f7806e490 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9f74006fd0 tx=0x7f9f7401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee728c218ad5f04 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7feb577fe640 1 --2- 172.21.15.12:0/1741112770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb400116c0 0x7feb40013ab0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00c160 tx=0x7feb4c01cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc098ee93eee035 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f47a8e4f640 1 -- 172.21.15.12:0/3025745241 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47a4153dc0 msgr2=0x7f47a40aabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f47a8e4f640 1 --2- 172.21.15.12:0/3025745241 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47a4153dc0 0x7f47a40aabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f47a8e4f640 1 -- 172.21.15.12:0/3025745241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47a40bd680 msgr2=0x7f47a40aa670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f47a8e4f640 1 --2- 172.21.15.12:0/3025745241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47a40bd680 0x7f47a40aa670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f47a8e4f640 1 -- 172.21.15.12:0/3025745241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4798009420 con 0x7f47a406fe50 2023-10-16T23:27:50.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7feb55ffb640 1 -- 172.21.15.12:0/1741112770 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c0058e0 con 0x7feb400116c0 2023-10-16T23:27:50.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7feb55ffb640 1 -- 172.21.15.12:0/1741112770 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4c005a40 con 0x7feb400116c0 2023-10-16T23:27:50.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7feb55ffb640 1 -- 172.21.15.12:0/1741112770 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c005df0 con 0x7feb400116c0 2023-10-16T23:27:50.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f47a8e4f640 1 --2- 172.21.15.12:0/3025745241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47a406fe50 0x7f47a4141cb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f479c00c750 tx=0x7f479c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe4593c3640 1 Processor -- start 2023-10-16T23:27:50.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe4593c3640 1 -- start start 2023-10-16T23:27:50.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f47a17fa640 1 -- 172.21.15.12:0/3025745241 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c00ce60 con 0x7f47a406fe50 2023-10-16T23:27:50.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f47a17fa640 1 -- 172.21.15.12:0/3025745241 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479c00a640 con 0x7f47a406fe50 2023-10-16T23:27:50.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f47ab0b3640 1 -- 172.21.15.12:0/3025745241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a41421f0 con 0x7f47a406fe50 2023-10-16T23:27:50.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f47a17fa640 1 -- 172.21.15.12:0/3025745241 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c00a9b0 con 0x7f47a406fe50 2023-10-16T23:27:50.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f47ab0b3640 1 -- 172.21.15.12:0/3025745241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a40ab0f0 con 0x7f47a406fe50 2023-10-16T23:27:50.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7fe192bcf640 1 -- 172.21.15.12:0/2873246834 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18c0bcbb0 con 0x7fe18c14a690 2023-10-16T23:27:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f7870c1e640 1 Processor -- start 2023-10-16T23:27:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f054f7fe640 1 -- 172.21.15.12:0/526861968 >> v2:172.21.15.12:3300/0 conn(0x7f05500b3b80 msgr2=0x7f055014ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f054f7fe640 1 --2- 172.21.15.12:0/526861968 >> v2:172.21.15.12:3300/0 conn(0x7f05500b3b80 0x7f055014ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f054f7fe640 1 -- 172.21.15.12:0/526861968 >> v1:172.21.15.12:6789/0 conn(0x7f0550070990 legacy=0x7f055014d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:50.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.736+0000 7f054f7fe640 1 -- 172.21.15.12:0/526861968 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05500bc980 con 0x7f0550143430 2023-10-16T23:27:50.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f7870c1e640 1 -- start start 2023-10-16T23:27:50.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe4593c3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe45406bf20 0x7fe4541e7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe4593c3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4540b37e0 0x7fe4540b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe4593c3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4540ba7d0 0x7fe4541e49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe4593c3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45413fca0 con 0x7fe4540ba7d0 2023-10-16T23:27:50.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe4593c3640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45413f770 con 0x7fe4540b37e0 2023-10-16T23:27:50.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe4593c3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4541e80c0 con 0x7fe45406bf20 2023-10-16T23:27:50.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe452ffd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe45406bf20 0x7fe4541e7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7feb5d817640 1 -- 172.21.15.12:0/1741112770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb400116c0 msgr2=0x7feb40013ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7feb5d817640 1 --2- 172.21.15.12:0/1741112770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb400116c0 0x7feb40013ab0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00c160 tx=0x7feb4c01cb80 comp rx=0 tx=0).stop 2023-10-16T23:27:50.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7feb577fe640 1 -- 172.21.15.12:0/1741112770 reap_dead start 2023-10-16T23:27:50.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7feb5d817640 1 -- 172.21.15.12:0/1741112770 shutdown_connections 2023-10-16T23:27:50.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7feb5d817640 1 -- 172.21.15.12:0/1741112770 >> 172.21.15.12:0/1741112770 conn(0x7feb5806b400 msgr2=0x7feb5806b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:50.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe452ffd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe45406bf20 0x7fe4541e7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:51030/0 (socket says 172.21.15.12:51030) 2023-10-16T23:27:50.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe452ffd640 1 -- 172.21.15.12:0/2147478102 learned_addr learned my addr 172.21.15.12:0/2147478102 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:50.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe192bcf640 1 --2- 172.21.15.12:0/2873246834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe18c14a690 0x7fe18c14aae0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe18400c2e0 tx=0x7fe18401de30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16d40a649a9cc79e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe4527fc640 1 --2- 172.21.15.12:0/2147478102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4540b37e0 0x7fe4540b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f47ab0b3640 1 -- 172.21.15.12:0/3025745241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f47a406e490 con 0x7f47a406fe50 2023-10-16T23:27:50.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f7870c1e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7864007200 0x7f7864029ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f7870c1e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7864026320 0x7f786400b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f7870c1e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7864046d80 con 0x7f786402cbd0 2023-10-16T23:27:50.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f7870c1e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7864046650 con 0x7f7864026320 2023-10-16T23:27:50.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f7870c1e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7864025f50 con 0x7f7864007200 2023-10-16T23:27:50.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe452ffd640 1 -- 172.21.15.12:0/2147478102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4540b37e0 msgr2=0x7fe4540b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe452ffd640 1 --2- 172.21.15.12:0/2147478102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4540b37e0 0x7fe4540b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe452ffd640 1 -- 172.21.15.12:0/2147478102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4540ba7d0 msgr2=0x7fe4541e49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe4537fe640 1 --2- 172.21.15.12:0/2147478102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4540ba7d0 0x7fe4541e49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe452ffd640 1 --2- 172.21.15.12:0/2147478102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4540ba7d0 0x7fe4541e49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f7869d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7864026320 0x7f786400b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f7869d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7864026320 0x7f786400b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55650/0 (socket says 172.21.15.12:55650) 2023-10-16T23:27:50.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f7869d9b640 1 -- 172.21.15.12:0/4203426766 learned_addr learned my addr 172.21.15.12:0/4203426766 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:50.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe452ffd640 1 -- 172.21.15.12:0/2147478102 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44c009b30 con 0x7fe45406bf20 2023-10-16T23:27:50.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe4527fc640 1 --2- 172.21.15.12:0/2147478102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4540b37e0 0x7fe4540b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:27:50.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe4537fe640 1 --2- 172.21.15.12:0/2147478102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4540ba7d0 0x7fe4541e49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:50.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7feb5d817640 1 -- 172.21.15.12:0/1741112770 shutdown_connections 2023-10-16T23:27:50.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7feb5d817640 1 -- 172.21.15.12:0/1741112770 wait complete. 2023-10-16T23:27:50.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f786a59c640 1 --2- 172.21.15.12:0/4203426766 >> v2:172.21.15.31:3300/0 conn(0x7f7864007200 0x7f7864029ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe452ffd640 1 --2- 172.21.15.12:0/2147478102 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe45406bf20 0x7fe4541e7770 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0af040 tx=0x7fe44c019680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f054f7fe640 1 --2- 172.21.15.12:0/526861968 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0550143430 0x7f05501438a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0544009870 tx=0x7f054401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b37c60b9077565c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe1913cc640 1 -- 172.21.15.12:0/2873246834 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1840a6cf0 con 0x7fe18c14a690 2023-10-16T23:27:50.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe1913cc640 1 -- 172.21.15.12:0/2873246834 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1840a6e50 con 0x7fe18c14a690 2023-10-16T23:27:50.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f7869d9b640 1 -- 172.21.15.12:0/4203426766 >> v2:172.21.15.31:3300/0 conn(0x7f7864007200 msgr2=0x7f7864029ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:50.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe1913cc640 1 -- 172.21.15.12:0/2873246834 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18400a2f0 con 0x7fe18c14a690 2023-10-16T23:27:50.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f054dffb640 1 -- 172.21.15.12:0/526861968 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05440ac600 con 0x7f0550143430 2023-10-16T23:27:50.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f9f7cd99640 1 -- 172.21.15.12:0/631313504 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f740ab600 con 0x7f9f780bd700 2023-10-16T23:27:50.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f9f7cd99640 1 -- 172.21.15.12:0/631313504 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f740a7050 con 0x7f9f780bd700 2023-10-16T23:27:50.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f9f7cd99640 1 -- 172.21.15.12:0/631313504 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f740ab980 con 0x7f9f780bd700 2023-10-16T23:27:50.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f054dffb640 1 -- 172.21.15.12:0/526861968 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05440a8050 con 0x7f0550143430 2023-10-16T23:27:50.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f054dffb640 1 -- 172.21.15.12:0/526861968 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05440ac980 con 0x7f0550143430 2023-10-16T23:27:50.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f7869d9b640 1 --2- 172.21.15.12:0/4203426766 >> v2:172.21.15.31:3300/0 conn(0x7f7864007200 0x7f7864029ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f7869d9b640 1 -- 172.21.15.12:0/4203426766 >> v1:172.21.15.12:6789/0 conn(0x7f786402cbd0 legacy=0x7f78640d2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f7869d9b640 1 -- 172.21.15.12:0/4203426766 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7864046860 con 0x7f7864026320 2023-10-16T23:27:50.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f054ffff640 1 -- 172.21.15.12:0/526861968 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0550143430 msgr2=0x7f05501438a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f054ffff640 1 --2- 172.21.15.12:0/526861968 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0550143430 0x7f05501438a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0544009870 tx=0x7f054401c4d0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7feb5d817640 1 Processor -- start 2023-10-16T23:27:50.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe194632640 1 -- 172.21.15.12:0/2873246834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe18c14a690 msgr2=0x7fe18c14aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe194632640 1 --2- 172.21.15.12:0/2873246834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe18c14a690 0x7fe18c14aae0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe18400c2e0 tx=0x7fe18401de30 comp rx=0 tx=0).stop 2023-10-16T23:27:50.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f054ffff640 1 -- 172.21.15.12:0/526861968 shutdown_connections 2023-10-16T23:27:50.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f054ffff640 1 --2- 172.21.15.12:0/526861968 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0550143430 0x7f05501438a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f054ffff640 1 --2- 172.21.15.12:0/526861968 >> v2:172.21.15.12:3300/0 conn(0x7f05500b3b80 0x7f055014ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f054ffff640 1 -- 172.21.15.12:0/526861968 >> 172.21.15.12:0/526861968 conn(0x7f05500c0640 msgr2=0x7f05500c0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:50.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7feb5d817640 1 -- start start 2023-10-16T23:27:50.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f9f7ffff640 1 -- 172.21.15.12:0/631313504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f780bd700 msgr2=0x7f9f7806e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f9f7ffff640 1 --2- 172.21.15.12:0/631313504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f780bd700 0x7f9f7806e490 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9f74006fd0 tx=0x7f9f7401c4e0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f054ffff640 1 -- 172.21.15.12:0/526861968 shutdown_connections 2023-10-16T23:27:50.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f054ffff640 1 -- 172.21.15.12:0/526861968 wait complete. 2023-10-16T23:27:50.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe43b7fe640 1 -- 172.21.15.12:0/2147478102 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c0b8670 con 0x7fe45406bf20 2023-10-16T23:27:50.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe43b7fe640 1 -- 172.21.15.12:0/2147478102 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44c0b8810 con 0x7fe45406bf20 2023-10-16T23:27:50.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe43b7fe640 1 -- 172.21.15.12:0/2147478102 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c0b8bc0 con 0x7fe45406bf20 2023-10-16T23:27:50.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe4593c3640 1 -- 172.21.15.12:0/2147478102 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe45413e1f0 con 0x7fe45406bf20 2023-10-16T23:27:50.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe4593c3640 1 -- 172.21.15.12:0/2147478102 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4541e7cb0 con 0x7fe45406bf20 2023-10-16T23:27:50.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7feb5d817640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb400116c0 0x7feb580b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7feb5d817640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb5815d380 0x7feb58088bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7feb5d817640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb581f3dc0 0x7feb581f4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7feb5d817640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5806ba30 con 0x7feb5815d380 2023-10-16T23:27:50.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7feb5d817640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb580b4110 con 0x7feb581f3dc0 2023-10-16T23:27:50.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7feb5d817640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb58089130 con 0x7feb400116c0 2023-10-16T23:27:50.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7f47a17fa640 1 -- 172.21.15.12:0/3025745241 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f479c00ab10 con 0x7f47a406fe50 2023-10-16T23:27:50.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f47a17fa640 1 --2- 172.21.15.12:0/3025745241 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4790065f30 0x7f47900683f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f47a17fa640 1 -- 172.21.15.12:0/3025745241 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f479c082dd0 con 0x7f47a406fe50 2023-10-16T23:27:50.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f47a17fa640 1 --2- 172.21.15.12:0/3025745241 >> [v2:172.21.15.12:6800/38074,v1:172.21.15.12:6801/38074] conn(0x7f479006e770 0x7f4790070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f47a17fa640 1 -- 172.21.15.12:0/3025745241 --> [v2:172.21.15.12:6800/38074,v1:172.21.15.12:6801/38074] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4790071240 con 0x7f479006e770 2023-10-16T23:27:50.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f47a3fff640 1 --2- 172.21.15.12:0/3025745241 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4790065f30 0x7f47900683f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe194632640 1 -- 172.21.15.12:0/2873246834 shutdown_connections 2023-10-16T23:27:50.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe194632640 1 --2- 172.21.15.12:0/2873246834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe18c14a690 0x7fe18c14aae0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe194632640 1 --2- 172.21.15.12:0/2873246834 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe18c0ba7d0 0x7fe18c06ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.740+0000 7fe194632640 1 -- 172.21.15.12:0/2873246834 >> 172.21.15.12:0/2873246834 conn(0x7fe18c06b400 msgr2=0x7fe18c06b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:50.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7feb577fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb581f3dc0 0x7feb581f4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7feb577fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb581f3dc0 0x7feb581f4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:36360/0 (socket says 172.21.15.12:36360) 2023-10-16T23:27:50.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7feb577fe640 1 -- 172.21.15.12:0/3793699353 learned_addr learned my addr 172.21.15.12:0/3793699353 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:50.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f054ffff640 1 Processor -- start 2023-10-16T23:27:50.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f054ffff640 1 -- start start 2023-10-16T23:27:50.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7fe4593c3640 1 -- 172.21.15.12:0/2147478102 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe434000fd0 con 0x7fe45406bf20 2023-10-16T23:27:50.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f47a9650640 1 --2- 172.21.15.12:0/3025745241 >> [v2:172.21.15.12:6800/38074,v1:172.21.15.12:6801/38074] conn(0x7f479006e770 0x7f4790070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7feb56ffd640 1 --2- 172.21.15.12:0/3793699353 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb400116c0 0x7feb580b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f9f7ffff640 1 -- 172.21.15.12:0/631313504 shutdown_connections 2023-10-16T23:27:50.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f9f7ffff640 1 --2- 172.21.15.12:0/631313504 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f7814ede0 0x7f9f7814f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f9f7ffff640 1 --2- 172.21.15.12:0/631313504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f780bd700 0x7f9f7806e490 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9f74006fd0 tx=0x7f9f7401c4e0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f9f7ffff640 1 -- 172.21.15.12:0/631313504 >> 172.21.15.12:0/631313504 conn(0x7f9f7806b400 msgr2=0x7f9f7806b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:50.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f054ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0550070990 0x7f0550142770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f054ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05500b3b80 0x7f055013a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7fe194632640 1 -- 172.21.15.12:0/2873246834 shutdown_connections 2023-10-16T23:27:50.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f054ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0550143430 0x7f055013ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f054ffff640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055013b050 con 0x7f0550070990 2023-10-16T23:27:50.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f054ffff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05500701d0 con 0x7f0550143430 2023-10-16T23:27:50.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f054ffff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05501eb700 con 0x7f05500b3b80 2023-10-16T23:27:50.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f054effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0550070990 0x7f0550142770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f054effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0550070990 0x7f0550142770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55678/0 (socket says 172.21.15.12:55678) 2023-10-16T23:27:50.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f054effd640 1 -- 172.21.15.12:0/1131500683 learned_addr learned my addr 172.21.15.12:0/1131500683 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:50.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7feb567fc640 1 --2- 172.21.15.12:0/3793699353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb5815d380 0x7feb58088bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7feb56ffd640 1 -- 172.21.15.12:0/3793699353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb581f3dc0 msgr2=0x7feb581f4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7feb56ffd640 1 --2- 172.21.15.12:0/3793699353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb581f3dc0 0x7feb581f4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f054effd640 1 -- 172.21.15.12:0/1131500683 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05500b3b80 msgr2=0x7f055013a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f054effd640 1 --2- 172.21.15.12:0/1131500683 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05500b3b80 0x7f055013a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f054effd640 1 -- 172.21.15.12:0/1131500683 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0550143430 msgr2=0x7f055013ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f054effd640 1 --2- 172.21.15.12:0/1131500683 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0550143430 0x7f055013ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f054effd640 1 -- 172.21.15.12:0/1131500683 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05440094d0 con 0x7f0550070990 2023-10-16T23:27:50.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7feb56ffd640 1 -- 172.21.15.12:0/3793699353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb5815d380 msgr2=0x7feb58088bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7feb56ffd640 1 --2- 172.21.15.12:0/3793699353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb5815d380 0x7feb58088bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7feb56ffd640 1 -- 172.21.15.12:0/3793699353 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb580b4360 con 0x7feb400116c0 2023-10-16T23:27:50.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7feb567fc640 1 --2- 172.21.15.12:0/3793699353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb5815d380 0x7feb58088bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:27:50.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f9f7ffff640 1 -- 172.21.15.12:0/631313504 shutdown_connections 2023-10-16T23:27:50.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f054effd640 1 --2- 172.21.15.12:0/1131500683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0550070990 0x7f0550142770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f054800c7c0 tx=0x7f054800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7feb56ffd640 1 --2- 172.21.15.12:0/3793699353 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb400116c0 0x7feb580b69e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feb50009f00 tx=0x7feb50008630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f9f7ffff640 1 -- 172.21.15.12:0/631313504 wait complete. 2023-10-16T23:27:50.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7fe194632640 1 -- 172.21.15.12:0/2873246834 wait complete. 2023-10-16T23:27:50.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7fe194632640 1 Processor -- start 2023-10-16T23:27:50.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7fe43b7fe640 1 -- 172.21.15.12:0/2147478102 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fe44c006d50 con 0x7fe45406bf20 2023-10-16T23:27:50.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7fe43b7fe640 1 --2- 172.21.15.12:0/2147478102 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe440065f60 0x7fe440068420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7fe43b7fe640 1 -- 172.21.15.12:0/2147478102 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe44c11ed60 con 0x7fe45406bf20 2023-10-16T23:27:50.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7fe43b7fe640 1 --2- 172.21.15.12:0/2147478102 >> [v2:172.21.15.12:6808/38076,v1:172.21.15.12:6811/38076] conn(0x7fe44006e820 0x7fe440070c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7fe43b7fe640 1 -- 172.21.15.12:0/2147478102 --> [v2:172.21.15.12:6808/38076,v1:172.21.15.12:6811/38076] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe4400712f0 con 0x7fe44006e820 2023-10-16T23:27:50.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7fe43b7fe640 1 -- 172.21.15.12:0/2147478102 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe44c11f110 con 0x7fe45406bf20 2023-10-16T23:27:50.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f47a17fa640 1 -- 172.21.15.12:0/3025745241 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f479c050540 con 0x7f47a406fe50 2023-10-16T23:27:50.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7fe4527fc640 1 --2- 172.21.15.12:0/2147478102 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe440065f60 0x7fe440068420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f47a3fff640 1 --2- 172.21.15.12:0/3025745241 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4790065f30 0x7f47900683f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f47a4150500 tx=0x7f4794009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7f47a9650640 1 --2- 172.21.15.12:0/3025745241 >> [v2:172.21.15.12:6800/38074,v1:172.21.15.12:6801/38074] conn(0x7f479006e770 0x7f4790070b90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7feb3ffff640 1 -- 172.21.15.12:0/3793699353 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb50012040 con 0x7feb400116c0 2023-10-16T23:27:50.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7fe194632640 1 -- start start 2023-10-16T23:27:50.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7feb5d817640 1 -- 172.21.15.12:0/3793699353 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb580b4640 con 0x7feb400116c0 2023-10-16T23:27:50.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7feb5d817640 1 -- 172.21.15.12:0/3793699353 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb581f4950 con 0x7feb400116c0 2023-10-16T23:27:50.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.744+0000 7fe194632640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe18c0ba7d0 0x7fe18c0b7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7fe194632640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe18c0bd850 0x7fe18c1ebc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7fe194632640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe18c14a690 0x7fe18c144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7fe194632640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c1ec180 con 0x7fe18c0bd850 2023-10-16T23:27:50.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7fe194632640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c1452f0 con 0x7fe18c0ba7d0 2023-10-16T23:27:50.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7fe194632640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c1ee770 con 0x7fe18c14a690 2023-10-16T23:27:50.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7feb3ffff640 1 -- 172.21.15.12:0/3793699353 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb50003ba0 con 0x7feb400116c0 2023-10-16T23:27:50.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7fe4537fe640 1 --2- 172.21.15.12:0/2147478102 >> [v2:172.21.15.12:6808/38076,v1:172.21.15.12:6811/38076] conn(0x7fe44006e820 0x7fe440070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7fe1923ce640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe18c0ba7d0 0x7fe18c0b7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7fe1923ce640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe18c0ba7d0 0x7fe18c0b7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:36378/0 (socket says 172.21.15.12:36378) 2023-10-16T23:27:50.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7fe1923ce640 1 -- 172.21.15.12:0/1467086279 learned_addr learned my addr 172.21.15.12:0/1467086279 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:50.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7f9f7ffff640 1 Processor -- start 2023-10-16T23:27:50.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7fe191bcd640 1 --2- 172.21.15.12:0/1467086279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe18c0bd850 0x7fe18c1ebc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7fe4537fe640 1 --2- 172.21.15.12:0/2147478102 >> [v2:172.21.15.12:6808/38076,v1:172.21.15.12:6811/38076] conn(0x7fe44006e820 0x7fe440070c40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7fe192bcf640 1 --2- 172.21.15.12:0/1467086279 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe18c14a690 0x7fe18c144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7f05377fe640 1 -- 172.21.15.12:0/1131500683 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054800aa50 con 0x7f0550070990 2023-10-16T23:27:50.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7f05377fe640 1 -- 172.21.15.12:0/1131500683 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054800abb0 con 0x7f0550070990 2023-10-16T23:27:50.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7f054ffff640 1 -- 172.21.15.12:0/1131500683 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055006fe60 con 0x7f0550070990 2023-10-16T23:27:50.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7f05377fe640 1 -- 172.21.15.12:0/1131500683 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0548012420 con 0x7f0550070990 2023-10-16T23:27:50.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7f054ffff640 1 -- 172.21.15.12:0/1131500683 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05501e83c0 con 0x7f0550070990 2023-10-16T23:27:50.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7fe1923ce640 1 -- 172.21.15.12:0/1467086279 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe18c14a690 msgr2=0x7fe18c144db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7fe1923ce640 1 --2- 172.21.15.12:0/1467086279 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe18c14a690 0x7fe18c144db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7fe1923ce640 1 -- 172.21.15.12:0/1467086279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe18c0bd850 msgr2=0x7fe18c1ebc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7fe1923ce640 1 --2- 172.21.15.12:0/1467086279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe18c0bd850 0x7fe18c1ebc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7fe1923ce640 1 -- 172.21.15.12:0/1467086279 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18400c050 con 0x7fe18c0ba7d0 2023-10-16T23:27:50.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7fe1923ce640 1 --2- 172.21.15.12:0/1467086279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe18c0ba7d0 0x7fe18c0b7d50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe18800c4d0 tx=0x7fe18800c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7fe4527fc640 1 --2- 172.21.15.12:0/2147478102 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe440065f60 0x7fe440068420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe444000c10 tx=0x7fe44400b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7fe182ffd640 1 -- 172.21.15.12:0/1467086279 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1880052d0 con 0x7fe18c0ba7d0 2023-10-16T23:27:50.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7fe182ffd640 1 -- 172.21.15.12:0/1467086279 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe188005430 con 0x7fe18c0ba7d0 2023-10-16T23:27:50.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7f47a17fa640 1 -- 172.21.15.12:0/3025745241 <== osd.3 v2:172.21.15.12:6800/38074 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4790071240 con 0x7f479006e770 2023-10-16T23:27:50.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7fe182ffd640 1 -- 172.21.15.12:0/1467086279 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe188012830 con 0x7fe18c0ba7d0 2023-10-16T23:27:50.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7fe194632640 1 -- 172.21.15.12:0/1467086279 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe18c0be890 con 0x7fe18c0ba7d0 2023-10-16T23:27:50.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7fe194632640 1 -- 172.21.15.12:0/1467086279 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe18c0c06b0 con 0x7fe18c0ba7d0 2023-10-16T23:27:50.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7fe194632640 1 -- 172.21.15.12:0/1467086279 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe18c14b020 con 0x7fe18c0ba7d0 2023-10-16T23:27:50.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7f9f7ffff640 1 -- start start 2023-10-16T23:27:50.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7f9f7ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f780b3b20 0x7f9f781efb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7f9f7ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f7814ede0 0x7f9f7814a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7f9f7ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f780b66b0 0x7f9f781ec080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7f9f7ffff640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f781f0040 con 0x7f9f7814ede0 2023-10-16T23:27:50.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7f9f7ffff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7814ad50 con 0x7f9f780b3b20 2023-10-16T23:27:50.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7f9f7ffff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f780c0a30 con 0x7f9f780b66b0 2023-10-16T23:27:50.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7feb3ffff640 1 -- 172.21.15.12:0/3793699353 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb50004020 con 0x7feb400116c0 2023-10-16T23:27:50.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7fe43b7fe640 1 -- 172.21.15.12:0/2147478102 <== osd.1 v2:172.21.15.12:6808/38076 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe4400712f0 con 0x7fe44006e820 2023-10-16T23:27:50.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7f054ffff640 1 -- 172.21.15.12:0/1131500683 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f05500b7f20 con 0x7f0550070990 2023-10-16T23:27:50.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.748+0000 7f05377fe640 1 -- 172.21.15.12:0/1131500683 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f0548012580 con 0x7f0550070990 2023-10-16T23:27:50.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7feb3ffff640 1 -- 172.21.15.12:0/3793699353 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7feb50006d50 con 0x7feb400116c0 2023-10-16T23:27:50.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7f9f7e59c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f780b66b0 0x7f9f781ec080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7f9f7e59c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f780b66b0 0x7f9f781ec080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:51056/0 (socket says 172.21.15.12:51056) 2023-10-16T23:27:50.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7f9f7e59c640 1 -- 172.21.15.12:0/862304824 learned_addr learned my addr 172.21.15.12:0/862304824 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:50.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7f9f7dd9b640 1 --2- 172.21.15.12:0/862304824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f780b3b20 0x7f9f781efb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7f9f7d59a640 1 --2- 172.21.15.12:0/862304824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f7814ede0 0x7f9f7814a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7f05377fe640 1 --2- 172.21.15.12:0/1131500683 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f053c065e90 0x7f053c068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7f05377fe640 1 -- 172.21.15.12:0/1131500683 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0548083d20 con 0x7f0550070990 2023-10-16T23:27:50.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7f05377fe640 1 --2- 172.21.15.12:0/1131500683 >> [v2:172.21.15.12:6812/38075,v1:172.21.15.12:6814/38075] conn(0x7f053c06e650 0x7f053c070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7f05377fe640 1 -- 172.21.15.12:0/1131500683 --> [v2:172.21.15.12:6812/38075,v1:172.21.15.12:6814/38075] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f053c071120 con 0x7f053c06e650 2023-10-16T23:27:50.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7feb5d817640 1 -- 172.21.15.12:0/3793699353 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feb38000fd0 con 0x7feb400116c0 2023-10-16T23:27:50.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7f9f7d59a640 1 -- 172.21.15.12:0/862304824 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f780b66b0 msgr2=0x7f9f781ec080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7f9f7d59a640 1 --2- 172.21.15.12:0/862304824 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f780b66b0 0x7f9f781ec080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7f9f7d59a640 1 -- 172.21.15.12:0/862304824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f780b3b20 msgr2=0x7f9f781efb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7f9f7d59a640 1 --2- 172.21.15.12:0/862304824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f780b3b20 0x7f9f781efb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7f9f7d59a640 1 -- 172.21.15.12:0/862304824 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f74009480 con 0x7f9f7814ede0 2023-10-16T23:27:50.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7feb3ffff640 1 --2- 172.21.15.12:0/3793699353 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7feb44065fb0 0x7feb44068470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7f054e7fc640 1 --2- 172.21.15.12:0/1131500683 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f053c065e90 0x7f053c068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7feb3ffff640 1 -- 172.21.15.12:0/3793699353 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feb50083980 con 0x7feb400116c0 2023-10-16T23:27:50.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7feb567fc640 1 --2- 172.21.15.12:0/3793699353 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7feb44065fb0 0x7feb44068470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7f9f7d59a640 1 --2- 172.21.15.12:0/862304824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f7814ede0 0x7f9f7814a810 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9f6800c390 tx=0x7f9f6800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7f054f7fe640 1 --2- 172.21.15.12:0/1131500683 >> [v2:172.21.15.12:6812/38075,v1:172.21.15.12:6814/38075] conn(0x7f053c06e650 0x7f053c070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7feb3ffff640 1 --2- 172.21.15.12:0/3793699353 >> [v2:172.21.15.12:6809/38073,v1:172.21.15.12:6810/38073] conn(0x7feb4406e680 0x7feb44070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7feb3ffff640 1 -- 172.21.15.12:0/3793699353 --> [v2:172.21.15.12:6809/38073,v1:172.21.15.12:6810/38073] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feb44071150 con 0x7feb4406e680 2023-10-16T23:27:50.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7feb3ffff640 1 -- 172.21.15.12:0/3793699353 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb500510f0 con 0x7feb400116c0 2023-10-16T23:27:50.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7f054f7fe640 1 --2- 172.21.15.12:0/1131500683 >> [v2:172.21.15.12:6812/38075,v1:172.21.15.12:6814/38075] conn(0x7f053c06e650 0x7f053c070a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7f054e7fc640 1 --2- 172.21.15.12:0/1131500683 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f053c065e90 0x7f053c068350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f055014e410 tx=0x7f0540006ca0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7f05377fe640 1 -- 172.21.15.12:0/1131500683 <== osd.0 v2:172.21.15.12:6812/38075 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f053c071120 con 0x7f053c06e650 2023-10-16T23:27:50.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7feb577fe640 1 --2- 172.21.15.12:0/3793699353 >> [v2:172.21.15.12:6809/38073,v1:172.21.15.12:6810/38073] conn(0x7feb4406e680 0x7feb44070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7feb577fe640 1 --2- 172.21.15.12:0/3793699353 >> [v2:172.21.15.12:6809/38073,v1:172.21.15.12:6810/38073] conn(0x7feb4406e680 0x7feb44070aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7feb3ffff640 1 -- 172.21.15.12:0/3793699353 <== osd.2 v2:172.21.15.12:6809/38073 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7feb44071150 con 0x7feb4406e680 2023-10-16T23:27:50.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.756+0000 7feb567fc640 1 --2- 172.21.15.12:0/3793699353 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7feb44065fb0 0x7feb44068470 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feb48005a70 tx=0x7feb480059a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7fe182ffd640 1 -- 172.21.15.12:0/1467086279 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fe188012990 con 0x7fe18c0ba7d0 2023-10-16T23:27:50.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7fe182ffd640 1 --2- 172.21.15.12:0/1467086279 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe170065e90 0x7fe170068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7fe182ffd640 1 -- 172.21.15.12:0/1467086279 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe188083dd0 con 0x7fe18c0ba7d0 2023-10-16T23:27:50.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7fe182ffd640 1 --2- 172.21.15.12:0/1467086279 >> [v2:172.21.15.31:6816/38266,v1:172.21.15.31:6817/38266] conn(0x7fe17006e6d0 0x7fe170070af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7fe182ffd640 1 -- 172.21.15.12:0/1467086279 --> [v2:172.21.15.31:6816/38266,v1:172.21.15.31:6817/38266] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1700711a0 con 0x7fe17006e6d0 2023-10-16T23:27:50.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7fe182ffd640 1 -- 172.21.15.12:0/1467086279 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe188084180 con 0x7fe18c0ba7d0 2023-10-16T23:27:50.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7fe191bcd640 1 --2- 172.21.15.12:0/1467086279 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe170065e90 0x7fe170068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7fe192bcf640 1 --2- 172.21.15.12:0/1467086279 >> [v2:172.21.15.31:6816/38266,v1:172.21.15.31:6817/38266] conn(0x7fe17006e6d0 0x7fe170070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7fe192bcf640 1 --2- 172.21.15.12:0/1467086279 >> [v2:172.21.15.31:6816/38266,v1:172.21.15.31:6817/38266] conn(0x7fe17006e6d0 0x7fe170070af0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7fe191bcd640 1 --2- 172.21.15.12:0/1467086279 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe170065e90 0x7fe170068350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe18c155b10 tx=0x7fe17c009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7f9f6e7fc640 1 -- 172.21.15.12:0/862304824 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f68003600 con 0x7f9f7814ede0 2023-10-16T23:27:50.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7f9f6e7fc640 1 -- 172.21.15.12:0/862304824 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f68003760 con 0x7f9f7814ede0 2023-10-16T23:27:50.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7f9f7ffff640 1 -- 172.21.15.12:0/862304824 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f780c0d10 con 0x7f9f7814ede0 2023-10-16T23:27:50.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7f9f7ffff640 1 -- 172.21.15.12:0/862304824 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f780c06c0 con 0x7f9f7814ede0 2023-10-16T23:27:50.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7f9f6e7fc640 1 -- 172.21.15.12:0/862304824 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f68003b10 con 0x7f9f7814ede0 2023-10-16T23:27:50.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.752+0000 7f9f7ffff640 1 -- 172.21.15.12:0/862304824 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9f7815c320 con 0x7f9f7814ede0 2023-10-16T23:27:50.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.756+0000 7f9f6e7fc640 1 -- 172.21.15.12:0/862304824 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f9f68003c70 con 0x7f9f7814ede0 2023-10-16T23:27:50.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.756+0000 7f9f6e7fc640 1 --2- 172.21.15.12:0/862304824 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9f5c065f30 0x7f9f5c0683f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.756+0000 7f9f6e7fc640 1 -- 172.21.15.12:0/862304824 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9f68082d60 con 0x7f9f7814ede0 2023-10-16T23:27:50.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.756+0000 7f9f6e7fc640 1 --2- 172.21.15.12:0/862304824 >> [v2:172.21.15.31:6824/38263,v1:172.21.15.31:6825/38263] conn(0x7f9f5c06e770 0x7f9f5c070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.756+0000 7f9f6e7fc640 1 -- 172.21.15.12:0/862304824 --> [v2:172.21.15.31:6824/38263,v1:172.21.15.31:6825/38263] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f5c071240 con 0x7f9f5c06e770 2023-10-16T23:27:50.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.756+0000 7f7869d9b640 1 --2- 172.21.15.12:0/4203426766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7864026320 0x7f786400b0e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7864046790 tx=0x7f786001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf9ff2c2ddaa976 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.756+0000 7f786959a640 1 -- 172.21.15.12:0/4203426766 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78600ab610 con 0x7f7864026320 2023-10-16T23:27:50.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.756+0000 7f9f7e59c640 1 --2- 172.21.15.12:0/862304824 >> [v2:172.21.15.31:6824/38263,v1:172.21.15.31:6825/38263] conn(0x7f9f5c06e770 0x7f9f5c070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.756+0000 7fe182ffd640 1 -- 172.21.15.12:0/1467086279 <== osd.4 v2:172.21.15.31:6816/38266 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe1700711a0 con 0x7fe17006e6d0 2023-10-16T23:27:50.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.756+0000 7f9f7dd9b640 1 --2- 172.21.15.12:0/862304824 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9f5c065f30 0x7f9f5c0683f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.756+0000 7f9f6e7fc640 1 -- 172.21.15.12:0/862304824 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f680504d0 con 0x7f9f7814ede0 2023-10-16T23:27:50.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.756+0000 7f786959a640 1 -- 172.21.15.12:0/4203426766 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78600ab770 con 0x7f7864026320 2023-10-16T23:27:50.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.756+0000 7f786959a640 1 -- 172.21.15.12:0/4203426766 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78600abb00 con 0x7f7864026320 2023-10-16T23:27:50.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.756+0000 7f9f7e59c640 1 --2- 172.21.15.12:0/862304824 >> [v2:172.21.15.31:6824/38263,v1:172.21.15.31:6825/38263] conn(0x7f9f5c06e770 0x7f9f5c070b90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.756+0000 7f05377fe640 1 -- 172.21.15.12:0/1131500683 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0548051400 con 0x7f0550070990 2023-10-16T23:27:50.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.756+0000 7f7870c1e640 1 -- 172.21.15.12:0/4203426766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7864026320 msgr2=0x7f786400b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.756+0000 7f7870c1e640 1 --2- 172.21.15.12:0/4203426766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7864026320 0x7f786400b0e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7864046790 tx=0x7f786001c520 comp rx=0 tx=0).stop 2023-10-16T23:27:50.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.756+0000 7f9f7dd9b640 1 --2- 172.21.15.12:0/862304824 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9f5c065f30 0x7f9f5c0683f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9f740ad000 tx=0x7f9f740a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.756+0000 7f7870c1e640 1 -- 172.21.15.12:0/4203426766 shutdown_connections 2023-10-16T23:27:50.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.756+0000 7f7870c1e640 1 --2- 172.21.15.12:0/4203426766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7864026320 0x7f786400b0e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.756+0000 7f7870c1e640 1 --2- 172.21.15.12:0/4203426766 >> v2:172.21.15.31:3300/0 conn(0x7f7864007200 0x7f7864029ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.756+0000 7f7870c1e640 1 -- 172.21.15.12:0/4203426766 >> 172.21.15.12:0/4203426766 conn(0x7f786400a5c0 msgr2=0x7f786400a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:50.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.756+0000 7f7870c1e640 1 -- 172.21.15.12:0/4203426766 shutdown_connections 2023-10-16T23:27:50.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.756+0000 7f7870c1e640 1 -- 172.21.15.12:0/4203426766 wait complete. 2023-10-16T23:27:50.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.760+0000 7f9f6e7fc640 1 -- 172.21.15.12:0/862304824 <== osd.6 v2:172.21.15.31:6824/38263 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9f5c071240 con 0x7f9f5c06e770 2023-10-16T23:27:50.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.760+0000 7f7870c1e640 1 Processor -- start 2023-10-16T23:27:50.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.760+0000 7f7870c1e640 1 -- start start 2023-10-16T23:27:50.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.760+0000 7f7870c1e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7864007200 0x7f7864172ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.760+0000 7f7870c1e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7864026320 0x7f78640cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.760+0000 7f7870c1e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f786402cbd0 0x7f78640cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.760+0000 7f7870c1e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786403fa50 con 0x7f786402cbd0 2023-10-16T23:27:50.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.760+0000 7f7870c1e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78640cc170 con 0x7f7864007200 2023-10-16T23:27:50.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.760+0000 7f7870c1e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7864041230 con 0x7f7864026320 2023-10-16T23:27:50.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.760+0000 7f7869d9b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7864026320 0x7f78640cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.760+0000 7f7869d9b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7864026320 0x7f78640cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:51060/0 (socket says 172.21.15.12:51060) 2023-10-16T23:27:50.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.760+0000 7f7869d9b640 1 -- 172.21.15.12:0/3296383100 learned_addr learned my addr 172.21.15.12:0/3296383100 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:50.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.760+0000 7f786a59c640 1 --2- 172.21.15.12:0/3296383100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7864007200 0x7f7864172ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.760+0000 7f786b59e640 1 --2- 172.21.15.12:0/3296383100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f786402cbd0 0x7f78640cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.760+0000 7f7869d9b640 1 -- 172.21.15.12:0/3296383100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7864007200 msgr2=0x7f7864172ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.760+0000 7f7869d9b640 1 --2- 172.21.15.12:0/3296383100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7864007200 0x7f7864172ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.760+0000 7f7869d9b640 1 -- 172.21.15.12:0/3296383100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f786402cbd0 msgr2=0x7f78640cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.760+0000 7f7869d9b640 1 --2- 172.21.15.12:0/3296383100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f786402cbd0 0x7f78640cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.760+0000 7f7869d9b640 1 -- 172.21.15.12:0/3296383100 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78600094d0 con 0x7f7864026320 2023-10-16T23:27:50.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.760+0000 7f786b59e640 1 --2- 172.21.15.12:0/3296383100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f786402cbd0 0x7f78640cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T23:27:50.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.760+0000 7f7869d9b640 1 --2- 172.21.15.12:0/3296383100 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7864026320 0x7f78640cb6f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f78600ad040 tx=0x7f786001ad60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.760+0000 7f785affd640 1 -- 172.21.15.12:0/3296383100 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78600b4800 con 0x7f7864026320 2023-10-16T23:27:50.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.760+0000 7f785affd640 1 -- 172.21.15.12:0/3296383100 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78600b4960 con 0x7f7864026320 2023-10-16T23:27:50.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.760+0000 7f785affd640 1 -- 172.21.15.12:0/3296383100 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78600b4cf0 con 0x7f7864026320 2023-10-16T23:27:50.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.764+0000 7f7870c1e640 1 -- 172.21.15.12:0/3296383100 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7864040f50 con 0x7f7864026320 2023-10-16T23:27:50.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.764+0000 7f7870c1e640 1 -- 172.21.15.12:0/3296383100 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7864040990 con 0x7f7864026320 2023-10-16T23:27:50.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.768+0000 7f9c60eee640 1 Processor -- start 2023-10-16T23:27:50.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.764+0000 7f785affd640 1 -- 172.21.15.12:0/3296383100 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f78600b3380 con 0x7f7864026320 2023-10-16T23:27:50.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.764+0000 7f785affd640 1 --2- 172.21.15.12:0/3296383100 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f784c065e60 0x7f784c068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.764+0000 7f785affd640 1 -- 172.21.15.12:0/3296383100 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f786011d9d0 con 0x7f7864026320 2023-10-16T23:27:50.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.768+0000 7f786a59c640 1 --2- 172.21.15.12:0/3296383100 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f784c065e60 0x7f784c068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.768+0000 7f786a59c640 1 --2- 172.21.15.12:0/3296383100 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f784c065e60 0x7f784c068320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f785c009b60 tx=0x7f785c009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.768+0000 7f9c60eee640 1 -- start start 2023-10-16T23:27:50.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.768+0000 7f9c60eee640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9c54042600 0x7f9c540d1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.768+0000 7f9c60eee640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c540d6070 con 0x7f9c540d53f0 2023-10-16T23:27:50.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.768+0000 7f9c60eee640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c54026650 con 0x7f9c54025fe0 2023-10-16T23:27:50.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.768+0000 7f9c60eee640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c540d5d90 con 0x7f9c54042600 2023-10-16T23:27:50.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.768+0000 7f9c5a59c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9c540d53f0 0x7f9c5400af10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38190/0 (socket says 172.21.15.12:38190) 2023-10-16T23:27:50.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.768+0000 7f9c59d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9c54042600 0x7f9c540d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.768+0000 7f9c59d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9c54042600 0x7f9c540d1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55702/0 (socket says 172.21.15.12:55702) 2023-10-16T23:27:50.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.768+0000 7f9c59d9b640 1 -- 172.21.15.12:0/1643430351 learned_addr learned my addr 172.21.15.12:0/1643430351 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:50.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.768+0000 7f9c59d9b640 1 -- 172.21.15.12:0/1643430351 >> v1:172.21.15.31:6789/0 conn(0x7f9c54025fe0 legacy=0x7f9c540d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.768+0000 7f9c59d9b640 1 -- 172.21.15.12:0/1643430351 >> v1:172.21.15.12:6789/0 conn(0x7f9c540d53f0 legacy=0x7f9c5400af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:50.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.768+0000 7f9c59d9b640 1 -- 172.21.15.12:0/1643430351 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c540466a0 con 0x7f9c54042600 2023-10-16T23:27:50.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7fe4593c3640 1 -- 172.21.15.12:0/2147478102 --> [v2:172.21.15.12:6808/38076,v1:172.21.15.12:6811/38076] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe434002cf0 con 0x7fe44006e820 2023-10-16T23:27:50.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7f7870c1e640 1 --2- 172.21.15.12:0/3296383100 >> [v2:172.21.15.31:6800/38265,v1:172.21.15.31:6801/38265] conn(0x7f78640244b0 0x7f7864024890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7f7870c1e640 1 -- 172.21.15.12:0/3296383100 --> [v2:172.21.15.31:6800/38265,v1:172.21.15.31:6801/38265] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7864005450 con 0x7f78640244b0 2023-10-16T23:27:50.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7f786b59e640 1 --2- 172.21.15.12:0/3296383100 >> [v2:172.21.15.31:6800/38265,v1:172.21.15.31:6801/38265] conn(0x7f78640244b0 0x7f7864024890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7fe43b7fe640 1 -- 172.21.15.12:0/2147478102 <== osd.1 v2:172.21.15.12:6808/38076 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe434002cf0 con 0x7fe44006e820 2023-10-16T23:27:50.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7feb5d817640 1 -- 172.21.15.12:0/3793699353 --> [v2:172.21.15.12:6809/38073,v1:172.21.15.12:6810/38073] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feb38002cf0 con 0x7feb4406e680 2023-10-16T23:27:50.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7f9c59d9b640 1 --2- 172.21.15.12:0/1643430351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c54042600 0x7f9c540d1b10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9c50008870 tx=0x7f9c5001e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d035752c8a6d0a6c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7f786b59e640 1 --2- 172.21.15.12:0/3296383100 >> [v2:172.21.15.31:6800/38265,v1:172.21.15.31:6801/38265] conn(0x7f78640244b0 0x7f7864024890 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7feb3ffff640 1 -- 172.21.15.12:0/3793699353 <== osd.2 v2:172.21.15.12:6809/38073 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7feb38002cf0 con 0x7feb4406e680 2023-10-16T23:27:50.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7fe4593c3640 1 -- 172.21.15.12:0/2147478102 >> [v2:172.21.15.12:6808/38076,v1:172.21.15.12:6811/38076] conn(0x7fe44006e820 msgr2=0x7fe440070c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7fe4593c3640 1 --2- 172.21.15.12:0/2147478102 >> [v2:172.21.15.12:6808/38076,v1:172.21.15.12:6811/38076] conn(0x7fe44006e820 0x7fe440070c40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7f9c5959a640 1 -- 172.21.15.12:0/1643430351 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c500a7a50 con 0x7f9c54042600 2023-10-16T23:27:50.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7f9c5959a640 1 -- 172.21.15.12:0/1643430351 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c500ab070 con 0x7f9c54042600 2023-10-16T23:27:50.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7fe4593c3640 1 -- 172.21.15.12:0/2147478102 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe440065f60 msgr2=0x7fe440068420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7fe4593c3640 1 --2- 172.21.15.12:0/2147478102 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe440065f60 0x7fe440068420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe444000c10 tx=0x7fe44400b040 comp rx=0 tx=0).stop 2023-10-16T23:27:50.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7fe4593c3640 1 -- 172.21.15.12:0/2147478102 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe45406bf20 msgr2=0x7fe4541e7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7fe4593c3640 1 --2- 172.21.15.12:0/2147478102 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe45406bf20 0x7fe4541e7770 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0af040 tx=0x7fe44c019680 comp rx=0 tx=0).stop 2023-10-16T23:27:50.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7fe4537fe640 1 -- 172.21.15.12:0/2147478102 reap_dead start 2023-10-16T23:27:50.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7f9c5959a640 1 -- 172.21.15.12:0/1643430351 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c500a7dd0 con 0x7f9c54042600 2023-10-16T23:27:50.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7fe4593c3640 1 -- 172.21.15.12:0/2147478102 shutdown_connections 2023-10-16T23:27:50.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7fe4593c3640 1 -- 172.21.15.12:0/2147478102 >> 172.21.15.12:0/2147478102 conn(0x7fe45406b400 msgr2=0x7fe4540b98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:50.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7feb5d817640 1 -- 172.21.15.12:0/3793699353 >> [v2:172.21.15.12:6809/38073,v1:172.21.15.12:6810/38073] conn(0x7feb4406e680 msgr2=0x7feb44070aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7feb5d817640 1 --2- 172.21.15.12:0/3793699353 >> [v2:172.21.15.12:6809/38073,v1:172.21.15.12:6810/38073] conn(0x7feb4406e680 0x7feb44070aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7fe4593c3640 1 -- 172.21.15.12:0/2147478102 shutdown_connections 2023-10-16T23:27:50.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7fe4593c3640 1 -- 172.21.15.12:0/2147478102 wait complete. 2023-10-16T23:27:50.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7feb5d817640 1 -- 172.21.15.12:0/3793699353 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7feb44065fb0 msgr2=0x7feb44068470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7feb5d817640 1 --2- 172.21.15.12:0/3793699353 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7feb44065fb0 0x7feb44068470 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feb48005a70 tx=0x7feb480059a0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7feb5d817640 1 -- 172.21.15.12:0/3793699353 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb400116c0 msgr2=0x7feb580b69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7feb5d817640 1 --2- 172.21.15.12:0/3793699353 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feb400116c0 0x7feb580b69e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feb50009f00 tx=0x7feb50008630 comp rx=0 tx=0).stop 2023-10-16T23:27:50.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7feb577fe640 1 -- 172.21.15.12:0/3793699353 reap_dead start 2023-10-16T23:27:50.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7f9c60eee640 1 -- 172.21.15.12:0/1643430351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c54042600 msgr2=0x7f9c540d1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7f9c60eee640 1 --2- 172.21.15.12:0/1643430351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c54042600 0x7f9c540d1b10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9c50008870 tx=0x7f9c5001e960 comp rx=0 tx=0).stop 2023-10-16T23:27:50.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7f9c60eee640 1 -- 172.21.15.12:0/1643430351 shutdown_connections 2023-10-16T23:27:50.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7f9c60eee640 1 --2- 172.21.15.12:0/1643430351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c54042600 0x7f9c540d1b10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7f9c60eee640 1 -- 172.21.15.12:0/1643430351 >> 172.21.15.12:0/1643430351 conn(0x7f9c5400a3f0 msgr2=0x7f9c5400a800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:50.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7f9c60eee640 1 -- 172.21.15.12:0/1643430351 shutdown_connections 2023-10-16T23:27:50.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7f9c60eee640 1 -- 172.21.15.12:0/1643430351 wait complete. 2023-10-16T23:27:50.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.772+0000 7f785affd640 1 -- 172.21.15.12:0/3296383100 <== osd.7 v2:172.21.15.31:6800/38265 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7864005450 con 0x7f78640244b0 2023-10-16T23:27:50.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.776+0000 7f9c60eee640 1 Processor -- start 2023-10-16T23:27:50.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.776+0000 7f9c60eee640 1 -- start start 2023-10-16T23:27:50.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.776+0000 7f9c60eee640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c54025fe0 0x7f9c54024e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.776+0000 7f9c60eee640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c54042600 0x7f9c540d0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.776+0000 7f9c60eee640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c540d53f0 0x7f9c5403d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.776+0000 7f9c60eee640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5403e030 con 0x7f9c540d53f0 2023-10-16T23:27:50.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.776+0000 7f9c60eee640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5403fde0 con 0x7f9c54025fe0 2023-10-16T23:27:50.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.776+0000 7f9c60eee640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c540400c0 con 0x7f9c54042600 2023-10-16T23:27:50.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.776+0000 7feb5d817640 1 -- 172.21.15.12:0/3793699353 shutdown_connections 2023-10-16T23:27:50.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.776+0000 7feb5d817640 1 -- 172.21.15.12:0/3793699353 >> 172.21.15.12:0/3793699353 conn(0x7feb5806b400 msgr2=0x7feb581e6530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:50.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.776+0000 7f9c5ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c540d53f0 0x7f9c5403d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.776+0000 7f9c59d9b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c54042600 0x7f9c540d0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.776+0000 7f9c59d9b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c54042600 0x7f9c540d0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:51062/0 (socket says 172.21.15.12:51062) 2023-10-16T23:27:50.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.776+0000 7f9c59d9b640 1 -- 172.21.15.12:0/1300592519 learned_addr learned my addr 172.21.15.12:0/1300592519 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:50.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.776+0000 7f9c5a59c640 1 --2- 172.21.15.12:0/1300592519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c54025fe0 0x7f9c54024e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.776+0000 7feb5d817640 1 -- 172.21.15.12:0/3793699353 shutdown_connections 2023-10-16T23:27:50.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.776+0000 7f9c59d9b640 1 -- 172.21.15.12:0/1300592519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c54025fe0 msgr2=0x7f9c54024e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.776+0000 7f9c59d9b640 1 --2- 172.21.15.12:0/1300592519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c54025fe0 0x7f9c54024e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.776+0000 7f9c59d9b640 1 -- 172.21.15.12:0/1300592519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c540d53f0 msgr2=0x7f9c5403d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.776+0000 7f9c59d9b640 1 --2- 172.21.15.12:0/1300592519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c540d53f0 0x7f9c5403d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.776+0000 7f9c59d9b640 1 -- 172.21.15.12:0/1300592519 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c50008550 con 0x7f9c54042600 2023-10-16T23:27:50.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.776+0000 7f9c5ad9d640 1 --2- 172.21.15.12:0/1300592519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c540d53f0 0x7f9c5403d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T23:27:50.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.776+0000 7f9c59d9b640 1 --2- 172.21.15.12:0/1300592519 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c54042600 0x7f9c540d0890 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9c5001b5d0 tx=0x7f9c5001d200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.780+0000 7f9c4affd640 1 -- 172.21.15.12:0/1300592519 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c500a7e50 con 0x7f9c54042600 2023-10-16T23:27:50.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.780+0000 7f9c60eee640 1 -- 172.21.15.12:0/1300592519 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c540ce3c0 con 0x7f9c54042600 2023-10-16T23:27:50.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.780+0000 7f9c60eee640 1 -- 172.21.15.12:0/1300592519 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5403e280 con 0x7f9c54042600 2023-10-16T23:27:50.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.780+0000 7f9c4affd640 1 -- 172.21.15.12:0/1300592519 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5000b0b0 con 0x7f9c54042600 2023-10-16T23:27:50.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.780+0000 7f9c4affd640 1 -- 172.21.15.12:0/1300592519 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5000b480 con 0x7f9c54042600 2023-10-16T23:27:50.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.780+0000 7feb5d817640 1 -- 172.21.15.12:0/3793699353 wait complete. 2023-10-16T23:27:50.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.780+0000 7f9c60eee640 1 -- 172.21.15.12:0/1300592519 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9c40000fd0 con 0x7f9c54042600 2023-10-16T23:27:50.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.780+0000 7f9c4affd640 1 -- 172.21.15.12:0/1300592519 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f9c5000b5e0 con 0x7f9c54042600 2023-10-16T23:27:50.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.780+0000 7f054ffff640 1 -- 172.21.15.12:0/1131500683 --> [v2:172.21.15.12:6812/38075,v1:172.21.15.12:6814/38075] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0550061940 con 0x7f053c06e650 2023-10-16T23:27:50.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.780+0000 7f9c4affd640 1 --2- 172.21.15.12:0/1300592519 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9c3c065e90 0x7f9c3c068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.780+0000 7f9c4affd640 1 -- 172.21.15.12:0/1300592519 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9c5011e890 con 0x7f9c54042600 2023-10-16T23:27:50.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.780+0000 7f9c4affd640 1 --2- 172.21.15.12:0/1300592519 >> [v2:172.21.15.31:6805/38264,v1:172.21.15.31:6807/38264] conn(0x7f9c3c06e6d0 0x7f9c3c070af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:50.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.780+0000 7f9c4affd640 1 -- 172.21.15.12:0/1300592519 --> [v2:172.21.15.31:6805/38264,v1:172.21.15.31:6807/38264] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9c3c0711a0 con 0x7f9c3c06e6d0 2023-10-16T23:27:50.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.780+0000 7f9c4affd640 1 -- 172.21.15.12:0/1300592519 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c5011ec00 con 0x7f9c54042600 2023-10-16T23:27:50.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.780+0000 7f9c5a59c640 1 --2- 172.21.15.12:0/1300592519 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9c3c065e90 0x7f9c3c068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.784+0000 7f05377fe640 1 -- 172.21.15.12:0/1131500683 <== osd.0 v2:172.21.15.12:6812/38075 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0550061940 con 0x7f053c06e650 2023-10-16T23:27:50.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.784+0000 7f9c5ad9d640 1 --2- 172.21.15.12:0/1300592519 >> [v2:172.21.15.31:6805/38264,v1:172.21.15.31:6807/38264] conn(0x7f9c3c06e6d0 0x7f9c3c070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:50.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.784+0000 7f9c5a59c640 1 --2- 172.21.15.12:0/1300592519 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9c3c065e90 0x7f9c3c068350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c073ea0 tx=0x7f9c5c08c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.784+0000 7f9c5ad9d640 1 --2- 172.21.15.12:0/1300592519 >> [v2:172.21.15.31:6805/38264,v1:172.21.15.31:6807/38264] conn(0x7f9c3c06e6d0 0x7f9c3c070af0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:50.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.784+0000 7f47ab0b3640 1 -- 172.21.15.12:0/3025745241 --> [v2:172.21.15.12:6800/38074,v1:172.21.15.12:6801/38074] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f47a40b6d00 con 0x7f479006e770 2023-10-16T23:27:50.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.784+0000 7f47a17fa640 1 -- 172.21.15.12:0/3025745241 <== osd.3 v2:172.21.15.12:6800/38074 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f47a40b6d00 con 0x7f479006e770 2023-10-16T23:27:50.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.784+0000 7f47ab0b3640 1 -- 172.21.15.12:0/3025745241 >> [v2:172.21.15.12:6800/38074,v1:172.21.15.12:6801/38074] conn(0x7f479006e770 msgr2=0x7f4790070b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.784+0000 7f47ab0b3640 1 --2- 172.21.15.12:0/3025745241 >> [v2:172.21.15.12:6800/38074,v1:172.21.15.12:6801/38074] conn(0x7f479006e770 0x7f4790070b90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.784+0000 7f47ab0b3640 1 -- 172.21.15.12:0/3025745241 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4790065f30 msgr2=0x7f47900683f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.784+0000 7f47ab0b3640 1 --2- 172.21.15.12:0/3025745241 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4790065f30 0x7f47900683f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f47a4150500 tx=0x7f4794009190 comp rx=0 tx=0).stop 2023-10-16T23:27:50.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.784+0000 7f47ab0b3640 1 -- 172.21.15.12:0/3025745241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47a406fe50 msgr2=0x7f47a4141cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.784+0000 7f47ab0b3640 1 --2- 172.21.15.12:0/3025745241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47a406fe50 0x7f47a4141cb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f479c00c750 tx=0x7f479c00cc10 comp rx=0 tx=0).stop 2023-10-16T23:27:50.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.784+0000 7f47a9650640 1 -- 172.21.15.12:0/3025745241 reap_dead start 2023-10-16T23:27:50.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.784+0000 7f9c4affd640 1 -- 172.21.15.12:0/1300592519 <== osd.5 v2:172.21.15.31:6805/38264 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9c3c0711a0 con 0x7f9c3c06e6d0 2023-10-16T23:27:50.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.788+0000 7f054ffff640 1 -- 172.21.15.12:0/1131500683 >> [v2:172.21.15.12:6812/38075,v1:172.21.15.12:6814/38075] conn(0x7f053c06e650 msgr2=0x7f053c070a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.788+0000 7f054ffff640 1 --2- 172.21.15.12:0/1131500683 >> [v2:172.21.15.12:6812/38075,v1:172.21.15.12:6814/38075] conn(0x7f053c06e650 0x7f053c070a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.788+0000 7f054ffff640 1 -- 172.21.15.12:0/1131500683 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f053c065e90 msgr2=0x7f053c068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.788+0000 7f054ffff640 1 --2- 172.21.15.12:0/1131500683 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f053c065e90 0x7f053c068350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f055014e410 tx=0x7f0540006ca0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.788+0000 7f054ffff640 1 -- 172.21.15.12:0/1131500683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0550070990 msgr2=0x7f0550142770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.788+0000 7f054ffff640 1 --2- 172.21.15.12:0/1131500683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0550070990 0x7f0550142770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f054800c7c0 tx=0x7f054800cc80 comp rx=0 tx=0).stop 2023-10-16T23:27:50.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.788+0000 7f054f7fe640 1 -- 172.21.15.12:0/1131500683 reap_dead start 2023-10-16T23:27:50.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.788+0000 7f054ffff640 1 -- 172.21.15.12:0/1131500683 shutdown_connections 2023-10-16T23:27:50.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.788+0000 7f054ffff640 1 -- 172.21.15.12:0/1131500683 >> 172.21.15.12:0/1131500683 conn(0x7f05500c0640 msgr2=0x7f05500b82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:50.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.788+0000 7f054ffff640 1 -- 172.21.15.12:0/1131500683 shutdown_connections 2023-10-16T23:27:50.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.788+0000 7f054ffff640 1 -- 172.21.15.12:0/1131500683 wait complete. 2023-10-16T23:27:50.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.788+0000 7f9f7ffff640 1 -- 172.21.15.12:0/862304824 --> [v2:172.21.15.31:6824/38263,v1:172.21.15.31:6825/38263] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9f78061940 con 0x7f9f5c06e770 2023-10-16T23:27:50.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.788+0000 7f9f6e7fc640 1 -- 172.21.15.12:0/862304824 <== osd.6 v2:172.21.15.31:6824/38263 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9f78061940 con 0x7f9f5c06e770 2023-10-16T23:27:50.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.788+0000 7f9f7ffff640 1 -- 172.21.15.12:0/862304824 >> [v2:172.21.15.31:6824/38263,v1:172.21.15.31:6825/38263] conn(0x7f9f5c06e770 msgr2=0x7f9f5c070b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.788+0000 7f9f7ffff640 1 --2- 172.21.15.12:0/862304824 >> [v2:172.21.15.31:6824/38263,v1:172.21.15.31:6825/38263] conn(0x7f9f5c06e770 0x7f9f5c070b90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.788+0000 7f9f7ffff640 1 -- 172.21.15.12:0/862304824 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9f5c065f30 msgr2=0x7f9f5c0683f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.788+0000 7f9f7ffff640 1 --2- 172.21.15.12:0/862304824 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9f5c065f30 0x7f9f5c0683f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9f740ad000 tx=0x7f9f740a6000 comp rx=0 tx=0).stop 2023-10-16T23:27:50.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.788+0000 7f9f7ffff640 1 -- 172.21.15.12:0/862304824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f7814ede0 msgr2=0x7f9f7814a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.788+0000 7f9f7ffff640 1 --2- 172.21.15.12:0/862304824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f7814ede0 0x7f9f7814a810 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9f6800c390 tx=0x7f9f6800c850 comp rx=0 tx=0).stop 2023-10-16T23:27:50.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.788+0000 7f9f7e59c640 1 -- 172.21.15.12:0/862304824 reap_dead start 2023-10-16T23:27:50.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.788+0000 7f9f7ffff640 1 -- 172.21.15.12:0/862304824 shutdown_connections 2023-10-16T23:27:50.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.788+0000 7f9f7ffff640 1 -- 172.21.15.12:0/862304824 >> 172.21.15.12:0/862304824 conn(0x7f9f7806b400 msgr2=0x7f9f78143ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:50.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.788+0000 7f9f7ffff640 1 -- 172.21.15.12:0/862304824 shutdown_connections 2023-10-16T23:27:50.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.788+0000 7f9f7ffff640 1 -- 172.21.15.12:0/862304824 wait complete. 2023-10-16T23:27:50.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.788+0000 7f47ab0b3640 1 -- 172.21.15.12:0/3025745241 shutdown_connections 2023-10-16T23:27:50.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.788+0000 7f47ab0b3640 1 -- 172.21.15.12:0/3025745241 >> 172.21.15.12:0/3025745241 conn(0x7f47a406b400 msgr2=0x7f47a4152520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:50.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.792+0000 7f47ab0b3640 1 -- 172.21.15.12:0/3025745241 shutdown_connections 2023-10-16T23:27:50.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.792+0000 7f47ab0b3640 1 -- 172.21.15.12:0/3025745241 wait complete. 2023-10-16T23:27:50.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.792+0000 7f7870c1e640 1 -- 172.21.15.12:0/3296383100 --> [v2:172.21.15.31:6800/38265,v1:172.21.15.31:6801/38265] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f786400a070 con 0x7f78640244b0 2023-10-16T23:27:50.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.792+0000 7f785affd640 1 -- 172.21.15.12:0/3296383100 <== osd.7 v2:172.21.15.31:6800/38265 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f786400a070 con 0x7f78640244b0 2023-10-16T23:27:50.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.796+0000 7fe194632640 1 -- 172.21.15.12:0/1467086279 --> [v2:172.21.15.31:6816/38266,v1:172.21.15.31:6817/38266] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe18c061940 con 0x7fe17006e6d0 2023-10-16T23:27:50.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.796+0000 7fe182ffd640 1 -- 172.21.15.12:0/1467086279 <== osd.4 v2:172.21.15.31:6816/38266 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe18c061940 con 0x7fe17006e6d0 2023-10-16T23:27:50.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.796+0000 7fe194632640 1 -- 172.21.15.12:0/1467086279 >> [v2:172.21.15.31:6816/38266,v1:172.21.15.31:6817/38266] conn(0x7fe17006e6d0 msgr2=0x7fe170070af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.796+0000 7fe194632640 1 --2- 172.21.15.12:0/1467086279 >> [v2:172.21.15.31:6816/38266,v1:172.21.15.31:6817/38266] conn(0x7fe17006e6d0 0x7fe170070af0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.796+0000 7fe194632640 1 -- 172.21.15.12:0/1467086279 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe170065e90 msgr2=0x7fe170068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.796+0000 7fe194632640 1 --2- 172.21.15.12:0/1467086279 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe170065e90 0x7fe170068350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe18c155b10 tx=0x7fe17c009240 comp rx=0 tx=0).stop 2023-10-16T23:27:50.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.796+0000 7fe194632640 1 -- 172.21.15.12:0/1467086279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe18c0ba7d0 msgr2=0x7fe18c0b7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.796+0000 7fe194632640 1 --2- 172.21.15.12:0/1467086279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe18c0ba7d0 0x7fe18c0b7d50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe18800c4d0 tx=0x7fe18800c990 comp rx=0 tx=0).stop 2023-10-16T23:27:50.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.796+0000 7fe192bcf640 1 -- 172.21.15.12:0/1467086279 reap_dead start 2023-10-16T23:27:50.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.796+0000 7fe194632640 1 -- 172.21.15.12:0/1467086279 shutdown_connections 2023-10-16T23:27:50.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.796+0000 7fe194632640 1 -- 172.21.15.12:0/1467086279 >> 172.21.15.12:0/1467086279 conn(0x7fe18c06b400 msgr2=0x7fe18c145c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:50.908 INFO:teuthology.orchestra.run.smithi012.stdout:64424509447 2023-10-16T23:27:50.908 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-16T23:27:50.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.796+0000 7fe194632640 1 -- 172.21.15.12:0/1467086279 shutdown_connections 2023-10-16T23:27:50.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.796+0000 7fe194632640 1 -- 172.21.15.12:0/1467086279 wait complete. 2023-10-16T23:27:50.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.800+0000 7f7870c1e640 1 -- 172.21.15.12:0/3296383100 >> [v2:172.21.15.31:6800/38265,v1:172.21.15.31:6801/38265] conn(0x7f78640244b0 msgr2=0x7f7864024890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.800+0000 7f7870c1e640 1 --2- 172.21.15.12:0/3296383100 >> [v2:172.21.15.31:6800/38265,v1:172.21.15.31:6801/38265] conn(0x7f78640244b0 0x7f7864024890 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.800+0000 7f7870c1e640 1 -- 172.21.15.12:0/3296383100 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f784c065e60 msgr2=0x7f784c068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.800+0000 7f7870c1e640 1 --2- 172.21.15.12:0/3296383100 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f784c065e60 0x7f784c068320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f785c009b60 tx=0x7f785c009190 comp rx=0 tx=0).stop 2023-10-16T23:27:50.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.800+0000 7f7870c1e640 1 -- 172.21.15.12:0/3296383100 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7864026320 msgr2=0x7f78640cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.800+0000 7f7870c1e640 1 --2- 172.21.15.12:0/3296383100 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7864026320 0x7f78640cb6f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f78600ad040 tx=0x7f786001ad60 comp rx=0 tx=0).stop 2023-10-16T23:27:50.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.800+0000 7f786b59e640 1 -- 172.21.15.12:0/3296383100 reap_dead start 2023-10-16T23:27:50.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.800+0000 7f7870c1e640 1 -- 172.21.15.12:0/3296383100 shutdown_connections 2023-10-16T23:27:50.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.800+0000 7f7870c1e640 1 -- 172.21.15.12:0/3296383100 >> 172.21.15.12:0/3296383100 conn(0x7f786400a5c0 msgr2=0x7f786400a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:50.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.800+0000 7f7870c1e640 1 -- 172.21.15.12:0/3296383100 shutdown_connections 2023-10-16T23:27:50.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.800+0000 7f7870c1e640 1 -- 172.21.15.12:0/3296383100 wait complete. 2023-10-16T23:27:50.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.812+0000 7f9c60eee640 1 -- 172.21.15.12:0/1300592519 --> [v2:172.21.15.31:6805/38264,v1:172.21.15.31:6807/38264] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9c40002cc0 con 0x7f9c3c06e6d0 2023-10-16T23:27:50.913 INFO:teuthology.orchestra.run.smithi012.stdout:64424509449 2023-10-16T23:27:50.914 INFO:teuthology.orchestra.run.smithi012.stdout:60129542152 2023-10-16T23:27:50.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.812+0000 7f9c4affd640 1 -- 172.21.15.12:0/1300592519 <== osd.5 v2:172.21.15.31:6805/38264 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9c40002cc0 con 0x7f9c3c06e6d0 2023-10-16T23:27:50.915 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-16T23:27:50.916 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-16T23:27:50.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.812+0000 7f9c60eee640 1 -- 172.21.15.12:0/1300592519 >> [v2:172.21.15.31:6805/38264,v1:172.21.15.31:6807/38264] conn(0x7f9c3c06e6d0 msgr2=0x7f9c3c070af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.812+0000 7f9c60eee640 1 --2- 172.21.15.12:0/1300592519 >> [v2:172.21.15.31:6805/38264,v1:172.21.15.31:6807/38264] conn(0x7f9c3c06e6d0 0x7f9c3c070af0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:50.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.812+0000 7f9c60eee640 1 -- 172.21.15.12:0/1300592519 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9c3c065e90 msgr2=0x7f9c3c068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.812+0000 7f9c60eee640 1 --2- 172.21.15.12:0/1300592519 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9c3c065e90 0x7f9c3c068350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c073ea0 tx=0x7f9c5c08c040 comp rx=0 tx=0).stop 2023-10-16T23:27:50.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.812+0000 7f9c60eee640 1 -- 172.21.15.12:0/1300592519 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c54042600 msgr2=0x7f9c540d0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:50.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.812+0000 7f9c60eee640 1 --2- 172.21.15.12:0/1300592519 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9c54042600 0x7f9c540d0890 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9c5001b5d0 tx=0x7f9c5001d200 comp rx=0 tx=0).stop 2023-10-16T23:27:50.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.812+0000 7f9c5ad9d640 1 -- 172.21.15.12:0/1300592519 reap_dead start 2023-10-16T23:27:50.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.812+0000 7f9c60eee640 1 -- 172.21.15.12:0/1300592519 shutdown_connections 2023-10-16T23:27:50.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.812+0000 7f9c60eee640 1 -- 172.21.15.12:0/1300592519 >> 172.21.15.12:0/1300592519 conn(0x7f9c5400a3f0 msgr2=0x7f9c54026840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:50.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.812+0000 7f9c60eee640 1 -- 172.21.15.12:0/1300592519 shutdown_connections 2023-10-16T23:27:50.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:50.812+0000 7f9c60eee640 1 -- 172.21.15.12:0/1300592519 wait complete. 2023-10-16T23:27:50.920 INFO:teuthology.orchestra.run.smithi012.stdout:64424509448 2023-10-16T23:27:50.920 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-16T23:27:50.921 INFO:teuthology.orchestra.run.smithi012.stdout:64424509447 2023-10-16T23:27:50.921 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-16T23:27:50.922 INFO:teuthology.orchestra.run.smithi012.stdout:60129542152 2023-10-16T23:27:50.923 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-16T23:27:50.924 INFO:teuthology.orchestra.run.smithi012.stdout:64424509449 2023-10-16T23:27:50.924 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-16T23:27:50.925 INFO:teuthology.orchestra.run.smithi012.stdout:64424509447 2023-10-16T23:27:50.925 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-16T23:27:51.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.124+0000 7f17cb715640 1 Processor -- start 2023-10-16T23:27:51.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.124+0000 7f17cb715640 1 -- start start 2023-10-16T23:27:51.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.124+0000 7f17cb715640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f17c40bd850 0x7f17c406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.124+0000 7f17cb715640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f17c40ba7d0 0x7f17c40b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.124+0000 7f17cb715640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c406f340 con 0x7f17c40b3d20 2023-10-16T23:27:51.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.124+0000 7f17cb715640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c4070b80 con 0x7f17c40ba7d0 2023-10-16T23:27:51.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.124+0000 7f17cb715640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c40b7550 con 0x7f17c40bd850 2023-10-16T23:27:51.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.124+0000 7f17c94b1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f17c40bd850 0x7f17c406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.124+0000 7f17c94b1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f17c40bd850 0x7f17c406ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:51066/0 (socket says 172.21.15.12:51066) 2023-10-16T23:27:51.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.124+0000 7f17c94b1640 1 -- 172.21.15.12:0/2177802162 learned_addr learned my addr 172.21.15.12:0/2177802162 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:51.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.124+0000 7f17c94b1640 1 -- 172.21.15.12:0/2177802162 >> v2:172.21.15.12:3300/0 conn(0x7f17c40ba7d0 msgr2=0x7f17c40b37e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T23:27:51.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.124+0000 7f17c94b1640 1 --2- 172.21.15.12:0/2177802162 >> v2:172.21.15.12:3300/0 conn(0x7f17c40ba7d0 0x7f17c40b37e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.124+0000 7f17c94b1640 1 -- 172.21.15.12:0/2177802162 >> v1:172.21.15.12:6789/0 conn(0x7f17c40b3d20 legacy=0x7f17c414a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.128+0000 7fecdfd2c640 1 Processor -- start 2023-10-16T23:27:51.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.124+0000 7f17c94b1640 1 -- 172.21.15.12:0/2177802162 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c40bcbb0 con 0x7f17c40bd850 2023-10-16T23:27:51.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.128+0000 7f17c94b1640 1 --2- 172.21.15.12:0/2177802162 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f17c40bd850 0x7f17c406ee00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f17bc00d3c0 tx=0x7f17bc01ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4005049912cee77e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:51.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.128+0000 7fecdfd2c640 1 -- start start 2023-10-16T23:27:51.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.128+0000 7f17bbfff640 1 -- 172.21.15.12:0/2177802162 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc0a7ce0 con 0x7f17c40bd850 2023-10-16T23:27:51.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.128+0000 7f17bbfff640 1 -- 172.21.15.12:0/2177802162 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17bc0ab070 con 0x7f17c40bd850 2023-10-16T23:27:51.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.128+0000 7fecdfd2c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fecd80ba7d0 0x7fecd806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.128+0000 7fecdfd2c640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd806f340 con 0x7fecd80b37e0 2023-10-16T23:27:51.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.128+0000 7fecdfd2c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd80bcbb0 con 0x7fecd806bf20 2023-10-16T23:27:51.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.128+0000 7fecdfd2c640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd8070b80 con 0x7fecd80ba7d0 2023-10-16T23:27:51.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.128+0000 7f17bbfff640 1 -- 172.21.15.12:0/2177802162 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc0b1620 con 0x7f17c40bd850 2023-10-16T23:27:51.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f17cb715640 1 -- 172.21.15.12:0/2177802162 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f17c40bd850 msgr2=0x7f17c406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f17cb715640 1 --2- 172.21.15.12:0/2177802162 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f17c40bd850 0x7f17c406ee00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f17bc00d3c0 tx=0x7f17bc01ee30 comp rx=0 tx=0).stop 2023-10-16T23:27:51.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.128+0000 7fecdd2c7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fecd80ba7d0 0x7fecd806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7fecdd2c7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fecd80ba7d0 0x7fecd806ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55714/0 (socket says 172.21.15.12:55714) 2023-10-16T23:27:51.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7fecdd2c7640 1 -- 172.21.15.12:0/508141486 learned_addr learned my addr 172.21.15.12:0/508141486 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:51.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7fecdd2c7640 1 -- 172.21.15.12:0/508141486 >> v1:172.21.15.31:6789/0 conn(0x7fecd806bf20 legacy=0x7fecd80bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7fecdd2c7640 1 -- 172.21.15.12:0/508141486 >> v1:172.21.15.12:6789/0 conn(0x7fecd80b37e0 legacy=0x7fecd814a690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T23:27:51.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7fecdd2c7640 1 -- 172.21.15.12:0/508141486 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd814f1e0 con 0x7fecd80ba7d0 2023-10-16T23:27:51.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f17cb715640 1 -- 172.21.15.12:0/2177802162 shutdown_connections 2023-10-16T23:27:51.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f17cb715640 1 --2- 172.21.15.12:0/2177802162 >> v2:172.21.15.12:3300/0 conn(0x7f17c40ba7d0 0x7f17c40b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f17cb715640 1 --2- 172.21.15.12:0/2177802162 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f17c40bd850 0x7f17c406ee00 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f17bc00d3c0 tx=0x7f17bc01ee30 comp rx=0 tx=0).stop 2023-10-16T23:27:51.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f17cb715640 1 -- 172.21.15.12:0/2177802162 >> 172.21.15.12:0/2177802162 conn(0x7f17c406b400 msgr2=0x7f17c406b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:51.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f5815fac640 1 Processor -- start 2023-10-16T23:27:51.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f17cb715640 1 -- 172.21.15.12:0/2177802162 shutdown_connections 2023-10-16T23:27:51.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f17cb715640 1 -- 172.21.15.12:0/2177802162 wait complete. 2023-10-16T23:27:51.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f1503fff640 1 Processor -- start 2023-10-16T23:27:51.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f1503fff640 1 -- start start 2023-10-16T23:27:51.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7fa60b102640 1 Processor -- start 2023-10-16T23:27:51.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f5815fac640 1 -- start start 2023-10-16T23:27:51.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f5815fac640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f58101571a0 0x7f5810157580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f5815fac640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5810070480 0x7f58100ba1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f5815fac640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f581006fa60 con 0x7f581006e520 2023-10-16T23:27:51.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f5815fac640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5810157da0 con 0x7f5810070480 2023-10-16T23:27:51.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f5815fac640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f581006f6f0 con 0x7f58101571a0 2023-10-16T23:27:51.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f5814faa640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f58101571a0 0x7f5810157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f580ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5810070480 0x7f58100ba1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f580ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5810070480 0x7f58100ba1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55718/0 (socket says 172.21.15.12:55718) 2023-10-16T23:27:51.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f580ffff640 1 -- 172.21.15.12:0/217039297 learned_addr learned my addr 172.21.15.12:0/217039297 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:51.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f17cb715640 1 Processor -- start 2023-10-16T23:27:51.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f1503fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f14fc02c630 0x7f14fc006ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f1503fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f14fc007420 0x7f14fc041c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f1502ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f14fc02c630 0x7f14fc006ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f1503fff640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14fc046680 con 0x7f14fc042710 2023-10-16T23:27:51.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f1503fff640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14fc042d30 con 0x7f14fc02c630 2023-10-16T23:27:51.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f1503fff640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14fc0d2c30 con 0x7f14fc007420 2023-10-16T23:27:51.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7fa60b102640 1 -- start start 2023-10-16T23:27:51.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7fa60b102640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa604156dd0 0x7fa604071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7fa60b102640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa60406f050 0x7fa604153a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7fa60b102640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6041578c0 con 0x7fa60406faf0 2023-10-16T23:27:51.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7fa60b102640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6040b40a0 con 0x7fa604156dd0 2023-10-16T23:27:51.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7fa60b102640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6040bd7e0 con 0x7fa60406f050 2023-10-16T23:27:51.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7fa608e9e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa604156dd0 0x7fa604071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7fa608e9e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa604156dd0 0x7fa604071290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55728/0 (socket says 172.21.15.12:55728) 2023-10-16T23:27:51.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7fa608e9e640 1 -- 172.21.15.12:0/328431380 learned_addr learned my addr 172.21.15.12:0/328431380 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:51.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7fa60969f640 1 --2- 172.21.15.12:0/328431380 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa60406f050 0x7fa604153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f554b841640 1 Processor -- start 2023-10-16T23:27:51.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f15037fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f14fc007420 0x7f14fc041c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f15027fc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f14fc042710 0x7f14fc0414f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:49318/0 (socket says 172.21.15.12:49318) 2023-10-16T23:27:51.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f15027fc640 1 -- 172.21.15.12:0/1533495439 learned_addr learned my addr 172.21.15.12:0/1533495439 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:51.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7fa6037fe640 1 -- 172.21.15.12:0/328431380 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 567193405 0 0) 0x7fa6041578c0 con 0x7fa60406faf0 2023-10-16T23:27:51.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7fa6037fe640 1 -- 172.21.15.12:0/328431380 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5f4003530 con 0x7fa60406faf0 2023-10-16T23:27:51.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7fa60969f640 1 -- 172.21.15.12:0/328431380 >> v2:172.21.15.12:3300/0 conn(0x7fa604156dd0 msgr2=0x7fa604071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:51.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7fa60969f640 1 --2- 172.21.15.12:0/328431380 >> v2:172.21.15.12:3300/0 conn(0x7fa604156dd0 0x7fa604071290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7fa60969f640 1 -- 172.21.15.12:0/328431380 >> v1:172.21.15.31:6789/0 conn(0x7fa60406faf0 legacy=0x7fa6041571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7fa60969f640 1 -- 172.21.15.12:0/328431380 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6040bd540 con 0x7fa60406f050 2023-10-16T23:27:51.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f554b841640 1 -- start start 2023-10-16T23:27:51.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7fecdd2c7640 1 --2- 172.21.15.12:0/508141486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecd80ba7d0 0x7fecd806ee00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fecd4010bb0 tx=0x7fecd4024ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6acd5d1c76043589 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:51.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f17cb715640 1 -- start start 2023-10-16T23:27:51.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f17cb715640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f17c40b3d20 0x7f17c40b9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f17cb715640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17c40ba7d0 0x7f17c40b8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f17cb715640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17c414a940 0x7f17c414a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f17cb715640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c414a6f0 con 0x7f17c40ba7d0 2023-10-16T23:27:51.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f17cb715640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c40b8480 con 0x7f17c414a940 2023-10-16T23:27:51.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f17cb715640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c4148930 con 0x7f17c40b3d20 2023-10-16T23:27:51.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f17c94b1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f17c40b3d20 0x7f17c40b9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f17c94b1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f17c40b3d20 0x7f17c40b9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:51086/0 (socket says 172.21.15.12:51086) 2023-10-16T23:27:51.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f17c94b1640 1 -- 172.21.15.12:0/2208115666 learned_addr learned my addr 172.21.15.12:0/2208115666 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:51.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f17c9cb2640 1 --2- 172.21.15.12:0/2208115666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17c414a940 0x7f17c414a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f17c8cb0640 1 --2- 172.21.15.12:0/2208115666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17c40ba7d0 0x7f17c40b8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f15037fe640 1 -- 172.21.15.12:0/1533495439 >> v2:172.21.15.12:3300/0 conn(0x7f14fc02c630 msgr2=0x7f14fc006ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:51.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f15037fe640 1 --2- 172.21.15.12:0/1533495439 >> v2:172.21.15.12:3300/0 conn(0x7f14fc02c630 0x7f14fc006ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f15037fe640 1 -- 172.21.15.12:0/1533495439 >> v1:172.21.15.31:6789/0 conn(0x7f14fc042710 legacy=0x7f14fc0414f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f15037fe640 1 -- 172.21.15.12:0/1533495439 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14fc0d5fc0 con 0x7f14fc007420 2023-10-16T23:27:51.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f1c6d2c2640 1 Processor -- start 2023-10-16T23:27:51.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f1c6d2c2640 1 -- start start 2023-10-16T23:27:51.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f554b841640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55440c5a80 0x7f554406ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f554b841640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f554406e490 0x7f554406f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f554b841640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5544157640 con 0x7f55440c4ed0 2023-10-16T23:27:51.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f554b841640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55441535a0 con 0x7f554406e490 2023-10-16T23:27:51.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f554b841640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5544157920 con 0x7f55440c5a80 2023-10-16T23:27:51.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f55495dd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55440c5a80 0x7f554406ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f55495dd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55440c5a80 0x7f554406ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:51090/0 (socket says 172.21.15.12:51090) 2023-10-16T23:27:51.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f55495dd640 1 -- 172.21.15.12:0/2367770217 learned_addr learned my addr 172.21.15.12:0/2367770217 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:51.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f17c8cb0640 1 -- 172.21.15.12:0/2208115666 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f17c40b3d20 msgr2=0x7f17c40b9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f17c8cb0640 1 --2- 172.21.15.12:0/2208115666 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f17c40b3d20 0x7f17c40b9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f17c8cb0640 1 -- 172.21.15.12:0/2208115666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17c414a940 msgr2=0x7f17c414a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f17c8cb0640 1 --2- 172.21.15.12:0/2208115666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17c414a940 0x7f17c414a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f17c8cb0640 1 -- 172.21.15.12:0/2208115666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17bc00d050 con 0x7f17c40ba7d0 2023-10-16T23:27:51.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f55495dd640 1 -- 172.21.15.12:0/2367770217 >> v2:172.21.15.12:3300/0 conn(0x7f554406e490 msgr2=0x7f554406f150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T23:27:51.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f55495dd640 1 --2- 172.21.15.12:0/2367770217 >> v2:172.21.15.12:3300/0 conn(0x7f554406e490 0x7f554406f150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f55495dd640 1 -- 172.21.15.12:0/2367770217 >> v1:172.21.15.12:6789/0 conn(0x7f55440c4ed0 legacy=0x7f55441539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:51.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f55495dd640 1 -- 172.21.15.12:0/2367770217 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55440c4a10 con 0x7f55440c5a80 2023-10-16T23:27:51.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f17c8cb0640 1 --2- 172.21.15.12:0/2208115666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17c40ba7d0 0x7f17c40b8760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f17b40072c0 tx=0x7f17b4007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:51.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7fecdcac6640 1 -- 172.21.15.12:0/508141486 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd40adc90 con 0x7fecd80ba7d0 2023-10-16T23:27:51.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7fecdcac6640 1 -- 172.21.15.12:0/508141486 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd40addf0 con 0x7fecd80ba7d0 2023-10-16T23:27:51.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7fecdcac6640 1 -- 172.21.15.12:0/508141486 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd40b5660 con 0x7fecd80ba7d0 2023-10-16T23:27:51.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f1c6d2c2640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c60007140 0x7f1c60025fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f1c6d2c2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1c60046930 0x7f1c600d3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f1c6d2c2640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c60029fc0 con 0x7f1c6002aa60 2023-10-16T23:27:51.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f1c6d2c2640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6002a6b0 con 0x7f1c60046930 2023-10-16T23:27:51.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f1c6d2c2640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6002a210 con 0x7f1c60007140 2023-10-16T23:27:51.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f17b9ffb640 1 -- 172.21.15.12:0/2208115666 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b4005d00 con 0x7f17c40ba7d0 2023-10-16T23:27:51.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f17b9ffb640 1 -- 172.21.15.12:0/2208115666 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b400a050 con 0x7f17c40ba7d0 2023-10-16T23:27:51.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f17b9ffb640 1 -- 172.21.15.12:0/2208115666 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b4005ea0 con 0x7f17c40ba7d0 2023-10-16T23:27:51.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f17cb715640 1 -- 172.21.15.12:0/2208115666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c4148aa0 con 0x7f17c40ba7d0 2023-10-16T23:27:51.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f17cb715640 1 -- 172.21.15.12:0/2208115666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c4140e30 con 0x7f17c40ba7d0 2023-10-16T23:27:51.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f580ffff640 1 -- 172.21.15.12:0/217039297 >> v2:172.21.15.31:3300/0 conn(0x7f58101571a0 msgr2=0x7f5810157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:51.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f580ffff640 1 --2- 172.21.15.12:0/217039297 >> v2:172.21.15.31:3300/0 conn(0x7f58101571a0 0x7f5810157580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f580ffff640 1 -- 172.21.15.12:0/217039297 >> v1:172.21.15.12:6789/0 conn(0x7f581006e520 legacy=0x7f58100bac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:51.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.132+0000 7f580ffff640 1 -- 172.21.15.12:0/217039297 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5810157ac0 con 0x7f5810070480 2023-10-16T23:27:51.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f1c6cac1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1c60046930 0x7f1c600d3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f1c6cac1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1c60046930 0x7f1c600d3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55758/0 (socket says 172.21.15.12:55758) 2023-10-16T23:27:51.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f1c6cac1640 1 -- 172.21.15.12:0/2784229981 learned_addr learned my addr 172.21.15.12:0/2784229981 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f1c67fff640 1 --2- 172.21.15.12:0/2784229981 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c60007140 0x7f1c60025fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f580ffff640 1 --2- 172.21.15.12:0/217039297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5810070480 0x7f58100ba1a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f58100bc7b0 tx=0x7f580001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b369e3e50c41722 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f580f7fe640 1 -- 172.21.15.12:0/217039297 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58000ab600 con 0x7f5810070480 2023-10-16T23:27:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f1c67fff640 1 -- 172.21.15.12:0/2784229981 >> v2:172.21.15.12:3300/0 conn(0x7f1c60046930 msgr2=0x7f1c600d3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f1c67fff640 1 --2- 172.21.15.12:0/2784229981 >> v2:172.21.15.12:3300/0 conn(0x7f1c60046930 0x7f1c600d3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f1c67fff640 1 -- 172.21.15.12:0/2784229981 >> v1:172.21.15.31:6789/0 conn(0x7f1c6002aa60 legacy=0x7f1c600d3840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T23:27:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f1c67fff640 1 -- 172.21.15.12:0/2784229981 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6002cd10 con 0x7f1c60007140 2023-10-16T23:27:51.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f580f7fe640 1 -- 172.21.15.12:0/217039297 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58000a7050 con 0x7f5810070480 2023-10-16T23:27:51.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f580f7fe640 1 -- 172.21.15.12:0/217039297 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58000ab9c0 con 0x7f5810070480 2023-10-16T23:27:51.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f17cb715640 1 -- 172.21.15.12:0/2208115666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c4148c60 con 0x7f17c40ba7d0 2023-10-16T23:27:51.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7f15037fe640 1 --2- 172.21.15.12:0/1533495439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14fc007420 0x7f14fc041c00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1504072890 tx=0x7f1504098120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9a3dd63e3aae61b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:51.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7fecdfd2c640 1 -- 172.21.15.12:0/508141486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecd80ba7d0 msgr2=0x7fecd806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.136+0000 7fecdfd2c640 1 --2- 172.21.15.12:0/508141486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecd80ba7d0 0x7fecd806ee00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fecd4010bb0 tx=0x7fecd4024ec0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f1501ffb640 1 -- 172.21.15.12:0/1533495439 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1504127600 con 0x7f14fc007420 2023-10-16T23:27:51.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f55495dd640 1 --2- 172.21.15.12:0/2367770217 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55440c5a80 0x7f554406ec10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f553c009e80 tx=0x7f553c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b63f036c6cfa4afe server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:51.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f1501ffb640 1 -- 172.21.15.12:0/1533495439 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1504123050 con 0x7f14fc007420 2023-10-16T23:27:51.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f1501ffb640 1 -- 172.21.15.12:0/1533495439 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15041279e0 con 0x7f14fc007420 2023-10-16T23:27:51.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f553bfff640 1 -- 172.21.15.12:0/2367770217 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c0a57e0 con 0x7f55440c5a80 2023-10-16T23:27:51.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7fa60969f640 1 --2- 172.21.15.12:0/328431380 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa60406f050 0x7fa604153a90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc009d90 tx=0x7fa5fc01c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca6eaab4a55b15cf server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:51.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7fa6037fe640 1 -- 172.21.15.12:0/328431380 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc0a5890 con 0x7fa60406f050 2023-10-16T23:27:51.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7fa6037fe640 1 -- 172.21.15.12:0/328431380 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5fc0a59f0 con 0x7fa60406f050 2023-10-16T23:27:51.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7fa6037fe640 1 -- 172.21.15.12:0/328431380 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc0a5d60 con 0x7fa60406f050 2023-10-16T23:27:51.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f5815fac640 1 -- 172.21.15.12:0/217039297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5810070480 msgr2=0x7f58100ba1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f5815fac640 1 --2- 172.21.15.12:0/217039297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5810070480 0x7f58100ba1a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f58100bc7b0 tx=0x7f580001c450 comp rx=0 tx=0).stop 2023-10-16T23:27:51.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f5815fac640 1 -- 172.21.15.12:0/217039297 shutdown_connections 2023-10-16T23:27:51.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f5815fac640 1 --2- 172.21.15.12:0/217039297 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5810070480 0x7f58100ba1a0 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f58100bc7b0 tx=0x7f580001c450 comp rx=0 tx=0).stop 2023-10-16T23:27:51.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f5815fac640 1 --2- 172.21.15.12:0/217039297 >> v2:172.21.15.31:3300/0 conn(0x7f58101571a0 0x7f5810157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f5815fac640 1 -- 172.21.15.12:0/217039297 >> 172.21.15.12:0/217039297 conn(0x7f58100c0640 msgr2=0x7f58100c0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:51.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7fa60b102640 1 -- 172.21.15.12:0/328431380 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa60406f050 msgr2=0x7fa604153a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7fa60b102640 1 --2- 172.21.15.12:0/328431380 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa60406f050 0x7fa604153a90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc009d90 tx=0x7fa5fc01c8c0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f553bfff640 1 -- 172.21.15.12:0/2367770217 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553c0a5940 con 0x7f55440c5a80 2023-10-16T23:27:51.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f553bfff640 1 -- 172.21.15.12:0/2367770217 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c0a5cd0 con 0x7f55440c5a80 2023-10-16T23:27:51.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f17b9ffb640 1 -- 172.21.15.12:0/2208115666 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f17b40062f0 con 0x7f17c40ba7d0 2023-10-16T23:27:51.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f5815fac640 1 -- 172.21.15.12:0/217039297 shutdown_connections 2023-10-16T23:27:51.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f1503fff640 1 -- 172.21.15.12:0/1533495439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14fc007420 msgr2=0x7f14fc041c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f1503fff640 1 --2- 172.21.15.12:0/1533495439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14fc007420 0x7f14fc041c00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1504072890 tx=0x7f1504098120 comp rx=0 tx=0).stop 2023-10-16T23:27:51.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7fa60b102640 1 -- 172.21.15.12:0/328431380 shutdown_connections 2023-10-16T23:27:51.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7fa60b102640 1 --2- 172.21.15.12:0/328431380 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa60406f050 0x7fa604153a90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7fa60b102640 1 --2- 172.21.15.12:0/328431380 >> v2:172.21.15.12:3300/0 conn(0x7fa604156dd0 0x7fa604071290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7fa60b102640 1 -- 172.21.15.12:0/328431380 >> 172.21.15.12:0/328431380 conn(0x7fa6040bd960 msgr2=0x7fa6040bdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:51.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7fa60b102640 1 -- 172.21.15.12:0/328431380 shutdown_connections 2023-10-16T23:27:51.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f17b9ffb640 1 --2- 172.21.15.12:0/2208115666 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f17a8065f30 0x7f17a80683f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7fa60b102640 1 -- 172.21.15.12:0/328431380 wait complete. 2023-10-16T23:27:51.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f17b9ffb640 1 -- 172.21.15.12:0/2208115666 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f17b4083430 con 0x7f17c40ba7d0 2023-10-16T23:27:51.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7fecdfd2c640 1 -- 172.21.15.12:0/508141486 shutdown_connections 2023-10-16T23:27:51.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7fecdfd2c640 1 --2- 172.21.15.12:0/508141486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecd80ba7d0 0x7fecd806ee00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7fecdfd2c640 1 -- 172.21.15.12:0/508141486 >> 172.21.15.12:0/508141486 conn(0x7fecd806b400 msgr2=0x7fecd806b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:51.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f5815fac640 1 -- 172.21.15.12:0/217039297 wait complete. 2023-10-16T23:27:51.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7fecdfd2c640 1 -- 172.21.15.12:0/508141486 shutdown_connections 2023-10-16T23:27:51.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f17c94b1640 1 --2- 172.21.15.12:0/2208115666 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f17a8065f30 0x7f17a80683f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7fecdfd2c640 1 -- 172.21.15.12:0/508141486 wait complete. 2023-10-16T23:27:51.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f554b841640 1 -- 172.21.15.12:0/2367770217 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55440c5a80 msgr2=0x7f554406ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f554b841640 1 --2- 172.21.15.12:0/2367770217 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55440c5a80 0x7f554406ec10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f553c009e80 tx=0x7f553c01c940 comp rx=0 tx=0).stop 2023-10-16T23:27:51.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f17c94b1640 1 --2- 172.21.15.12:0/2208115666 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f17a8065f30 0x7f17a80683f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f17bc01d4e0 tx=0x7f17bc00a040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:51.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f554b841640 1 -- 172.21.15.12:0/2367770217 shutdown_connections 2023-10-16T23:27:51.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f554b841640 1 --2- 172.21.15.12:0/2367770217 >> v2:172.21.15.12:3300/0 conn(0x7f554406e490 0x7f554406f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f554b841640 1 --2- 172.21.15.12:0/2367770217 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55440c5a80 0x7f554406ec10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f554b841640 1 -- 172.21.15.12:0/2367770217 >> 172.21.15.12:0/2367770217 conn(0x7f554406b400 msgr2=0x7f554406b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:51.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f1503fff640 1 -- 172.21.15.12:0/1533495439 shutdown_connections 2023-10-16T23:27:51.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f1503fff640 1 --2- 172.21.15.12:0/1533495439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14fc007420 0x7f14fc041c00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f1503fff640 1 --2- 172.21.15.12:0/1533495439 >> v2:172.21.15.12:3300/0 conn(0x7f14fc02c630 0x7f14fc006ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f1503fff640 1 -- 172.21.15.12:0/1533495439 >> 172.21.15.12:0/1533495439 conn(0x7f14fc00a500 msgr2=0x7f14fc00a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:51.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f5815fac640 1 Processor -- start 2023-10-16T23:27:51.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f1c67fff640 1 --2- 172.21.15.12:0/2784229981 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c60007140 0x7f1c60025fd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1c540097c0 tx=0x7f1c5401c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a62d3aea2e3b7d49 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:51.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7fa60b102640 1 Processor -- start 2023-10-16T23:27:51.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7fecdfd2c640 1 Processor -- start 2023-10-16T23:27:51.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f554b841640 1 -- 172.21.15.12:0/2367770217 shutdown_connections 2023-10-16T23:27:51.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f1c66ffd640 1 -- 172.21.15.12:0/2784229981 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c540ab600 con 0x7f1c60007140 2023-10-16T23:27:51.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f554b841640 1 -- 172.21.15.12:0/2367770217 wait complete. 2023-10-16T23:27:51.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7fecdfd2c640 1 -- start start 2023-10-16T23:27:51.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fecdfd2c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fecd806bf20 0x7fecd80bf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fecdfd2c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecd80b37e0 0x7fecd80b6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fecdfd2c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fecd80ba7d0 0x7fecd80b6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fecdfd2c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd813fb10 con 0x7fecd80b37e0 2023-10-16T23:27:51.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fecdfd2c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd80b4500 con 0x7fecd806bf20 2023-10-16T23:27:51.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fecdfd2c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd80bf5e0 con 0x7fecd80ba7d0 2023-10-16T23:27:51.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fecdd2c7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecd80b37e0 0x7fecd80b6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fecdd2c7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecd80b37e0 0x7fecd80b6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55766/0 (socket says 172.21.15.12:55766) 2023-10-16T23:27:51.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fecdd2c7640 1 -- 172.21.15.12:0/1537729373 learned_addr learned my addr 172.21.15.12:0/1537729373 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:51.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7f5815fac640 1 -- start start 2023-10-16T23:27:51.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f5815fac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f581006e520 0x7f58101520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f5815fac640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58101571a0 0x7f5810152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f5815fac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5810146150 0x7f58101465b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f5815fac640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58100a8510 con 0x7f5810146150 2023-10-16T23:27:51.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f5815fac640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5810151c60 con 0x7f581006e520 2023-10-16T23:27:51.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f5815fac640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58101531a0 con 0x7f58101571a0 2023-10-16T23:27:51.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fecddac8640 1 --2- 172.21.15.12:0/1537729373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fecd806bf20 0x7fecd80bf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fecde2c9640 1 --2- 172.21.15.12:0/1537729373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fecd80ba7d0 0x7fecd80b6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.140+0000 7fa60b102640 1 -- start start 2023-10-16T23:27:51.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fa60b102640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa60406f050 0x7fa60413df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fa60b102640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa60406faf0 0x7fa6041345e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fa60b102640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa604156dd0 0x7fa604155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fa60b102640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60413dae0 con 0x7fa604156dd0 2023-10-16T23:27:51.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fa60b102640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60413fe30 con 0x7fa60406faf0 2023-10-16T23:27:51.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fa60b102640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6040b4b50 con 0x7fa60406f050 2023-10-16T23:27:51.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fa60969f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa604156dd0 0x7fa604155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fa60969f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa604156dd0 0x7fa604155bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55772/0 (socket says 172.21.15.12:55772) 2023-10-16T23:27:51.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fa60969f640 1 -- 172.21.15.12:0/317411339 learned_addr learned my addr 172.21.15.12:0/317411339 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:51.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fa603fff640 1 --2- 172.21.15.12:0/317411339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa60406faf0 0x7fa6041345e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fecdd2c7640 1 -- 172.21.15.12:0/1537729373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fecd80ba7d0 msgr2=0x7fecd80b6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fecdd2c7640 1 --2- 172.21.15.12:0/1537729373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fecd80ba7d0 0x7fecd80b6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fecdd2c7640 1 -- 172.21.15.12:0/1537729373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fecd806bf20 msgr2=0x7fecd80bf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fecdd2c7640 1 --2- 172.21.15.12:0/1537729373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fecd806bf20 0x7fecd80bf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fecdd2c7640 1 -- 172.21.15.12:0/1537729373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd4010810 con 0x7fecd80b37e0 2023-10-16T23:27:51.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f58157ab640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5810146150 0x7f58101465b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f58157ab640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5810146150 0x7f58101465b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55782/0 (socket says 172.21.15.12:55782) 2023-10-16T23:27:51.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f5814faa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f581006e520 0x7f58101520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f580ffff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58101571a0 0x7f5810152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f554b841640 1 Processor -- start 2023-10-16T23:27:51.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fecdd2c7640 1 --2- 172.21.15.12:0/1537729373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecd80b37e0 0x7fecd80b6690 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fecd4022af0 tx=0x7fecd4021c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:51.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f5814faa640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f581006e520 0x7f58101520f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:36458/0 (socket says 172.21.15.12:36458) 2023-10-16T23:27:51.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f5814faa640 1 -- 172.21.15.12:0/2540608853 learned_addr learned my addr 172.21.15.12:0/2540608853 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:51.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fa60969f640 1 -- 172.21.15.12:0/317411339 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa60406f050 msgr2=0x7fa60413df90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T23:27:51.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fa60969f640 1 --2- 172.21.15.12:0/317411339 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa60406f050 0x7fa60413df90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fa60969f640 1 -- 172.21.15.12:0/317411339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa60406faf0 msgr2=0x7fa6041345e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fa60969f640 1 --2- 172.21.15.12:0/317411339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa60406faf0 0x7fa6041345e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fa60969f640 1 -- 172.21.15.12:0/317411339 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc009a70 con 0x7fa604156dd0 2023-10-16T23:27:51.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fa603fff640 1 --2- 172.21.15.12:0/317411339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa60406faf0 0x7fa6041345e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:27:51.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7fa60969f640 1 --2- 172.21.15.12:0/317411339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa604156dd0 0x7fa604155bf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc01a4f0 tx=0x7fa5fc019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:51.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f1c66ffd640 1 -- 172.21.15.12:0/2784229981 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c540a7050 con 0x7f1c60007140 2023-10-16T23:27:51.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f1c66ffd640 1 -- 172.21.15.12:0/2784229981 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c540ab980 con 0x7f1c60007140 2023-10-16T23:27:51.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f1c6d2c2640 1 -- 172.21.15.12:0/2784229981 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c60007140 msgr2=0x7f1c60025fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f1c6d2c2640 1 --2- 172.21.15.12:0/2784229981 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c60007140 0x7f1c60025fd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1c540097c0 tx=0x7f1c5401c3b0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f554b841640 1 -- start start 2023-10-16T23:27:51.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f5814faa640 1 -- 172.21.15.12:0/2540608853 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58101571a0 msgr2=0x7f5810152c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f5814faa640 1 --2- 172.21.15.12:0/2540608853 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58101571a0 0x7f5810152c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f5814faa640 1 -- 172.21.15.12:0/2540608853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5810146150 msgr2=0x7f58101465b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f5814faa640 1 --2- 172.21.15.12:0/2540608853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5810146150 0x7f58101465b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f5814faa640 1 -- 172.21.15.12:0/2540608853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58000094d0 con 0x7f581006e520 2023-10-16T23:27:51.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f58157ab640 1 --2- 172.21.15.12:0/2540608853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5810146150 0x7f58101465b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T23:27:51.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f1c6d2c2640 1 -- 172.21.15.12:0/2784229981 shutdown_connections 2023-10-16T23:27:51.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f1c6d2c2640 1 --2- 172.21.15.12:0/2784229981 >> v2:172.21.15.12:3300/0 conn(0x7f1c60046930 0x7f1c600d3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f1c6d2c2640 1 --2- 172.21.15.12:0/2784229981 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c60007140 0x7f1c60025fd0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f1c6d2c2640 1 -- 172.21.15.12:0/2784229981 >> 172.21.15.12:0/2784229981 conn(0x7f1c6000a500 msgr2=0x7f1c6000a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:51.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f1503fff640 1 -- 172.21.15.12:0/1533495439 shutdown_connections 2023-10-16T23:27:51.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f5814faa640 1 --2- 172.21.15.12:0/2540608853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f581006e520 0x7f58101520f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f580800efc0 tx=0x7f580800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:51.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f1503fff640 1 -- 172.21.15.12:0/1533495439 wait complete. 2023-10-16T23:27:51.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f580d7fa640 1 -- 172.21.15.12:0/2540608853 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5808009b80 con 0x7f581006e520 2023-10-16T23:27:51.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f554b841640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f554406e490 0x7f55441ef640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f554b841640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55440c4ed0 0x7f55441ec8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f554b841640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55440c5a80 0x7f5544147100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f554b841640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55440be100 con 0x7f554406e490 2023-10-16T23:27:51.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f554b841640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55441efb80 con 0x7f55440c5a80 2023-10-16T23:27:51.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f554b841640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55441efe00 con 0x7f55440c4ed0 2023-10-16T23:27:51.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f5815fac640 1 -- 172.21.15.12:0/2540608853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58100b6dd0 con 0x7f581006e520 2023-10-16T23:27:51.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f5815fac640 1 -- 172.21.15.12:0/2540608853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58101518f0 con 0x7f581006e520 2023-10-16T23:27:51.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f580d7fa640 1 -- 172.21.15.12:0/2540608853 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580800f040 con 0x7f581006e520 2023-10-16T23:27:51.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f580d7fa640 1 -- 172.21.15.12:0/2540608853 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58080146a0 con 0x7f581006e520 2023-10-16T23:27:51.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f55495dd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f554406e490 0x7f55441ef640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f55495dd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f554406e490 0x7f55441ef640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55786/0 (socket says 172.21.15.12:55786) 2023-10-16T23:27:51.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f55495dd640 1 -- 172.21.15.12:0/2553096282 learned_addr learned my addr 172.21.15.12:0/2553096282 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:51.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f5548ddc640 1 --2- 172.21.15.12:0/2553096282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55440c4ed0 0x7f55441ec8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f5549dde640 1 --2- 172.21.15.12:0/2553096282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55440c5a80 0x7f5544147100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f1503fff640 1 Processor -- start 2023-10-16T23:27:51.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f1503fff640 1 -- start start 2023-10-16T23:27:51.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f5815fac640 1 -- 172.21.15.12:0/2540608853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f4005260 con 0x7f581006e520 2023-10-16T23:27:51.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f5549dde640 1 -- 172.21.15.12:0/2553096282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55440c4ed0 msgr2=0x7f55441ec8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f5549dde640 1 --2- 172.21.15.12:0/2553096282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55440c4ed0 0x7f55441ec8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f5549dde640 1 -- 172.21.15.12:0/2553096282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f554406e490 msgr2=0x7f55441ef640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f5549dde640 1 --2- 172.21.15.12:0/2553096282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f554406e490 0x7f55441ef640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.144+0000 7f5549dde640 1 -- 172.21.15.12:0/2553096282 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c009b30 con 0x7f55440c5a80 2023-10-16T23:27:51.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f1503fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14fc007420 0x7f14fc177410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f1503fff640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14fc02c630 0x7f14fc0cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f1503fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14fc042710 0x7f14fc178300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f1503fff640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc17b240 con 0x7f14fc007420 2023-10-16T23:27:51.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f1503fff640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc177e70 con 0x7f14fc042710 2023-10-16T23:27:51.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f1503fff640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc03d830 con 0x7f14fc02c630 2023-10-16T23:27:51.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f1502ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14fc007420 0x7f14fc177410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f1502ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14fc007420 0x7f14fc177410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55790/0 (socket says 172.21.15.12:55790) 2023-10-16T23:27:51.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f1502ffd640 1 -- 172.21.15.12:0/1913023534 learned_addr learned my addr 172.21.15.12:0/1913023534 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:51.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f5549dde640 1 --2- 172.21.15.12:0/2553096282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55440c5a80 0x7f5544147100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f553400c3e0 tx=0x7f553400c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:51.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f15027fc640 1 --2- 172.21.15.12:0/1913023534 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14fc02c630 0x7f14fc0cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7fa6017fa640 1 -- 172.21.15.12:0/317411339 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc003ba0 con 0x7fa604156dd0 2023-10-16T23:27:51.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7fecce7fc640 1 -- 172.21.15.12:0/1537729373 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd40b5de0 con 0x7fecd80b37e0 2023-10-16T23:27:51.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7fa60b102640 1 -- 172.21.15.12:0/317411339 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60413d3c0 con 0x7fa604156dd0 2023-10-16T23:27:51.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7fa60b102640 1 -- 172.21.15.12:0/317411339 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60413dcc0 con 0x7fa604156dd0 2023-10-16T23:27:51.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7fecdfd2c640 1 -- 172.21.15.12:0/1537729373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd813fee0 con 0x7fecd80b37e0 2023-10-16T23:27:51.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7fecdfd2c640 1 -- 172.21.15.12:0/1537729373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd80c0b60 con 0x7fecd80b37e0 2023-10-16T23:27:51.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7fecce7fc640 1 -- 172.21.15.12:0/1537729373 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd40bf440 con 0x7fecd80b37e0 2023-10-16T23:27:51.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7fecce7fc640 1 -- 172.21.15.12:0/1537729373 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd40bf7f0 con 0x7fecd80b37e0 2023-10-16T23:27:51.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f17b9ffb640 1 -- 172.21.15.12:0/2208115666 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f17b4050b10 con 0x7f17c40ba7d0 2023-10-16T23:27:51.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7fa60b102640 1 -- 172.21.15.12:0/317411339 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60413d220 con 0x7fa604156dd0 2023-10-16T23:27:51.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f5539ffb640 1 -- 172.21.15.12:0/2553096282 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5534003600 con 0x7f55440c5a80 2023-10-16T23:27:51.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f5539ffb640 1 -- 172.21.15.12:0/2553096282 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5534003780 con 0x7f55440c5a80 2023-10-16T23:27:51.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f5539ffb640 1 -- 172.21.15.12:0/2553096282 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5534003b70 con 0x7f55440c5a80 2023-10-16T23:27:51.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f15027fc640 1 -- 172.21.15.12:0/1913023534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14fc042710 msgr2=0x7f14fc178300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f15027fc640 1 --2- 172.21.15.12:0/1913023534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14fc042710 0x7f14fc178300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f15027fc640 1 -- 172.21.15.12:0/1913023534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14fc007420 msgr2=0x7f14fc177410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f15027fc640 1 --2- 172.21.15.12:0/1913023534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14fc007420 0x7f14fc177410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f15027fc640 1 -- 172.21.15.12:0/1913023534 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150406e2e0 con 0x7f14fc02c630 2023-10-16T23:27:51.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f15027fc640 1 --2- 172.21.15.12:0/1913023534 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14fc02c630 0x7f14fc0cecf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f14f800c3e0 tx=0x7f14f800c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:51.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f14eb7fe640 1 -- 172.21.15.12:0/1913023534 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f8007dc0 con 0x7f14fc02c630 2023-10-16T23:27:51.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f1503fff640 1 -- 172.21.15.12:0/1913023534 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14fc17b490 con 0x7f14fc02c630 2023-10-16T23:27:51.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f1503fff640 1 -- 172.21.15.12:0/1913023534 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14fc040bb0 con 0x7f14fc02c630 2023-10-16T23:27:51.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f14eb7fe640 1 -- 172.21.15.12:0/1913023534 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f80090d0 con 0x7f14fc02c630 2023-10-16T23:27:51.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f14eb7fe640 1 -- 172.21.15.12:0/1913023534 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f8009480 con 0x7f14fc02c630 2023-10-16T23:27:51.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f554b841640 1 -- 172.21.15.12:0/2553096282 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55441f00e0 con 0x7f55440c5a80 2023-10-16T23:27:51.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f554b841640 1 -- 172.21.15.12:0/2553096282 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55441ece30 con 0x7f55440c5a80 2023-10-16T23:27:51.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f580d7fa640 1 -- 172.21.15.12:0/2540608853 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f5808014800 con 0x7f581006e520 2023-10-16T23:27:51.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f580d7fa640 1 --2- 172.21.15.12:0/2540608853 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f57f0065e60 0x7f57f0068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f580d7fa640 1 -- 172.21.15.12:0/2540608853 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5808084980 con 0x7f581006e520 2023-10-16T23:27:51.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7fecdfd2c640 1 -- 172.21.15.12:0/1537729373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd80c0d80 con 0x7fecd80b37e0 2023-10-16T23:27:51.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7fa6017fa640 1 -- 172.21.15.12:0/317411339 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5fc003d00 con 0x7fa604156dd0 2023-10-16T23:27:51.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f580ffff640 1 --2- 172.21.15.12:0/2540608853 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f57f0065e60 0x7f57f0068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f554b841640 1 -- 172.21.15.12:0/2553096282 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5544061940 con 0x7f55440c5a80 2023-10-16T23:27:51.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7f1503fff640 1 -- 172.21.15.12:0/1913023534 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e4005260 con 0x7f14fc02c630 2023-10-16T23:27:51.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.148+0000 7fa6017fa640 1 -- 172.21.15.12:0/317411339 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc004240 con 0x7fa604156dd0 2023-10-16T23:27:51.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.152+0000 7f580ffff640 1 --2- 172.21.15.12:0/2540608853 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f57f0065e60 0x7f57f0068320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f58000ad000 tx=0x7f58000a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:51.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.152+0000 7fa6017fa640 1 -- 172.21.15.12:0/317411339 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fa5fc0b4070 con 0x7fa604156dd0 2023-10-16T23:27:51.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.152+0000 7f1c6d2c2640 1 -- 172.21.15.12:0/2784229981 shutdown_connections 2023-10-16T23:27:51.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.152+0000 7fa6017fa640 1 --2- 172.21.15.12:0/317411339 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fa5e8065e60 0x7fa5e8068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.152+0000 7fa608e9e640 1 --2- 172.21.15.12:0/317411339 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fa5e8065e60 0x7fa5e8068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.152+0000 7fa6017fa640 1 -- 172.21.15.12:0/317411339 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa5fc0efdd0 con 0x7fa604156dd0 2023-10-16T23:27:51.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.152+0000 7fa608e9e640 1 --2- 172.21.15.12:0/317411339 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fa5e8065e60 0x7fa5e8068320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009940 tx=0x7fa5f8009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:51.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.152+0000 7f1c6d2c2640 1 -- 172.21.15.12:0/2784229981 wait complete. 2023-10-16T23:27:51.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.152+0000 7f1c6d2c2640 1 Processor -- start 2023-10-16T23:27:51.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.152+0000 7fecce7fc640 1 -- 172.21.15.12:0/1537729373 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fecd40bf950 con 0x7fecd80b37e0 2023-10-16T23:27:51.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.152+0000 7f14eb7fe640 1 -- 172.21.15.12:0/1913023534 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f14f80095e0 con 0x7f14fc02c630 2023-10-16T23:27:51.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.152+0000 7f14eb7fe640 1 --2- 172.21.15.12:0/1913023534 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f14f0065e90 0x7f14f0068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.152+0000 7f14eb7fe640 1 -- 172.21.15.12:0/1913023534 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f14f8085ad0 con 0x7f14fc02c630 2023-10-16T23:27:51.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.152+0000 7f1502ffd640 1 --2- 172.21.15.12:0/1913023534 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f14f0065e90 0x7f14f0068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.152+0000 7f1502ffd640 1 --2- 172.21.15.12:0/1913023534 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f14f0065e90 0x7f14f0068350 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f14f400afd0 tx=0x7f14f400c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:51.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.152+0000 7fecce7fc640 1 --2- 172.21.15.12:0/1537729373 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fecbc065e60 0x7fecbc068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.152+0000 7fecce7fc640 1 -- 172.21.15.12:0/1537729373 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fecd41271f0 con 0x7fecd80b37e0 2023-10-16T23:27:51.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.152+0000 7fecddac8640 1 --2- 172.21.15.12:0/1537729373 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fecbc065e60 0x7fecbc068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.152+0000 7f1c6d2c2640 1 -- start start 2023-10-16T23:27:51.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.152+0000 7f1c6d2c2640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c60007140 0x7f1c6003d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.152+0000 7f1c6d2c2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c6002aa60 0x7f1c600cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.152+0000 7f1c6d2c2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c60046930 0x7f1c6017e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.152+0000 7f1c6d2c2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c600d00e0 con 0x7f1c60046930 2023-10-16T23:27:51.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.152+0000 7f1c6d2c2640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c600d1c20 con 0x7f1c6002aa60 2023-10-16T23:27:51.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.152+0000 7f1c6d2c2640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c600d1f00 con 0x7f1c60007140 2023-10-16T23:27:51.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.156+0000 7f1c6cac1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c60046930 0x7f1c6017e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.156+0000 7f1c6cac1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c60046930 0x7f1c6017e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55794/0 (socket says 172.21.15.12:55794) 2023-10-16T23:27:51.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.156+0000 7f1c6cac1640 1 -- 172.21.15.12:0/1222646165 learned_addr learned my addr 172.21.15.12:0/1222646165 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:51.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.156+0000 7f1c677fe640 1 --2- 172.21.15.12:0/1222646165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c6002aa60 0x7f1c600cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.156+0000 7f1c67fff640 1 --2- 172.21.15.12:0/1222646165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c60007140 0x7f1c6003d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.156+0000 7fecddac8640 1 --2- 172.21.15.12:0/1537729373 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fecbc065e60 0x7fecbc068320 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fecd814dd60 tx=0x7fecd0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:51.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.156+0000 7f1c6cac1640 1 -- 172.21.15.12:0/1222646165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c60007140 msgr2=0x7f1c6003d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.156+0000 7f1c6cac1640 1 --2- 172.21.15.12:0/1222646165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c60007140 0x7f1c6003d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.156+0000 7f1c6cac1640 1 -- 172.21.15.12:0/1222646165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c6002aa60 msgr2=0x7f1c600cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.156+0000 7f1c6cac1640 1 --2- 172.21.15.12:0/1222646165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c6002aa60 0x7f1c600cf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.156+0000 7f1c6cac1640 1 -- 172.21.15.12:0/1222646165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c54009420 con 0x7f1c60046930 2023-10-16T23:27:51.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.156+0000 7f1c6cac1640 1 --2- 172.21.15.12:0/1222646165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c60046930 0x7f1c6017e290 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00e7f0 tx=0x7f1c5c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:51.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.156+0000 7f4aa8b3d640 1 Processor -- start 2023-10-16T23:27:51.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.156+0000 7f4aa8b3d640 1 -- start start 2023-10-16T23:27:51.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.156+0000 7f4aa8b3d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4aa406f530 0x7f4aa4152730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.156+0000 7f4aa8b3d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa40a6770 con 0x7f4aa414eda0 2023-10-16T23:27:51.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.156+0000 7f4aa3fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4aa414eda0 0x7f4aa4152c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38230/0 (socket says 172.21.15.12:38230) 2023-10-16T23:27:51.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.156+0000 7f4aa3fff640 1 -- 172.21.15.12:0/1301681177 learned_addr learned my addr 172.21.15.12:0/1301681177 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:51.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.156+0000 7f4aa2ffd640 1 --2- 172.21.15.12:0/1301681177 >> v2:172.21.15.31:3300/0 conn(0x7f4aa406f530 0x7f4aa4152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.156+0000 7f4aa8b3d640 1 -- 172.21.15.12:0/1301681177 --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa40a3fb0 con 0x7f4aa40c1ff0 2023-10-16T23:27:51.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.156+0000 7f4aa8b3d640 1 -- 172.21.15.12:0/1301681177 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa40a3cd0 con 0x7f4aa406f530 2023-10-16T23:27:51.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.156+0000 7f4aa2ffd640 1 -- 172.21.15.12:0/1301681177 >> v1:172.21.15.31:6789/0 conn(0x7f4aa40c1ff0 legacy=0x7f4aa414e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.156+0000 7f4aa2ffd640 1 -- 172.21.15.12:0/1301681177 >> v1:172.21.15.12:6789/0 conn(0x7f4aa414eda0 legacy=0x7f4aa4152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.156+0000 7f4aa2ffd640 1 -- 172.21.15.12:0/1301681177 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa40c23d0 con 0x7f4aa406f530 2023-10-16T23:27:51.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.156+0000 7fa6017fa640 1 -- 172.21.15.12:0/317411339 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fa5fc0eba10 con 0x7fa604156dd0 2023-10-16T23:27:51.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.160+0000 7f4aa2ffd640 1 --2- 172.21.15.12:0/1301681177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa406f530 0x7f4aa4152730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4a980097c0 tx=0x7f4a9801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e64ebf69deba0f5e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:51.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.160+0000 7f1c64ff9640 1 -- 172.21.15.12:0/1222646165 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c00eea0 con 0x7f1c60046930 2023-10-16T23:27:51.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.164+0000 7f1c64ff9640 1 -- 172.21.15.12:0/1222646165 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c00c940 con 0x7f1c60046930 2023-10-16T23:27:51.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.164+0000 7f1c64ff9640 1 -- 172.21.15.12:0/1222646165 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c00ccd0 con 0x7f1c60046930 2023-10-16T23:27:51.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.164+0000 7f1c6d2c2640 1 -- 172.21.15.12:0/1222646165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c600d21e0 con 0x7f1c60046930 2023-10-16T23:27:51.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.164+0000 7f1c6d2c2640 1 -- 172.21.15.12:0/1222646165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c600cfa00 con 0x7f1c60046930 2023-10-16T23:27:51.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.164+0000 7f580d7fa640 1 -- 172.21.15.12:0/2540608853 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f5808052070 con 0x7f581006e520 2023-10-16T23:27:51.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.164+0000 7fecce7fc640 1 -- 172.21.15.12:0/1537729373 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fecd40f4ad0 con 0x7fecd80b37e0 2023-10-16T23:27:51.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.164+0000 7f4aa27fc640 1 -- 172.21.15.12:0/1301681177 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a980a6040 con 0x7f4aa406f530 2023-10-16T23:27:51.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.164+0000 7f4aa27fc640 1 -- 172.21.15.12:0/1301681177 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a980aa600 con 0x7f4aa406f530 2023-10-16T23:27:51.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.164+0000 7f5539ffb640 1 -- 172.21.15.12:0/2553096282 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f5534003cd0 con 0x7f55440c5a80 2023-10-16T23:27:51.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.164+0000 7f4aa27fc640 1 -- 172.21.15.12:0/1301681177 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a980a6040 con 0x7f4aa406f530 2023-10-16T23:27:51.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.164+0000 7f4aa8b3d640 1 -- 172.21.15.12:0/1301681177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa406f530 msgr2=0x7f4aa4152730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.164+0000 7f5539ffb640 1 --2- 172.21.15.12:0/2553096282 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5528065eb0 0x7f5528068370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.164+0000 7f4aa8b3d640 1 --2- 172.21.15.12:0/1301681177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa406f530 0x7f4aa4152730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4a980097c0 tx=0x7f4a9801c480 comp rx=0 tx=0).stop 2023-10-16T23:27:51.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.164+0000 7f1c6d2c2640 1 -- 172.21.15.12:0/1222646165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c60005390 con 0x7f1c60046930 2023-10-16T23:27:51.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.164+0000 7f5539ffb640 1 -- 172.21.15.12:0/2553096282 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5534083110 con 0x7f55440c5a80 2023-10-16T23:27:51.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.164+0000 7f55495dd640 1 --2- 172.21.15.12:0/2553096282 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5528065eb0 0x7f5528068370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.164+0000 7f14eb7fe640 1 -- 172.21.15.12:0/1913023534 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f14f80531c0 con 0x7f14fc02c630 2023-10-16T23:27:51.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.164+0000 7f4aa8b3d640 1 -- 172.21.15.12:0/1301681177 shutdown_connections 2023-10-16T23:27:51.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.164+0000 7f4aa8b3d640 1 --2- 172.21.15.12:0/1301681177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa406f530 0x7f4aa4152730 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.164+0000 7f4aa8b3d640 1 -- 172.21.15.12:0/1301681177 >> 172.21.15.12:0/1301681177 conn(0x7f4aa402b760 msgr2=0x7f4aa40c1680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:51.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.164+0000 7f1c64ff9640 1 -- 172.21.15.12:0/1222646165 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f1c5c013470 con 0x7f1c60046930 2023-10-16T23:27:51.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.164+0000 7f1c64ff9640 1 --2- 172.21.15.12:0/1222646165 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1c4c065e60 0x7f1c4c068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.168+0000 7f1c64ff9640 1 -- 172.21.15.12:0/1222646165 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1c5c084000 con 0x7f1c60046930 2023-10-16T23:27:51.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.168+0000 7f1c67fff640 1 --2- 172.21.15.12:0/1222646165 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1c4c065e60 0x7f1c4c068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.168+0000 7f4aa8b3d640 1 -- 172.21.15.12:0/1301681177 shutdown_connections 2023-10-16T23:27:51.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.168+0000 7f55495dd640 1 --2- 172.21.15.12:0/2553096282 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5528065eb0 0x7f5528068370 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f553c01d1e0 tx=0x7f553c0a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:51.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.168+0000 7f1c67fff640 1 --2- 172.21.15.12:0/1222646165 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1c4c065e60 0x7f1c4c068320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1c540ad000 tx=0x7f1c54008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:51.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.168+0000 7f4aa8b3d640 1 -- 172.21.15.12:0/1301681177 wait complete. 2023-10-16T23:27:51.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.168+0000 7f4aa8b3d640 1 Processor -- start 2023-10-16T23:27:51.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.168+0000 7f4aa8b3d640 1 -- start start 2023-10-16T23:27:51.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.168+0000 7f4aa8b3d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4aa40c1ff0 0x7f4aa4140f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.168+0000 7f4aa8b3d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa414eda0 0x7f4aa414d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.168+0000 7f4aa8b3d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa413bd80 0x7f4aa414dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.168+0000 7f4aa3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa413bd80 0x7f4aa414dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.168+0000 7f4aa3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa413bd80 0x7f4aa414dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55810/0 (socket says 172.21.15.12:55810) 2023-10-16T23:27:51.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.168+0000 7f4aa3fff640 1 -- 172.21.15.12:0/734111224 learned_addr learned my addr 172.21.15.12:0/734111224 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:51.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.168+0000 7f4aa8b3d640 1 -- 172.21.15.12:0/734111224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa413f9e0 con 0x7f4aa413bd80 2023-10-16T23:27:51.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.168+0000 7f4aa8b3d640 1 -- 172.21.15.12:0/734111224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa41418a0 con 0x7f4aa414eda0 2023-10-16T23:27:51.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.168+0000 7f4aa8b3d640 1 -- 172.21.15.12:0/734111224 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa4141460 con 0x7f4aa40c1ff0 2023-10-16T23:27:51.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.172+0000 7f4aa2ffd640 1 --2- 172.21.15.12:0/734111224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa414eda0 0x7f4aa414d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.172+0000 7f4aa37fe640 1 --2- 172.21.15.12:0/734111224 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4aa40c1ff0 0x7f4aa4140f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.172+0000 7f4aa3fff640 1 -- 172.21.15.12:0/734111224 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4aa40c1ff0 msgr2=0x7f4aa4140f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.172+0000 7f4aa3fff640 1 --2- 172.21.15.12:0/734111224 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4aa40c1ff0 0x7f4aa4140f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.172+0000 7f4aa3fff640 1 -- 172.21.15.12:0/734111224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa414eda0 msgr2=0x7f4aa414d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.172+0000 7f4aa3fff640 1 --2- 172.21.15.12:0/734111224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa414eda0 0x7f4aa414d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.172+0000 7f4aa3fff640 1 -- 172.21.15.12:0/734111224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a98009420 con 0x7f4aa413bd80 2023-10-16T23:27:51.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.172+0000 7f4aa37fe640 1 --2- 172.21.15.12:0/734111224 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4aa40c1ff0 0x7f4aa4140f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:51.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.172+0000 7f4aa3fff640 1 --2- 172.21.15.12:0/734111224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa413bd80 0x7f4aa414dae0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c00cab0 tx=0x7f4a9c00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:51.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.172+0000 7f1c64ff9640 1 -- 172.21.15.12:0/1222646165 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f1c5c051770 con 0x7f1c60046930 2023-10-16T23:27:51.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.172+0000 7f4a8bfff640 1 -- 172.21.15.12:0/734111224 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c00abd0 con 0x7f4aa413bd80 2023-10-16T23:27:51.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.172+0000 7f4a8bfff640 1 -- 172.21.15.12:0/734111224 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9c00ad30 con 0x7f4aa413bd80 2023-10-16T23:27:51.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.172+0000 7f4aa8b3d640 1 -- 172.21.15.12:0/734111224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa4141dd0 con 0x7f4aa413bd80 2023-10-16T23:27:51.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.172+0000 7f4aa8b3d640 1 -- 172.21.15.12:0/734111224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa406baf0 con 0x7f4aa413bd80 2023-10-16T23:27:51.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.172+0000 7f4a8bfff640 1 -- 172.21.15.12:0/734111224 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c00aea0 con 0x7f4aa413bd80 2023-10-16T23:27:51.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.176+0000 7f4a8bfff640 1 -- 172.21.15.12:0/734111224 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f4a9c012600 con 0x7f4aa413bd80 2023-10-16T23:27:51.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.176+0000 7f4a8bfff640 1 --2- 172.21.15.12:0/734111224 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4a90065eb0 0x7f4a90068370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:51.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.176+0000 7f4a8bfff640 1 -- 172.21.15.12:0/734111224 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4a9c083480 con 0x7f4aa413bd80 2023-10-16T23:27:51.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.180+0000 7f5539ffb640 1 -- 172.21.15.12:0/2553096282 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f5534050880 con 0x7f55440c5a80 2023-10-16T23:27:51.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.180+0000 7f4aa37fe640 1 --2- 172.21.15.12:0/734111224 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4a90065eb0 0x7f4a90068370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:51.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.180+0000 7f4aa8b3d640 1 -- 172.21.15.12:0/734111224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a84005260 con 0x7f4aa413bd80 2023-10-16T23:27:51.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.180+0000 7f4aa37fe640 1 --2- 172.21.15.12:0/734111224 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4a90065eb0 0x7f4a90068370 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4a940016f0 tx=0x7f4a94009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:51.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.188+0000 7f4a8bfff640 1 -- 172.21.15.12:0/734111224 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f4a9c050cf0 con 0x7f4aa413bd80 2023-10-16T23:27:51.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.460+0000 7f17cb715640 1 -- 172.21.15.12:0/2208115666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f17c4061940 con 0x7f17c40ba7d0 2023-10-16T23:27:51.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.460+0000 7f17b9ffb640 1 -- 172.21.15.12:0/2208115666 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f17b401c020 con 0x7f17c40ba7d0 2023-10-16T23:27:51.465 INFO:teuthology.orchestra.run.smithi012.stdout:64424509448 2023-10-16T23:27:51.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.464+0000 7f17a77fe640 1 -- 172.21.15.12:0/2208115666 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f17a8065f30 msgr2=0x7f17a80683f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.464+0000 7f17a77fe640 1 --2- 172.21.15.12:0/2208115666 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f17a8065f30 0x7f17a80683f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f17bc01d4e0 tx=0x7f17bc00a040 comp rx=0 tx=0).stop 2023-10-16T23:27:51.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.464+0000 7f17a77fe640 1 -- 172.21.15.12:0/2208115666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17c40ba7d0 msgr2=0x7f17c40b8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.464+0000 7f17a77fe640 1 --2- 172.21.15.12:0/2208115666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17c40ba7d0 0x7f17c40b8760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f17b40072c0 tx=0x7f17b4007780 comp rx=0 tx=0).stop 2023-10-16T23:27:51.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.464+0000 7f17a77fe640 1 -- 172.21.15.12:0/2208115666 shutdown_connections 2023-10-16T23:27:51.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.464+0000 7f17a77fe640 1 --2- 172.21.15.12:0/2208115666 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f17a8065f30 0x7f17a80683f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.464+0000 7f17a77fe640 1 --2- 172.21.15.12:0/2208115666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17c414a940 0x7f17c414a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.464+0000 7f17a77fe640 1 --2- 172.21.15.12:0/2208115666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17c40ba7d0 0x7f17c40b8760 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.464+0000 7f17a77fe640 1 --2- 172.21.15.12:0/2208115666 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f17c40b3d20 0x7f17c40b9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.464+0000 7f17a77fe640 1 -- 172.21.15.12:0/2208115666 >> 172.21.15.12:0/2208115666 conn(0x7f17c406b400 msgr2=0x7f17c406b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:51.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.464+0000 7f17a77fe640 1 -- 172.21.15.12:0/2208115666 shutdown_connections 2023-10-16T23:27:51.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.464+0000 7f17a77fe640 1 -- 172.21.15.12:0/2208115666 wait complete. 2023-10-16T23:27:51.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.472+0000 7fa60b102640 1 -- 172.21.15.12:0/317411339 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa60413d220 con 0x7fa604156dd0 2023-10-16T23:27:51.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.476+0000 7fa6017fa640 1 -- 172.21.15.12:0/317411339 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa60413d220 con 0x7fa604156dd0 2023-10-16T23:27:51.480 INFO:teuthology.orchestra.run.smithi012.stdout:60129542151 2023-10-16T23:27:51.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.484+0000 7fa5eeffd640 1 -- 172.21.15.12:0/317411339 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fa5e8065e60 msgr2=0x7fa5e8068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.484+0000 7fa5eeffd640 1 --2- 172.21.15.12:0/317411339 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fa5e8065e60 0x7fa5e8068320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009940 tx=0x7fa5f8009240 comp rx=0 tx=0).stop 2023-10-16T23:27:51.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.484+0000 7fa5eeffd640 1 -- 172.21.15.12:0/317411339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa604156dd0 msgr2=0x7fa604155bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.484+0000 7fa5eeffd640 1 --2- 172.21.15.12:0/317411339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa604156dd0 0x7fa604155bf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc01a4f0 tx=0x7fa5fc019660 comp rx=0 tx=0).stop 2023-10-16T23:27:51.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.484+0000 7fa5eeffd640 1 -- 172.21.15.12:0/317411339 shutdown_connections 2023-10-16T23:27:51.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.484+0000 7fa5eeffd640 1 --2- 172.21.15.12:0/317411339 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fa5e8065e60 0x7fa5e8068320 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.484+0000 7fa5eeffd640 1 --2- 172.21.15.12:0/317411339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa604156dd0 0x7fa604155bf0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.484+0000 7fa5eeffd640 1 --2- 172.21.15.12:0/317411339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa60406faf0 0x7fa6041345e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.484+0000 7fa5eeffd640 1 --2- 172.21.15.12:0/317411339 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa60406f050 0x7fa60413df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.484+0000 7fa5eeffd640 1 -- 172.21.15.12:0/317411339 >> 172.21.15.12:0/317411339 conn(0x7fa6040bd960 msgr2=0x7fa604143960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:51.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.484+0000 7fa5eeffd640 1 -- 172.21.15.12:0/317411339 shutdown_connections 2023-10-16T23:27:51.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.484+0000 7fa5eeffd640 1 -- 172.21.15.12:0/317411339 wait complete. 2023-10-16T23:27:51.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.484+0000 7f5815fac640 1 -- 172.21.15.12:0/2540608853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f57f40057e0 con 0x7f581006e520 2023-10-16T23:27:51.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.0 2023-10-16T23:27:51.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.488+0000 7f580d7fa640 1 -- 172.21.15.12:0/2540608853 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5808018090 con 0x7f581006e520 2023-10-16T23:27:51.491 INFO:teuthology.orchestra.run.smithi012.stdout:60129542151 2023-10-16T23:27:51.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.488+0000 7f1503fff640 1 -- 172.21.15.12:0/1913023534 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f14e4005510 con 0x7f14fc02c630 2023-10-16T23:27:51.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.488+0000 7f554b841640 1 -- 172.21.15.12:0/2553096282 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f55440c3220 con 0x7f55440c5a80 2023-10-16T23:27:51.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.488+0000 7f14eb7fe640 1 -- 172.21.15.12:0/1913023534 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f14f801a020 con 0x7f14fc02c630 2023-10-16T23:27:51.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.488+0000 7f5539ffb640 1 -- 172.21.15.12:0/2553096282 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5534017090 con 0x7f55440c5a80 2023-10-16T23:27:51.493 INFO:teuthology.orchestra.run.smithi012.stdout:64424509446 2023-10-16T23:27:51.493 INFO:teuthology.orchestra.run.smithi012.stdout:64424509447 2023-10-16T23:27:51.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.488+0000 7f1503fff640 1 -- 172.21.15.12:0/1913023534 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f14f0065e90 msgr2=0x7f14f0068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.488+0000 7f1503fff640 1 --2- 172.21.15.12:0/1913023534 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f14f0065e90 0x7f14f0068350 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f14f400afd0 tx=0x7f14f400c040 comp rx=0 tx=0).stop 2023-10-16T23:27:51.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.488+0000 7f1503fff640 1 -- 172.21.15.12:0/1913023534 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14fc02c630 msgr2=0x7f14fc0cecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.488+0000 7f1503fff640 1 --2- 172.21.15.12:0/1913023534 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14fc02c630 0x7f14fc0cecf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f14f800c3e0 tx=0x7f14f800c8a0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.488+0000 7f1503fff640 1 -- 172.21.15.12:0/1913023534 shutdown_connections 2023-10-16T23:27:51.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.488+0000 7f1503fff640 1 --2- 172.21.15.12:0/1913023534 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f14f0065e90 0x7f14f0068350 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.488+0000 7f1503fff640 1 --2- 172.21.15.12:0/1913023534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14fc042710 0x7f14fc178300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.488+0000 7f1503fff640 1 --2- 172.21.15.12:0/1913023534 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14fc02c630 0x7f14fc0cecf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.488+0000 7f1503fff640 1 --2- 172.21.15.12:0/1913023534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14fc007420 0x7f14fc177410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.488+0000 7f1503fff640 1 -- 172.21.15.12:0/1913023534 >> 172.21.15.12:0/1913023534 conn(0x7f14fc00a500 msgr2=0x7f14fc02a480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:51.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f1503fff640 1 -- 172.21.15.12:0/1913023534 shutdown_connections 2023-10-16T23:27:51.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f1503fff640 1 -- 172.21.15.12:0/1913023534 wait complete. 2023-10-16T23:27:51.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f1c6d2c2640 1 -- 172.21.15.12:0/1222646165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1c600414f0 con 0x7f1c60046930 2023-10-16T23:27:51.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f5815fac640 1 -- 172.21.15.12:0/2540608853 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f57f0065e60 msgr2=0x7f57f0068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f5815fac640 1 --2- 172.21.15.12:0/2540608853 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f57f0065e60 0x7f57f0068320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f58000ad000 tx=0x7f58000a6000 comp rx=0 tx=0).stop 2023-10-16T23:27:51.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f5815fac640 1 -- 172.21.15.12:0/2540608853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f581006e520 msgr2=0x7f58101520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f5815fac640 1 --2- 172.21.15.12:0/2540608853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f581006e520 0x7f58101520f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f580800efc0 tx=0x7f580800c490 comp rx=0 tx=0).stop 2023-10-16T23:27:51.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f1c64ff9640 1 -- 172.21.15.12:0/1222646165 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1c5c017020 con 0x7f1c60046930 2023-10-16T23:27:51.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f5815fac640 1 -- 172.21.15.12:0/2540608853 shutdown_connections 2023-10-16T23:27:51.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f5815fac640 1 --2- 172.21.15.12:0/2540608853 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f57f0065e60 0x7f57f0068320 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f5815fac640 1 --2- 172.21.15.12:0/2540608853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5810146150 0x7f58101465b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f5815fac640 1 --2- 172.21.15.12:0/2540608853 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58101571a0 0x7f5810152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f5815fac640 1 --2- 172.21.15.12:0/2540608853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f581006e520 0x7f58101520f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f5815fac640 1 -- 172.21.15.12:0/2540608853 >> 172.21.15.12:0/2540608853 conn(0x7f58100c0640 msgr2=0x7f58100c0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:51.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f5815fac640 1 -- 172.21.15.12:0/2540608853 shutdown_connections 2023-10-16T23:27:51.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f5815fac640 1 -- 172.21.15.12:0/2540608853 wait complete. 2023-10-16T23:27:51.501 INFO:teuthology.orchestra.run.smithi012.stdout:64424509446 2023-10-16T23:27:51.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f554b841640 1 -- 172.21.15.12:0/2553096282 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5528065eb0 msgr2=0x7f5528068370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f554b841640 1 --2- 172.21.15.12:0/2553096282 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5528065eb0 0x7f5528068370 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f553c01d1e0 tx=0x7f553c0a7070 comp rx=0 tx=0).stop 2023-10-16T23:27:51.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f554b841640 1 -- 172.21.15.12:0/2553096282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55440c5a80 msgr2=0x7f5544147100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f554b841640 1 --2- 172.21.15.12:0/2553096282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55440c5a80 0x7f5544147100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f553400c3e0 tx=0x7f553400c8a0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f554b841640 1 -- 172.21.15.12:0/2553096282 shutdown_connections 2023-10-16T23:27:51.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f554b841640 1 --2- 172.21.15.12:0/2553096282 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5528065eb0 0x7f5528068370 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f554b841640 1 --2- 172.21.15.12:0/2553096282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55440c5a80 0x7f5544147100 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f554b841640 1 --2- 172.21.15.12:0/2553096282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55440c4ed0 0x7f55441ec8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f554b841640 1 --2- 172.21.15.12:0/2553096282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f554406e490 0x7f55441ef640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f554b841640 1 -- 172.21.15.12:0/2553096282 >> 172.21.15.12:0/2553096282 conn(0x7f554406b400 msgr2=0x7f55440c6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:51.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7fecdfd2c640 1 -- 172.21.15.12:0/1537729373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fecd80c0d80 con 0x7fecd80b37e0 2023-10-16T23:27:51.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7fecce7fc640 1 -- 172.21.15.12:0/1537729373 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fecd40ba090 con 0x7fecd80b37e0 2023-10-16T23:27:51.505 INFO:teuthology.orchestra.run.smithi012.stdout:64424509446 2023-10-16T23:27:51.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f1c6d2c2640 1 -- 172.21.15.12:0/1222646165 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1c4c065e60 msgr2=0x7f1c4c068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f1c6d2c2640 1 --2- 172.21.15.12:0/1222646165 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1c4c065e60 0x7f1c4c068320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1c540ad000 tx=0x7f1c54008040 comp rx=0 tx=0).stop 2023-10-16T23:27:51.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f1c6d2c2640 1 -- 172.21.15.12:0/1222646165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c60046930 msgr2=0x7f1c6017e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f1c6d2c2640 1 --2- 172.21.15.12:0/1222646165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c60046930 0x7f1c6017e290 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00e7f0 tx=0x7f1c5c00ecb0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f1c6d2c2640 1 -- 172.21.15.12:0/1222646165 shutdown_connections 2023-10-16T23:27:51.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f1c6d2c2640 1 --2- 172.21.15.12:0/1222646165 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1c4c065e60 0x7f1c4c068320 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f1c6d2c2640 1 --2- 172.21.15.12:0/1222646165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c60046930 0x7f1c6017e290 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f1c6d2c2640 1 --2- 172.21.15.12:0/1222646165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c6002aa60 0x7f1c600cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f1c6d2c2640 1 --2- 172.21.15.12:0/1222646165 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c60007140 0x7f1c6003d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f1c6d2c2640 1 -- 172.21.15.12:0/1222646165 >> 172.21.15.12:0/1222646165 conn(0x7f1c6000a500 msgr2=0x7f1c600d28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:51.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f1c6d2c2640 1 -- 172.21.15.12:0/1222646165 shutdown_connections 2023-10-16T23:27:51.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.492+0000 7f1c6d2c2640 1 -- 172.21.15.12:0/1222646165 wait complete. 2023-10-16T23:27:51.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.496+0000 7fecdfd2c640 1 -- 172.21.15.12:0/1537729373 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fecbc065e60 msgr2=0x7fecbc068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.496+0000 7fecdfd2c640 1 --2- 172.21.15.12:0/1537729373 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fecbc065e60 0x7fecbc068320 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fecd814dd60 tx=0x7fecd0009040 comp rx=0 tx=0).stop 2023-10-16T23:27:51.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.496+0000 7fecdfd2c640 1 -- 172.21.15.12:0/1537729373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecd80b37e0 msgr2=0x7fecd80b6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.496+0000 7fecdfd2c640 1 --2- 172.21.15.12:0/1537729373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecd80b37e0 0x7fecd80b6690 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fecd4022af0 tx=0x7fecd4021c60 comp rx=0 tx=0).stop 2023-10-16T23:27:51.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.496+0000 7f554b841640 1 -- 172.21.15.12:0/2553096282 shutdown_connections 2023-10-16T23:27:51.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.496+0000 7fecdfd2c640 1 -- 172.21.15.12:0/1537729373 shutdown_connections 2023-10-16T23:27:51.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.496+0000 7fecdfd2c640 1 --2- 172.21.15.12:0/1537729373 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fecbc065e60 0x7fecbc068320 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.496+0000 7f554b841640 1 -- 172.21.15.12:0/2553096282 wait complete. 2023-10-16T23:27:51.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.496+0000 7fecdfd2c640 1 --2- 172.21.15.12:0/1537729373 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fecd80ba7d0 0x7fecd80b6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.496+0000 7fecdfd2c640 1 --2- 172.21.15.12:0/1537729373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fecd80b37e0 0x7fecd80b6690 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.496+0000 7fecdfd2c640 1 --2- 172.21.15.12:0/1537729373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fecd806bf20 0x7fecd80bf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.496+0000 7fecdfd2c640 1 -- 172.21.15.12:0/1537729373 >> 172.21.15.12:0/1537729373 conn(0x7fecd806b400 msgr2=0x7fecd8145e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:51.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.496+0000 7fecdfd2c640 1 -- 172.21.15.12:0/1537729373 shutdown_connections 2023-10-16T23:27:51.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.496+0000 7fecdfd2c640 1 -- 172.21.15.12:0/1537729373 wait complete. 2023-10-16T23:27:51.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.508+0000 7f4aa8b3d640 1 -- 172.21.15.12:0/734111224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4a840057e0 con 0x7f4aa413bd80 2023-10-16T23:27:51.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.512+0000 7f4a8bfff640 1 -- 172.21.15.12:0/734111224 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4a9c017090 con 0x7f4aa413bd80 2023-10-16T23:27:51.515 INFO:teuthology.orchestra.run.smithi012.stdout:64424509448 2023-10-16T23:27:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.512+0000 7f4aa8b3d640 1 -- 172.21.15.12:0/734111224 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4a90065eb0 msgr2=0x7f4a90068370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.512+0000 7f4aa8b3d640 1 --2- 172.21.15.12:0/734111224 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4a90065eb0 0x7f4a90068370 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4a940016f0 tx=0x7f4a94009040 comp rx=0 tx=0).stop 2023-10-16T23:27:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.512+0000 7f4aa8b3d640 1 -- 172.21.15.12:0/734111224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa413bd80 msgr2=0x7f4aa414dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.512+0000 7f4aa8b3d640 1 --2- 172.21.15.12:0/734111224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa413bd80 0x7f4aa414dae0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c00cab0 tx=0x7f4a9c00cf70 comp rx=0 tx=0).stop 2023-10-16T23:27:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.516+0000 7f4aa8b3d640 1 -- 172.21.15.12:0/734111224 shutdown_connections 2023-10-16T23:27:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.516+0000 7f4aa8b3d640 1 --2- 172.21.15.12:0/734111224 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4a90065eb0 0x7f4a90068370 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.516+0000 7f4aa8b3d640 1 --2- 172.21.15.12:0/734111224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aa413bd80 0x7f4aa414dae0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.516+0000 7f4aa8b3d640 1 --2- 172.21.15.12:0/734111224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4aa414eda0 0x7f4aa414d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.516+0000 7f4aa8b3d640 1 --2- 172.21.15.12:0/734111224 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4aa40c1ff0 0x7f4aa4140f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:51.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.516+0000 7f4aa8b3d640 1 -- 172.21.15.12:0/734111224 >> 172.21.15.12:0/734111224 conn(0x7f4aa402b760 msgr2=0x7f4aa414fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:51.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.516+0000 7f4aa8b3d640 1 -- 172.21.15.12:0/734111224 shutdown_connections 2023-10-16T23:27:51.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:51.516+0000 7f4aa8b3d640 1 -- 172.21.15.12:0/734111224 wait complete. 2023-10-16T23:27:51.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.7 2023-10-16T23:27:51.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.3 2023-10-16T23:27:51.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.2 2023-10-16T23:27:51.534 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.6 2023-10-16T23:27:51.535 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.1 2023-10-16T23:27:51.536 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.5 2023-10-16T23:27:51.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.4 2023-10-16T23:27:52.491 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-16T23:27:52.522 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-16T23:27:52.522 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-16T23:27:52.529 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-16T23:27:52.536 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-16T23:27:52.536 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-16T23:27:52.537 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-16T23:27:52.544 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-16T23:27:52.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.672+0000 7f7b03336640 1 Processor -- start 2023-10-16T23:27:52.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.672+0000 7f7b03336640 1 -- start start 2023-10-16T23:27:52.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.672+0000 7f7b03336640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7afc0ba7d0 0x7f7afc06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.672+0000 7f7b03336640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7afc06f340 con 0x7f7afc0bd850 2023-10-16T23:27:52.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.672+0000 7f7b03336640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7afc0bcbb0 con 0x7f7afc14a690 2023-10-16T23:27:52.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.672+0000 7f7b03336640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7afc070b80 con 0x7f7afc0ba7d0 2023-10-16T23:27:52.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.672+0000 7f7b010d2640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7afc0bd850 0x7f7afc0b37e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38244/0 (socket says 172.21.15.12:38244) 2023-10-16T23:27:52.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.672+0000 7f7b010d2640 1 -- 172.21.15.12:0/2240588328 learned_addr learned my addr 172.21.15.12:0/2240588328 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:52.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.672+0000 7f7b008d1640 1 --2- 172.21.15.12:0/2240588328 >> v2:172.21.15.31:3300/0 conn(0x7f7afc0ba7d0 0x7f7afc06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.672+0000 7f7af3fff640 1 -- 172.21.15.12:0/2240588328 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1306371770 0 0) 0x7f7afc06f340 con 0x7f7afc0bd850 2023-10-16T23:27:52.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.672+0000 7f7af3fff640 1 -- 172.21.15.12:0/2240588328 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ae8003530 con 0x7f7afc0bd850 2023-10-16T23:27:52.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.672+0000 7f7b008d1640 1 -- 172.21.15.12:0/2240588328 >> v1:172.21.15.31:6789/0 conn(0x7f7afc14a690 legacy=0x7f7afc14aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.672+0000 7f7b008d1640 1 -- 172.21.15.12:0/2240588328 >> v1:172.21.15.12:6789/0 conn(0x7f7afc0bd850 legacy=0x7f7afc0b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.672+0000 7f7b008d1640 1 -- 172.21.15.12:0/2240588328 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7afc14f1e0 con 0x7f7afc0ba7d0 2023-10-16T23:27:52.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.676+0000 7f7b008d1640 1 --2- 172.21.15.12:0/2240588328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7afc0ba7d0 0x7f7afc06ee00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7af400c2e0 tx=0x7f7af401de30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d437ccd765f6e6f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:52.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.676+0000 7f7af3fff640 1 -- 172.21.15.12:0/2240588328 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af40a6cf0 con 0x7f7afc0ba7d0 2023-10-16T23:27:52.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.676+0000 7f7af3fff640 1 -- 172.21.15.12:0/2240588328 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af40a6e50 con 0x7f7afc0ba7d0 2023-10-16T23:27:52.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.676+0000 7f7b03336640 1 -- 172.21.15.12:0/2240588328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7afc0ba7d0 msgr2=0x7f7afc06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.676+0000 7f7b03336640 1 --2- 172.21.15.12:0/2240588328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7afc0ba7d0 0x7f7afc06ee00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7af400c2e0 tx=0x7f7af401de30 comp rx=0 tx=0).stop 2023-10-16T23:27:52.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.680+0000 7f7b03336640 1 -- 172.21.15.12:0/2240588328 shutdown_connections 2023-10-16T23:27:52.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.680+0000 7f7b03336640 1 --2- 172.21.15.12:0/2240588328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7afc0ba7d0 0x7f7afc06ee00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.680+0000 7f7b03336640 1 -- 172.21.15.12:0/2240588328 >> 172.21.15.12:0/2240588328 conn(0x7f7afc06b400 msgr2=0x7f7afc06b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:52.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.680+0000 7f7b03336640 1 -- 172.21.15.12:0/2240588328 shutdown_connections 2023-10-16T23:27:52.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.680+0000 7f7b03336640 1 -- 172.21.15.12:0/2240588328 wait complete. 2023-10-16T23:27:52.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.680+0000 7f7b03336640 1 Processor -- start 2023-10-16T23:27:52.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.680+0000 7f7b03336640 1 -- start start 2023-10-16T23:27:52.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.680+0000 7f7b03336640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7afc0bd850 0x7f7afc0c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.680+0000 7f7b03336640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7afc14a690 0x7f7afc0b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.680+0000 7f7b03336640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7afc0b4370 0x7f7afc1ef010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.680+0000 7f7b03336640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc1405e0 con 0x7f7afc14a690 2023-10-16T23:27:52.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.680+0000 7f7b03336640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc14a280 con 0x7f7afc0bd850 2023-10-16T23:27:52.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.680+0000 7f7b03336640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc0c1430 con 0x7f7afc0b4370 2023-10-16T23:27:52.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.680+0000 7f7b008d1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7afc14a690 0x7f7afc0b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.680+0000 7f7b008d1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7afc14a690 0x7f7afc0b5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55822/0 (socket says 172.21.15.12:55822) 2023-10-16T23:27:52.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.680+0000 7f7b008d1640 1 -- 172.21.15.12:0/2636615920 learned_addr learned my addr 172.21.15.12:0/2636615920 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:52.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.680+0000 7f7b010d2640 1 --2- 172.21.15.12:0/2636615920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7afc0bd850 0x7f7afc0c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.680+0000 7f7b018d3640 1 --2- 172.21.15.12:0/2636615920 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7afc0b4370 0x7f7afc1ef010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.684+0000 7f7b008d1640 1 -- 172.21.15.12:0/2636615920 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7afc0b4370 msgr2=0x7f7afc1ef010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.684+0000 7f7b008d1640 1 --2- 172.21.15.12:0/2636615920 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7afc0b4370 0x7f7afc1ef010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.684+0000 7f7b008d1640 1 -- 172.21.15.12:0/2636615920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7afc0bd850 msgr2=0x7f7afc0c0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.684+0000 7f7b008d1640 1 --2- 172.21.15.12:0/2636615920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7afc0bd850 0x7f7afc0c0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.684+0000 7f7b008d1640 1 -- 172.21.15.12:0/2636615920 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af400c050 con 0x7f7afc14a690 2023-10-16T23:27:52.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.684+0000 7f7b018d3640 1 --2- 172.21.15.12:0/2636615920 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7afc0b4370 0x7f7afc1ef010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:27:52.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.684+0000 7f7b008d1640 1 --2- 172.21.15.12:0/2636615920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7afc14a690 0x7f7afc0b5210 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7af401aa40 tx=0x7f7af401abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:52.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.684+0000 7f7af1ffb640 1 -- 172.21.15.12:0/2636615920 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af400a690 con 0x7f7afc14a690 2023-10-16T23:27:52.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.684+0000 7f7b03336640 1 -- 172.21.15.12:0/2636615920 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7afc149f50 con 0x7f7afc14a690 2023-10-16T23:27:52.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.684+0000 7f7b03336640 1 -- 172.21.15.12:0/2636615920 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7afc0b5750 con 0x7f7afc14a690 2023-10-16T23:27:52.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.684+0000 7f7af1ffb640 1 -- 172.21.15.12:0/2636615920 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af400a7f0 con 0x7f7afc14a690 2023-10-16T23:27:52.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.684+0000 7f7af1ffb640 1 -- 172.21.15.12:0/2636615920 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af4007e30 con 0x7f7afc14a690 2023-10-16T23:27:52.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.684+0000 7f7af1ffb640 1 -- 172.21.15.12:0/2636615920 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f7af40b9470 con 0x7f7afc14a690 2023-10-16T23:27:52.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.684+0000 7f7af1ffb640 1 --2- 172.21.15.12:0/2636615920 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7ae0065f60 0x7f7ae0068420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.684+0000 7f7af1ffb640 1 -- 172.21.15.12:0/2636615920 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7af411f190 con 0x7f7afc14a690 2023-10-16T23:27:52.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.688+0000 7f7b010d2640 1 --2- 172.21.15.12:0/2636615920 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7ae0065f60 0x7f7ae0068420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.688+0000 7f7b03336640 1 -- 172.21.15.12:0/2636615920 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7adc005260 con 0x7f7afc14a690 2023-10-16T23:27:52.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.688+0000 7f7b010d2640 1 --2- 172.21.15.12:0/2636615920 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7ae0065f60 0x7f7ae0068420 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7aec007fd0 tx=0x7f7aec009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:52.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.696+0000 7f7af1ffb640 1 -- 172.21.15.12:0/2636615920 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f7af40ec730 con 0x7f7afc14a690 2023-10-16T23:27:52.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.708+0000 7f2088208640 1 Processor -- start 2023-10-16T23:27:52.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.708+0000 7f2088208640 1 -- start start 2023-10-16T23:27:52.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.708+0000 7f2088208640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f207803c640 0x7f2078043600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.708+0000 7f2088208640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f207802ea40 0x7f2078043b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.708+0000 7f2088208640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20780d3830 con 0x7f2078028270 2023-10-16T23:27:52.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.708+0000 7f2088208640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20780d46d0 con 0x7f207802ea40 2023-10-16T23:27:52.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.708+0000 7f2088208640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20780d4af0 con 0x7f207803c640 2023-10-16T23:27:52.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.708+0000 7f20867a5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f207802ea40 0x7f2078043b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.708+0000 7f20867a5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f207802ea40 0x7f2078043b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55834/0 (socket says 172.21.15.12:55834) 2023-10-16T23:27:52.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.708+0000 7f20867a5640 1 -- 172.21.15.12:0/42964590 learned_addr learned my addr 172.21.15.12:0/42964590 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:52.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.708+0000 7f20857a3640 1 --2- 172.21.15.12:0/42964590 >> v2:172.21.15.31:3300/0 conn(0x7f207803c640 0x7f2078043600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.708+0000 7f20867a5640 1 -- 172.21.15.12:0/42964590 >> v2:172.21.15.31:3300/0 conn(0x7f207803c640 msgr2=0x7f2078043600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:52.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.708+0000 7f20867a5640 1 --2- 172.21.15.12:0/42964590 >> v2:172.21.15.31:3300/0 conn(0x7f207803c640 0x7f2078043600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.708+0000 7f20867a5640 1 -- 172.21.15.12:0/42964590 >> v1:172.21.15.31:6789/0 conn(0x7f2078028270 legacy=0x7f2078048600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.708+0000 7f20867a5640 1 -- 172.21.15.12:0/42964590 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2078047d60 con 0x7f207802ea40 2023-10-16T23:27:52.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.712+0000 7f20867a5640 1 --2- 172.21.15.12:0/42964590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f207802ea40 0x7f2078043b40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2080000b70 tx=0x7f2080096150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c003fe8f8c87bca server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:52.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.712+0000 7f2084fa2640 1 -- 172.21.15.12:0/42964590 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2080126440 con 0x7f207802ea40 2023-10-16T23:27:52.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.712+0000 7f2084fa2640 1 -- 172.21.15.12:0/42964590 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20801265a0 con 0x7f207802ea40 2023-10-16T23:27:52.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.716+0000 7f2084fa2640 1 -- 172.21.15.12:0/42964590 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20801269d0 con 0x7f207802ea40 2023-10-16T23:27:52.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.716+0000 7f2088208640 1 -- 172.21.15.12:0/42964590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f207802ea40 msgr2=0x7f2078043b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.716+0000 7f2088208640 1 --2- 172.21.15.12:0/42964590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f207802ea40 0x7f2078043b40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2080000b70 tx=0x7f2080096150 comp rx=0 tx=0).stop 2023-10-16T23:27:52.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.716+0000 7f2088208640 1 -- 172.21.15.12:0/42964590 shutdown_connections 2023-10-16T23:27:52.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.716+0000 7f2088208640 1 --2- 172.21.15.12:0/42964590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f207802ea40 0x7f2078043b40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.716+0000 7f2088208640 1 --2- 172.21.15.12:0/42964590 >> v2:172.21.15.31:3300/0 conn(0x7f207803c640 0x7f2078043600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.716+0000 7f2088208640 1 -- 172.21.15.12:0/42964590 >> 172.21.15.12:0/42964590 conn(0x7f2078045a30 msgr2=0x7f2078045e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:52.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.716+0000 7f2088208640 1 -- 172.21.15.12:0/42964590 shutdown_connections 2023-10-16T23:27:52.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.716+0000 7f2088208640 1 -- 172.21.15.12:0/42964590 wait complete. 2023-10-16T23:27:52.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.716+0000 7f2088208640 1 Processor -- start 2023-10-16T23:27:52.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.716+0000 7f2088208640 1 -- start start 2023-10-16T23:27:52.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.716+0000 7f2088208640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2078028270 0x7f207803f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.716+0000 7f2088208640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f207802ea40 0x7f207803ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.716+0000 7f2088208640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f207803c640 0x7f2078172ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.716+0000 7f2088208640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207803f730 con 0x7f2078028270 2023-10-16T23:27:52.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.716+0000 7f2088208640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207803d3f0 con 0x7f207803c640 2023-10-16T23:27:52.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.716+0000 7f2088208640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f207803d6f0 con 0x7f207802ea40 2023-10-16T23:27:52.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.716+0000 7f2085fa4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2078028270 0x7f207803f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.716+0000 7f2085fa4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2078028270 0x7f207803f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55844/0 (socket says 172.21.15.12:55844) 2023-10-16T23:27:52.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.716+0000 7f2085fa4640 1 -- 172.21.15.12:0/2869672898 learned_addr learned my addr 172.21.15.12:0/2869672898 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:52.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.716+0000 7f20857a3640 1 --2- 172.21.15.12:0/2869672898 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f207802ea40 0x7f207803ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.716+0000 7f20867a5640 1 --2- 172.21.15.12:0/2869672898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f207803c640 0x7f2078172ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f2085fa4640 1 -- 172.21.15.12:0/2869672898 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f207802ea40 msgr2=0x7f207803ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f2085fa4640 1 --2- 172.21.15.12:0/2869672898 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f207802ea40 0x7f207803ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f2085fa4640 1 -- 172.21.15.12:0/2869672898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f207803c640 msgr2=0x7f2078172ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f2085fa4640 1 --2- 172.21.15.12:0/2869672898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f207803c640 0x7f2078172ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f2085fa4640 1 -- 172.21.15.12:0/2869672898 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207803d990 con 0x7f2078028270 2023-10-16T23:27:52.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f2085fa4640 1 --2- 172.21.15.12:0/2869672898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2078028270 0x7f207803f1f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f207000c5d0 tx=0x7f207000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:52.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f20767fc640 1 -- 172.21.15.12:0/2869672898 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2070005480 con 0x7f2078028270 2023-10-16T23:27:52.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f20767fc640 1 -- 172.21.15.12:0/2869672898 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2070003600 con 0x7f2078028270 2023-10-16T23:27:52.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f20767fc640 1 -- 172.21.15.12:0/2869672898 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20700039b0 con 0x7f2078028270 2023-10-16T23:27:52.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f47a8a0b640 1 Processor -- start 2023-10-16T23:27:52.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f2088208640 1 -- 172.21.15.12:0/2869672898 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20780089a0 con 0x7f2078028270 2023-10-16T23:27:52.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f2088208640 1 -- 172.21.15.12:0/2869672898 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2078009ac0 con 0x7f2078028270 2023-10-16T23:27:52.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f5e99415640 1 Processor -- start 2023-10-16T23:27:52.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f47a8a0b640 1 -- start start 2023-10-16T23:27:52.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f47a8a0b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f47a414ada0 0x7f47a406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f47a8a0b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a406f340 con 0x7f47a40bd850 2023-10-16T23:27:52.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f47a8a0b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a40bcbb0 con 0x7f47a40ba7d0 2023-10-16T23:27:52.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f47a8a0b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a4070b80 con 0x7f47a414ada0 2023-10-16T23:27:52.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f5e99415640 1 -- start start 2023-10-16T23:27:52.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f47a259c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f47a40bd850 0x7f47a40b37e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38252/0 (socket says 172.21.15.12:38252) 2023-10-16T23:27:52.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f47a259c640 1 -- 172.21.15.12:0/1594333030 learned_addr learned my addr 172.21.15.12:0/1594333030 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:52.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f47a2d9d640 1 --2- 172.21.15.12:0/1594333030 >> v2:172.21.15.31:3300/0 conn(0x7f47a414ada0 0x7f47a406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f47a159a640 1 -- 172.21.15.12:0/1594333030 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3085257618 0 0) 0x7f47a406f340 con 0x7f47a40bd850 2023-10-16T23:27:52.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f47a159a640 1 -- 172.21.15.12:0/1594333030 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f478c003530 con 0x7f47a40bd850 2023-10-16T23:27:52.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f5e99415640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5e940b7f30 0x7f5e94152c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f5e99415640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e940bc240 0x7f5e941531b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f5e99415640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e940b6fe0 con 0x7f5e940bbcf0 2023-10-16T23:27:52.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f5e99415640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e940b7470 con 0x7f5e940bc240 2023-10-16T23:27:52.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7f5e99415640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e940bc790 con 0x7f5e940b7f30 2023-10-16T23:27:52.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7f5e93fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5e940b7f30 0x7f5e94152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7f5e93fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5e940b7f30 0x7f5e94152c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:36544/0 (socket says 172.21.15.12:36544) 2023-10-16T23:27:52.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7f5e93fff640 1 -- 172.21.15.12:0/703882155 learned_addr learned my addr 172.21.15.12:0/703882155 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:52.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7f5e98c14640 1 --2- 172.21.15.12:0/703882155 >> v2:172.21.15.12:3300/0 conn(0x7f5e940bc240 0x7f5e941531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7f20767fc640 1 -- 172.21.15.12:0/2869672898 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f2070003b10 con 0x7f2078028270 2023-10-16T23:27:52.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7f2088208640 1 -- 172.21.15.12:0/2869672898 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2068005260 con 0x7f2078028270 2023-10-16T23:27:52.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7f47a2d9d640 1 -- 172.21.15.12:0/1594333030 >> v1:172.21.15.31:6789/0 conn(0x7f47a40ba7d0 legacy=0x7f47a414a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7f47a2d9d640 1 -- 172.21.15.12:0/1594333030 >> v1:172.21.15.12:6789/0 conn(0x7f47a40bd850 legacy=0x7f47a40b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7f47a2d9d640 1 -- 172.21.15.12:0/1594333030 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a414f1e0 con 0x7f47a414ada0 2023-10-16T23:27:52.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7f20767fc640 1 --2- 172.21.15.12:0/2869672898 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f206c065fd0 0x7f206c068490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7f20767fc640 1 -- 172.21.15.12:0/2869672898 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2070082d70 con 0x7f2078028270 2023-10-16T23:27:52.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7f5e93fff640 1 -- 172.21.15.12:0/703882155 >> v2:172.21.15.12:3300/0 conn(0x7f5e940bc240 msgr2=0x7f5e941531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:52.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7f5e93fff640 1 --2- 172.21.15.12:0/703882155 >> v2:172.21.15.12:3300/0 conn(0x7f5e940bc240 0x7f5e941531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7f5e93fff640 1 -- 172.21.15.12:0/703882155 >> v1:172.21.15.12:6789/0 conn(0x7f5e940bbcf0 legacy=0x7f5e94156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7f5e93fff640 1 -- 172.21.15.12:0/703882155 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e940bca70 con 0x7f5e940b7f30 2023-10-16T23:27:52.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7f20857a3640 1 --2- 172.21.15.12:0/2869672898 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f206c065fd0 0x7f206c068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7f20857a3640 1 --2- 172.21.15.12:0/2869672898 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f206c065fd0 0x7f206c068490 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f20780486e0 tx=0x7f207c009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:52.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7f3c83a1d640 1 Processor -- start 2023-10-16T23:27:52.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7f72385ec640 1 Processor -- start 2023-10-16T23:27:52.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7f3c83a1d640 1 -- start start 2023-10-16T23:27:52.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7f72385ec640 1 -- start start 2023-10-16T23:27:52.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f47a2d9d640 1 --2- 172.21.15.12:0/1594333030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47a414ada0 0x7f47a406ee00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4794009740 tx=0x7f479401c2b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1c7be5e9a2a265d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f47a159a640 1 -- 172.21.15.12:0/1594333030 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47940ab600 con 0x7f47a414ada0 2023-10-16T23:27:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f3c83a1d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3c7c14ecd0 0x7f3c7c06ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f3c83a1d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c7c0709f0 0x7f3c7c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f3c83a1d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c7c06e770 con 0x7f3c7c0bd240 2023-10-16T23:27:52.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f3c83a1d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c7c0701e0 con 0x7f3c7c14ecd0 2023-10-16T23:27:52.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f3c83a1d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c0b3c30 con 0x7f3c7c0709f0 2023-10-16T23:27:52.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f3c80fb8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c7c0709f0 0x7f3c7c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f3c80fb8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c7c0709f0 0x7f3c7c06fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:51176/0 (socket says 172.21.15.12:51176) 2023-10-16T23:27:52.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f72385ec640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7228008da0 0x7f722802dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f72385ec640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f722802b040 0x7f7228042f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f72385ec640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7228042780 con 0x7f72280429a0 2023-10-16T23:27:52.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f72385ec640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72280470a0 con 0x7f722802b040 2023-10-16T23:27:52.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f72385ec640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f722800c340 con 0x7f7228008da0 2023-10-16T23:27:52.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f3c80fb8640 1 -- 172.21.15.12:0/2736481979 learned_addr learned my addr 172.21.15.12:0/2736481979 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:52.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f3c817b9640 1 --2- 172.21.15.12:0/2736481979 >> v2:172.21.15.12:3300/0 conn(0x7f3c7c14ecd0 0x7f3c7c06ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f7236b89640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f72280429a0 0x7f7228045e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38276/0 (socket says 172.21.15.12:38276) 2023-10-16T23:27:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f7236b89640 1 -- 172.21.15.12:0/2078749146 learned_addr learned my addr 172.21.15.12:0/2078749146 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f7235b87640 1 --2- 172.21.15.12:0/2078749146 >> v2:172.21.15.31:3300/0 conn(0x7f722802b040 0x7f7228042f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f5e93fff640 1 --2- 172.21.15.12:0/703882155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e940b7f30 0x7f5e94152c70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5e940bdec0 tx=0x7f5e8401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66459d15af8319dd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:52.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f3c80fb8640 1 -- 172.21.15.12:0/2736481979 >> v2:172.21.15.12:3300/0 conn(0x7f3c7c14ecd0 msgr2=0x7f3c7c06ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:52.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f7236388640 1 --2- 172.21.15.12:0/2078749146 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7228008da0 0x7f722802dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f7235b87640 1 -- 172.21.15.12:0/2078749146 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7228008da0 msgr2=0x7f722802dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:52.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f7235b87640 1 --2- 172.21.15.12:0/2078749146 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7228008da0 0x7f722802dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f7235b87640 1 -- 172.21.15.12:0/2078749146 >> v1:172.21.15.12:6789/0 conn(0x7f72280429a0 legacy=0x7f7228045e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f7235b87640 1 -- 172.21.15.12:0/2078749146 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72280277c0 con 0x7f722802b040 2023-10-16T23:27:52.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f47a159a640 1 -- 172.21.15.12:0/1594333030 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47940a7050 con 0x7f47a414ada0 2023-10-16T23:27:52.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f47a159a640 1 -- 172.21.15.12:0/1594333030 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47940ab960 con 0x7f47a414ada0 2023-10-16T23:27:52.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f47a8a0b640 1 -- 172.21.15.12:0/1594333030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47a414ada0 msgr2=0x7f47a406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f47a8a0b640 1 --2- 172.21.15.12:0/1594333030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47a414ada0 0x7f47a406ee00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4794009740 tx=0x7f479401c2b0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f47a8a0b640 1 -- 172.21.15.12:0/1594333030 shutdown_connections 2023-10-16T23:27:52.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f47a8a0b640 1 --2- 172.21.15.12:0/1594333030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47a414ada0 0x7f47a406ee00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f47a8a0b640 1 -- 172.21.15.12:0/1594333030 >> 172.21.15.12:0/1594333030 conn(0x7f47a406b400 msgr2=0x7f47a406b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:52.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f5e937fe640 1 -- 172.21.15.12:0/703882155 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e840ad680 con 0x7f5e940b7f30 2023-10-16T23:27:52.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f5e937fe640 1 -- 172.21.15.12:0/703882155 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e840ad7e0 con 0x7f5e940b7f30 2023-10-16T23:27:52.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f5e937fe640 1 -- 172.21.15.12:0/703882155 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e840adb70 con 0x7f5e940b7f30 2023-10-16T23:27:52.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f5e99415640 1 -- 172.21.15.12:0/703882155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e940b7f30 msgr2=0x7f5e94152c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f5e99415640 1 --2- 172.21.15.12:0/703882155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e940b7f30 0x7f5e94152c70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5e940bdec0 tx=0x7f5e8401c470 comp rx=0 tx=0).stop 2023-10-16T23:27:52.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f47a8a0b640 1 -- 172.21.15.12:0/1594333030 shutdown_connections 2023-10-16T23:27:52.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f5e99415640 1 -- 172.21.15.12:0/703882155 shutdown_connections 2023-10-16T23:27:52.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f5e99415640 1 --2- 172.21.15.12:0/703882155 >> v2:172.21.15.12:3300/0 conn(0x7f5e940bc240 0x7f5e941531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f5e99415640 1 --2- 172.21.15.12:0/703882155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e940b7f30 0x7f5e94152c70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f5e99415640 1 -- 172.21.15.12:0/703882155 >> 172.21.15.12:0/703882155 conn(0x7f5e940c1ca0 msgr2=0x7f5e940c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:52.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.720+0000 7fdbaf4c7640 1 Processor -- start 2023-10-16T23:27:52.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7fdbaf4c7640 1 -- start start 2023-10-16T23:27:52.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7fdbaf4c7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdba8070630 0x7fdba80baea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7fdbaf4c7640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdba815d090 0x7fdba80bb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7fdbaf4c7640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba806ea50 con 0x7fdba80bd6d0 2023-10-16T23:27:52.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7fdbaf4c7640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba80ba1e0 con 0x7fdba8070630 2023-10-16T23:27:52.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7fdbaf4c7640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba806e770 con 0x7fdba815d090 2023-10-16T23:27:52.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7fdbad263640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fdba80bd6d0 0x7fdba815c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:49370/0 (socket says 172.21.15.12:49370) 2023-10-16T23:27:52.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7fdbad263640 1 -- 172.21.15.12:0/3345538134 learned_addr learned my addr 172.21.15.12:0/3345538134 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:52.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7fdbada64640 1 --2- 172.21.15.12:0/3345538134 >> v2:172.21.15.31:3300/0 conn(0x7fdba815d090 0x7fdba80bb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.724+0000 7fdb9ffff640 1 -- 172.21.15.12:0/3345538134 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 228936979 0 0) 0x7fdba806ea50 con 0x7fdba80bd6d0 2023-10-16T23:27:52.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7fdb9ffff640 1 -- 172.21.15.12:0/3345538134 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb94005740 con 0x7fdba80bd6d0 2023-10-16T23:27:52.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7fdbaca62640 1 --2- 172.21.15.12:0/3345538134 >> v2:172.21.15.12:3300/0 conn(0x7fdba8070630 0x7fdba80baea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7fdb9ffff640 1 -- 172.21.15.12:0/3345538134 <== mon.1 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3019712323 0 0) 0x7fdb94005740 con 0x7fdba80bd6d0 2023-10-16T23:27:52.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7fdb9ffff640 1 -- 172.21.15.12:0/3345538134 >> v2:172.21.15.31:3300/0 conn(0x7fdba815d090 msgr2=0x7fdba80bb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:52.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7fdb9ffff640 1 --2- 172.21.15.12:0/3345538134 >> v2:172.21.15.31:3300/0 conn(0x7fdba815d090 0x7fdba80bb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7fdb9ffff640 1 -- 172.21.15.12:0/3345538134 >> v2:172.21.15.12:3300/0 conn(0x7fdba8070630 msgr2=0x7fdba80baea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:52.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7fdb9ffff640 1 --2- 172.21.15.12:0/3345538134 >> v2:172.21.15.12:3300/0 conn(0x7fdba8070630 0x7fdba80baea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7fdb9ffff640 1 -- 172.21.15.12:0/3345538134 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba80ba600 con 0x7fdba80bd6d0 2023-10-16T23:27:52.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7fdb9ffff640 1 -- 172.21.15.12:0/3345538134 <== mon.1 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7fdba4001680 con 0x7fdba80bd6d0 2023-10-16T23:27:52.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7fdb9ffff640 1 -- 172.21.15.12:0/3345538134 >> v1:172.21.15.31:6789/0 conn(0x7fdba80bd6d0 legacy=0x7fdba815c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7fdb9ffff640 1 --2- 172.21.15.12:0/3345538134 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb94005be0 0x7fdb94006000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7fdb9ffff640 1 --2- 172.21.15.12:0/3345538134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb94006540 0x7fdb940069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7fdb9ffff640 1 --2- 172.21.15.12:0/3345538134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb940070f0 0x7fdb9401cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7fdb9ffff640 1 -- 172.21.15.12:0/3345538134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba80ba1e0 con 0x7fdb94006540 2023-10-16T23:27:52.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7fdb9ffff640 1 -- 172.21.15.12:0/3345538134 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba806e770 con 0x7fdb940070f0 2023-10-16T23:27:52.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7fdb9ffff640 1 -- 172.21.15.12:0/3345538134 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9401d0e0 con 0x7fdb94005be0 2023-10-16T23:27:52.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7fdbad263640 1 --2- 172.21.15.12:0/3345538134 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb94005be0 0x7fdb94006000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7fdbada64640 1 --2- 172.21.15.12:0/3345538134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb940070f0 0x7fdb9401cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7fdbad263640 1 -- 172.21.15.12:0/3345538134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb940070f0 msgr2=0x7fdb9401cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:52.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7fdbad263640 1 --2- 172.21.15.12:0/3345538134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb940070f0 0x7fdb9401cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7fdbad263640 1 -- 172.21.15.12:0/3345538134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb94006540 msgr2=0x7fdb940069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:52.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7fdbad263640 1 --2- 172.21.15.12:0/3345538134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb94006540 0x7fdb940069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7fdbad263640 1 -- 172.21.15.12:0/3345538134 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb94005740 con 0x7fdb94005be0 2023-10-16T23:27:52.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7fdbada64640 1 -- 172.21.15.12:0/3345538134 reap_dead start 2023-10-16T23:27:52.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f5e99415640 1 -- 172.21.15.12:0/703882155 shutdown_connections 2023-10-16T23:27:52.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f47a8a0b640 1 -- 172.21.15.12:0/1594333030 wait complete. 2023-10-16T23:27:52.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f47a8a0b640 1 Processor -- start 2023-10-16T23:27:52.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f7235b87640 1 --2- 172.21.15.12:0/2078749146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f722802b040 0x7f7228042f10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f722c0097c0 tx=0x7f722c01c4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2996cf2ab19b4fbe server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:52.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f3c80fb8640 1 --2- 172.21.15.12:0/2736481979 >> v2:172.21.15.12:3300/0 conn(0x7f3c7c14ecd0 0x7f3c7c06ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f7235386640 1 -- 172.21.15.12:0/2078749146 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722c0ab600 con 0x7f722802b040 2023-10-16T23:27:52.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f3c80fb8640 1 -- 172.21.15.12:0/2736481979 >> v1:172.21.15.12:6789/0 conn(0x7f3c7c0bd240 legacy=0x7f3c7c14f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.728+0000 7f3c80fb8640 1 -- 172.21.15.12:0/2736481979 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7c06e9c0 con 0x7f3c7c0709f0 2023-10-16T23:27:52.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f7235386640 1 -- 172.21.15.12:0/2078749146 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722c0a7050 con 0x7f722802b040 2023-10-16T23:27:52.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f7235386640 1 -- 172.21.15.12:0/2078749146 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722c0ab9a0 con 0x7f722802b040 2023-10-16T23:27:52.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f3c817b9640 1 --2- 172.21.15.12:0/2736481979 >> v2:172.21.15.12:3300/0 conn(0x7f3c7c14ecd0 0x7f3c7c06ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:27:52.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f3c80fb8640 1 --2- 172.21.15.12:0/2736481979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c7c0709f0 0x7f3c7c06fca0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c014420 tx=0x7f3c6c025540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16eafe82602ab262 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:52.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f3c73fff640 1 -- 172.21.15.12:0/2736481979 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c0af640 con 0x7f3c7c0709f0 2023-10-16T23:27:52.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f3c73fff640 1 -- 172.21.15.12:0/2736481979 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6c0af7a0 con 0x7f3c7c0709f0 2023-10-16T23:27:52.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f3c73fff640 1 -- 172.21.15.12:0/2736481979 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c0afb10 con 0x7f3c7c0709f0 2023-10-16T23:27:52.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f20767fc640 1 -- 172.21.15.12:0/2869672898 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f2070050500 con 0x7f2078028270 2023-10-16T23:27:52.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f5e99415640 1 -- 172.21.15.12:0/703882155 wait complete. 2023-10-16T23:27:52.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f5e99415640 1 Processor -- start 2023-10-16T23:27:52.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f47a8a0b640 1 -- start start 2023-10-16T23:27:52.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f47a8a0b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47a40ba7d0 0x7f47a4159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f47a8a0b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47a40bd850 0x7f47a413b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f47a8a0b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47a414ada0 0x7f47a40bff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f47a8a0b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a40b6a80 con 0x7f47a40bd850 2023-10-16T23:27:52.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f47a8a0b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a413bbb0 con 0x7f47a40ba7d0 2023-10-16T23:27:52.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f47a8a0b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a415b020 con 0x7f47a414ada0 2023-10-16T23:27:52.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f47a1d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47a40bd850 0x7f47a413b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f47a259c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47a40ba7d0 0x7f47a4159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f47a1d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47a40bd850 0x7f47a413b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55880/0 (socket says 172.21.15.12:55880) 2023-10-16T23:27:52.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f47a1d9b640 1 -- 172.21.15.12:0/2712873916 learned_addr learned my addr 172.21.15.12:0/2712873916 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:52.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f47a259c640 1 -- 172.21.15.12:0/2712873916 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47a414ada0 msgr2=0x7f47a40bff60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T23:27:52.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f47a259c640 1 --2- 172.21.15.12:0/2712873916 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47a414ada0 0x7f47a40bff60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f47a259c640 1 -- 172.21.15.12:0/2712873916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47a40bd850 msgr2=0x7f47a413b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f47a259c640 1 --2- 172.21.15.12:0/2712873916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47a40bd850 0x7f47a413b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f47a259c640 1 -- 172.21.15.12:0/2712873916 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4794009420 con 0x7f47a40ba7d0 2023-10-16T23:27:52.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f3c83a1d640 1 -- 172.21.15.12:0/2736481979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c7c0709f0 msgr2=0x7f3c7c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f3c83a1d640 1 --2- 172.21.15.12:0/2736481979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c7c0709f0 0x7f3c7c06fca0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c014420 tx=0x7f3c6c025540 comp rx=0 tx=0).stop 2023-10-16T23:27:52.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f3c83a1d640 1 -- 172.21.15.12:0/2736481979 shutdown_connections 2023-10-16T23:27:52.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f3c83a1d640 1 --2- 172.21.15.12:0/2736481979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c7c0709f0 0x7f3c7c06fca0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f3c83a1d640 1 --2- 172.21.15.12:0/2736481979 >> v2:172.21.15.12:3300/0 conn(0x7f3c7c14ecd0 0x7f3c7c06ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f72385ec640 1 -- 172.21.15.12:0/2078749146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f722802b040 msgr2=0x7f7228042f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f72385ec640 1 --2- 172.21.15.12:0/2078749146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f722802b040 0x7f7228042f10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f722c0097c0 tx=0x7f722c01c4c0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f72385ec640 1 -- 172.21.15.12:0/2078749146 shutdown_connections 2023-10-16T23:27:52.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f72385ec640 1 --2- 172.21.15.12:0/2078749146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f722802b040 0x7f7228042f10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f72385ec640 1 --2- 172.21.15.12:0/2078749146 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7228008da0 0x7f722802dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f72385ec640 1 -- 172.21.15.12:0/2078749146 >> 172.21.15.12:0/2078749146 conn(0x7f722800b580 msgr2=0x7f722800b990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:52.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f3c83a1d640 1 -- 172.21.15.12:0/2736481979 >> 172.21.15.12:0/2736481979 conn(0x7f3c7c06b5d0 msgr2=0x7f3c7c06b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:52.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7fdbad263640 1 --2- 172.21.15.12:0/3345538134 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb94005be0 0x7fdb94006000 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdba400c110 tx=0x7fdba401cb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8d851a620539f05 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:52.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f47a259c640 1 --2- 172.21.15.12:0/2712873916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47a40ba7d0 0x7f47a4159370 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4798005890 tx=0x7f479800c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:52.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f3c83a1d640 1 -- 172.21.15.12:0/2736481979 shutdown_connections 2023-10-16T23:27:52.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f72385ec640 1 -- 172.21.15.12:0/2078749146 shutdown_connections 2023-10-16T23:27:52.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f3c83a1d640 1 -- 172.21.15.12:0/2736481979 wait complete. 2023-10-16T23:27:52.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7f72385ec640 1 -- 172.21.15.12:0/2078749146 wait complete. 2023-10-16T23:27:52.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7fdb9ffff640 1 -- 172.21.15.12:0/3345538134 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba40058e0 con 0x7fdb94005be0 2023-10-16T23:27:52.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7fdb9ffff640 1 -- 172.21.15.12:0/3345538134 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba4005a60 con 0x7fdb94005be0 2023-10-16T23:27:52.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7fdb9ffff640 1 -- 172.21.15.12:0/3345538134 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba4005e50 con 0x7fdb94005be0 2023-10-16T23:27:52.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7fdbaf4c7640 1 -- 172.21.15.12:0/3345538134 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb94005be0 msgr2=0x7fdb94006000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7fdbaf4c7640 1 --2- 172.21.15.12:0/3345538134 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb94005be0 0x7fdb94006000 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdba400c110 tx=0x7fdba401cb20 comp rx=0 tx=0).stop 2023-10-16T23:27:52.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7fdbaf4c7640 1 -- 172.21.15.12:0/3345538134 shutdown_connections 2023-10-16T23:27:52.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7fdbaf4c7640 1 --2- 172.21.15.12:0/3345538134 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb94005be0 0x7fdb94006000 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.732+0000 7fdbaf4c7640 1 -- 172.21.15.12:0/3345538134 >> 172.21.15.12:0/3345538134 conn(0x7fdba806b5d0 msgr2=0x7fdba806b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:52.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f4792ffd640 1 -- 172.21.15.12:0/2712873916 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4798005cf0 con 0x7f47a40ba7d0 2023-10-16T23:27:52.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f47a8a0b640 1 -- 172.21.15.12:0/2712873916 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a40b6710 con 0x7f47a40ba7d0 2023-10-16T23:27:52.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f47a8a0b640 1 -- 172.21.15.12:0/2712873916 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a41385b0 con 0x7f47a40ba7d0 2023-10-16T23:27:52.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f4792ffd640 1 -- 172.21.15.12:0/2712873916 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4798005e50 con 0x7f47a40ba7d0 2023-10-16T23:27:52.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f4792ffd640 1 -- 172.21.15.12:0/2712873916 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47980072d0 con 0x7f47a40ba7d0 2023-10-16T23:27:52.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f72385ec640 1 Processor -- start 2023-10-16T23:27:52.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f47a8a0b640 1 -- 172.21.15.12:0/2712873916 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4788005260 con 0x7f47a40ba7d0 2023-10-16T23:27:52.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7fdbaf4c7640 1 -- 172.21.15.12:0/3345538134 shutdown_connections 2023-10-16T23:27:52.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7fdbaf4c7640 1 -- 172.21.15.12:0/3345538134 wait complete. 2023-10-16T23:27:52.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f72385ec640 1 -- start start 2023-10-16T23:27:52.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7fdbaf4c7640 1 Processor -- start 2023-10-16T23:27:52.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f72385ec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7228008da0 0x7f72280d5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f72385ec640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f722802b040 0x7f72280d5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f72385ec640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72280429a0 0x7f72280cded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f72385ec640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72280d8590 con 0x7f72280429a0 2023-10-16T23:27:52.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f72385ec640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72280d6510 con 0x7f7228008da0 2023-10-16T23:27:52.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f72385ec640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72280d77b0 con 0x7f722802b040 2023-10-16T23:27:52.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f7235b87640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f722802b040 0x7f72280d5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f7236b89640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72280429a0 0x7f72280cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f7235b87640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f722802b040 0x7f72280d5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:51204/0 (socket says 172.21.15.12:51204) 2023-10-16T23:27:52.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f7235b87640 1 -- 172.21.15.12:0/3682439514 learned_addr learned my addr 172.21.15.12:0/3682439514 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:52.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f7236388640 1 --2- 172.21.15.12:0/3682439514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7228008da0 0x7f72280d5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f7235b87640 1 -- 172.21.15.12:0/3682439514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7228008da0 msgr2=0x7f72280d5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f7235b87640 1 --2- 172.21.15.12:0/3682439514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7228008da0 0x7f72280d5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f7235b87640 1 -- 172.21.15.12:0/3682439514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72280429a0 msgr2=0x7f72280cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f7235b87640 1 --2- 172.21.15.12:0/3682439514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72280429a0 0x7f72280cded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f7235b87640 1 -- 172.21.15.12:0/3682439514 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f722c009420 con 0x7f722802b040 2023-10-16T23:27:52.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f7236b89640 1 --2- 172.21.15.12:0/3682439514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72280429a0 0x7f72280cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T23:27:52.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7fdbaf4c7640 1 -- start start 2023-10-16T23:27:52.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7fdbaf4c7640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb94005be0 0x7fdba80b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7fdbaf4c7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdba80b65e0 0x7fdba81f7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7fdbaf4c7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdba81f7e80 0x7fdba81f8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7fdbaf4c7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba80b6b50 con 0x7fdba80b65e0 2023-10-16T23:27:52.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7fdbaf4c7640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba81f4e50 con 0x7fdba81f7e80 2023-10-16T23:27:52.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7fdbaf4c7640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba81f53d0 con 0x7fdb94005be0 2023-10-16T23:27:52.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7fdbaca62640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdba80b65e0 0x7fdba81f7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7fdbaca62640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdba80b65e0 0x7fdba81f7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55896/0 (socket says 172.21.15.12:55896) 2023-10-16T23:27:52.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7fdbaca62640 1 -- 172.21.15.12:0/2840606361 learned_addr learned my addr 172.21.15.12:0/2840606361 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:52.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7fdbad263640 1 --2- 172.21.15.12:0/2840606361 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb94005be0 0x7fdba80b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f7235b87640 1 --2- 172.21.15.12:0/3682439514 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f722802b040 0x7f72280d5fd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f722c01a0f0 tx=0x7f722c019260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:52.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7fdbaca62640 1 -- 172.21.15.12:0/2840606361 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb94005be0 msgr2=0x7fdba80b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7fdbaca62640 1 --2- 172.21.15.12:0/2840606361 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb94005be0 0x7fdba80b4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7fdbaca62640 1 -- 172.21.15.12:0/2840606361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdba81f7e80 msgr2=0x7fdba81f8300 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T23:27:52.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7fdbaca62640 1 --2- 172.21.15.12:0/2840606361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdba81f7e80 0x7fdba81f8300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7fdbaca62640 1 -- 172.21.15.12:0/2840606361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba80b4a50 con 0x7fdba80b65e0 2023-10-16T23:27:52.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f3c83a1d640 1 Processor -- start 2023-10-16T23:27:52.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f7222ffd640 1 -- 172.21.15.12:0/3682439514 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722c003bb0 con 0x7f722802b040 2023-10-16T23:27:52.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7fdbaca62640 1 --2- 172.21.15.12:0/2840606361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdba80b65e0 0x7fdba81f7940 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdb9800e7d0 tx=0x7fdb9800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:52.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f4792ffd640 1 -- 172.21.15.12:0/2712873916 <== mon.1 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f4798007430 con 0x7f47a40ba7d0 2023-10-16T23:27:52.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f4792ffd640 1 --2- 172.21.15.12:0/2712873916 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4784065f60 0x7f4784068420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f4792ffd640 1 -- 172.21.15.12:0/2712873916 <== mon.1 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f47980834c0 con 0x7f47a40ba7d0 2023-10-16T23:27:52.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f72385ec640 1 -- 172.21.15.12:0/3682439514 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72280d7a90 con 0x7f722802b040 2023-10-16T23:27:52.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.736+0000 7f72385ec640 1 -- 172.21.15.12:0/3682439514 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f722816db80 con 0x7f722802b040 2023-10-16T23:27:52.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.740+0000 7f47a1d9b640 1 --2- 172.21.15.12:0/2712873916 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4784065f60 0x7f4784068420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.740+0000 7fdb9dffb640 1 -- 172.21.15.12:0/2840606361 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9800eee0 con 0x7fdba80b65e0 2023-10-16T23:27:52.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.740+0000 7fdbaf4c7640 1 -- 172.21.15.12:0/2840606361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba80c04c0 con 0x7fdba80b65e0 2023-10-16T23:27:52.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.740+0000 7fdbaf4c7640 1 -- 172.21.15.12:0/2840606361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba80b5120 con 0x7fdba80b65e0 2023-10-16T23:27:52.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.740+0000 7f7222ffd640 1 -- 172.21.15.12:0/3682439514 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722c003d10 con 0x7f722802b040 2023-10-16T23:27:52.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.740+0000 7f7222ffd640 1 -- 172.21.15.12:0/3682439514 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722c0b4620 con 0x7f722802b040 2023-10-16T23:27:52.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.740+0000 7fdb9dffb640 1 -- 172.21.15.12:0/2840606361 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9800c8c0 con 0x7fdba80b65e0 2023-10-16T23:27:52.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.740+0000 7fdb9dffb640 1 -- 172.21.15.12:0/2840606361 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9800cc30 con 0x7fdba80b65e0 2023-10-16T23:27:52.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.740+0000 7f3c83a1d640 1 -- start start 2023-10-16T23:27:52.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.740+0000 7f47a1d9b640 1 --2- 172.21.15.12:0/2712873916 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4784065f60 0x7f4784068420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f47a415acc0 tx=0x7f479c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:52.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.740+0000 7f7222ffd640 1 -- 172.21.15.12:0/3682439514 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f722c0b2040 con 0x7f722802b040 2023-10-16T23:27:52.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.740+0000 7f7222ffd640 1 --2- 172.21.15.12:0/3682439514 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7214065e60 0x7f7214068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.740+0000 7f7222ffd640 1 -- 172.21.15.12:0/3682439514 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f722c11d6c0 con 0x7f722802b040 2023-10-16T23:27:52.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.740+0000 7f72385ec640 1 -- 172.21.15.12:0/3682439514 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7218005260 con 0x7f722802b040 2023-10-16T23:27:52.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.740+0000 7f7236388640 1 --2- 172.21.15.12:0/3682439514 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7214065e60 0x7f7214068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.740+0000 7fdbaf4c7640 1 -- 172.21.15.12:0/2840606361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb88005260 con 0x7fdba80b65e0 2023-10-16T23:27:52.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.740+0000 7fdb9dffb640 1 -- 172.21.15.12:0/2840606361 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fdb9800cd90 con 0x7fdba80b65e0 2023-10-16T23:27:52.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.740+0000 7fdb9dffb640 1 --2- 172.21.15.12:0/2840606361 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fdb8c065e60 0x7fdb8c068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.740+0000 7fdb9dffb640 1 -- 172.21.15.12:0/2840606361 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdb98083a20 con 0x7fdba80b65e0 2023-10-16T23:27:52.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.740+0000 7fdbad263640 1 --2- 172.21.15.12:0/2840606361 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fdb8c065e60 0x7fdb8c068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f5e99415640 1 -- start start 2023-10-16T23:27:52.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f5e99415640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e940b7f30 0x7f5e94155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f5e99415640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e940bbcf0 0x7f5e941f7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f5e99415640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e940bc240 0x7f5e941f75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f5e99415640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e94156790 con 0x7f5e940b7f30 2023-10-16T23:27:52.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f5e99415640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e940b9180 con 0x7f5e940bbcf0 2023-10-16T23:27:52.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f5e99415640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e940b9460 con 0x7f5e940bc240 2023-10-16T23:27:52.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7fdbad263640 1 --2- 172.21.15.12:0/2840606361 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fdb8c065e60 0x7fdb8c068320 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdba40aa000 tx=0x7fdba40019b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:52.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f7236388640 1 --2- 172.21.15.12:0/3682439514 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7214065e60 0x7f7214068320 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7224007a60 tx=0x7f7224008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:52.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f3c83a1d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c7c0709f0 0x7f3c7c1455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f5e98c14640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e940bc240 0x7f5e941f75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f5e93fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e940b7f30 0x7f5e94155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f5e98c14640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e940bc240 0x7f5e941f75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:51210/0 (socket says 172.21.15.12:51210) 2023-10-16T23:27:52.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f5e98c14640 1 -- 172.21.15.12:0/2061704777 learned_addr learned my addr 172.21.15.12:0/2061704777 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:52.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f3c83a1d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c7c0bd240 0x7f3c7c0bafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f3c83a1d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c7c14ecd0 0x7f3c7c0b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f3c83a1d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c0b6eb0 con 0x7f3c7c0bd240 2023-10-16T23:27:52.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f3c83a1d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c0b7090 con 0x7f3c7c14ecd0 2023-10-16T23:27:52.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f3c83a1d640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7c145c50 con 0x7f3c7c0709f0 2023-10-16T23:27:52.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f5e8bfff640 1 --2- 172.21.15.12:0/2061704777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e940bbcf0 0x7f5e941f7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f3c817b9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c7c0709f0 0x7f3c7c1455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f3c817b9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c7c0709f0 0x7f3c7c1455c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:51218/0 (socket says 172.21.15.12:51218) 2023-10-16T23:27:52.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f3c817b9640 1 -- 172.21.15.12:0/239527332 learned_addr learned my addr 172.21.15.12:0/239527332 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:52.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f5e93fff640 1 -- 172.21.15.12:0/2061704777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e940bc240 msgr2=0x7f5e941f75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f5e93fff640 1 --2- 172.21.15.12:0/2061704777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e940bc240 0x7f5e941f75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f5e93fff640 1 -- 172.21.15.12:0/2061704777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e940bbcf0 msgr2=0x7f5e941f7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f5e93fff640 1 --2- 172.21.15.12:0/2061704777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e940bbcf0 0x7f5e941f7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f5e93fff640 1 -- 172.21.15.12:0/2061704777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e840094d0 con 0x7f5e940b7f30 2023-10-16T23:27:52.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f3c80fb8640 1 --2- 172.21.15.12:0/239527332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c7c0bd240 0x7f3c7c0bafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f5e93fff640 1 --2- 172.21.15.12:0/2061704777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e940b7f30 0x7f5e94155bd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5e840ac000 tx=0x7f5e94157ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:52.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f3c817b9640 1 -- 172.21.15.12:0/239527332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c7c14ecd0 msgr2=0x7f3c7c0b5e80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-16T23:27:52.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f3c817b9640 1 --2- 172.21.15.12:0/239527332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c7c14ecd0 0x7f3c7c0b5e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f3c817b9640 1 -- 172.21.15.12:0/239527332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c7c0bd240 msgr2=0x7f3c7c0bafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f3c817b9640 1 --2- 172.21.15.12:0/239527332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c7c0bd240 0x7f3c7c0bafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f3c817b9640 1 -- 172.21.15.12:0/239527332 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c00fd10 con 0x7f3c7c0709f0 2023-10-16T23:27:52.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f3c817b9640 1 --2- 172.21.15.12:0/239527332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c7c0709f0 0x7f3c7c1455c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3c7800d800 tx=0x7f3c7800dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:52.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f5e917fa640 1 -- 172.21.15.12:0/2061704777 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e840add60 con 0x7f5e940b7f30 2023-10-16T23:27:52.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f5e917fa640 1 -- 172.21.15.12:0/2061704777 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e840b6440 con 0x7f5e940b7f30 2023-10-16T23:27:52.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7fdb9dffb640 1 -- 172.21.15.12:0/2840606361 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fdb98051100 con 0x7fdba80b65e0 2023-10-16T23:27:52.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f5e99415640 1 -- 172.21.15.12:0/2061704777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e940b9740 con 0x7f5e940b7f30 2023-10-16T23:27:52.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.744+0000 7f5e99415640 1 -- 172.21.15.12:0/2061704777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e94156c90 con 0x7f5e940b7f30 2023-10-16T23:27:52.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.748+0000 7f5e917fa640 1 -- 172.21.15.12:0/2061704777 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e840b67f0 con 0x7f5e940b7f30 2023-10-16T23:27:52.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.748+0000 7f5e99415640 1 -- 172.21.15.12:0/2061704777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e94156900 con 0x7f5e940b7f30 2023-10-16T23:27:52.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.748+0000 7f5e917fa640 1 -- 172.21.15.12:0/2061704777 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f5e840b4070 con 0x7f5e940b7f30 2023-10-16T23:27:52.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.748+0000 7f5e917fa640 1 --2- 172.21.15.12:0/2061704777 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5e74065e90 0x7f5e74068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.748+0000 7f5e917fa640 1 -- 172.21.15.12:0/2061704777 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5e8411e160 con 0x7f5e940b7f30 2023-10-16T23:27:52.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.748+0000 7f5e8bfff640 1 --2- 172.21.15.12:0/2061704777 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5e74065e90 0x7f5e74068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.748+0000 7f5e8bfff640 1 --2- 172.21.15.12:0/2061704777 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5e74065e90 0x7f5e74068350 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5e9414fb40 tx=0x7f5e7c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:52.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.752+0000 7f4792ffd640 1 -- 172.21.15.12:0/2712873916 <== mon.1 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f4798050ba0 con 0x7f47a40ba7d0 2023-10-16T23:27:52.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.752+0000 7f5e917fa640 1 -- 172.21.15.12:0/2061704777 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f5e840eb8c0 con 0x7f5e940b7f30 2023-10-16T23:27:52.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.756+0000 7f3c71ffb640 1 -- 172.21.15.12:0/239527332 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c780096c0 con 0x7f3c7c0709f0 2023-10-16T23:27:52.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.756+0000 7f3c71ffb640 1 -- 172.21.15.12:0/239527332 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c78009820 con 0x7f3c7c0709f0 2023-10-16T23:27:52.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.756+0000 7f3c71ffb640 1 -- 172.21.15.12:0/239527332 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c78009bb0 con 0x7f3c7c0709f0 2023-10-16T23:27:52.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.756+0000 7f3c83a1d640 1 -- 172.21.15.12:0/239527332 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c7c0b72e0 con 0x7f3c7c0709f0 2023-10-16T23:27:52.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.756+0000 7f3c83a1d640 1 -- 172.21.15.12:0/239527332 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c7c0bb500 con 0x7f3c7c0709f0 2023-10-16T23:27:52.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.756+0000 7f7222ffd640 1 -- 172.21.15.12:0/3682439514 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f722c0ead90 con 0x7f722802b040 2023-10-16T23:27:52.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.760+0000 7f3c71ffb640 1 -- 172.21.15.12:0/239527332 <== mon.2 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f3c78009d10 con 0x7f3c7c0709f0 2023-10-16T23:27:52.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.760+0000 7f3c71ffb640 1 --2- 172.21.15.12:0/239527332 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3c60065e90 0x7f3c60068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.760+0000 7f3c71ffb640 1 -- 172.21.15.12:0/239527332 <== mon.2 v2:172.21.15.31:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3c78083f70 con 0x7f3c7c0709f0 2023-10-16T23:27:52.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.760+0000 7f3c80fb8640 1 --2- 172.21.15.12:0/239527332 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3c60065e90 0x7f3c60068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.760+0000 7f3c80fb8640 1 --2- 172.21.15.12:0/239527332 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3c60065e90 0x7f3c60068350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c0b7000 tx=0x7f3c6c0b0000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:52.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.764+0000 7f3c83a1d640 1 -- 172.21.15.12:0/239527332 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c7c0ba2e0 con 0x7f3c7c0709f0 2023-10-16T23:27:52.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.772+0000 7f5b01330640 1 Processor -- start 2023-10-16T23:27:52.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.772+0000 7f5b01330640 1 -- start start 2023-10-16T23:27:52.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.772+0000 7f5b01330640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5af4006d90 0x7f5af4008970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.772+0000 7f5b01330640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5af4008eb0 0x7f5af40e4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.772+0000 7f5b01330640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af4043e00 con 0x7f5af403b470 2023-10-16T23:27:52.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.772+0000 7f5b01330640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af40071f0 con 0x7f5af4006d90 2023-10-16T23:27:52.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.772+0000 7f5b01330640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af4043bc0 con 0x7f5af4008eb0 2023-10-16T23:27:52.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.772+0000 7f5afbfff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5af403b470 0x7f5af4042c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38284/0 (socket says 172.21.15.12:38284) 2023-10-16T23:27:52.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.772+0000 7f5afbfff640 1 -- 172.21.15.12:0/2406952190 learned_addr learned my addr 172.21.15.12:0/2406952190 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:52.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.772+0000 7f5afb7fe640 1 --2- 172.21.15.12:0/2406952190 >> v2:172.21.15.12:3300/0 conn(0x7f5af4006d90 0x7f5af4008970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.772+0000 7f5b00b2f640 1 --2- 172.21.15.12:0/2406952190 >> v2:172.21.15.31:3300/0 conn(0x7f5af4008eb0 0x7f5af40e4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.772+0000 7f5afaffd640 1 -- 172.21.15.12:0/2406952190 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 265463721 0 0) 0x7f5af4043e00 con 0x7f5af403b470 2023-10-16T23:27:52.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.772+0000 7f5afaffd640 1 -- 172.21.15.12:0/2406952190 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5aec003530 con 0x7f5af403b470 2023-10-16T23:27:52.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.772+0000 7f5b00b2f640 1 -- 172.21.15.12:0/2406952190 >> v2:172.21.15.12:3300/0 conn(0x7f5af4006d90 msgr2=0x7f5af4008970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:52.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.772+0000 7f5b00b2f640 1 --2- 172.21.15.12:0/2406952190 >> v2:172.21.15.12:3300/0 conn(0x7f5af4006d90 0x7f5af4008970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.772+0000 7f5b00b2f640 1 -- 172.21.15.12:0/2406952190 >> v1:172.21.15.12:6789/0 conn(0x7f5af403b470 legacy=0x7f5af4042c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.772+0000 7f5afaffd640 1 -- 172.21.15.12:0/2406952190 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3942033514 0 0) 0x7f5aec003530 con 0x7f5af403b470 2023-10-16T23:27:52.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.772+0000 7f5b00b2f640 1 -- 172.21.15.12:0/2406952190 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af40438e0 con 0x7f5af4008eb0 2023-10-16T23:27:52.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.776+0000 7f3c71ffb640 1 -- 172.21.15.12:0/239527332 <== mon.2 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f3c78051520 con 0x7f3c7c0709f0 2023-10-16T23:27:52.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.776+0000 7f5b00b2f640 1 --2- 172.21.15.12:0/2406952190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5af4008eb0 0x7f5af40e4890 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5afc072890 tx=0x7f5afc095ff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b59683db02fdf5c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:52.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.776+0000 7f5afaffd640 1 -- 172.21.15.12:0/2406952190 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8001680 con 0x7f5af4008eb0 2023-10-16T23:27:52.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.776+0000 7f5afaffd640 1 -- 172.21.15.12:0/2406952190 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc11eb90 con 0x7f5af4008eb0 2023-10-16T23:27:52.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.776+0000 7f5afaffd640 1 -- 172.21.15.12:0/2406952190 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc126440 con 0x7f5af4008eb0 2023-10-16T23:27:52.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.780+0000 7f5b01330640 1 -- 172.21.15.12:0/2406952190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5af4008eb0 msgr2=0x7f5af40e4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.780+0000 7f5b01330640 1 --2- 172.21.15.12:0/2406952190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5af4008eb0 0x7f5af40e4890 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5afc072890 tx=0x7f5afc095ff0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.780+0000 7f5b01330640 1 -- 172.21.15.12:0/2406952190 shutdown_connections 2023-10-16T23:27:52.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.780+0000 7f5b01330640 1 --2- 172.21.15.12:0/2406952190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5af4008eb0 0x7f5af40e4890 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.780+0000 7f5b01330640 1 --2- 172.21.15.12:0/2406952190 >> v2:172.21.15.12:3300/0 conn(0x7f5af4006d90 0x7f5af4008970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.780+0000 7f5b01330640 1 -- 172.21.15.12:0/2406952190 >> 172.21.15.12:0/2406952190 conn(0x7f5af4044a30 msgr2=0x7f5af4044e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:52.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.780+0000 7f5b01330640 1 -- 172.21.15.12:0/2406952190 shutdown_connections 2023-10-16T23:27:52.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.780+0000 7f5b01330640 1 -- 172.21.15.12:0/2406952190 wait complete. 2023-10-16T23:27:52.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.780+0000 7f5b01330640 1 Processor -- start 2023-10-16T23:27:52.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.780+0000 7f5b01330640 1 -- start start 2023-10-16T23:27:52.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.780+0000 7f5b01330640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5af4006d90 0x7f5af403fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.780+0000 7f5b01330640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5af4008eb0 0x7f5af41756d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.780+0000 7f5b01330640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5af403b470 0x7f5af40d67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.780+0000 7f5b01330640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af40da8e0 con 0x7f5af403b470 2023-10-16T23:27:52.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.780+0000 7f5b01330640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af41760d0 con 0x7f5af4008eb0 2023-10-16T23:27:52.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.780+0000 7f5b01330640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af41763b0 con 0x7f5af4006d90 2023-10-16T23:27:52.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.780+0000 7f5b00b2f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5af403b470 0x7f5af40d67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.780+0000 7f5b00b2f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5af403b470 0x7f5af40d67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55922/0 (socket says 172.21.15.12:55922) 2023-10-16T23:27:52.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.780+0000 7f5b00b2f640 1 -- 172.21.15.12:0/3267998077 learned_addr learned my addr 172.21.15.12:0/3267998077 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:52.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.780+0000 7f5afbfff640 1 --2- 172.21.15.12:0/3267998077 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5af4006d90 0x7f5af403fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.784+0000 7f5afb7fe640 1 --2- 172.21.15.12:0/3267998077 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5af4008eb0 0x7f5af41756d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.784+0000 7f5b00b2f640 1 -- 172.21.15.12:0/3267998077 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5af4006d90 msgr2=0x7f5af403fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.784+0000 7f5b00b2f640 1 --2- 172.21.15.12:0/3267998077 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5af4006d90 0x7f5af403fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.784+0000 7f5b00b2f640 1 -- 172.21.15.12:0/3267998077 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5af4008eb0 msgr2=0x7f5af41756d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:52.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.784+0000 7f5b00b2f640 1 --2- 172.21.15.12:0/3267998077 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5af4008eb0 0x7f5af41756d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:52.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.784+0000 7f5b00b2f640 1 -- 172.21.15.12:0/3267998077 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc06e2e0 con 0x7f5af403b470 2023-10-16T23:27:52.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.784+0000 7f5b00b2f640 1 --2- 172.21.15.12:0/3267998077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5af403b470 0x7f5af40d67e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5afc04f950 tx=0x7f5afc092de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:52.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.792+0000 7f5af8ff9640 1 -- 172.21.15.12:0/3267998077 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc126e60 con 0x7f5af403b470 2023-10-16T23:27:52.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.792+0000 7f5af8ff9640 1 -- 172.21.15.12:0/3267998077 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc131440 con 0x7f5af403b470 2023-10-16T23:27:52.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.792+0000 7f5b01330640 1 -- 172.21.15.12:0/3267998077 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af40447b0 con 0x7f5af403b470 2023-10-16T23:27:52.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.792+0000 7f5b01330640 1 -- 172.21.15.12:0/3267998077 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af40da200 con 0x7f5af403b470 2023-10-16T23:27:52.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.792+0000 7f5b01330640 1 -- 172.21.15.12:0/3267998077 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af403f960 con 0x7f5af403b470 2023-10-16T23:27:52.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.800+0000 7f5af8ff9640 1 -- 172.21.15.12:0/3267998077 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc1317b0 con 0x7f5af403b470 2023-10-16T23:27:52.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.800+0000 7f5af8ff9640 1 -- 172.21.15.12:0/3267998077 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f5afc12f3f0 con 0x7f5af403b470 2023-10-16T23:27:52.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.800+0000 7f5af8ff9640 1 --2- 172.21.15.12:0/3267998077 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5ae0065fb0 0x7f5ae0068470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:52.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.800+0000 7f5af8ff9640 1 -- 172.21.15.12:0/3267998077 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5afc197970 con 0x7f5af403b470 2023-10-16T23:27:52.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.800+0000 7f5afbfff640 1 --2- 172.21.15.12:0/3267998077 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5ae0065fb0 0x7f5ae0068470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:52.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.800+0000 7f5afbfff640 1 --2- 172.21.15.12:0/3267998077 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5ae0065fb0 0x7f5ae0068470 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80011f0 tx=0x7f5ae8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:52.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:52.804+0000 7f5af8ff9640 1 -- 172.21.15.12:0/3267998077 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f5afc165030 con 0x7f5af403b470 2023-10-16T23:27:53.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.004+0000 7f7b03336640 1 -- 172.21.15.12:0/2636615920 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7adc005510 con 0x7f7afc14a690 2023-10-16T23:27:53.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.004+0000 7f7af1ffb640 1 -- 172.21.15.12:0/2636615920 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7af40efd50 con 0x7f7afc14a690 2023-10-16T23:27:53.010 INFO:teuthology.orchestra.run.smithi012.stdout:64424509449 2023-10-16T23:27:53.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.008+0000 7f7ae77fe640 1 -- 172.21.15.12:0/2636615920 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7ae0065f60 msgr2=0x7f7ae0068420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:53.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.008+0000 7f7ae77fe640 1 --2- 172.21.15.12:0/2636615920 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7ae0065f60 0x7f7ae0068420 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7aec007fd0 tx=0x7f7aec009040 comp rx=0 tx=0).stop 2023-10-16T23:27:53.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.008+0000 7f7ae77fe640 1 -- 172.21.15.12:0/2636615920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7afc14a690 msgr2=0x7f7afc0b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:53.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.008+0000 7f7ae77fe640 1 --2- 172.21.15.12:0/2636615920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7afc14a690 0x7f7afc0b5210 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7af401aa40 tx=0x7f7af401abd0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.008+0000 7f7ae77fe640 1 -- 172.21.15.12:0/2636615920 shutdown_connections 2023-10-16T23:27:53.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.008+0000 7f7ae77fe640 1 --2- 172.21.15.12:0/2636615920 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7ae0065f60 0x7f7ae0068420 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.008+0000 7f7ae77fe640 1 --2- 172.21.15.12:0/2636615920 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7afc0b4370 0x7f7afc1ef010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.008+0000 7f7ae77fe640 1 --2- 172.21.15.12:0/2636615920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7afc14a690 0x7f7afc0b5210 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.008+0000 7f7ae77fe640 1 --2- 172.21.15.12:0/2636615920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7afc0bd850 0x7f7afc0c0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.008+0000 7f7ae77fe640 1 -- 172.21.15.12:0/2636615920 >> 172.21.15.12:0/2636615920 conn(0x7f7afc06b400 msgr2=0x7f7afc14aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.008+0000 7f7ae77fe640 1 -- 172.21.15.12:0/2636615920 shutdown_connections 2023-10-16T23:27:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.008+0000 7f7ae77fe640 1 -- 172.21.15.12:0/2636615920 wait complete. 2023-10-16T23:27:53.032 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.0 2023-10-16T23:27:53.033 DEBUG:teuthology.parallel:result is None 2023-10-16T23:27:53.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.036+0000 7f5e99415640 1 -- 172.21.15.12:0/2061704777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5e94061940 con 0x7f5e940b7f30 2023-10-16T23:27:53.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.036+0000 7f5e917fa640 1 -- 172.21.15.12:0/2061704777 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5e840b2020 con 0x7f5e940b7f30 2023-10-16T23:27:53.040 INFO:teuthology.orchestra.run.smithi012.stdout:64424509447 2023-10-16T23:27:53.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.040+0000 7f5e99415640 1 -- 172.21.15.12:0/2061704777 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5e74065e90 msgr2=0x7f5e74068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:53.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.040+0000 7f5e99415640 1 --2- 172.21.15.12:0/2061704777 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5e74065e90 0x7f5e74068350 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5e9414fb40 tx=0x7f5e7c009040 comp rx=0 tx=0).stop 2023-10-16T23:27:53.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.040+0000 7f5e99415640 1 -- 172.21.15.12:0/2061704777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e940b7f30 msgr2=0x7f5e94155bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:53.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.040+0000 7f5e99415640 1 --2- 172.21.15.12:0/2061704777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e940b7f30 0x7f5e94155bd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5e840ac000 tx=0x7f5e94157ba0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.040+0000 7f5e99415640 1 -- 172.21.15.12:0/2061704777 shutdown_connections 2023-10-16T23:27:53.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.040+0000 7f5e99415640 1 --2- 172.21.15.12:0/2061704777 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5e74065e90 0x7f5e74068350 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.040+0000 7f5e99415640 1 --2- 172.21.15.12:0/2061704777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e940bc240 0x7f5e941f75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.040+0000 7f5e99415640 1 --2- 172.21.15.12:0/2061704777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e940bbcf0 0x7f5e941f7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.040+0000 7f5e99415640 1 --2- 172.21.15.12:0/2061704777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e940b7f30 0x7f5e94155bd0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.040+0000 7f5e99415640 1 -- 172.21.15.12:0/2061704777 >> 172.21.15.12:0/2061704777 conn(0x7f5e940c1ca0 msgr2=0x7f5e9406a100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:53.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.040+0000 7f5e99415640 1 -- 172.21.15.12:0/2061704777 shutdown_connections 2023-10-16T23:27:53.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.040+0000 7f5e99415640 1 -- 172.21.15.12:0/2061704777 wait complete. 2023-10-16T23:27:53.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.052+0000 7f2088208640 1 -- 172.21.15.12:0/2869672898 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f20680057e0 con 0x7f2078028270 2023-10-16T23:27:53.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.052+0000 7f20767fc640 1 -- 172.21.15.12:0/2869672898 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2070017020 con 0x7f2078028270 2023-10-16T23:27:53.056 INFO:teuthology.orchestra.run.smithi012.stdout:64424509447 2023-10-16T23:27:53.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.056+0000 7f2088208640 1 -- 172.21.15.12:0/2869672898 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f206c065fd0 msgr2=0x7f206c068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:53.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.056+0000 7f2088208640 1 --2- 172.21.15.12:0/2869672898 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f206c065fd0 0x7f206c068490 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f20780486e0 tx=0x7f207c009190 comp rx=0 tx=0).stop 2023-10-16T23:27:53.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.056+0000 7f2088208640 1 -- 172.21.15.12:0/2869672898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2078028270 msgr2=0x7f207803f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:53.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.056+0000 7f2088208640 1 --2- 172.21.15.12:0/2869672898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2078028270 0x7f207803f1f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f207000c5d0 tx=0x7f207000ca90 comp rx=0 tx=0).stop 2023-10-16T23:27:53.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.056+0000 7f2088208640 1 -- 172.21.15.12:0/2869672898 shutdown_connections 2023-10-16T23:27:53.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.056+0000 7f2088208640 1 --2- 172.21.15.12:0/2869672898 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f206c065fd0 0x7f206c068490 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.056+0000 7f2088208640 1 --2- 172.21.15.12:0/2869672898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f207803c640 0x7f2078172ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.056+0000 7f2088208640 1 --2- 172.21.15.12:0/2869672898 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f207802ea40 0x7f207803ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.056+0000 7f2088208640 1 --2- 172.21.15.12:0/2869672898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2078028270 0x7f207803f1f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.056+0000 7f2088208640 1 -- 172.21.15.12:0/2869672898 >> 172.21.15.12:0/2869672898 conn(0x7f2078045a30 msgr2=0x7f207802da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:53.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.056+0000 7f2088208640 1 -- 172.21.15.12:0/2869672898 shutdown_connections 2023-10-16T23:27:53.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.056+0000 7f2088208640 1 -- 172.21.15.12:0/2869672898 wait complete. 2023-10-16T23:27:53.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.060+0000 7f3c83a1d640 1 -- 172.21.15.12:0/239527332 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3c7c0673a0 con 0x7f3c7c0709f0 2023-10-16T23:27:53.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.060+0000 7f3c71ffb640 1 -- 172.21.15.12:0/239527332 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c78018070 con 0x7f3c7c0709f0 2023-10-16T23:27:53.064 INFO:teuthology.orchestra.run.smithi012.stdout:64424509448 2023-10-16T23:27:53.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.064+0000 7f3c83a1d640 1 -- 172.21.15.12:0/239527332 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3c60065e90 msgr2=0x7f3c60068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:53.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.064+0000 7f3c83a1d640 1 --2- 172.21.15.12:0/239527332 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3c60065e90 0x7f3c60068350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c0b7000 tx=0x7f3c6c0b0000 comp rx=0 tx=0).stop 2023-10-16T23:27:53.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.064+0000 7f3c83a1d640 1 -- 172.21.15.12:0/239527332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c7c0709f0 msgr2=0x7f3c7c1455c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:53.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.064+0000 7f3c83a1d640 1 --2- 172.21.15.12:0/239527332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c7c0709f0 0x7f3c7c1455c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3c7800d800 tx=0x7f3c7800dcc0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.064+0000 7f3c83a1d640 1 -- 172.21.15.12:0/239527332 shutdown_connections 2023-10-16T23:27:53.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.064+0000 7f3c83a1d640 1 --2- 172.21.15.12:0/239527332 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3c60065e90 0x7f3c60068350 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.064+0000 7f3c83a1d640 1 --2- 172.21.15.12:0/239527332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c7c14ecd0 0x7f3c7c0b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.064+0000 7f3c83a1d640 1 --2- 172.21.15.12:0/239527332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c7c0bd240 0x7f3c7c0bafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.064+0000 7f3c83a1d640 1 --2- 172.21.15.12:0/239527332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3c7c0709f0 0x7f3c7c1455c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.064+0000 7f3c83a1d640 1 -- 172.21.15.12:0/239527332 >> 172.21.15.12:0/239527332 conn(0x7f3c7c06b5d0 msgr2=0x7f3c7c0be6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:53.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.064+0000 7f3c83a1d640 1 -- 172.21.15.12:0/239527332 shutdown_connections 2023-10-16T23:27:53.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.064+0000 7f3c83a1d640 1 -- 172.21.15.12:0/239527332 wait complete. 2023-10-16T23:27:53.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.5 2023-10-16T23:27:53.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.064+0000 7fdbaf4c7640 1 -- 172.21.15.12:0/2840606361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdb880057e0 con 0x7fdba80b65e0 2023-10-16T23:27:53.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.064+0000 7fdb9dffb640 1 -- 172.21.15.12:0/2840606361 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdb98017090 con 0x7fdba80b65e0 2023-10-16T23:27:53.070 DEBUG:teuthology.parallel:result is None 2023-10-16T23:27:53.071 INFO:teuthology.orchestra.run.smithi012.stdout:64424509447 2023-10-16T23:27:53.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.068+0000 7fdbaf4c7640 1 -- 172.21.15.12:0/2840606361 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fdb8c065e60 msgr2=0x7fdb8c068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:53.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.068+0000 7fdbaf4c7640 1 --2- 172.21.15.12:0/2840606361 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fdb8c065e60 0x7fdb8c068320 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdba40aa000 tx=0x7fdba40019b0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.068+0000 7fdbaf4c7640 1 -- 172.21.15.12:0/2840606361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdba80b65e0 msgr2=0x7fdba81f7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:53.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.068+0000 7fdbaf4c7640 1 --2- 172.21.15.12:0/2840606361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdba80b65e0 0x7fdba81f7940 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdb9800e7d0 tx=0x7fdb9800ec90 comp rx=0 tx=0).stop 2023-10-16T23:27:53.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.068+0000 7fdbaf4c7640 1 -- 172.21.15.12:0/2840606361 shutdown_connections 2023-10-16T23:27:53.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.068+0000 7fdbaf4c7640 1 --2- 172.21.15.12:0/2840606361 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fdb8c065e60 0x7fdb8c068320 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.068+0000 7fdbaf4c7640 1 --2- 172.21.15.12:0/2840606361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdba81f7e80 0x7fdba81f8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.068+0000 7fdbaf4c7640 1 --2- 172.21.15.12:0/2840606361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdba80b65e0 0x7fdba81f7940 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.068+0000 7fdbaf4c7640 1 --2- 172.21.15.12:0/2840606361 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb94005be0 0x7fdba80b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.068+0000 7fdbaf4c7640 1 -- 172.21.15.12:0/2840606361 >> 172.21.15.12:0/2840606361 conn(0x7fdba806b5d0 msgr2=0x7fdba806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:53.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.068+0000 7fdbaf4c7640 1 -- 172.21.15.12:0/2840606361 shutdown_connections 2023-10-16T23:27:53.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.068+0000 7fdbaf4c7640 1 -- 172.21.15.12:0/2840606361 wait complete. 2023-10-16T23:27:53.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.076+0000 7f47a8a0b640 1 -- 172.21.15.12:0/2712873916 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f47880050d0 con 0x7f47a40ba7d0 2023-10-16T23:27:53.078 INFO:teuthology.orchestra.run.smithi012.stdout:60129542152 2023-10-16T23:27:53.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.076+0000 7f4792ffd640 1 -- 172.21.15.12:0/2712873916 <== mon.1 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4798021020 con 0x7f47a40ba7d0 2023-10-16T23:27:53.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.076+0000 7f72385ec640 1 -- 172.21.15.12:0/3682439514 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7218005510 con 0x7f722802b040 2023-10-16T23:27:53.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.076+0000 7f7222ffd640 1 -- 172.21.15.12:0/3682439514 <== mon.2 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f722c0ee3b0 con 0x7f722802b040 2023-10-16T23:27:53.080 INFO:teuthology.orchestra.run.smithi012.stdout:60129542152 2023-10-16T23:27:53.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.080+0000 7f47a8a0b640 1 -- 172.21.15.12:0/2712873916 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4784065f60 msgr2=0x7f4784068420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:53.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.080+0000 7f47a8a0b640 1 --2- 172.21.15.12:0/2712873916 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4784065f60 0x7f4784068420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f47a415acc0 tx=0x7f479c009040 comp rx=0 tx=0).stop 2023-10-16T23:27:53.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.080+0000 7f47a8a0b640 1 -- 172.21.15.12:0/2712873916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47a40ba7d0 msgr2=0x7f47a4159370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:53.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.080+0000 7f47a8a0b640 1 --2- 172.21.15.12:0/2712873916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47a40ba7d0 0x7f47a4159370 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4798005890 tx=0x7f479800c960 comp rx=0 tx=0).stop 2023-10-16T23:27:53.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.080+0000 7f47a8a0b640 1 -- 172.21.15.12:0/2712873916 shutdown_connections 2023-10-16T23:27:53.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.080+0000 7f47a8a0b640 1 --2- 172.21.15.12:0/2712873916 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4784065f60 0x7f4784068420 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.080+0000 7f47a8a0b640 1 --2- 172.21.15.12:0/2712873916 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f47a414ada0 0x7f47a40bff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.080+0000 7f47a8a0b640 1 --2- 172.21.15.12:0/2712873916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47a40bd850 0x7f47a413b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.080+0000 7f47a8a0b640 1 --2- 172.21.15.12:0/2712873916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47a40ba7d0 0x7f47a4159370 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.080+0000 7f47a8a0b640 1 -- 172.21.15.12:0/2712873916 >> 172.21.15.12:0/2712873916 conn(0x7f47a406b400 msgr2=0x7f47a40b9030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:53.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.080+0000 7f47a8a0b640 1 -- 172.21.15.12:0/2712873916 shutdown_connections 2023-10-16T23:27:53.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.080+0000 7f47a8a0b640 1 -- 172.21.15.12:0/2712873916 wait complete. 2023-10-16T23:27:53.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.080+0000 7f72385ec640 1 -- 172.21.15.12:0/3682439514 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7214065e60 msgr2=0x7f7214068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:53.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.080+0000 7f72385ec640 1 --2- 172.21.15.12:0/3682439514 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7214065e60 0x7f7214068320 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7224007a60 tx=0x7f7224008040 comp rx=0 tx=0).stop 2023-10-16T23:27:53.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.080+0000 7f72385ec640 1 -- 172.21.15.12:0/3682439514 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f722802b040 msgr2=0x7f72280d5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:53.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.080+0000 7f72385ec640 1 --2- 172.21.15.12:0/3682439514 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f722802b040 0x7f72280d5fd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f722c01a0f0 tx=0x7f722c019260 comp rx=0 tx=0).stop 2023-10-16T23:27:53.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.080+0000 7f72385ec640 1 -- 172.21.15.12:0/3682439514 shutdown_connections 2023-10-16T23:27:53.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.080+0000 7f72385ec640 1 --2- 172.21.15.12:0/3682439514 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7214065e60 0x7f7214068320 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.080+0000 7f72385ec640 1 --2- 172.21.15.12:0/3682439514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72280429a0 0x7f72280cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.080+0000 7f72385ec640 1 --2- 172.21.15.12:0/3682439514 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f722802b040 0x7f72280d5fd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.080+0000 7f72385ec640 1 --2- 172.21.15.12:0/3682439514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7228008da0 0x7f72280d5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.080+0000 7f72385ec640 1 -- 172.21.15.12:0/3682439514 >> 172.21.15.12:0/3682439514 conn(0x7f722800b580 msgr2=0x7f7228028540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:53.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.080+0000 7f72385ec640 1 -- 172.21.15.12:0/3682439514 shutdown_connections 2023-10-16T23:27:53.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.080+0000 7f72385ec640 1 -- 172.21.15.12:0/3682439514 wait complete. 2023-10-16T23:27:53.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.6 2023-10-16T23:27:53.089 DEBUG:teuthology.parallel:result is None 2023-10-16T23:27:53.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.1 2023-10-16T23:27:53.094 DEBUG:teuthology.parallel:result is None 2023-10-16T23:27:53.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.3 2023-10-16T23:27:53.098 DEBUG:teuthology.parallel:result is None 2023-10-16T23:27:53.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.7 2023-10-16T23:27:53.104 DEBUG:teuthology.parallel:result is None 2023-10-16T23:27:53.105 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.2 2023-10-16T23:27:53.105 DEBUG:teuthology.parallel:result is None 2023-10-16T23:27:53.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.108+0000 7f5b01330640 1 -- 172.21.15.12:0/3267998077 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5af403f960 con 0x7f5af403b470 2023-10-16T23:27:53.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.108+0000 7f5af8ff9640 1 -- 172.21.15.12:0/3267998077 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5af403f960 con 0x7f5af403b470 2023-10-16T23:27:53.112 INFO:teuthology.orchestra.run.smithi012.stdout:64424509449 2023-10-16T23:27:53.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.108+0000 7f5b01330640 1 -- 172.21.15.12:0/3267998077 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5ae0065fb0 msgr2=0x7f5ae0068470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:53.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.108+0000 7f5b01330640 1 --2- 172.21.15.12:0/3267998077 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5ae0065fb0 0x7f5ae0068470 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80011f0 tx=0x7f5ae8009040 comp rx=0 tx=0).stop 2023-10-16T23:27:53.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.108+0000 7f5b01330640 1 -- 172.21.15.12:0/3267998077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5af403b470 msgr2=0x7f5af40d67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:53.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.108+0000 7f5b01330640 1 --2- 172.21.15.12:0/3267998077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5af403b470 0x7f5af40d67e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5afc04f950 tx=0x7f5afc092de0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.112+0000 7f5b01330640 1 -- 172.21.15.12:0/3267998077 shutdown_connections 2023-10-16T23:27:53.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.112+0000 7f5b01330640 1 --2- 172.21.15.12:0/3267998077 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5ae0065fb0 0x7f5ae0068470 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.112+0000 7f5b01330640 1 --2- 172.21.15.12:0/3267998077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5af403b470 0x7f5af40d67e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.112+0000 7f5b01330640 1 --2- 172.21.15.12:0/3267998077 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5af4008eb0 0x7f5af41756d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.112+0000 7f5b01330640 1 --2- 172.21.15.12:0/3267998077 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5af4006d90 0x7f5af403fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.112+0000 7f5b01330640 1 -- 172.21.15.12:0/3267998077 >> 172.21.15.12:0/3267998077 conn(0x7f5af4044a30 msgr2=0x7f5af40279e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:53.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.112+0000 7f5b01330640 1 -- 172.21.15.12:0/3267998077 shutdown_connections 2023-10-16T23:27:53.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.112+0000 7f5b01330640 1 -- 172.21.15.12:0/3267998077 wait complete. 2023-10-16T23:27:53.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.4 2023-10-16T23:27:53.128 DEBUG:teuthology.parallel:result is None 2023-10-16T23:27:53.128 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-16T23:27:53.129 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T23:27:53.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.280+0000 7fb962f16640 1 Processor -- start 2023-10-16T23:27:53.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.280+0000 7fb962f16640 1 -- start start 2023-10-16T23:27:53.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.284+0000 7fb962f16640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb95c0c1130 0x7fb95c14fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:53.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.284+0000 7fb962f16640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb95c071510 0x7fb95c150070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:53.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.284+0000 7fb962f16640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb95c0ba570 0x7fb95c0bbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:53.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.284+0000 7fb962f16640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb95c1505b0 con 0x7fb95c0c1130 2023-10-16T23:27:53.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.284+0000 7fb962f16640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb95c06f350 con 0x7fb95c0ba570 2023-10-16T23:27:53.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.284+0000 7fb962f16640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c06f630 con 0x7fb95c071510 2023-10-16T23:27:53.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.284+0000 7fb960cb2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb95c0c1130 0x7fb95c14fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:53.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.284+0000 7fb960cb2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb95c0c1130 0x7fb95c14fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55928/0 (socket says 172.21.15.12:55928) 2023-10-16T23:27:53.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.284+0000 7fb960cb2640 1 -- 172.21.15.12:0/1624057001 learned_addr learned my addr 172.21.15.12:0/1624057001 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:53.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.284+0000 7fb9614b3640 1 --2- 172.21.15.12:0/1624057001 >> v2:172.21.15.31:3300/0 conn(0x7fb95c0ba570 0x7fb95c0bbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:53.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.284+0000 7fb95bfff640 1 --2- 172.21.15.12:0/1624057001 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb95c071510 0x7fb95c150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:53.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.284+0000 7fb960cb2640 1 -- 172.21.15.12:0/1624057001 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb95c071510 msgr2=0x7fb95c150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:53.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.284+0000 7fb960cb2640 1 --2- 172.21.15.12:0/1624057001 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb95c071510 0x7fb95c150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.284+0000 7fb960cb2640 1 -- 172.21.15.12:0/1624057001 >> v2:172.21.15.31:3300/0 conn(0x7fb95c0ba570 msgr2=0x7fb95c0bbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:53.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.284+0000 7fb960cb2640 1 --2- 172.21.15.12:0/1624057001 >> v2:172.21.15.31:3300/0 conn(0x7fb95c0ba570 0x7fb95c0bbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.284+0000 7fb960cb2640 1 -- 172.21.15.12:0/1624057001 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95c14f610 con 0x7fb95c0c1130 2023-10-16T23:27:53.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.284+0000 7fb960cb2640 1 --2- 172.21.15.12:0/1624057001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb95c0c1130 0x7fb95c14fb30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb95c06e700 tx=0x7fb94c01c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd43ff4181491cc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:53.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.284+0000 7fb95b7fe640 1 -- 172.21.15.12:0/1624057001 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c0ab600 con 0x7fb95c0c1130 2023-10-16T23:27:53.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.284+0000 7fb95b7fe640 1 -- 172.21.15.12:0/1624057001 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94c0a7050 con 0x7fb95c0c1130 2023-10-16T23:27:53.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.284+0000 7fb95b7fe640 1 -- 172.21.15.12:0/1624057001 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c0ab980 con 0x7fb95c0c1130 2023-10-16T23:27:53.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb962f16640 1 -- 172.21.15.12:0/1624057001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb95c0c1130 msgr2=0x7fb95c14fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:53.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb962f16640 1 --2- 172.21.15.12:0/1624057001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb95c0c1130 0x7fb95c14fb30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb95c06e700 tx=0x7fb94c01c240 comp rx=0 tx=0).stop 2023-10-16T23:27:53.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb962f16640 1 -- 172.21.15.12:0/1624057001 shutdown_connections 2023-10-16T23:27:53.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb962f16640 1 --2- 172.21.15.12:0/1624057001 >> v2:172.21.15.31:3300/0 conn(0x7fb95c0ba570 0x7fb95c0bbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb962f16640 1 --2- 172.21.15.12:0/1624057001 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb95c071510 0x7fb95c150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb962f16640 1 --2- 172.21.15.12:0/1624057001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb95c0c1130 0x7fb95c14fb30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb962f16640 1 -- 172.21.15.12:0/1624057001 >> 172.21.15.12:0/1624057001 conn(0x7fb95c06ba20 msgr2=0x7fb95c0c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:53.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb962f16640 1 -- 172.21.15.12:0/1624057001 shutdown_connections 2023-10-16T23:27:53.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb962f16640 1 -- 172.21.15.12:0/1624057001 wait complete. 2023-10-16T23:27:53.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb962f16640 1 Processor -- start 2023-10-16T23:27:53.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb962f16640 1 -- start start 2023-10-16T23:27:53.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb962f16640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb95c071510 0x7fb95c14d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:53.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb962f16640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb95c0ba570 0x7fb95c0b6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:53.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb962f16640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb95c0c1130 0x7fb95c144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:53.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb962f16640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c1e8980 con 0x7fb95c0ba570 2023-10-16T23:27:53.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb962f16640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c1444b0 con 0x7fb95c0c1130 2023-10-16T23:27:53.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb962f16640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c0b6c60 con 0x7fb95c071510 2023-10-16T23:27:53.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb95bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb95c0ba570 0x7fb95c0b6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:53.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb95bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb95c0ba570 0x7fb95c0b6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55934/0 (socket says 172.21.15.12:55934) 2023-10-16T23:27:53.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb95bfff640 1 -- 172.21.15.12:0/1606530539 learned_addr learned my addr 172.21.15.12:0/1606530539 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:53.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb960cb2640 1 --2- 172.21.15.12:0/1606530539 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb95c071510 0x7fb95c14d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:53.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb9614b3640 1 --2- 172.21.15.12:0/1606530539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb95c0c1130 0x7fb95c144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:53.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb95bfff640 1 -- 172.21.15.12:0/1606530539 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb95c071510 msgr2=0x7fb95c14d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:53.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb95bfff640 1 --2- 172.21.15.12:0/1606530539 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb95c071510 0x7fb95c14d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb95bfff640 1 -- 172.21.15.12:0/1606530539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb95c0c1130 msgr2=0x7fb95c144940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:53.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb95bfff640 1 --2- 172.21.15.12:0/1606530539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb95c0c1130 0x7fb95c144940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb95bfff640 1 -- 172.21.15.12:0/1606530539 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c0094d0 con 0x7fb95c0ba570 2023-10-16T23:27:53.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb95bfff640 1 --2- 172.21.15.12:0/1606530539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb95c0ba570 0x7fb95c0b6720 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb94400e8b0 tx=0x7fb94400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:53.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb9597fa640 1 -- 172.21.15.12:0/1606530539 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94400c940 con 0x7fb95c0ba570 2023-10-16T23:27:53.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb9597fa640 1 -- 172.21.15.12:0/1606530539 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94400caa0 con 0x7fb95c0ba570 2023-10-16T23:27:53.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb9597fa640 1 -- 172.21.15.12:0/1606530539 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94400ce50 con 0x7fb95c0ba570 2023-10-16T23:27:53.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb962f16640 1 -- 172.21.15.12:0/1606530539 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb95c1e86e0 con 0x7fb95c0ba570 2023-10-16T23:27:53.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.288+0000 7fb962f16640 1 -- 172.21.15.12:0/1606530539 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb95c0b70d0 con 0x7fb95c0ba570 2023-10-16T23:27:53.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.292+0000 7fb962f16640 1 -- 172.21.15.12:0/1606530539 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb95c144660 con 0x7fb95c0ba570 2023-10-16T23:27:53.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.292+0000 7fb9597fa640 1 -- 172.21.15.12:0/1606530539 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fb944013470 con 0x7fb95c0ba570 2023-10-16T23:27:53.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.292+0000 7fb9597fa640 1 --2- 172.21.15.12:0/1606530539 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb93c065e90 0x7fb93c068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:53.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.292+0000 7fb9597fa640 1 -- 172.21.15.12:0/1606530539 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb9440838d0 con 0x7fb95c0ba570 2023-10-16T23:27:53.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.292+0000 7fb960cb2640 1 --2- 172.21.15.12:0/1606530539 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb93c065e90 0x7fb93c068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:53.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.292+0000 7fb960cb2640 1 --2- 172.21.15.12:0/1606530539 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb93c065e90 0x7fb93c068350 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0ad000 tx=0x7fb94c0a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:53.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.296+0000 7fb9597fa640 1 -- 172.21.15.12:0/1606530539 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fb95c144660 con 0x7fb95c0ba570 2023-10-16T23:27:53.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.444+0000 7fb962f16640 1 -- 172.21.15.12:0/1606530539 --> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb95c142ec0 con 0x7fb93c065e90 2023-10-16T23:27:53.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.468+0000 7fb9597fa640 1 -- 172.21.15.12:0/1606530539 <== mgr.4108 v2:172.21.15.31:6832/37949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286541 (secure 0 0 0) 0x7fb95c142ec0 con 0x7fb93c065e90 2023-10-16T23:27:53.473 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:53.477 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-16T23:27:53.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.472+0000 7fb962f16640 1 -- 172.21.15.12:0/1606530539 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb93c065e90 msgr2=0x7fb93c068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:53.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.472+0000 7fb962f16640 1 --2- 172.21.15.12:0/1606530539 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb93c065e90 0x7fb93c068350 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0ad000 tx=0x7fb94c0a6000 comp rx=0 tx=0).stop 2023-10-16T23:27:53.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.472+0000 7fb962f16640 1 -- 172.21.15.12:0/1606530539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb95c0ba570 msgr2=0x7fb95c0b6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:53.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.472+0000 7fb962f16640 1 --2- 172.21.15.12:0/1606530539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb95c0ba570 0x7fb95c0b6720 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb94400e8b0 tx=0x7fb94400ed70 comp rx=0 tx=0).stop 2023-10-16T23:27:53.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.472+0000 7fb962f16640 1 -- 172.21.15.12:0/1606530539 shutdown_connections 2023-10-16T23:27:53.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.472+0000 7fb962f16640 1 --2- 172.21.15.12:0/1606530539 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb93c065e90 0x7fb93c068350 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.472+0000 7fb962f16640 1 --2- 172.21.15.12:0/1606530539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb95c0c1130 0x7fb95c144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.472+0000 7fb962f16640 1 --2- 172.21.15.12:0/1606530539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb95c0ba570 0x7fb95c0b6720 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.472+0000 7fb962f16640 1 --2- 172.21.15.12:0/1606530539 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb95c071510 0x7fb95c14d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.472+0000 7fb962f16640 1 -- 172.21.15.12:0/1606530539 >> 172.21.15.12:0/1606530539 conn(0x7fb95c06ba20 msgr2=0x7fb95c0b9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:53.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.472+0000 7fb962f16640 1 -- 172.21.15.12:0/1606530539 shutdown_connections 2023-10-16T23:27:53.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.472+0000 7fb962f16640 1 -- 172.21.15.12:0/1606530539 wait complete. 2023-10-16T23:27:53.490 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2023-10-16T23:27:53.288377+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222856,"kb_used_data":3144,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751864,"statfs":{"total":773094113280,"available":772865908736,"internally_reserved":0,"allocated":3219456,"data_stored":1912212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.590393"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302132+0000","last_change":"2023-10-16T23:27:40.706600+0000","last_active":"2023-10-16T23:27:42.302132+0000","last_peered":"2023-10-16T23:27:42.302132+0000","last_clean":"2023-10-16T23:27:42.302132+0000","last_became_active":"2023-10-16T23:27:40.706320+0000","last_became_peered":"2023-10-16T23:27:40.706320+0000","last_unstale":"2023-10-16T23:27:42.302132+0000","last_undegraded":"2023-10-16T23:27:42.302132+0000","last_fullsized":"2023-10-16T23:27:42.302132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:48:20.356964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952090+0000","last_change":"2023-10-16T23:27:40.756555+0000","last_active":"2023-10-16T23:27:41.952090+0000","last_peered":"2023-10-16T23:27:41.952090+0000","last_clean":"2023-10-16T23:27:41.952090+0000","last_became_active":"2023-10-16T23:27:40.754736+0000","last_became_peered":"2023-10-16T23:27:40.754736+0000","last_unstale":"2023-10-16T23:27:41.952090+0000","last_undegraded":"2023-10-16T23:27:41.952090+0000","last_fullsized":"2023-10-16T23:27:41.952090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:45.642622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704753+0000","last_change":"2023-10-16T23:27:40.726586+0000","last_active":"2023-10-16T23:27:41.704753+0000","last_peered":"2023-10-16T23:27:41.704753+0000","last_clean":"2023-10-16T23:27:41.704753+0000","last_became_active":"2023-10-16T23:27:40.725731+0000","last_became_peered":"2023-10-16T23:27:40.725731+0000","last_unstale":"2023-10-16T23:27:41.704753+0000","last_undegraded":"2023-10-16T23:27:41.704753+0000","last_fullsized":"2023-10-16T23:27:41.704753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:04:22.434372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702719+0000","last_change":"2023-10-16T23:27:40.715543+0000","last_active":"2023-10-16T23:27:41.702719+0000","last_peered":"2023-10-16T23:27:41.702719+0000","last_clean":"2023-10-16T23:27:41.702719+0000","last_became_active":"2023-10-16T23:27:40.714592+0000","last_became_peered":"2023-10-16T23:27:40.714592+0000","last_unstale":"2023-10-16T23:27:41.702719+0000","last_undegraded":"2023-10-16T23:27:41.702719+0000","last_fullsized":"2023-10-16T23:27:41.702719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:42:37.696897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642193+0000","last_change":"2023-10-16T23:27:40.722734+0000","last_active":"2023-10-16T23:27:42.642193+0000","last_peered":"2023-10-16T23:27:42.642193+0000","last_clean":"2023-10-16T23:27:42.642193+0000","last_became_active":"2023-10-16T23:27:40.722399+0000","last_became_peered":"2023-10-16T23:27:40.722399+0000","last_unstale":"2023-10-16T23:27:42.642193+0000","last_undegraded":"2023-10-16T23:27:42.642193+0000","last_fullsized":"2023-10-16T23:27:42.642193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:19:17.463284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702182+0000","last_change":"2023-10-16T23:27:40.716139+0000","last_active":"2023-10-16T23:27:41.702182+0000","last_peered":"2023-10-16T23:27:41.702182+0000","last_clean":"2023-10-16T23:27:41.702182+0000","last_became_active":"2023-10-16T23:27:40.715294+0000","last_became_peered":"2023-10-16T23:27:40.715294+0000","last_unstale":"2023-10-16T23:27:41.702182+0000","last_undegraded":"2023-10-16T23:27:41.702182+0000","last_fullsized":"2023-10-16T23:27:41.702182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:19:17.463284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302587+0000","last_change":"2023-10-16T23:27:40.762253+0000","last_active":"2023-10-16T23:27:42.302587+0000","last_peered":"2023-10-16T23:27:42.302587+0000","last_clean":"2023-10-16T23:27:42.302587+0000","last_became_active":"2023-10-16T23:27:40.760726+0000","last_became_peered":"2023-10-16T23:27:40.760726+0000","last_unstale":"2023-10-16T23:27:42.302587+0000","last_undegraded":"2023-10-16T23:27:42.302587+0000","last_fullsized":"2023-10-16T23:27:42.302587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:50:08.569961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.951568+0000","last_change":"2023-10-16T23:27:40.756184+0000","last_active":"2023-10-16T23:27:41.951568+0000","last_peered":"2023-10-16T23:27:41.951568+0000","last_clean":"2023-10-16T23:27:41.951568+0000","last_became_active":"2023-10-16T23:27:40.755276+0000","last_became_peered":"2023-10-16T23:27:40.755276+0000","last_unstale":"2023-10-16T23:27:41.951568+0000","last_undegraded":"2023-10-16T23:27:41.951568+0000","last_fullsized":"2023-10-16T23:27:41.951568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642253+0000","last_change":"2023-10-16T23:27:40.724060+0000","last_active":"2023-10-16T23:27:42.642253+0000","last_peered":"2023-10-16T23:27:42.642253+0000","last_clean":"2023-10-16T23:27:42.642253+0000","last_became_active":"2023-10-16T23:27:40.723701+0000","last_became_peered":"2023-10-16T23:27:40.723701+0000","last_unstale":"2023-10-16T23:27:42.642253+0000","last_undegraded":"2023-10-16T23:27:42.642253+0000","last_fullsized":"2023-10-16T23:27:42.642253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:04.722168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952181+0000","last_change":"2023-10-16T23:27:40.756783+0000","last_active":"2023-10-16T23:27:41.952181+0000","last_peered":"2023-10-16T23:27:41.952181+0000","last_clean":"2023-10-16T23:27:41.952181+0000","last_became_active":"2023-10-16T23:27:40.755772+0000","last_became_peered":"2023-10-16T23:27:40.755772+0000","last_unstale":"2023-10-16T23:27:41.952181+0000","last_undegraded":"2023-10-16T23:27:41.952181+0000","last_fullsized":"2023-10-16T23:27:41.952181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704832+0000","last_change":"2023-10-16T23:27:40.724754+0000","last_active":"2023-10-16T23:27:41.704832+0000","last_peered":"2023-10-16T23:27:41.704832+0000","last_clean":"2023-10-16T23:27:41.704832+0000","last_became_active":"2023-10-16T23:27:40.724031+0000","last_became_peered":"2023-10-16T23:27:40.724031+0000","last_unstale":"2023-10-16T23:27:41.704832+0000","last_undegraded":"2023-10-16T23:27:41.704832+0000","last_fullsized":"2023-10-16T23:27:41.704832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:04.722168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302045+0000","last_change":"2023-10-16T23:27:40.724453+0000","last_active":"2023-10-16T23:27:42.302045+0000","last_peered":"2023-10-16T23:27:42.302045+0000","last_clean":"2023-10-16T23:27:42.302045+0000","last_became_active":"2023-10-16T23:27:40.724099+0000","last_became_peered":"2023-10-16T23:27:40.724099+0000","last_unstale":"2023-10-16T23:27:42.302045+0000","last_undegraded":"2023-10-16T23:27:42.302045+0000","last_fullsized":"2023-10-16T23:27:42.302045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:01:05.350517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302015+0000","last_change":"2023-10-16T23:27:40.704484+0000","last_active":"2023-10-16T23:27:42.302015+0000","last_peered":"2023-10-16T23:27:42.302015+0000","last_clean":"2023-10-16T23:27:42.302015+0000","last_became_active":"2023-10-16T23:27:40.704162+0000","last_became_peered":"2023-10-16T23:27:40.704162+0000","last_unstale":"2023-10-16T23:27:42.302015+0000","last_undegraded":"2023-10-16T23:27:42.302015+0000","last_fullsized":"2023-10-16T23:27:42.302015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:15:16.646850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.951790+0000","last_change":"2023-10-16T23:27:40.738913+0000","last_active":"2023-10-16T23:27:41.951790+0000","last_peered":"2023-10-16T23:27:41.951790+0000","last_clean":"2023-10-16T23:27:41.951790+0000","last_became_active":"2023-10-16T23:27:40.738070+0000","last_became_peered":"2023-10-16T23:27:40.738070+0000","last_unstale":"2023-10-16T23:27:41.951790+0000","last_undegraded":"2023-10-16T23:27:41.951790+0000","last_fullsized":"2023-10-16T23:27:41.951790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:56:41.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302643+0000","last_change":"2023-10-16T23:27:40.762529+0000","last_active":"2023-10-16T23:27:42.302643+0000","last_peered":"2023-10-16T23:27:42.302643+0000","last_clean":"2023-10-16T23:27:42.302643+0000","last_became_active":"2023-10-16T23:27:40.761570+0000","last_became_peered":"2023-10-16T23:27:40.761570+0000","last_unstale":"2023-10-16T23:27:42.302643+0000","last_undegraded":"2023-10-16T23:27:42.302643+0000","last_fullsized":"2023-10-16T23:27:42.302643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:46.449264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702044+0000","last_change":"2023-10-16T23:27:40.719227+0000","last_active":"2023-10-16T23:27:41.702044+0000","last_peered":"2023-10-16T23:27:41.702044+0000","last_clean":"2023-10-16T23:27:41.702044+0000","last_became_active":"2023-10-16T23:27:40.718276+0000","last_became_peered":"2023-10-16T23:27:40.718276+0000","last_unstale":"2023-10-16T23:27:41.702044+0000","last_undegraded":"2023-10-16T23:27:41.702044+0000","last_fullsized":"2023-10-16T23:27:41.702044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642387+0000","last_change":"2023-10-16T23:27:40.719723+0000","last_active":"2023-10-16T23:27:42.642387+0000","last_peered":"2023-10-16T23:27:42.642387+0000","last_clean":"2023-10-16T23:27:42.642387+0000","last_became_active":"2023-10-16T23:27:40.719402+0000","last_became_peered":"2023-10-16T23:27:40.719402+0000","last_unstale":"2023-10-16T23:27:42.642387+0000","last_undegraded":"2023-10-16T23:27:42.642387+0000","last_fullsized":"2023-10-16T23:27:42.642387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:04:22.434372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704498+0000","last_change":"2023-10-16T23:27:40.732931+0000","last_active":"2023-10-16T23:27:41.704498+0000","last_peered":"2023-10-16T23:27:41.704498+0000","last_clean":"2023-10-16T23:27:41.704498+0000","last_became_active":"2023-10-16T23:27:40.732102+0000","last_became_peered":"2023-10-16T23:27:40.732102+0000","last_unstale":"2023-10-16T23:27:41.704498+0000","last_undegraded":"2023-10-16T23:27:41.704498+0000","last_fullsized":"2023-10-16T23:27:41.704498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:14.359461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302105+0000","last_change":"2023-10-16T23:27:40.728920+0000","last_active":"2023-10-16T23:27:42.302105+0000","last_peered":"2023-10-16T23:27:42.302105+0000","last_clean":"2023-10-16T23:27:42.302105+0000","last_became_active":"2023-10-16T23:27:40.728298+0000","last_became_peered":"2023-10-16T23:27:40.728298+0000","last_unstale":"2023-10-16T23:27:42.302105+0000","last_undegraded":"2023-10-16T23:27:42.302105+0000","last_fullsized":"2023-10-16T23:27:42.302105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:28:33.509782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704201+0000","last_change":"2023-10-16T23:27:40.745270+0000","last_active":"2023-10-16T23:27:41.704201+0000","last_peered":"2023-10-16T23:27:41.704201+0000","last_clean":"2023-10-16T23:27:41.704201+0000","last_became_active":"2023-10-16T23:27:40.744483+0000","last_became_peered":"2023-10-16T23:27:40.744483+0000","last_unstale":"2023-10-16T23:27:41.704201+0000","last_undegraded":"2023-10-16T23:27:41.704201+0000","last_fullsized":"2023-10-16T23:27:41.704201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:24:33.998070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302748+0000","last_change":"2023-10-16T23:27:40.761480+0000","last_active":"2023-10-16T23:27:42.302748+0000","last_peered":"2023-10-16T23:27:42.302748+0000","last_clean":"2023-10-16T23:27:42.302748+0000","last_became_active":"2023-10-16T23:27:40.760882+0000","last_became_peered":"2023-10-16T23:27:40.760882+0000","last_unstale":"2023-10-16T23:27:42.302748+0000","last_undegraded":"2023-10-16T23:27:42.302748+0000","last_fullsized":"2023-10-16T23:27:42.302748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:37:38.843931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.640893+0000","last_change":"2023-10-16T23:27:40.722620+0000","last_active":"2023-10-16T23:27:42.640893+0000","last_peered":"2023-10-16T23:27:42.640893+0000","last_clean":"2023-10-16T23:27:42.640893+0000","last_became_active":"2023-10-16T23:27:40.722302+0000","last_became_peered":"2023-10-16T23:27:40.722302+0000","last_unstale":"2023-10-16T23:27:42.640893+0000","last_undegraded":"2023-10-16T23:27:42.640893+0000","last_fullsized":"2023-10-16T23:27:42.640893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697349+0000","last_change":"2023-10-16T23:27:40.716578+0000","last_active":"2023-10-16T23:27:41.697349+0000","last_peered":"2023-10-16T23:27:41.697349+0000","last_clean":"2023-10-16T23:27:41.697349+0000","last_became_active":"2023-10-16T23:27:40.716228+0000","last_became_peered":"2023-10-16T23:27:40.716228+0000","last_unstale":"2023-10-16T23:27:41.697349+0000","last_undegraded":"2023-10-16T23:27:41.697349+0000","last_fullsized":"2023-10-16T23:27:41.697349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:27:29.534374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302466+0000","last_change":"2023-10-16T23:27:40.761323+0000","last_active":"2023-10-16T23:27:42.302466+0000","last_peered":"2023-10-16T23:27:42.302466+0000","last_clean":"2023-10-16T23:27:42.302466+0000","last_became_active":"2023-10-16T23:27:40.760659+0000","last_became_peered":"2023-10-16T23:27:40.760659+0000","last_unstale":"2023-10-16T23:27:42.302466+0000","last_undegraded":"2023-10-16T23:27:42.302466+0000","last_fullsized":"2023-10-16T23:27:42.302466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:09:55.835429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478936+0000","last_change":"2023-10-16T23:27:40.727629+0000","last_active":"2023-10-16T23:27:42.478936+0000","last_peered":"2023-10-16T23:27:42.478936+0000","last_clean":"2023-10-16T23:27:42.478936+0000","last_became_active":"2023-10-16T23:27:40.727334+0000","last_became_peered":"2023-10-16T23:27:40.727334+0000","last_unstale":"2023-10-16T23:27:42.478936+0000","last_undegraded":"2023-10-16T23:27:42.478936+0000","last_fullsized":"2023-10-16T23:27:42.478936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:38:33.383867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.479296+0000","last_change":"2023-10-16T23:27:40.704775+0000","last_active":"2023-10-16T23:27:42.479296+0000","last_peered":"2023-10-16T23:27:42.479296+0000","last_clean":"2023-10-16T23:27:42.479296+0000","last_became_active":"2023-10-16T23:27:40.704536+0000","last_became_peered":"2023-10-16T23:27:40.704536+0000","last_unstale":"2023-10-16T23:27:42.479296+0000","last_undegraded":"2023-10-16T23:27:42.479296+0000","last_fullsized":"2023-10-16T23:27:42.479296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952175+0000","last_change":"2023-10-16T23:27:40.764351+0000","last_active":"2023-10-16T23:27:41.952175+0000","last_peered":"2023-10-16T23:27:41.952175+0000","last_clean":"2023-10-16T23:27:41.952175+0000","last_became_active":"2023-10-16T23:27:40.763592+0000","last_became_peered":"2023-10-16T23:27:40.763592+0000","last_unstale":"2023-10-16T23:27:41.952175+0000","last_undegraded":"2023-10-16T23:27:41.952175+0000","last_fullsized":"2023-10-16T23:27:41.952175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.479026+0000","last_change":"2023-10-16T23:27:40.760989+0000","last_active":"2023-10-16T23:27:42.479026+0000","last_peered":"2023-10-16T23:27:42.479026+0000","last_clean":"2023-10-16T23:27:42.479026+0000","last_became_active":"2023-10-16T23:27:40.760615+0000","last_became_peered":"2023-10-16T23:27:40.760615+0000","last_unstale":"2023-10-16T23:27:42.479026+0000","last_undegraded":"2023-10-16T23:27:42.479026+0000","last_fullsized":"2023-10-16T23:27:42.479026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698072+0000","last_change":"2023-10-16T23:27:40.760762+0000","last_active":"2023-10-16T23:27:41.698072+0000","last_peered":"2023-10-16T23:27:41.698072+0000","last_clean":"2023-10-16T23:27:41.698072+0000","last_became_active":"2023-10-16T23:27:40.760437+0000","last_became_peered":"2023-10-16T23:27:40.760437+0000","last_unstale":"2023-10-16T23:27:41.698072+0000","last_undegraded":"2023-10-16T23:27:41.698072+0000","last_fullsized":"2023-10-16T23:27:41.698072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:55:29.771781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.703806+0000","last_change":"2023-10-16T23:27:40.745197+0000","last_active":"2023-10-16T23:27:41.703806+0000","last_peered":"2023-10-16T23:27:41.703806+0000","last_clean":"2023-10-16T23:27:41.703806+0000","last_became_active":"2023-10-16T23:27:40.744458+0000","last_became_peered":"2023-10-16T23:27:40.744458+0000","last_unstale":"2023-10-16T23:27:41.703806+0000","last_undegraded":"2023-10-16T23:27:41.703806+0000","last_fullsized":"2023-10-16T23:27:41.703806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697368+0000","last_change":"2023-10-16T23:27:40.711795+0000","last_active":"2023-10-16T23:27:41.697368+0000","last_peered":"2023-10-16T23:27:41.697368+0000","last_clean":"2023-10-16T23:27:41.697368+0000","last_became_active":"2023-10-16T23:27:40.711492+0000","last_became_peered":"2023-10-16T23:27:40.711492+0000","last_unstale":"2023-10-16T23:27:41.697368+0000","last_undegraded":"2023-10-16T23:27:41.697368+0000","last_fullsized":"2023-10-16T23:27:41.697368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:04:22.434372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702060+0000","last_change":"2023-10-16T23:27:40.710149+0000","last_active":"2023-10-16T23:27:41.702060+0000","last_peered":"2023-10-16T23:27:41.702060+0000","last_clean":"2023-10-16T23:27:41.702060+0000","last_became_active":"2023-10-16T23:27:40.709286+0000","last_became_peered":"2023-10-16T23:27:40.709286+0000","last_unstale":"2023-10-16T23:27:41.702060+0000","last_undegraded":"2023-10-16T23:27:41.702060+0000","last_fullsized":"2023-10-16T23:27:41.702060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:22:41.708468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698461+0000","last_change":"2023-10-16T23:27:40.707271+0000","last_active":"2023-10-16T23:27:41.698461+0000","last_peered":"2023-10-16T23:27:41.698461+0000","last_clean":"2023-10-16T23:27:41.698461+0000","last_became_active":"2023-10-16T23:27:40.706864+0000","last_became_peered":"2023-10-16T23:27:40.706864+0000","last_unstale":"2023-10-16T23:27:41.698461+0000","last_undegraded":"2023-10-16T23:27:41.698461+0000","last_fullsized":"2023-10-16T23:27:41.698461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302796+0000","last_change":"2023-10-16T23:27:40.353567+0000","last_active":"2023-10-16T23:27:42.302796+0000","last_peered":"2023-10-16T23:27:42.302796+0000","last_clean":"2023-10-16T23:27:42.302796+0000","last_became_active":"2023-10-16T23:27:40.352775+0000","last_became_peered":"2023-10-16T23:27:40.352775+0000","last_unstale":"2023-10-16T23:27:42.302796+0000","last_undegraded":"2023-10-16T23:27:42.302796+0000","last_fullsized":"2023-10-16T23:27:42.302796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:52:58.351406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952358+0000","last_change":"2023-10-16T23:27:40.765398+0000","last_active":"2023-10-16T23:27:41.952358+0000","last_peered":"2023-10-16T23:27:41.952358+0000","last_clean":"2023-10-16T23:27:41.952358+0000","last_became_active":"2023-10-16T23:27:40.764517+0000","last_became_peered":"2023-10-16T23:27:40.764517+0000","last_unstale":"2023-10-16T23:27:41.952358+0000","last_undegraded":"2023-10-16T23:27:41.952358+0000","last_fullsized":"2023-10-16T23:27:41.952358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:31.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641131+0000","last_change":"2023-10-16T23:27:40.335221+0000","last_active":"2023-10-16T23:27:42.641131+0000","last_peered":"2023-10-16T23:27:42.641131+0000","last_clean":"2023-10-16T23:27:42.641131+0000","last_became_active":"2023-10-16T23:27:40.334885+0000","last_became_peered":"2023-10-16T23:27:40.334885+0000","last_unstale":"2023-10-16T23:27:42.641131+0000","last_undegraded":"2023-10-16T23:27:42.641131+0000","last_fullsized":"2023-10-16T23:27:42.641131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641719+0000","last_change":"2023-10-16T23:27:40.719997+0000","last_active":"2023-10-16T23:27:42.641719+0000","last_peered":"2023-10-16T23:27:42.641719+0000","last_clean":"2023-10-16T23:27:42.641719+0000","last_became_active":"2023-10-16T23:27:40.719811+0000","last_became_peered":"2023-10-16T23:27:40.719811+0000","last_unstale":"2023-10-16T23:27:42.641719+0000","last_undegraded":"2023-10-16T23:27:42.641719+0000","last_fullsized":"2023-10-16T23:27:42.641719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:13.934735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302695+0000","last_change":"2023-10-16T23:27:40.357620+0000","last_active":"2023-10-16T23:27:42.302695+0000","last_peered":"2023-10-16T23:27:42.302695+0000","last_clean":"2023-10-16T23:27:42.302695+0000","last_became_active":"2023-10-16T23:27:40.357009+0000","last_became_peered":"2023-10-16T23:27:40.357009+0000","last_unstale":"2023-10-16T23:27:42.302695+0000","last_undegraded":"2023-10-16T23:27:42.302695+0000","last_fullsized":"2023-10-16T23:27:42.302695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:07:50.847519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698809+0000","last_change":"2023-10-16T23:27:40.760925+0000","last_active":"2023-10-16T23:27:41.698809+0000","last_peered":"2023-10-16T23:27:41.698809+0000","last_clean":"2023-10-16T23:27:41.698809+0000","last_became_active":"2023-10-16T23:27:40.760365+0000","last_became_peered":"2023-10-16T23:27:40.760365+0000","last_unstale":"2023-10-16T23:27:41.698809+0000","last_undegraded":"2023-10-16T23:27:41.698809+0000","last_fullsized":"2023-10-16T23:27:41.698809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:13.934735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702299+0000","last_change":"2023-10-16T23:27:40.331826+0000","last_active":"2023-10-16T23:27:41.702299+0000","last_peered":"2023-10-16T23:27:41.702299+0000","last_clean":"2023-10-16T23:27:41.702299+0000","last_became_active":"2023-10-16T23:27:40.330857+0000","last_became_peered":"2023-10-16T23:27:40.330857+0000","last_unstale":"2023-10-16T23:27:41.702299+0000","last_undegraded":"2023-10-16T23:27:41.702299+0000","last_fullsized":"2023-10-16T23:27:41.702299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:42:46.614672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.303087+0000","last_change":"2023-10-16T23:27:40.357691+0000","last_active":"2023-10-16T23:27:42.303087+0000","last_peered":"2023-10-16T23:27:42.303087+0000","last_clean":"2023-10-16T23:27:42.303087+0000","last_became_active":"2023-10-16T23:27:40.357047+0000","last_became_peered":"2023-10-16T23:27:40.357047+0000","last_unstale":"2023-10-16T23:27:42.303087+0000","last_undegraded":"2023-10-16T23:27:42.303087+0000","last_fullsized":"2023-10-16T23:27:42.303087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:00:00.805564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.951579+0000","last_change":"2023-10-16T23:27:40.763848+0000","last_active":"2023-10-16T23:27:41.951579+0000","last_peered":"2023-10-16T23:27:41.951579+0000","last_clean":"2023-10-16T23:27:41.951579+0000","last_became_active":"2023-10-16T23:27:40.763116+0000","last_became_peered":"2023-10-16T23:27:40.763116+0000","last_unstale":"2023-10-16T23:27:41.951579+0000","last_undegraded":"2023-10-16T23:27:41.951579+0000","last_fullsized":"2023-10-16T23:27:41.951579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.303028+0000","last_change":"2023-10-16T23:27:40.347016+0000","last_active":"2023-10-16T23:27:42.303028+0000","last_peered":"2023-10-16T23:27:42.303028+0000","last_clean":"2023-10-16T23:27:42.303028+0000","last_became_active":"2023-10-16T23:27:40.346439+0000","last_became_peered":"2023-10-16T23:27:40.346439+0000","last_unstale":"2023-10-16T23:27:42.303028+0000","last_undegraded":"2023-10-16T23:27:42.303028+0000","last_fullsized":"2023-10-16T23:27:42.303028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:08:40.047699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702083+0000","last_change":"2023-10-16T23:27:40.714905+0000","last_active":"2023-10-16T23:27:41.702083+0000","last_peered":"2023-10-16T23:27:41.702083+0000","last_clean":"2023-10-16T23:27:41.702083+0000","last_became_active":"2023-10-16T23:27:40.714098+0000","last_became_peered":"2023-10-16T23:27:40.714098+0000","last_unstale":"2023-10-16T23:27:41.702083+0000","last_undegraded":"2023-10-16T23:27:41.702083+0000","last_fullsized":"2023-10-16T23:27:41.702083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:13.934735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302935+0000","last_change":"2023-10-16T23:27:40.340462+0000","last_active":"2023-10-16T23:27:42.302935+0000","last_peered":"2023-10-16T23:27:42.302935+0000","last_clean":"2023-10-16T23:27:42.302935+0000","last_became_active":"2023-10-16T23:27:40.339531+0000","last_became_peered":"2023-10-16T23:27:40.339531+0000","last_unstale":"2023-10-16T23:27:42.302935+0000","last_undegraded":"2023-10-16T23:27:42.302935+0000","last_fullsized":"2023-10-16T23:27:42.302935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:33:50.768168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702961+0000","last_change":"2023-10-16T23:27:40.713930+0000","last_active":"2023-10-16T23:27:41.702961+0000","last_peered":"2023-10-16T23:27:41.702961+0000","last_clean":"2023-10-16T23:27:41.702961+0000","last_became_active":"2023-10-16T23:27:40.713087+0000","last_became_peered":"2023-10-16T23:27:40.713087+0000","last_unstale":"2023-10-16T23:27:41.702961+0000","last_undegraded":"2023-10-16T23:27:41.702961+0000","last_fullsized":"2023-10-16T23:27:41.702961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:15:24.177529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.951911+0000","last_change":"2023-10-16T23:27:40.320848+0000","last_active":"2023-10-16T23:27:41.951911+0000","last_peered":"2023-10-16T23:27:41.951911+0000","last_clean":"2023-10-16T23:27:41.951911+0000","last_became_active":"2023-10-16T23:27:40.319887+0000","last_became_peered":"2023-10-16T23:27:40.319887+0000","last_unstale":"2023-10-16T23:27:41.951911+0000","last_undegraded":"2023-10-16T23:27:41.951911+0000","last_fullsized":"2023-10-16T23:27:41.951911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:33:08.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641867+0000","last_change":"2023-10-16T23:27:40.726405+0000","last_active":"2023-10-16T23:27:42.641867+0000","last_peered":"2023-10-16T23:27:42.641867+0000","last_clean":"2023-10-16T23:27:42.641867+0000","last_became_active":"2023-10-16T23:27:40.725724+0000","last_became_peered":"2023-10-16T23:27:40.725724+0000","last_unstale":"2023-10-16T23:27:42.641867+0000","last_undegraded":"2023-10-16T23:27:42.641867+0000","last_fullsized":"2023-10-16T23:27:42.641867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698263+0000","last_change":"2023-10-16T23:27:40.337756+0000","last_active":"2023-10-16T23:27:41.698263+0000","last_peered":"2023-10-16T23:27:41.698263+0000","last_clean":"2023-10-16T23:27:41.698263+0000","last_became_active":"2023-10-16T23:27:40.337405+0000","last_became_peered":"2023-10-16T23:27:40.337405+0000","last_unstale":"2023-10-16T23:27:41.698263+0000","last_undegraded":"2023-10-16T23:27:41.698263+0000","last_fullsized":"2023-10-16T23:27:41.698263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:42.154580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704502+0000","last_change":"2023-10-16T23:27:40.722911+0000","last_active":"2023-10-16T23:27:41.704502+0000","last_peered":"2023-10-16T23:27:41.704502+0000","last_clean":"2023-10-16T23:27:41.704502+0000","last_became_active":"2023-10-16T23:27:40.722091+0000","last_became_peered":"2023-10-16T23:27:40.722091+0000","last_unstale":"2023-10-16T23:27:41.704502+0000","last_undegraded":"2023-10-16T23:27:41.704502+0000","last_fullsized":"2023-10-16T23:27:41.704502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.703208+0000","last_change":"2023-10-16T23:27:40.343242+0000","last_active":"2023-10-16T23:27:41.703208+0000","last_peered":"2023-10-16T23:27:41.703208+0000","last_clean":"2023-10-16T23:27:41.703208+0000","last_became_active":"2023-10-16T23:27:40.342213+0000","last_became_peered":"2023-10-16T23:27:40.342213+0000","last_unstale":"2023-10-16T23:27:41.703208+0000","last_undegraded":"2023-10-16T23:27:41.703208+0000","last_fullsized":"2023-10-16T23:27:41.703208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:04.095452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704900+0000","last_change":"2023-10-16T23:27:40.733845+0000","last_active":"2023-10-16T23:27:41.704900+0000","last_peered":"2023-10-16T23:27:41.704900+0000","last_clean":"2023-10-16T23:27:41.704900+0000","last_became_active":"2023-10-16T23:27:40.732996+0000","last_became_peered":"2023-10-16T23:27:40.732996+0000","last_unstale":"2023-10-16T23:27:41.704900+0000","last_undegraded":"2023-10-16T23:27:41.704900+0000","last_fullsized":"2023-10-16T23:27:41.704900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:06:04.512089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702852+0000","last_change":"2023-10-16T23:27:40.347984+0000","last_active":"2023-10-16T23:27:41.702852+0000","last_peered":"2023-10-16T23:27:41.702852+0000","last_clean":"2023-10-16T23:27:41.702852+0000","last_became_active":"2023-10-16T23:27:40.347253+0000","last_became_peered":"2023-10-16T23:27:40.347253+0000","last_unstale":"2023-10-16T23:27:41.702852+0000","last_undegraded":"2023-10-16T23:27:41.702852+0000","last_fullsized":"2023-10-16T23:27:41.702852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:42:46.614672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704750+0000","last_change":"2023-10-16T23:27:40.745245+0000","last_active":"2023-10-16T23:27:41.704750+0000","last_peered":"2023-10-16T23:27:41.704750+0000","last_clean":"2023-10-16T23:27:41.704750+0000","last_became_active":"2023-10-16T23:27:40.744571+0000","last_became_peered":"2023-10-16T23:27:40.744571+0000","last_unstale":"2023-10-16T23:27:41.704750+0000","last_undegraded":"2023-10-16T23:27:41.704750+0000","last_fullsized":"2023-10-16T23:27:41.704750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:10:39.974563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697473+0000","last_change":"2023-10-16T23:27:40.314767+0000","last_active":"2023-10-16T23:27:41.697473+0000","last_peered":"2023-10-16T23:27:41.697473+0000","last_clean":"2023-10-16T23:27:41.697473+0000","last_became_active":"2023-10-16T23:27:40.314242+0000","last_became_peered":"2023-10-16T23:27:40.314242+0000","last_unstale":"2023-10-16T23:27:41.697473+0000","last_undegraded":"2023-10-16T23:27:41.697473+0000","last_fullsized":"2023-10-16T23:27:41.697473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.479126+0000","last_change":"2023-10-16T23:27:40.709591+0000","last_active":"2023-10-16T23:27:42.479126+0000","last_peered":"2023-10-16T23:27:42.479126+0000","last_clean":"2023-10-16T23:27:42.479126+0000","last_became_active":"2023-10-16T23:27:40.709174+0000","last_became_peered":"2023-10-16T23:27:40.709174+0000","last_unstale":"2023-10-16T23:27:42.479126+0000","last_undegraded":"2023-10-16T23:27:42.479126+0000","last_fullsized":"2023-10-16T23:27:42.479126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:31.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.732645+0000","last_change":"2023-10-16T23:27:29.356842+0000","last_active":"2023-10-16T23:27:40.732645+0000","last_peered":"2023-10-16T23:27:40.732645+0000","last_clean":"2023-10-16T23:27:40.732645+0000","last_became_active":"2023-10-16T23:27:29.353846+0000","last_became_peered":"2023-10-16T23:27:29.353846+0000","last_unstale":"2023-10-16T23:27:40.732645+0000","last_undegraded":"2023-10-16T23:27:40.732645+0000","last_fullsized":"2023-10-16T23:27:40.732645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:28.136202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:28.136202+0000","last_clean_scrub_stamp":"2023-10-16T23:27:28.136202+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:34:30.590360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.706470+0000","last_change":"2023-10-16T23:27:36.278001+0000","last_active":"2023-10-16T23:27:40.706470+0000","last_peered":"2023-10-16T23:27:40.706470+0000","last_clean":"2023-10-16T23:27:40.706470+0000","last_became_active":"2023-10-16T23:27:36.277096+0000","last_became_peered":"2023-10-16T23:27:36.277096+0000","last_unstale":"2023-10-16T23:27:40.706470+0000","last_undegraded":"2023-10-16T23:27:40.706470+0000","last_fullsized":"2023-10-16T23:27:40.706470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:38:00.468059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697647+0000","last_change":"2023-10-16T23:27:40.331268+0000","last_active":"2023-10-16T23:27:41.697647+0000","last_peered":"2023-10-16T23:27:41.697647+0000","last_clean":"2023-10-16T23:27:41.697647+0000","last_became_active":"2023-10-16T23:27:40.330989+0000","last_became_peered":"2023-10-16T23:27:40.330989+0000","last_unstale":"2023-10-16T23:27:41.697647+0000","last_undegraded":"2023-10-16T23:27:41.697647+0000","last_fullsized":"2023-10-16T23:27:41.697647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:55.630817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702608+0000","last_change":"2023-10-16T23:27:40.726429+0000","last_active":"2023-10-16T23:27:41.702608+0000","last_peered":"2023-10-16T23:27:41.702608+0000","last_clean":"2023-10-16T23:27:41.702608+0000","last_became_active":"2023-10-16T23:27:40.725490+0000","last_became_peered":"2023-10-16T23:27:40.725490+0000","last_unstale":"2023-10-16T23:27:41.702608+0000","last_undegraded":"2023-10-16T23:27:41.702608+0000","last_fullsized":"2023-10-16T23:27:41.702608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:52:41.884757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.734075+0000","last_change":"2023-10-16T23:27:36.278865+0000","last_active":"2023-10-16T23:27:40.734075+0000","last_peered":"2023-10-16T23:27:40.734075+0000","last_clean":"2023-10-16T23:27:40.734075+0000","last_became_active":"2023-10-16T23:27:36.277974+0000","last_became_peered":"2023-10-16T23:27:36.277974+0000","last_unstale":"2023-10-16T23:27:40.734075+0000","last_undegraded":"2023-10-16T23:27:40.734075+0000","last_fullsized":"2023-10-16T23:27:40.734075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:31:09.411975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641255+0000","last_change":"2023-10-16T23:27:40.340025+0000","last_active":"2023-10-16T23:27:42.641255+0000","last_peered":"2023-10-16T23:27:42.641255+0000","last_clean":"2023-10-16T23:27:42.641255+0000","last_became_active":"2023-10-16T23:27:40.339569+0000","last_became_peered":"2023-10-16T23:27:40.339569+0000","last_unstale":"2023-10-16T23:27:42.641255+0000","last_undegraded":"2023-10-16T23:27:42.641255+0000","last_fullsized":"2023-10-16T23:27:42.641255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:42.154580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641378+0000","last_change":"2023-10-16T23:27:40.727415+0000","last_active":"2023-10-16T23:27:42.641378+0000","last_peered":"2023-10-16T23:27:42.641378+0000","last_clean":"2023-10-16T23:27:42.641378+0000","last_became_active":"2023-10-16T23:27:40.726813+0000","last_became_peered":"2023-10-16T23:27:40.726813+0000","last_unstale":"2023-10-16T23:27:42.641378+0000","last_undegraded":"2023-10-16T23:27:42.641378+0000","last_fullsized":"2023-10-16T23:27:42.641378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.694106+0000","last_change":"2023-10-16T23:27:36.294967+0000","last_active":"2023-10-16T23:27:40.694106+0000","last_peered":"2023-10-16T23:27:40.694106+0000","last_clean":"2023-10-16T23:27:40.694106+0000","last_became_active":"2023-10-16T23:27:36.294489+0000","last_became_peered":"2023-10-16T23:27:36.294489+0000","last_unstale":"2023-10-16T23:27:40.694106+0000","last_undegraded":"2023-10-16T23:27:40.694106+0000","last_fullsized":"2023-10-16T23:27:40.694106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:43:01.777197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478192+0000","last_change":"2023-10-16T23:27:40.327194+0000","last_active":"2023-10-16T23:27:42.478192+0000","last_peered":"2023-10-16T23:27:42.478192+0000","last_clean":"2023-10-16T23:27:42.478192+0000","last_became_active":"2023-10-16T23:27:40.326396+0000","last_became_peered":"2023-10-16T23:27:40.326396+0000","last_unstale":"2023-10-16T23:27:42.478192+0000","last_undegraded":"2023-10-16T23:27:42.478192+0000","last_fullsized":"2023-10-16T23:27:42.478192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:42.154580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.479151+0000","last_change":"2023-10-16T23:27:40.755777+0000","last_active":"2023-10-16T23:27:42.479151+0000","last_peered":"2023-10-16T23:27:42.479151+0000","last_clean":"2023-10-16T23:27:42.479151+0000","last_became_active":"2023-10-16T23:27:40.755489+0000","last_became_peered":"2023-10-16T23:27:40.755489+0000","last_unstale":"2023-10-16T23:27:42.479151+0000","last_undegraded":"2023-10-16T23:27:42.479151+0000","last_fullsized":"2023-10-16T23:27:42.479151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:06.148922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.720703+0000","last_change":"2023-10-16T23:27:36.279013+0000","last_active":"2023-10-16T23:27:40.720703+0000","last_peered":"2023-10-16T23:27:40.720703+0000","last_clean":"2023-10-16T23:27:40.720703+0000","last_became_active":"2023-10-16T23:27:36.278134+0000","last_became_peered":"2023-10-16T23:27:36.278134+0000","last_unstale":"2023-10-16T23:27:40.720703+0000","last_undegraded":"2023-10-16T23:27:40.720703+0000","last_fullsized":"2023-10-16T23:27:40.720703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:13:01.266310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704433+0000","last_change":"2023-10-16T23:27:40.342715+0000","last_active":"2023-10-16T23:27:41.704433+0000","last_peered":"2023-10-16T23:27:41.704433+0000","last_clean":"2023-10-16T23:27:41.704433+0000","last_became_active":"2023-10-16T23:27:40.341951+0000","last_became_peered":"2023-10-16T23:27:40.341951+0000","last_unstale":"2023-10-16T23:27:41.704433+0000","last_undegraded":"2023-10-16T23:27:41.704433+0000","last_fullsized":"2023-10-16T23:27:41.704433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:59.765109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478850+0000","last_change":"2023-10-16T23:27:40.731557+0000","last_active":"2023-10-16T23:27:42.478850+0000","last_peered":"2023-10-16T23:27:42.478850+0000","last_clean":"2023-10-16T23:27:42.478850+0000","last_became_active":"2023-10-16T23:27:40.731150+0000","last_became_peered":"2023-10-16T23:27:40.731150+0000","last_unstale":"2023-10-16T23:27:42.478850+0000","last_undegraded":"2023-10-16T23:27:42.478850+0000","last_fullsized":"2023-10-16T23:27:42.478850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952480+0000","last_change":"2023-10-16T23:27:40.320403+0000","last_active":"2023-10-16T23:27:41.952480+0000","last_peered":"2023-10-16T23:27:41.952480+0000","last_clean":"2023-10-16T23:27:41.952480+0000","last_became_active":"2023-10-16T23:27:40.319571+0000","last_became_peered":"2023-10-16T23:27:40.319571+0000","last_unstale":"2023-10-16T23:27:41.952480+0000","last_undegraded":"2023-10-16T23:27:41.952480+0000","last_fullsized":"2023-10-16T23:27:41.952480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.699523+0000","last_change":"2023-10-16T23:27:36.434134+0000","last_active":"2023-10-16T23:27:40.699523+0000","last_peered":"2023-10-16T23:27:40.699523+0000","last_clean":"2023-10-16T23:27:40.699523+0000","last_became_active":"2023-10-16T23:27:36.433808+0000","last_became_peered":"2023-10-16T23:27:36.433808+0000","last_unstale":"2023-10-16T23:27:40.699523+0000","last_undegraded":"2023-10-16T23:27:40.699523+0000","last_fullsized":"2023-10-16T23:27:40.699523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:58:44.833474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478822+0000","last_change":"2023-10-16T23:27:40.757932+0000","last_active":"2023-10-16T23:27:42.478822+0000","last_peered":"2023-10-16T23:27:42.478822+0000","last_clean":"2023-10-16T23:27:42.478822+0000","last_became_active":"2023-10-16T23:27:40.757670+0000","last_became_peered":"2023-10-16T23:27:40.757670+0000","last_unstale":"2023-10-16T23:27:42.478822+0000","last_undegraded":"2023-10-16T23:27:42.478822+0000","last_fullsized":"2023-10-16T23:27:42.478822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:25:31.037309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478894+0000","last_change":"2023-10-16T23:27:40.328161+0000","last_active":"2023-10-16T23:27:42.478894+0000","last_peered":"2023-10-16T23:27:42.478894+0000","last_clean":"2023-10-16T23:27:42.478894+0000","last_became_active":"2023-10-16T23:27:40.327804+0000","last_became_peered":"2023-10-16T23:27:40.327804+0000","last_unstale":"2023-10-16T23:27:42.478894+0000","last_undegraded":"2023-10-16T23:27:42.478894+0000","last_fullsized":"2023-10-16T23:27:42.478894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.734318+0000","last_change":"2023-10-16T23:27:36.434231+0000","last_active":"2023-10-16T23:27:40.734318+0000","last_peered":"2023-10-16T23:27:40.734318+0000","last_clean":"2023-10-16T23:27:40.734318+0000","last_became_active":"2023-10-16T23:27:36.433923+0000","last_became_peered":"2023-10-16T23:27:36.433923+0000","last_unstale":"2023-10-16T23:27:40.734318+0000","last_undegraded":"2023-10-16T23:27:40.734318+0000","last_fullsized":"2023-10-16T23:27:40.734318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:59.590093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642126+0000","last_change":"2023-10-16T23:27:40.756257+0000","last_active":"2023-10-16T23:27:42.642126+0000","last_peered":"2023-10-16T23:27:42.642126+0000","last_clean":"2023-10-16T23:27:42.642126+0000","last_became_active":"2023-10-16T23:27:40.755822+0000","last_became_peered":"2023-10-16T23:27:40.755822+0000","last_unstale":"2023-10-16T23:27:42.642126+0000","last_undegraded":"2023-10-16T23:27:42.642126+0000","last_fullsized":"2023-10-16T23:27:42.642126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698868+0000","last_change":"2023-10-16T23:27:40.333672+0000","last_active":"2023-10-16T23:27:41.698868+0000","last_peered":"2023-10-16T23:27:41.698868+0000","last_clean":"2023-10-16T23:27:41.698868+0000","last_became_active":"2023-10-16T23:27:40.333290+0000","last_became_peered":"2023-10-16T23:27:40.333290+0000","last_unstale":"2023-10-16T23:27:41.698868+0000","last_undegraded":"2023-10-16T23:27:41.698868+0000","last_fullsized":"2023-10-16T23:27:41.698868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:15:23.173526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.698124+0000","last_change":"2023-10-16T23:27:36.278805+0000","last_active":"2023-10-16T23:27:40.698124+0000","last_peered":"2023-10-16T23:27:40.698124+0000","last_clean":"2023-10-16T23:27:40.698124+0000","last_became_active":"2023-10-16T23:27:36.278209+0000","last_became_peered":"2023-10-16T23:27:36.278209+0000","last_unstale":"2023-10-16T23:27:40.698124+0000","last_undegraded":"2023-10-16T23:27:40.698124+0000","last_fullsized":"2023-10-16T23:27:40.698124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:38:00.468059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697202+0000","last_change":"2023-10-16T23:27:40.743576+0000","last_active":"2023-10-16T23:27:41.697202+0000","last_peered":"2023-10-16T23:27:41.697202+0000","last_clean":"2023-10-16T23:27:41.697202+0000","last_became_active":"2023-10-16T23:27:40.743293+0000","last_became_peered":"2023-10-16T23:27:40.743293+0000","last_unstale":"2023-10-16T23:27:41.697202+0000","last_undegraded":"2023-10-16T23:27:41.697202+0000","last_fullsized":"2023-10-16T23:27:41.697202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:14.359461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641711+0000","last_change":"2023-10-16T23:27:40.332668+0000","last_active":"2023-10-16T23:27:42.641711+0000","last_peered":"2023-10-16T23:27:42.641711+0000","last_clean":"2023-10-16T23:27:42.641711+0000","last_became_active":"2023-10-16T23:27:40.332084+0000","last_became_peered":"2023-10-16T23:27:40.332084+0000","last_unstale":"2023-10-16T23:27:42.641711+0000","last_undegraded":"2023-10-16T23:27:42.641711+0000","last_fullsized":"2023-10-16T23:27:42.641711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:14.260980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.698418+0000","last_change":"2023-10-16T23:27:36.281494+0000","last_active":"2023-10-16T23:27:40.698418+0000","last_peered":"2023-10-16T23:27:40.698418+0000","last_clean":"2023-10-16T23:27:40.698418+0000","last_became_active":"2023-10-16T23:27:36.280600+0000","last_became_peered":"2023-10-16T23:27:36.280600+0000","last_unstale":"2023-10-16T23:27:40.698418+0000","last_undegraded":"2023-10-16T23:27:40.698418+0000","last_fullsized":"2023-10-16T23:27:40.698418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:42:59.057101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702504+0000","last_change":"2023-10-16T23:27:40.756574+0000","last_active":"2023-10-16T23:27:41.702504+0000","last_peered":"2023-10-16T23:27:41.702504+0000","last_clean":"2023-10-16T23:27:41.702504+0000","last_became_active":"2023-10-16T23:27:40.755830+0000","last_became_peered":"2023-10-16T23:27:40.755830+0000","last_unstale":"2023-10-16T23:27:41.702504+0000","last_undegraded":"2023-10-16T23:27:41.702504+0000","last_fullsized":"2023-10-16T23:27:41.702504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:55:29.771781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704462+0000","last_change":"2023-10-16T23:27:40.745793+0000","last_active":"2023-10-16T23:27:41.704462+0000","last_peered":"2023-10-16T23:27:41.704462+0000","last_clean":"2023-10-16T23:27:41.704462+0000","last_became_active":"2023-10-16T23:27:40.745143+0000","last_became_peered":"2023-10-16T23:27:40.745143+0000","last_unstale":"2023-10-16T23:27:41.704462+0000","last_undegraded":"2023-10-16T23:27:41.704462+0000","last_fullsized":"2023-10-16T23:27:41.704462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:10:37.103208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704642+0000","last_change":"2023-10-16T23:27:40.352546+0000","last_active":"2023-10-16T23:27:41.704642+0000","last_peered":"2023-10-16T23:27:41.704642+0000","last_clean":"2023-10-16T23:27:41.704642+0000","last_became_active":"2023-10-16T23:27:40.351687+0000","last_became_peered":"2023-10-16T23:27:40.351687+0000","last_unstale":"2023-10-16T23:27:41.704642+0000","last_undegraded":"2023-10-16T23:27:41.704642+0000","last_fullsized":"2023-10-16T23:27:41.704642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:14.260980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478618+0000","last_change":"2023-10-16T23:27:40.727602+0000","last_active":"2023-10-16T23:27:42.478618+0000","last_peered":"2023-10-16T23:27:42.478618+0000","last_clean":"2023-10-16T23:27:42.478618+0000","last_became_active":"2023-10-16T23:27:40.727288+0000","last_became_peered":"2023-10-16T23:27:40.727288+0000","last_unstale":"2023-10-16T23:27:42.478618+0000","last_undegraded":"2023-10-16T23:27:42.478618+0000","last_fullsized":"2023-10-16T23:27:42.478618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:56:41.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302861+0000","last_change":"2023-10-16T23:27:40.332379+0000","last_active":"2023-10-16T23:27:42.302861+0000","last_peered":"2023-10-16T23:27:42.302861+0000","last_clean":"2023-10-16T23:27:42.302861+0000","last_became_active":"2023-10-16T23:27:40.331517+0000","last_became_peered":"2023-10-16T23:27:40.331517+0000","last_unstale":"2023-10-16T23:27:42.302861+0000","last_undegraded":"2023-10-16T23:27:42.302861+0000","last_fullsized":"2023-10-16T23:27:42.302861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:55.534068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952318+0000","last_change":"2023-10-16T23:27:40.336300+0000","last_active":"2023-10-16T23:27:41.952318+0000","last_peered":"2023-10-16T23:27:41.952318+0000","last_clean":"2023-10-16T23:27:41.952318+0000","last_became_active":"2023-10-16T23:27:40.333012+0000","last_became_peered":"2023-10-16T23:27:40.333012+0000","last_unstale":"2023-10-16T23:27:41.952318+0000","last_undegraded":"2023-10-16T23:27:41.952318+0000","last_fullsized":"2023-10-16T23:27:41.952318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697630+0000","last_change":"2023-10-16T23:27:40.760984+0000","last_active":"2023-10-16T23:27:41.697630+0000","last_peered":"2023-10-16T23:27:41.697630+0000","last_clean":"2023-10-16T23:27:41.697630+0000","last_became_active":"2023-10-16T23:27:40.760680+0000","last_became_peered":"2023-10-16T23:27:40.760680+0000","last_unstale":"2023-10-16T23:27:41.697630+0000","last_undegraded":"2023-10-16T23:27:41.697630+0000","last_fullsized":"2023-10-16T23:27:41.697630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:04.722168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642505+0000","last_change":"2023-10-16T23:27:40.339159+0000","last_active":"2023-10-16T23:27:42.642505+0000","last_peered":"2023-10-16T23:27:42.642505+0000","last_clean":"2023-10-16T23:27:42.642505+0000","last_became_active":"2023-10-16T23:27:40.338706+0000","last_became_peered":"2023-10-16T23:27:40.338706+0000","last_unstale":"2023-10-16T23:27:42.642505+0000","last_undegraded":"2023-10-16T23:27:42.642505+0000","last_fullsized":"2023-10-16T23:27:42.642505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:33:08.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697208+0000","last_change":"2023-10-16T23:27:40.713138+0000","last_active":"2023-10-16T23:27:41.697208+0000","last_peered":"2023-10-16T23:27:41.697208+0000","last_clean":"2023-10-16T23:27:41.697208+0000","last_became_active":"2023-10-16T23:27:40.712756+0000","last_became_peered":"2023-10-16T23:27:40.712756+0000","last_unstale":"2023-10-16T23:27:41.697208+0000","last_undegraded":"2023-10-16T23:27:41.697208+0000","last_fullsized":"2023-10-16T23:27:41.697208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:19:17.463284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.703371+0000","last_change":"2023-10-16T23:27:40.756418+0000","last_active":"2023-10-16T23:27:41.703371+0000","last_peered":"2023-10-16T23:27:41.703371+0000","last_clean":"2023-10-16T23:27:41.703371+0000","last_became_active":"2023-10-16T23:27:40.755714+0000","last_became_peered":"2023-10-16T23:27:40.755714+0000","last_unstale":"2023-10-16T23:27:41.703371+0000","last_undegraded":"2023-10-16T23:27:41.703371+0000","last_fullsized":"2023-10-16T23:27:41.703371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:56.634821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697319+0000","last_change":"2023-10-16T23:27:40.332275+0000","last_active":"2023-10-16T23:27:41.697319+0000","last_peered":"2023-10-16T23:27:41.697319+0000","last_clean":"2023-10-16T23:27:41.697319+0000","last_became_active":"2023-10-16T23:27:40.331428+0000","last_became_peered":"2023-10-16T23:27:40.331428+0000","last_unstale":"2023-10-16T23:27:41.697319+0000","last_undegraded":"2023-10-16T23:27:41.697319+0000","last_fullsized":"2023-10-16T23:27:41.697319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641125+0000","last_change":"2023-10-16T23:27:40.761081+0000","last_active":"2023-10-16T23:27:42.641125+0000","last_peered":"2023-10-16T23:27:42.641125+0000","last_clean":"2023-10-16T23:27:42.641125+0000","last_became_active":"2023-10-16T23:27:40.760779+0000","last_became_peered":"2023-10-16T23:27:40.760779+0000","last_unstale":"2023-10-16T23:27:42.641125+0000","last_undegraded":"2023-10-16T23:27:42.641125+0000","last_fullsized":"2023-10-16T23:27:42.641125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:31.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478605+0000","last_change":"2023-10-16T23:27:40.318419+0000","last_active":"2023-10-16T23:27:42.478605+0000","last_peered":"2023-10-16T23:27:42.478605+0000","last_clean":"2023-10-16T23:27:42.478605+0000","last_became_active":"2023-10-16T23:27:40.317622+0000","last_became_peered":"2023-10-16T23:27:40.317622+0000","last_unstale":"2023-10-16T23:27:42.478605+0000","last_undegraded":"2023-10-16T23:27:42.478605+0000","last_fullsized":"2023-10-16T23:27:42.478605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698467+0000","last_change":"2023-10-16T23:27:40.706263+0000","last_active":"2023-10-16T23:27:41.698467+0000","last_peered":"2023-10-16T23:27:41.698467+0000","last_clean":"2023-10-16T23:27:41.698467+0000","last_became_active":"2023-10-16T23:27:40.705956+0000","last_became_peered":"2023-10-16T23:27:40.705956+0000","last_unstale":"2023-10-16T23:27:41.698467+0000","last_undegraded":"2023-10-16T23:27:41.698467+0000","last_fullsized":"2023-10-16T23:27:41.698467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.703994+0000","last_change":"2023-10-16T23:27:40.344965+0000","last_active":"2023-10-16T23:27:41.703994+0000","last_peered":"2023-10-16T23:27:41.703994+0000","last_clean":"2023-10-16T23:27:41.703994+0000","last_became_active":"2023-10-16T23:27:40.344158+0000","last_became_peered":"2023-10-16T23:27:40.344158+0000","last_unstale":"2023-10-16T23:27:41.703994+0000","last_undegraded":"2023-10-16T23:27:41.703994+0000","last_fullsized":"2023-10-16T23:27:41.703994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:04.095452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302083+0000","last_change":"2023-10-16T23:27:40.713594+0000","last_active":"2023-10-16T23:27:42.302083+0000","last_peered":"2023-10-16T23:27:42.302083+0000","last_clean":"2023-10-16T23:27:42.302083+0000","last_became_active":"2023-10-16T23:27:40.712632+0000","last_became_peered":"2023-10-16T23:27:40.712632+0000","last_unstale":"2023-10-16T23:27:42.302083+0000","last_undegraded":"2023-10-16T23:27:42.302083+0000","last_fullsized":"2023-10-16T23:27:42.302083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:52.368847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642366+0000","last_change":"2023-10-16T23:27:40.357300+0000","last_active":"2023-10-16T23:27:42.642366+0000","last_peered":"2023-10-16T23:27:42.642366+0000","last_clean":"2023-10-16T23:27:42.642366+0000","last_became_active":"2023-10-16T23:27:40.356809+0000","last_became_peered":"2023-10-16T23:27:40.356809+0000","last_unstale":"2023-10-16T23:27:42.642366+0000","last_undegraded":"2023-10-16T23:27:42.642366+0000","last_fullsized":"2023-10-16T23:27:42.642366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704165+0000","last_change":"2023-10-16T23:27:40.726018+0000","last_active":"2023-10-16T23:27:41.704165+0000","last_peered":"2023-10-16T23:27:41.704165+0000","last_clean":"2023-10-16T23:27:41.704165+0000","last_became_active":"2023-10-16T23:27:40.724910+0000","last_became_peered":"2023-10-16T23:27:40.724910+0000","last_unstale":"2023-10-16T23:27:41.704165+0000","last_undegraded":"2023-10-16T23:27:41.704165+0000","last_fullsized":"2023-10-16T23:27:41.704165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:25:34.841325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.951808+0000","last_change":"2023-10-16T23:27:40.345785+0000","last_active":"2023-10-16T23:27:41.951808+0000","last_peered":"2023-10-16T23:27:41.951808+0000","last_clean":"2023-10-16T23:27:41.951808+0000","last_became_active":"2023-10-16T23:27:40.344531+0000","last_became_peered":"2023-10-16T23:27:40.344531+0000","last_unstale":"2023-10-16T23:27:41.951808+0000","last_undegraded":"2023-10-16T23:27:41.951808+0000","last_fullsized":"2023-10-16T23:27:41.951808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:55.630817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702429+0000","last_change":"2023-10-16T23:27:40.720573+0000","last_active":"2023-10-16T23:27:41.702429+0000","last_peered":"2023-10-16T23:27:41.702429+0000","last_clean":"2023-10-16T23:27:41.702429+0000","last_became_active":"2023-10-16T23:27:40.719758+0000","last_became_peered":"2023-10-16T23:27:40.719758+0000","last_unstale":"2023-10-16T23:27:41.702429+0000","last_undegraded":"2023-10-16T23:27:41.702429+0000","last_fullsized":"2023-10-16T23:27:41.702429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:27:29.534374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952407+0000","last_change":"2023-10-16T23:27:40.345400+0000","last_active":"2023-10-16T23:27:41.952407+0000","last_peered":"2023-10-16T23:27:41.952407+0000","last_clean":"2023-10-16T23:27:41.952407+0000","last_became_active":"2023-10-16T23:27:40.344589+0000","last_became_peered":"2023-10-16T23:27:40.344589+0000","last_unstale":"2023-10-16T23:27:41.952407+0000","last_undegraded":"2023-10-16T23:27:41.952407+0000","last_fullsized":"2023-10-16T23:27:41.952407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:15:23.173526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697731+0000","last_change":"2023-10-16T23:27:40.711211+0000","last_active":"2023-10-16T23:27:41.697731+0000","last_peered":"2023-10-16T23:27:41.697731+0000","last_clean":"2023-10-16T23:27:41.697731+0000","last_became_active":"2023-10-16T23:27:40.705936+0000","last_became_peered":"2023-10-16T23:27:40.705936+0000","last_unstale":"2023-10-16T23:27:41.697731+0000","last_undegraded":"2023-10-16T23:27:41.697731+0000","last_fullsized":"2023-10-16T23:27:41.697731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.699046+0000","last_change":"2023-10-16T23:27:40.323626+0000","last_active":"2023-10-16T23:27:41.699046+0000","last_peered":"2023-10-16T23:27:41.699046+0000","last_clean":"2023-10-16T23:27:41.699046+0000","last_became_active":"2023-10-16T23:27:40.323352+0000","last_became_peered":"2023-10-16T23:27:40.323352+0000","last_unstale":"2023-10-16T23:27:41.699046+0000","last_undegraded":"2023-10-16T23:27:41.699046+0000","last_fullsized":"2023-10-16T23:27:41.699046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:33:08.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702217+0000","last_change":"2023-10-16T23:27:40.749109+0000","last_active":"2023-10-16T23:27:41.702217+0000","last_peered":"2023-10-16T23:27:41.702217+0000","last_clean":"2023-10-16T23:27:41.702217+0000","last_became_active":"2023-10-16T23:27:40.748525+0000","last_became_peered":"2023-10-16T23:27:40.748525+0000","last_unstale":"2023-10-16T23:27:41.702217+0000","last_undegraded":"2023-10-16T23:27:41.702217+0000","last_fullsized":"2023-10-16T23:27:41.702217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:10:38.468420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642507+0000","last_change":"2023-10-16T23:27:40.338946+0000","last_active":"2023-10-16T23:27:42.642507+0000","last_peered":"2023-10-16T23:27:42.642507+0000","last_clean":"2023-10-16T23:27:42.642507+0000","last_became_active":"2023-10-16T23:27:40.338565+0000","last_became_peered":"2023-10-16T23:27:40.338565+0000","last_unstale":"2023-10-16T23:27:42.642507+0000","last_undegraded":"2023-10-16T23:27:42.642507+0000","last_fullsized":"2023-10-16T23:27:42.642507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:55.630817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":90844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":91496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":92464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]}]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":249856,"data_stored":90934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":90844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]}]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":824,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":843776,"data_stored":681794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":868352,"data_stored":682992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31288,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340552,"statfs":{"total":96636764160,"available":96604725248,"internally_reserved":0,"allocated":245760,"data_stored":90844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3580000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T23:27:53.497 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T23:27:53.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.652+0000 7f67f18eb640 1 Processor -- start 2023-10-16T23:27:53.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.652+0000 7f67f18eb640 1 -- start start 2023-10-16T23:27:53.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.652+0000 7f67f18eb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67ec0c34c0 0x7f67ec0a8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:53.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.652+0000 7f67f18eb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f67ec0a8c20 0x7f67ec14e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:53.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.652+0000 7f67f18eb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f67ec14ec90 0x7f67ec152860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:53.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.652+0000 7f67f18eb640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67ec14f0e0 con 0x7f67ec0a8c20 2023-10-16T23:27:53.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.652+0000 7f67f18eb640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67ec0bfe80 con 0x7f67ec14ec90 2023-10-16T23:27:53.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.652+0000 7f67f18eb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec0c0160 con 0x7f67ec0c34c0 2023-10-16T23:27:53.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.652+0000 7f67ea7fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f67ec0a8c20 0x7f67ec14e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:53.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.652+0000 7f67ea7fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f67ec0a8c20 0x7f67ec14e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55936/0 (socket says 172.21.15.12:55936) 2023-10-16T23:27:53.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.652+0000 7f67ea7fc640 1 -- 172.21.15.12:0/935369181 learned_addr learned my addr 172.21.15.12:0/935369181 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:53.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.652+0000 7f67eb7fe640 1 --2- 172.21.15.12:0/935369181 >> v2:172.21.15.31:3300/0 conn(0x7f67ec14ec90 0x7f67ec152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:53.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.652+0000 7f67ea7fc640 1 -- 172.21.15.12:0/935369181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67ec0c34c0 msgr2=0x7f67ec0a8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:53.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.652+0000 7f67eaffd640 1 --2- 172.21.15.12:0/935369181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67ec0c34c0 0x7f67ec0a8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:53.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.652+0000 7f67ea7fc640 1 --2- 172.21.15.12:0/935369181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67ec0c34c0 0x7f67ec0a8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.652+0000 7f67ea7fc640 1 -- 172.21.15.12:0/935369181 >> v2:172.21.15.31:3300/0 conn(0x7f67ec14ec90 msgr2=0x7f67ec152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:53.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.652+0000 7f67ea7fc640 1 --2- 172.21.15.12:0/935369181 >> v2:172.21.15.31:3300/0 conn(0x7f67ec14ec90 0x7f67ec152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.652+0000 7f67ea7fc640 1 -- 172.21.15.12:0/935369181 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ec06fc90 con 0x7f67ec0a8c20 2023-10-16T23:27:53.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.652+0000 7f67eb7fe640 1 --2- 172.21.15.12:0/935369181 >> v2:172.21.15.31:3300/0 conn(0x7f67ec14ec90 0x7f67ec152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:53.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.652+0000 7f67eaffd640 1 --2- 172.21.15.12:0/935369181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67ec0c34c0 0x7f67ec0a8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:53.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67ea7fc640 1 --2- 172.21.15.12:0/935369181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67ec0a8c20 0x7f67ec14e750 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f67ec06fa10 tx=0x7f67d401c120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8175a53c9fc345e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:53.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67e9ffb640 1 -- 172.21.15.12:0/935369181 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d40ab600 con 0x7f67ec0a8c20 2023-10-16T23:27:53.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67e9ffb640 1 -- 172.21.15.12:0/935369181 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d40a7050 con 0x7f67ec0a8c20 2023-10-16T23:27:53.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67e9ffb640 1 -- 172.21.15.12:0/935369181 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d40ab980 con 0x7f67ec0a8c20 2023-10-16T23:27:53.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67f18eb640 1 -- 172.21.15.12:0/935369181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67ec0a8c20 msgr2=0x7f67ec14e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:53.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67f18eb640 1 --2- 172.21.15.12:0/935369181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67ec0a8c20 0x7f67ec14e750 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f67ec06fa10 tx=0x7f67d401c120 comp rx=0 tx=0).stop 2023-10-16T23:27:53.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67f18eb640 1 -- 172.21.15.12:0/935369181 shutdown_connections 2023-10-16T23:27:53.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67f18eb640 1 --2- 172.21.15.12:0/935369181 >> v2:172.21.15.31:3300/0 conn(0x7f67ec14ec90 0x7f67ec152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67f18eb640 1 --2- 172.21.15.12:0/935369181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67ec0a8c20 0x7f67ec14e750 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67f18eb640 1 --2- 172.21.15.12:0/935369181 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67ec0c34c0 0x7f67ec0a8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67f18eb640 1 -- 172.21.15.12:0/935369181 >> 172.21.15.12:0/935369181 conn(0x7f67ec06ba00 msgr2=0x7f67ec0c2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:53.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67f18eb640 1 -- 172.21.15.12:0/935369181 shutdown_connections 2023-10-16T23:27:53.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67f18eb640 1 -- 172.21.15.12:0/935369181 wait complete. 2023-10-16T23:27:53.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67f18eb640 1 Processor -- start 2023-10-16T23:27:53.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67f18eb640 1 -- start start 2023-10-16T23:27:53.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67f18eb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67ec0a8c20 0x7f67ec1490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:53.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67f18eb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67ec0c34c0 0x7f67ec149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:53.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67f18eb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67ec14ec90 0x7f67ec13f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:53.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67f18eb640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec149b50 con 0x7f67ec14ec90 2023-10-16T23:27:53.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67f18eb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec141680 con 0x7f67ec0c34c0 2023-10-16T23:27:53.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67f18eb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec140930 con 0x7f67ec0a8c20 2023-10-16T23:27:53.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67eb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67ec14ec90 0x7f67ec13f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:53.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67eb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67ec14ec90 0x7f67ec13f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55952/0 (socket says 172.21.15.12:55952) 2023-10-16T23:27:53.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67eb7fe640 1 -- 172.21.15.12:0/2295983882 learned_addr learned my addr 172.21.15.12:0/2295983882 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:53.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67ea7fc640 1 --2- 172.21.15.12:0/2295983882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67ec0c34c0 0x7f67ec149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:53.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67eaffd640 1 --2- 172.21.15.12:0/2295983882 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67ec0a8c20 0x7f67ec1490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:53.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67eb7fe640 1 -- 172.21.15.12:0/2295983882 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67ec0a8c20 msgr2=0x7f67ec1490d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:53.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67eb7fe640 1 --2- 172.21.15.12:0/2295983882 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67ec0a8c20 0x7f67ec1490d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67eb7fe640 1 -- 172.21.15.12:0/2295983882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67ec0c34c0 msgr2=0x7f67ec149610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:53.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67eb7fe640 1 --2- 172.21.15.12:0/2295983882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67ec0c34c0 0x7f67ec149610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67eb7fe640 1 -- 172.21.15.12:0/2295983882 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d40094d0 con 0x7f67ec14ec90 2023-10-16T23:27:53.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.656+0000 7f67eaffd640 1 --2- 172.21.15.12:0/2295983882 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67ec0a8c20 0x7f67ec1490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:53.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.660+0000 7f67eb7fe640 1 --2- 172.21.15.12:0/2295983882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67ec14ec90 0x7f67ec13f130 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f67e400cd50 tx=0x7f67e400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:53.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.660+0000 7f67e3fff640 1 -- 172.21.15.12:0/2295983882 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e400f680 con 0x7f67ec14ec90 2023-10-16T23:27:53.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.660+0000 7f67e3fff640 1 -- 172.21.15.12:0/2295983882 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e400f800 con 0x7f67ec14ec90 2023-10-16T23:27:53.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.660+0000 7f67e3fff640 1 -- 172.21.15.12:0/2295983882 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e400fbb0 con 0x7f67ec14ec90 2023-10-16T23:27:53.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.660+0000 7f67f18eb640 1 -- 172.21.15.12:0/2295983882 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67ec140c10 con 0x7f67ec14ec90 2023-10-16T23:27:53.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.660+0000 7f67f18eb640 1 -- 172.21.15.12:0/2295983882 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67ec152510 con 0x7f67ec14ec90 2023-10-16T23:27:53.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.660+0000 7f67f18eb640 1 -- 172.21.15.12:0/2295983882 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67ec0673a0 con 0x7f67ec14ec90 2023-10-16T23:27:53.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.660+0000 7f67e3fff640 1 -- 172.21.15.12:0/2295983882 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f67e400b040 con 0x7f67ec14ec90 2023-10-16T23:27:53.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.660+0000 7f67e3fff640 1 --2- 172.21.15.12:0/2295983882 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f67cc065e60 0x7f67cc068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:53.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.660+0000 7f67e3fff640 1 -- 172.21.15.12:0/2295983882 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f67e4084160 con 0x7f67ec14ec90 2023-10-16T23:27:53.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.660+0000 7f67eaffd640 1 --2- 172.21.15.12:0/2295983882 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f67cc065e60 0x7f67cc068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:53.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.660+0000 7f67eaffd640 1 --2- 172.21.15.12:0/2295983882 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f67cc065e60 0x7f67cc068320 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f67dc006fd0 tx=0x7f67dc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:53.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.664+0000 7f67e3fff640 1 -- 172.21.15.12:0/2295983882 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f67e4051840 con 0x7f67ec14ec90 2023-10-16T23:27:53.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.812+0000 7f67f18eb640 1 -- 172.21.15.12:0/2295983882 --> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f67ec0bc3b0 con 0x7f67cc065e60 2023-10-16T23:27:53.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.832+0000 7f67e3fff640 1 -- 172.21.15.12:0/2295983882 <== mgr.4108 v2:172.21.15.31:6832/37949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286541 (secure 0 0 0) 0x7f67ec0bc3b0 con 0x7f67cc065e60 2023-10-16T23:27:53.838 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:53.840 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-16T23:27:53.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.836+0000 7f67f18eb640 1 -- 172.21.15.12:0/2295983882 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f67cc065e60 msgr2=0x7f67cc068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:53.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.836+0000 7f67f18eb640 1 --2- 172.21.15.12:0/2295983882 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f67cc065e60 0x7f67cc068320 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f67dc006fd0 tx=0x7f67dc008040 comp rx=0 tx=0).stop 2023-10-16T23:27:53.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.836+0000 7f67f18eb640 1 -- 172.21.15.12:0/2295983882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67ec14ec90 msgr2=0x7f67ec13f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:53.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.836+0000 7f67f18eb640 1 --2- 172.21.15.12:0/2295983882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67ec14ec90 0x7f67ec13f130 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f67e400cd50 tx=0x7f67e400a650 comp rx=0 tx=0).stop 2023-10-16T23:27:53.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.836+0000 7f67f18eb640 1 -- 172.21.15.12:0/2295983882 shutdown_connections 2023-10-16T23:27:53.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.836+0000 7f67f18eb640 1 --2- 172.21.15.12:0/2295983882 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f67cc065e60 0x7f67cc068320 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.836+0000 7f67f18eb640 1 --2- 172.21.15.12:0/2295983882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67ec14ec90 0x7f67ec13f130 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.836+0000 7f67f18eb640 1 --2- 172.21.15.12:0/2295983882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67ec0c34c0 0x7f67ec149610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.836+0000 7f67f18eb640 1 --2- 172.21.15.12:0/2295983882 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f67ec0a8c20 0x7f67ec1490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:53.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.836+0000 7f67f18eb640 1 -- 172.21.15.12:0/2295983882 >> 172.21.15.12:0/2295983882 conn(0x7f67ec06ba00 msgr2=0x7f67ec0c2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:53.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.836+0000 7f67f18eb640 1 -- 172.21.15.12:0/2295983882 shutdown_connections 2023-10-16T23:27:53.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:53.836+0000 7f67f18eb640 1 -- 172.21.15.12:0/2295983882 wait complete. 2023-10-16T23:27:53.856 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2023-10-16T23:27:53.288377+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222856,"kb_used_data":3144,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751864,"statfs":{"total":773094113280,"available":772865908736,"internally_reserved":0,"allocated":3219456,"data_stored":1912212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.590393"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302132+0000","last_change":"2023-10-16T23:27:40.706600+0000","last_active":"2023-10-16T23:27:42.302132+0000","last_peered":"2023-10-16T23:27:42.302132+0000","last_clean":"2023-10-16T23:27:42.302132+0000","last_became_active":"2023-10-16T23:27:40.706320+0000","last_became_peered":"2023-10-16T23:27:40.706320+0000","last_unstale":"2023-10-16T23:27:42.302132+0000","last_undegraded":"2023-10-16T23:27:42.302132+0000","last_fullsized":"2023-10-16T23:27:42.302132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:48:20.356964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952090+0000","last_change":"2023-10-16T23:27:40.756555+0000","last_active":"2023-10-16T23:27:41.952090+0000","last_peered":"2023-10-16T23:27:41.952090+0000","last_clean":"2023-10-16T23:27:41.952090+0000","last_became_active":"2023-10-16T23:27:40.754736+0000","last_became_peered":"2023-10-16T23:27:40.754736+0000","last_unstale":"2023-10-16T23:27:41.952090+0000","last_undegraded":"2023-10-16T23:27:41.952090+0000","last_fullsized":"2023-10-16T23:27:41.952090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:45.642622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704753+0000","last_change":"2023-10-16T23:27:40.726586+0000","last_active":"2023-10-16T23:27:41.704753+0000","last_peered":"2023-10-16T23:27:41.704753+0000","last_clean":"2023-10-16T23:27:41.704753+0000","last_became_active":"2023-10-16T23:27:40.725731+0000","last_became_peered":"2023-10-16T23:27:40.725731+0000","last_unstale":"2023-10-16T23:27:41.704753+0000","last_undegraded":"2023-10-16T23:27:41.704753+0000","last_fullsized":"2023-10-16T23:27:41.704753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:04:22.434372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702719+0000","last_change":"2023-10-16T23:27:40.715543+0000","last_active":"2023-10-16T23:27:41.702719+0000","last_peered":"2023-10-16T23:27:41.702719+0000","last_clean":"2023-10-16T23:27:41.702719+0000","last_became_active":"2023-10-16T23:27:40.714592+0000","last_became_peered":"2023-10-16T23:27:40.714592+0000","last_unstale":"2023-10-16T23:27:41.702719+0000","last_undegraded":"2023-10-16T23:27:41.702719+0000","last_fullsized":"2023-10-16T23:27:41.702719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:42:37.696897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642193+0000","last_change":"2023-10-16T23:27:40.722734+0000","last_active":"2023-10-16T23:27:42.642193+0000","last_peered":"2023-10-16T23:27:42.642193+0000","last_clean":"2023-10-16T23:27:42.642193+0000","last_became_active":"2023-10-16T23:27:40.722399+0000","last_became_peered":"2023-10-16T23:27:40.722399+0000","last_unstale":"2023-10-16T23:27:42.642193+0000","last_undegraded":"2023-10-16T23:27:42.642193+0000","last_fullsized":"2023-10-16T23:27:42.642193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:19:17.463284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702182+0000","last_change":"2023-10-16T23:27:40.716139+0000","last_active":"2023-10-16T23:27:41.702182+0000","last_peered":"2023-10-16T23:27:41.702182+0000","last_clean":"2023-10-16T23:27:41.702182+0000","last_became_active":"2023-10-16T23:27:40.715294+0000","last_became_peered":"2023-10-16T23:27:40.715294+0000","last_unstale":"2023-10-16T23:27:41.702182+0000","last_undegraded":"2023-10-16T23:27:41.702182+0000","last_fullsized":"2023-10-16T23:27:41.702182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:19:17.463284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302587+0000","last_change":"2023-10-16T23:27:40.762253+0000","last_active":"2023-10-16T23:27:42.302587+0000","last_peered":"2023-10-16T23:27:42.302587+0000","last_clean":"2023-10-16T23:27:42.302587+0000","last_became_active":"2023-10-16T23:27:40.760726+0000","last_became_peered":"2023-10-16T23:27:40.760726+0000","last_unstale":"2023-10-16T23:27:42.302587+0000","last_undegraded":"2023-10-16T23:27:42.302587+0000","last_fullsized":"2023-10-16T23:27:42.302587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:50:08.569961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.951568+0000","last_change":"2023-10-16T23:27:40.756184+0000","last_active":"2023-10-16T23:27:41.951568+0000","last_peered":"2023-10-16T23:27:41.951568+0000","last_clean":"2023-10-16T23:27:41.951568+0000","last_became_active":"2023-10-16T23:27:40.755276+0000","last_became_peered":"2023-10-16T23:27:40.755276+0000","last_unstale":"2023-10-16T23:27:41.951568+0000","last_undegraded":"2023-10-16T23:27:41.951568+0000","last_fullsized":"2023-10-16T23:27:41.951568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642253+0000","last_change":"2023-10-16T23:27:40.724060+0000","last_active":"2023-10-16T23:27:42.642253+0000","last_peered":"2023-10-16T23:27:42.642253+0000","last_clean":"2023-10-16T23:27:42.642253+0000","last_became_active":"2023-10-16T23:27:40.723701+0000","last_became_peered":"2023-10-16T23:27:40.723701+0000","last_unstale":"2023-10-16T23:27:42.642253+0000","last_undegraded":"2023-10-16T23:27:42.642253+0000","last_fullsized":"2023-10-16T23:27:42.642253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:04.722168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952181+0000","last_change":"2023-10-16T23:27:40.756783+0000","last_active":"2023-10-16T23:27:41.952181+0000","last_peered":"2023-10-16T23:27:41.952181+0000","last_clean":"2023-10-16T23:27:41.952181+0000","last_became_active":"2023-10-16T23:27:40.755772+0000","last_became_peered":"2023-10-16T23:27:40.755772+0000","last_unstale":"2023-10-16T23:27:41.952181+0000","last_undegraded":"2023-10-16T23:27:41.952181+0000","last_fullsized":"2023-10-16T23:27:41.952181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704832+0000","last_change":"2023-10-16T23:27:40.724754+0000","last_active":"2023-10-16T23:27:41.704832+0000","last_peered":"2023-10-16T23:27:41.704832+0000","last_clean":"2023-10-16T23:27:41.704832+0000","last_became_active":"2023-10-16T23:27:40.724031+0000","last_became_peered":"2023-10-16T23:27:40.724031+0000","last_unstale":"2023-10-16T23:27:41.704832+0000","last_undegraded":"2023-10-16T23:27:41.704832+0000","last_fullsized":"2023-10-16T23:27:41.704832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:04.722168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302045+0000","last_change":"2023-10-16T23:27:40.724453+0000","last_active":"2023-10-16T23:27:42.302045+0000","last_peered":"2023-10-16T23:27:42.302045+0000","last_clean":"2023-10-16T23:27:42.302045+0000","last_became_active":"2023-10-16T23:27:40.724099+0000","last_became_peered":"2023-10-16T23:27:40.724099+0000","last_unstale":"2023-10-16T23:27:42.302045+0000","last_undegraded":"2023-10-16T23:27:42.302045+0000","last_fullsized":"2023-10-16T23:27:42.302045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:01:05.350517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302015+0000","last_change":"2023-10-16T23:27:40.704484+0000","last_active":"2023-10-16T23:27:42.302015+0000","last_peered":"2023-10-16T23:27:42.302015+0000","last_clean":"2023-10-16T23:27:42.302015+0000","last_became_active":"2023-10-16T23:27:40.704162+0000","last_became_peered":"2023-10-16T23:27:40.704162+0000","last_unstale":"2023-10-16T23:27:42.302015+0000","last_undegraded":"2023-10-16T23:27:42.302015+0000","last_fullsized":"2023-10-16T23:27:42.302015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:15:16.646850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.951790+0000","last_change":"2023-10-16T23:27:40.738913+0000","last_active":"2023-10-16T23:27:41.951790+0000","last_peered":"2023-10-16T23:27:41.951790+0000","last_clean":"2023-10-16T23:27:41.951790+0000","last_became_active":"2023-10-16T23:27:40.738070+0000","last_became_peered":"2023-10-16T23:27:40.738070+0000","last_unstale":"2023-10-16T23:27:41.951790+0000","last_undegraded":"2023-10-16T23:27:41.951790+0000","last_fullsized":"2023-10-16T23:27:41.951790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:56:41.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302643+0000","last_change":"2023-10-16T23:27:40.762529+0000","last_active":"2023-10-16T23:27:42.302643+0000","last_peered":"2023-10-16T23:27:42.302643+0000","last_clean":"2023-10-16T23:27:42.302643+0000","last_became_active":"2023-10-16T23:27:40.761570+0000","last_became_peered":"2023-10-16T23:27:40.761570+0000","last_unstale":"2023-10-16T23:27:42.302643+0000","last_undegraded":"2023-10-16T23:27:42.302643+0000","last_fullsized":"2023-10-16T23:27:42.302643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:46.449264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702044+0000","last_change":"2023-10-16T23:27:40.719227+0000","last_active":"2023-10-16T23:27:41.702044+0000","last_peered":"2023-10-16T23:27:41.702044+0000","last_clean":"2023-10-16T23:27:41.702044+0000","last_became_active":"2023-10-16T23:27:40.718276+0000","last_became_peered":"2023-10-16T23:27:40.718276+0000","last_unstale":"2023-10-16T23:27:41.702044+0000","last_undegraded":"2023-10-16T23:27:41.702044+0000","last_fullsized":"2023-10-16T23:27:41.702044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642387+0000","last_change":"2023-10-16T23:27:40.719723+0000","last_active":"2023-10-16T23:27:42.642387+0000","last_peered":"2023-10-16T23:27:42.642387+0000","last_clean":"2023-10-16T23:27:42.642387+0000","last_became_active":"2023-10-16T23:27:40.719402+0000","last_became_peered":"2023-10-16T23:27:40.719402+0000","last_unstale":"2023-10-16T23:27:42.642387+0000","last_undegraded":"2023-10-16T23:27:42.642387+0000","last_fullsized":"2023-10-16T23:27:42.642387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:04:22.434372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704498+0000","last_change":"2023-10-16T23:27:40.732931+0000","last_active":"2023-10-16T23:27:41.704498+0000","last_peered":"2023-10-16T23:27:41.704498+0000","last_clean":"2023-10-16T23:27:41.704498+0000","last_became_active":"2023-10-16T23:27:40.732102+0000","last_became_peered":"2023-10-16T23:27:40.732102+0000","last_unstale":"2023-10-16T23:27:41.704498+0000","last_undegraded":"2023-10-16T23:27:41.704498+0000","last_fullsized":"2023-10-16T23:27:41.704498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:14.359461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302105+0000","last_change":"2023-10-16T23:27:40.728920+0000","last_active":"2023-10-16T23:27:42.302105+0000","last_peered":"2023-10-16T23:27:42.302105+0000","last_clean":"2023-10-16T23:27:42.302105+0000","last_became_active":"2023-10-16T23:27:40.728298+0000","last_became_peered":"2023-10-16T23:27:40.728298+0000","last_unstale":"2023-10-16T23:27:42.302105+0000","last_undegraded":"2023-10-16T23:27:42.302105+0000","last_fullsized":"2023-10-16T23:27:42.302105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:28:33.509782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704201+0000","last_change":"2023-10-16T23:27:40.745270+0000","last_active":"2023-10-16T23:27:41.704201+0000","last_peered":"2023-10-16T23:27:41.704201+0000","last_clean":"2023-10-16T23:27:41.704201+0000","last_became_active":"2023-10-16T23:27:40.744483+0000","last_became_peered":"2023-10-16T23:27:40.744483+0000","last_unstale":"2023-10-16T23:27:41.704201+0000","last_undegraded":"2023-10-16T23:27:41.704201+0000","last_fullsized":"2023-10-16T23:27:41.704201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:24:33.998070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302748+0000","last_change":"2023-10-16T23:27:40.761480+0000","last_active":"2023-10-16T23:27:42.302748+0000","last_peered":"2023-10-16T23:27:42.302748+0000","last_clean":"2023-10-16T23:27:42.302748+0000","last_became_active":"2023-10-16T23:27:40.760882+0000","last_became_peered":"2023-10-16T23:27:40.760882+0000","last_unstale":"2023-10-16T23:27:42.302748+0000","last_undegraded":"2023-10-16T23:27:42.302748+0000","last_fullsized":"2023-10-16T23:27:42.302748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:37:38.843931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.640893+0000","last_change":"2023-10-16T23:27:40.722620+0000","last_active":"2023-10-16T23:27:42.640893+0000","last_peered":"2023-10-16T23:27:42.640893+0000","last_clean":"2023-10-16T23:27:42.640893+0000","last_became_active":"2023-10-16T23:27:40.722302+0000","last_became_peered":"2023-10-16T23:27:40.722302+0000","last_unstale":"2023-10-16T23:27:42.640893+0000","last_undegraded":"2023-10-16T23:27:42.640893+0000","last_fullsized":"2023-10-16T23:27:42.640893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697349+0000","last_change":"2023-10-16T23:27:40.716578+0000","last_active":"2023-10-16T23:27:41.697349+0000","last_peered":"2023-10-16T23:27:41.697349+0000","last_clean":"2023-10-16T23:27:41.697349+0000","last_became_active":"2023-10-16T23:27:40.716228+0000","last_became_peered":"2023-10-16T23:27:40.716228+0000","last_unstale":"2023-10-16T23:27:41.697349+0000","last_undegraded":"2023-10-16T23:27:41.697349+0000","last_fullsized":"2023-10-16T23:27:41.697349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:27:29.534374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302466+0000","last_change":"2023-10-16T23:27:40.761323+0000","last_active":"2023-10-16T23:27:42.302466+0000","last_peered":"2023-10-16T23:27:42.302466+0000","last_clean":"2023-10-16T23:27:42.302466+0000","last_became_active":"2023-10-16T23:27:40.760659+0000","last_became_peered":"2023-10-16T23:27:40.760659+0000","last_unstale":"2023-10-16T23:27:42.302466+0000","last_undegraded":"2023-10-16T23:27:42.302466+0000","last_fullsized":"2023-10-16T23:27:42.302466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:09:55.835429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478936+0000","last_change":"2023-10-16T23:27:40.727629+0000","last_active":"2023-10-16T23:27:42.478936+0000","last_peered":"2023-10-16T23:27:42.478936+0000","last_clean":"2023-10-16T23:27:42.478936+0000","last_became_active":"2023-10-16T23:27:40.727334+0000","last_became_peered":"2023-10-16T23:27:40.727334+0000","last_unstale":"2023-10-16T23:27:42.478936+0000","last_undegraded":"2023-10-16T23:27:42.478936+0000","last_fullsized":"2023-10-16T23:27:42.478936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:38:33.383867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.479296+0000","last_change":"2023-10-16T23:27:40.704775+0000","last_active":"2023-10-16T23:27:42.479296+0000","last_peered":"2023-10-16T23:27:42.479296+0000","last_clean":"2023-10-16T23:27:42.479296+0000","last_became_active":"2023-10-16T23:27:40.704536+0000","last_became_peered":"2023-10-16T23:27:40.704536+0000","last_unstale":"2023-10-16T23:27:42.479296+0000","last_undegraded":"2023-10-16T23:27:42.479296+0000","last_fullsized":"2023-10-16T23:27:42.479296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952175+0000","last_change":"2023-10-16T23:27:40.764351+0000","last_active":"2023-10-16T23:27:41.952175+0000","last_peered":"2023-10-16T23:27:41.952175+0000","last_clean":"2023-10-16T23:27:41.952175+0000","last_became_active":"2023-10-16T23:27:40.763592+0000","last_became_peered":"2023-10-16T23:27:40.763592+0000","last_unstale":"2023-10-16T23:27:41.952175+0000","last_undegraded":"2023-10-16T23:27:41.952175+0000","last_fullsized":"2023-10-16T23:27:41.952175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.479026+0000","last_change":"2023-10-16T23:27:40.760989+0000","last_active":"2023-10-16T23:27:42.479026+0000","last_peered":"2023-10-16T23:27:42.479026+0000","last_clean":"2023-10-16T23:27:42.479026+0000","last_became_active":"2023-10-16T23:27:40.760615+0000","last_became_peered":"2023-10-16T23:27:40.760615+0000","last_unstale":"2023-10-16T23:27:42.479026+0000","last_undegraded":"2023-10-16T23:27:42.479026+0000","last_fullsized":"2023-10-16T23:27:42.479026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698072+0000","last_change":"2023-10-16T23:27:40.760762+0000","last_active":"2023-10-16T23:27:41.698072+0000","last_peered":"2023-10-16T23:27:41.698072+0000","last_clean":"2023-10-16T23:27:41.698072+0000","last_became_active":"2023-10-16T23:27:40.760437+0000","last_became_peered":"2023-10-16T23:27:40.760437+0000","last_unstale":"2023-10-16T23:27:41.698072+0000","last_undegraded":"2023-10-16T23:27:41.698072+0000","last_fullsized":"2023-10-16T23:27:41.698072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:55:29.771781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.703806+0000","last_change":"2023-10-16T23:27:40.745197+0000","last_active":"2023-10-16T23:27:41.703806+0000","last_peered":"2023-10-16T23:27:41.703806+0000","last_clean":"2023-10-16T23:27:41.703806+0000","last_became_active":"2023-10-16T23:27:40.744458+0000","last_became_peered":"2023-10-16T23:27:40.744458+0000","last_unstale":"2023-10-16T23:27:41.703806+0000","last_undegraded":"2023-10-16T23:27:41.703806+0000","last_fullsized":"2023-10-16T23:27:41.703806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697368+0000","last_change":"2023-10-16T23:27:40.711795+0000","last_active":"2023-10-16T23:27:41.697368+0000","last_peered":"2023-10-16T23:27:41.697368+0000","last_clean":"2023-10-16T23:27:41.697368+0000","last_became_active":"2023-10-16T23:27:40.711492+0000","last_became_peered":"2023-10-16T23:27:40.711492+0000","last_unstale":"2023-10-16T23:27:41.697368+0000","last_undegraded":"2023-10-16T23:27:41.697368+0000","last_fullsized":"2023-10-16T23:27:41.697368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:04:22.434372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702060+0000","last_change":"2023-10-16T23:27:40.710149+0000","last_active":"2023-10-16T23:27:41.702060+0000","last_peered":"2023-10-16T23:27:41.702060+0000","last_clean":"2023-10-16T23:27:41.702060+0000","last_became_active":"2023-10-16T23:27:40.709286+0000","last_became_peered":"2023-10-16T23:27:40.709286+0000","last_unstale":"2023-10-16T23:27:41.702060+0000","last_undegraded":"2023-10-16T23:27:41.702060+0000","last_fullsized":"2023-10-16T23:27:41.702060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:22:41.708468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698461+0000","last_change":"2023-10-16T23:27:40.707271+0000","last_active":"2023-10-16T23:27:41.698461+0000","last_peered":"2023-10-16T23:27:41.698461+0000","last_clean":"2023-10-16T23:27:41.698461+0000","last_became_active":"2023-10-16T23:27:40.706864+0000","last_became_peered":"2023-10-16T23:27:40.706864+0000","last_unstale":"2023-10-16T23:27:41.698461+0000","last_undegraded":"2023-10-16T23:27:41.698461+0000","last_fullsized":"2023-10-16T23:27:41.698461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302796+0000","last_change":"2023-10-16T23:27:40.353567+0000","last_active":"2023-10-16T23:27:42.302796+0000","last_peered":"2023-10-16T23:27:42.302796+0000","last_clean":"2023-10-16T23:27:42.302796+0000","last_became_active":"2023-10-16T23:27:40.352775+0000","last_became_peered":"2023-10-16T23:27:40.352775+0000","last_unstale":"2023-10-16T23:27:42.302796+0000","last_undegraded":"2023-10-16T23:27:42.302796+0000","last_fullsized":"2023-10-16T23:27:42.302796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:52:58.351406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952358+0000","last_change":"2023-10-16T23:27:40.765398+0000","last_active":"2023-10-16T23:27:41.952358+0000","last_peered":"2023-10-16T23:27:41.952358+0000","last_clean":"2023-10-16T23:27:41.952358+0000","last_became_active":"2023-10-16T23:27:40.764517+0000","last_became_peered":"2023-10-16T23:27:40.764517+0000","last_unstale":"2023-10-16T23:27:41.952358+0000","last_undegraded":"2023-10-16T23:27:41.952358+0000","last_fullsized":"2023-10-16T23:27:41.952358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:31.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641131+0000","last_change":"2023-10-16T23:27:40.335221+0000","last_active":"2023-10-16T23:27:42.641131+0000","last_peered":"2023-10-16T23:27:42.641131+0000","last_clean":"2023-10-16T23:27:42.641131+0000","last_became_active":"2023-10-16T23:27:40.334885+0000","last_became_peered":"2023-10-16T23:27:40.334885+0000","last_unstale":"2023-10-16T23:27:42.641131+0000","last_undegraded":"2023-10-16T23:27:42.641131+0000","last_fullsized":"2023-10-16T23:27:42.641131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641719+0000","last_change":"2023-10-16T23:27:40.719997+0000","last_active":"2023-10-16T23:27:42.641719+0000","last_peered":"2023-10-16T23:27:42.641719+0000","last_clean":"2023-10-16T23:27:42.641719+0000","last_became_active":"2023-10-16T23:27:40.719811+0000","last_became_peered":"2023-10-16T23:27:40.719811+0000","last_unstale":"2023-10-16T23:27:42.641719+0000","last_undegraded":"2023-10-16T23:27:42.641719+0000","last_fullsized":"2023-10-16T23:27:42.641719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:13.934735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302695+0000","last_change":"2023-10-16T23:27:40.357620+0000","last_active":"2023-10-16T23:27:42.302695+0000","last_peered":"2023-10-16T23:27:42.302695+0000","last_clean":"2023-10-16T23:27:42.302695+0000","last_became_active":"2023-10-16T23:27:40.357009+0000","last_became_peered":"2023-10-16T23:27:40.357009+0000","last_unstale":"2023-10-16T23:27:42.302695+0000","last_undegraded":"2023-10-16T23:27:42.302695+0000","last_fullsized":"2023-10-16T23:27:42.302695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:07:50.847519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698809+0000","last_change":"2023-10-16T23:27:40.760925+0000","last_active":"2023-10-16T23:27:41.698809+0000","last_peered":"2023-10-16T23:27:41.698809+0000","last_clean":"2023-10-16T23:27:41.698809+0000","last_became_active":"2023-10-16T23:27:40.760365+0000","last_became_peered":"2023-10-16T23:27:40.760365+0000","last_unstale":"2023-10-16T23:27:41.698809+0000","last_undegraded":"2023-10-16T23:27:41.698809+0000","last_fullsized":"2023-10-16T23:27:41.698809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:13.934735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702299+0000","last_change":"2023-10-16T23:27:40.331826+0000","last_active":"2023-10-16T23:27:41.702299+0000","last_peered":"2023-10-16T23:27:41.702299+0000","last_clean":"2023-10-16T23:27:41.702299+0000","last_became_active":"2023-10-16T23:27:40.330857+0000","last_became_peered":"2023-10-16T23:27:40.330857+0000","last_unstale":"2023-10-16T23:27:41.702299+0000","last_undegraded":"2023-10-16T23:27:41.702299+0000","last_fullsized":"2023-10-16T23:27:41.702299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:42:46.614672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.303087+0000","last_change":"2023-10-16T23:27:40.357691+0000","last_active":"2023-10-16T23:27:42.303087+0000","last_peered":"2023-10-16T23:27:42.303087+0000","last_clean":"2023-10-16T23:27:42.303087+0000","last_became_active":"2023-10-16T23:27:40.357047+0000","last_became_peered":"2023-10-16T23:27:40.357047+0000","last_unstale":"2023-10-16T23:27:42.303087+0000","last_undegraded":"2023-10-16T23:27:42.303087+0000","last_fullsized":"2023-10-16T23:27:42.303087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:00:00.805564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.951579+0000","last_change":"2023-10-16T23:27:40.763848+0000","last_active":"2023-10-16T23:27:41.951579+0000","last_peered":"2023-10-16T23:27:41.951579+0000","last_clean":"2023-10-16T23:27:41.951579+0000","last_became_active":"2023-10-16T23:27:40.763116+0000","last_became_peered":"2023-10-16T23:27:40.763116+0000","last_unstale":"2023-10-16T23:27:41.951579+0000","last_undegraded":"2023-10-16T23:27:41.951579+0000","last_fullsized":"2023-10-16T23:27:41.951579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.303028+0000","last_change":"2023-10-16T23:27:40.347016+0000","last_active":"2023-10-16T23:27:42.303028+0000","last_peered":"2023-10-16T23:27:42.303028+0000","last_clean":"2023-10-16T23:27:42.303028+0000","last_became_active":"2023-10-16T23:27:40.346439+0000","last_became_peered":"2023-10-16T23:27:40.346439+0000","last_unstale":"2023-10-16T23:27:42.303028+0000","last_undegraded":"2023-10-16T23:27:42.303028+0000","last_fullsized":"2023-10-16T23:27:42.303028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:08:40.047699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702083+0000","last_change":"2023-10-16T23:27:40.714905+0000","last_active":"2023-10-16T23:27:41.702083+0000","last_peered":"2023-10-16T23:27:41.702083+0000","last_clean":"2023-10-16T23:27:41.702083+0000","last_became_active":"2023-10-16T23:27:40.714098+0000","last_became_peered":"2023-10-16T23:27:40.714098+0000","last_unstale":"2023-10-16T23:27:41.702083+0000","last_undegraded":"2023-10-16T23:27:41.702083+0000","last_fullsized":"2023-10-16T23:27:41.702083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:13.934735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302935+0000","last_change":"2023-10-16T23:27:40.340462+0000","last_active":"2023-10-16T23:27:42.302935+0000","last_peered":"2023-10-16T23:27:42.302935+0000","last_clean":"2023-10-16T23:27:42.302935+0000","last_became_active":"2023-10-16T23:27:40.339531+0000","last_became_peered":"2023-10-16T23:27:40.339531+0000","last_unstale":"2023-10-16T23:27:42.302935+0000","last_undegraded":"2023-10-16T23:27:42.302935+0000","last_fullsized":"2023-10-16T23:27:42.302935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:33:50.768168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702961+0000","last_change":"2023-10-16T23:27:40.713930+0000","last_active":"2023-10-16T23:27:41.702961+0000","last_peered":"2023-10-16T23:27:41.702961+0000","last_clean":"2023-10-16T23:27:41.702961+0000","last_became_active":"2023-10-16T23:27:40.713087+0000","last_became_peered":"2023-10-16T23:27:40.713087+0000","last_unstale":"2023-10-16T23:27:41.702961+0000","last_undegraded":"2023-10-16T23:27:41.702961+0000","last_fullsized":"2023-10-16T23:27:41.702961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:15:24.177529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.951911+0000","last_change":"2023-10-16T23:27:40.320848+0000","last_active":"2023-10-16T23:27:41.951911+0000","last_peered":"2023-10-16T23:27:41.951911+0000","last_clean":"2023-10-16T23:27:41.951911+0000","last_became_active":"2023-10-16T23:27:40.319887+0000","last_became_peered":"2023-10-16T23:27:40.319887+0000","last_unstale":"2023-10-16T23:27:41.951911+0000","last_undegraded":"2023-10-16T23:27:41.951911+0000","last_fullsized":"2023-10-16T23:27:41.951911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:33:08.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641867+0000","last_change":"2023-10-16T23:27:40.726405+0000","last_active":"2023-10-16T23:27:42.641867+0000","last_peered":"2023-10-16T23:27:42.641867+0000","last_clean":"2023-10-16T23:27:42.641867+0000","last_became_active":"2023-10-16T23:27:40.725724+0000","last_became_peered":"2023-10-16T23:27:40.725724+0000","last_unstale":"2023-10-16T23:27:42.641867+0000","last_undegraded":"2023-10-16T23:27:42.641867+0000","last_fullsized":"2023-10-16T23:27:42.641867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698263+0000","last_change":"2023-10-16T23:27:40.337756+0000","last_active":"2023-10-16T23:27:41.698263+0000","last_peered":"2023-10-16T23:27:41.698263+0000","last_clean":"2023-10-16T23:27:41.698263+0000","last_became_active":"2023-10-16T23:27:40.337405+0000","last_became_peered":"2023-10-16T23:27:40.337405+0000","last_unstale":"2023-10-16T23:27:41.698263+0000","last_undegraded":"2023-10-16T23:27:41.698263+0000","last_fullsized":"2023-10-16T23:27:41.698263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:42.154580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704502+0000","last_change":"2023-10-16T23:27:40.722911+0000","last_active":"2023-10-16T23:27:41.704502+0000","last_peered":"2023-10-16T23:27:41.704502+0000","last_clean":"2023-10-16T23:27:41.704502+0000","last_became_active":"2023-10-16T23:27:40.722091+0000","last_became_peered":"2023-10-16T23:27:40.722091+0000","last_unstale":"2023-10-16T23:27:41.704502+0000","last_undegraded":"2023-10-16T23:27:41.704502+0000","last_fullsized":"2023-10-16T23:27:41.704502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.703208+0000","last_change":"2023-10-16T23:27:40.343242+0000","last_active":"2023-10-16T23:27:41.703208+0000","last_peered":"2023-10-16T23:27:41.703208+0000","last_clean":"2023-10-16T23:27:41.703208+0000","last_became_active":"2023-10-16T23:27:40.342213+0000","last_became_peered":"2023-10-16T23:27:40.342213+0000","last_unstale":"2023-10-16T23:27:41.703208+0000","last_undegraded":"2023-10-16T23:27:41.703208+0000","last_fullsized":"2023-10-16T23:27:41.703208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:04.095452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704900+0000","last_change":"2023-10-16T23:27:40.733845+0000","last_active":"2023-10-16T23:27:41.704900+0000","last_peered":"2023-10-16T23:27:41.704900+0000","last_clean":"2023-10-16T23:27:41.704900+0000","last_became_active":"2023-10-16T23:27:40.732996+0000","last_became_peered":"2023-10-16T23:27:40.732996+0000","last_unstale":"2023-10-16T23:27:41.704900+0000","last_undegraded":"2023-10-16T23:27:41.704900+0000","last_fullsized":"2023-10-16T23:27:41.704900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:06:04.512089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702852+0000","last_change":"2023-10-16T23:27:40.347984+0000","last_active":"2023-10-16T23:27:41.702852+0000","last_peered":"2023-10-16T23:27:41.702852+0000","last_clean":"2023-10-16T23:27:41.702852+0000","last_became_active":"2023-10-16T23:27:40.347253+0000","last_became_peered":"2023-10-16T23:27:40.347253+0000","last_unstale":"2023-10-16T23:27:41.702852+0000","last_undegraded":"2023-10-16T23:27:41.702852+0000","last_fullsized":"2023-10-16T23:27:41.702852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:42:46.614672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704750+0000","last_change":"2023-10-16T23:27:40.745245+0000","last_active":"2023-10-16T23:27:41.704750+0000","last_peered":"2023-10-16T23:27:41.704750+0000","last_clean":"2023-10-16T23:27:41.704750+0000","last_became_active":"2023-10-16T23:27:40.744571+0000","last_became_peered":"2023-10-16T23:27:40.744571+0000","last_unstale":"2023-10-16T23:27:41.704750+0000","last_undegraded":"2023-10-16T23:27:41.704750+0000","last_fullsized":"2023-10-16T23:27:41.704750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:10:39.974563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697473+0000","last_change":"2023-10-16T23:27:40.314767+0000","last_active":"2023-10-16T23:27:41.697473+0000","last_peered":"2023-10-16T23:27:41.697473+0000","last_clean":"2023-10-16T23:27:41.697473+0000","last_became_active":"2023-10-16T23:27:40.314242+0000","last_became_peered":"2023-10-16T23:27:40.314242+0000","last_unstale":"2023-10-16T23:27:41.697473+0000","last_undegraded":"2023-10-16T23:27:41.697473+0000","last_fullsized":"2023-10-16T23:27:41.697473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.479126+0000","last_change":"2023-10-16T23:27:40.709591+0000","last_active":"2023-10-16T23:27:42.479126+0000","last_peered":"2023-10-16T23:27:42.479126+0000","last_clean":"2023-10-16T23:27:42.479126+0000","last_became_active":"2023-10-16T23:27:40.709174+0000","last_became_peered":"2023-10-16T23:27:40.709174+0000","last_unstale":"2023-10-16T23:27:42.479126+0000","last_undegraded":"2023-10-16T23:27:42.479126+0000","last_fullsized":"2023-10-16T23:27:42.479126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:31.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.732645+0000","last_change":"2023-10-16T23:27:29.356842+0000","last_active":"2023-10-16T23:27:40.732645+0000","last_peered":"2023-10-16T23:27:40.732645+0000","last_clean":"2023-10-16T23:27:40.732645+0000","last_became_active":"2023-10-16T23:27:29.353846+0000","last_became_peered":"2023-10-16T23:27:29.353846+0000","last_unstale":"2023-10-16T23:27:40.732645+0000","last_undegraded":"2023-10-16T23:27:40.732645+0000","last_fullsized":"2023-10-16T23:27:40.732645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:28.136202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:28.136202+0000","last_clean_scrub_stamp":"2023-10-16T23:27:28.136202+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:34:30.590360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.706470+0000","last_change":"2023-10-16T23:27:36.278001+0000","last_active":"2023-10-16T23:27:40.706470+0000","last_peered":"2023-10-16T23:27:40.706470+0000","last_clean":"2023-10-16T23:27:40.706470+0000","last_became_active":"2023-10-16T23:27:36.277096+0000","last_became_peered":"2023-10-16T23:27:36.277096+0000","last_unstale":"2023-10-16T23:27:40.706470+0000","last_undegraded":"2023-10-16T23:27:40.706470+0000","last_fullsized":"2023-10-16T23:27:40.706470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:38:00.468059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697647+0000","last_change":"2023-10-16T23:27:40.331268+0000","last_active":"2023-10-16T23:27:41.697647+0000","last_peered":"2023-10-16T23:27:41.697647+0000","last_clean":"2023-10-16T23:27:41.697647+0000","last_became_active":"2023-10-16T23:27:40.330989+0000","last_became_peered":"2023-10-16T23:27:40.330989+0000","last_unstale":"2023-10-16T23:27:41.697647+0000","last_undegraded":"2023-10-16T23:27:41.697647+0000","last_fullsized":"2023-10-16T23:27:41.697647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:55.630817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702608+0000","last_change":"2023-10-16T23:27:40.726429+0000","last_active":"2023-10-16T23:27:41.702608+0000","last_peered":"2023-10-16T23:27:41.702608+0000","last_clean":"2023-10-16T23:27:41.702608+0000","last_became_active":"2023-10-16T23:27:40.725490+0000","last_became_peered":"2023-10-16T23:27:40.725490+0000","last_unstale":"2023-10-16T23:27:41.702608+0000","last_undegraded":"2023-10-16T23:27:41.702608+0000","last_fullsized":"2023-10-16T23:27:41.702608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:52:41.884757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.734075+0000","last_change":"2023-10-16T23:27:36.278865+0000","last_active":"2023-10-16T23:27:40.734075+0000","last_peered":"2023-10-16T23:27:40.734075+0000","last_clean":"2023-10-16T23:27:40.734075+0000","last_became_active":"2023-10-16T23:27:36.277974+0000","last_became_peered":"2023-10-16T23:27:36.277974+0000","last_unstale":"2023-10-16T23:27:40.734075+0000","last_undegraded":"2023-10-16T23:27:40.734075+0000","last_fullsized":"2023-10-16T23:27:40.734075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:31:09.411975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641255+0000","last_change":"2023-10-16T23:27:40.340025+0000","last_active":"2023-10-16T23:27:42.641255+0000","last_peered":"2023-10-16T23:27:42.641255+0000","last_clean":"2023-10-16T23:27:42.641255+0000","last_became_active":"2023-10-16T23:27:40.339569+0000","last_became_peered":"2023-10-16T23:27:40.339569+0000","last_unstale":"2023-10-16T23:27:42.641255+0000","last_undegraded":"2023-10-16T23:27:42.641255+0000","last_fullsized":"2023-10-16T23:27:42.641255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:42.154580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641378+0000","last_change":"2023-10-16T23:27:40.727415+0000","last_active":"2023-10-16T23:27:42.641378+0000","last_peered":"2023-10-16T23:27:42.641378+0000","last_clean":"2023-10-16T23:27:42.641378+0000","last_became_active":"2023-10-16T23:27:40.726813+0000","last_became_peered":"2023-10-16T23:27:40.726813+0000","last_unstale":"2023-10-16T23:27:42.641378+0000","last_undegraded":"2023-10-16T23:27:42.641378+0000","last_fullsized":"2023-10-16T23:27:42.641378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.694106+0000","last_change":"2023-10-16T23:27:36.294967+0000","last_active":"2023-10-16T23:27:40.694106+0000","last_peered":"2023-10-16T23:27:40.694106+0000","last_clean":"2023-10-16T23:27:40.694106+0000","last_became_active":"2023-10-16T23:27:36.294489+0000","last_became_peered":"2023-10-16T23:27:36.294489+0000","last_unstale":"2023-10-16T23:27:40.694106+0000","last_undegraded":"2023-10-16T23:27:40.694106+0000","last_fullsized":"2023-10-16T23:27:40.694106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:43:01.777197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478192+0000","last_change":"2023-10-16T23:27:40.327194+0000","last_active":"2023-10-16T23:27:42.478192+0000","last_peered":"2023-10-16T23:27:42.478192+0000","last_clean":"2023-10-16T23:27:42.478192+0000","last_became_active":"2023-10-16T23:27:40.326396+0000","last_became_peered":"2023-10-16T23:27:40.326396+0000","last_unstale":"2023-10-16T23:27:42.478192+0000","last_undegraded":"2023-10-16T23:27:42.478192+0000","last_fullsized":"2023-10-16T23:27:42.478192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:42.154580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.479151+0000","last_change":"2023-10-16T23:27:40.755777+0000","last_active":"2023-10-16T23:27:42.479151+0000","last_peered":"2023-10-16T23:27:42.479151+0000","last_clean":"2023-10-16T23:27:42.479151+0000","last_became_active":"2023-10-16T23:27:40.755489+0000","last_became_peered":"2023-10-16T23:27:40.755489+0000","last_unstale":"2023-10-16T23:27:42.479151+0000","last_undegraded":"2023-10-16T23:27:42.479151+0000","last_fullsized":"2023-10-16T23:27:42.479151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:06.148922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.720703+0000","last_change":"2023-10-16T23:27:36.279013+0000","last_active":"2023-10-16T23:27:40.720703+0000","last_peered":"2023-10-16T23:27:40.720703+0000","last_clean":"2023-10-16T23:27:40.720703+0000","last_became_active":"2023-10-16T23:27:36.278134+0000","last_became_peered":"2023-10-16T23:27:36.278134+0000","last_unstale":"2023-10-16T23:27:40.720703+0000","last_undegraded":"2023-10-16T23:27:40.720703+0000","last_fullsized":"2023-10-16T23:27:40.720703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:13:01.266310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704433+0000","last_change":"2023-10-16T23:27:40.342715+0000","last_active":"2023-10-16T23:27:41.704433+0000","last_peered":"2023-10-16T23:27:41.704433+0000","last_clean":"2023-10-16T23:27:41.704433+0000","last_became_active":"2023-10-16T23:27:40.341951+0000","last_became_peered":"2023-10-16T23:27:40.341951+0000","last_unstale":"2023-10-16T23:27:41.704433+0000","last_undegraded":"2023-10-16T23:27:41.704433+0000","last_fullsized":"2023-10-16T23:27:41.704433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:59.765109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478850+0000","last_change":"2023-10-16T23:27:40.731557+0000","last_active":"2023-10-16T23:27:42.478850+0000","last_peered":"2023-10-16T23:27:42.478850+0000","last_clean":"2023-10-16T23:27:42.478850+0000","last_became_active":"2023-10-16T23:27:40.731150+0000","last_became_peered":"2023-10-16T23:27:40.731150+0000","last_unstale":"2023-10-16T23:27:42.478850+0000","last_undegraded":"2023-10-16T23:27:42.478850+0000","last_fullsized":"2023-10-16T23:27:42.478850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952480+0000","last_change":"2023-10-16T23:27:40.320403+0000","last_active":"2023-10-16T23:27:41.952480+0000","last_peered":"2023-10-16T23:27:41.952480+0000","last_clean":"2023-10-16T23:27:41.952480+0000","last_became_active":"2023-10-16T23:27:40.319571+0000","last_became_peered":"2023-10-16T23:27:40.319571+0000","last_unstale":"2023-10-16T23:27:41.952480+0000","last_undegraded":"2023-10-16T23:27:41.952480+0000","last_fullsized":"2023-10-16T23:27:41.952480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.699523+0000","last_change":"2023-10-16T23:27:36.434134+0000","last_active":"2023-10-16T23:27:40.699523+0000","last_peered":"2023-10-16T23:27:40.699523+0000","last_clean":"2023-10-16T23:27:40.699523+0000","last_became_active":"2023-10-16T23:27:36.433808+0000","last_became_peered":"2023-10-16T23:27:36.433808+0000","last_unstale":"2023-10-16T23:27:40.699523+0000","last_undegraded":"2023-10-16T23:27:40.699523+0000","last_fullsized":"2023-10-16T23:27:40.699523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:58:44.833474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478822+0000","last_change":"2023-10-16T23:27:40.757932+0000","last_active":"2023-10-16T23:27:42.478822+0000","last_peered":"2023-10-16T23:27:42.478822+0000","last_clean":"2023-10-16T23:27:42.478822+0000","last_became_active":"2023-10-16T23:27:40.757670+0000","last_became_peered":"2023-10-16T23:27:40.757670+0000","last_unstale":"2023-10-16T23:27:42.478822+0000","last_undegraded":"2023-10-16T23:27:42.478822+0000","last_fullsized":"2023-10-16T23:27:42.478822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:25:31.037309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478894+0000","last_change":"2023-10-16T23:27:40.328161+0000","last_active":"2023-10-16T23:27:42.478894+0000","last_peered":"2023-10-16T23:27:42.478894+0000","last_clean":"2023-10-16T23:27:42.478894+0000","last_became_active":"2023-10-16T23:27:40.327804+0000","last_became_peered":"2023-10-16T23:27:40.327804+0000","last_unstale":"2023-10-16T23:27:42.478894+0000","last_undegraded":"2023-10-16T23:27:42.478894+0000","last_fullsized":"2023-10-16T23:27:42.478894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.734318+0000","last_change":"2023-10-16T23:27:36.434231+0000","last_active":"2023-10-16T23:27:40.734318+0000","last_peered":"2023-10-16T23:27:40.734318+0000","last_clean":"2023-10-16T23:27:40.734318+0000","last_became_active":"2023-10-16T23:27:36.433923+0000","last_became_peered":"2023-10-16T23:27:36.433923+0000","last_unstale":"2023-10-16T23:27:40.734318+0000","last_undegraded":"2023-10-16T23:27:40.734318+0000","last_fullsized":"2023-10-16T23:27:40.734318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:59.590093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642126+0000","last_change":"2023-10-16T23:27:40.756257+0000","last_active":"2023-10-16T23:27:42.642126+0000","last_peered":"2023-10-16T23:27:42.642126+0000","last_clean":"2023-10-16T23:27:42.642126+0000","last_became_active":"2023-10-16T23:27:40.755822+0000","last_became_peered":"2023-10-16T23:27:40.755822+0000","last_unstale":"2023-10-16T23:27:42.642126+0000","last_undegraded":"2023-10-16T23:27:42.642126+0000","last_fullsized":"2023-10-16T23:27:42.642126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698868+0000","last_change":"2023-10-16T23:27:40.333672+0000","last_active":"2023-10-16T23:27:41.698868+0000","last_peered":"2023-10-16T23:27:41.698868+0000","last_clean":"2023-10-16T23:27:41.698868+0000","last_became_active":"2023-10-16T23:27:40.333290+0000","last_became_peered":"2023-10-16T23:27:40.333290+0000","last_unstale":"2023-10-16T23:27:41.698868+0000","last_undegraded":"2023-10-16T23:27:41.698868+0000","last_fullsized":"2023-10-16T23:27:41.698868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:15:23.173526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.698124+0000","last_change":"2023-10-16T23:27:36.278805+0000","last_active":"2023-10-16T23:27:40.698124+0000","last_peered":"2023-10-16T23:27:40.698124+0000","last_clean":"2023-10-16T23:27:40.698124+0000","last_became_active":"2023-10-16T23:27:36.278209+0000","last_became_peered":"2023-10-16T23:27:36.278209+0000","last_unstale":"2023-10-16T23:27:40.698124+0000","last_undegraded":"2023-10-16T23:27:40.698124+0000","last_fullsized":"2023-10-16T23:27:40.698124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:38:00.468059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697202+0000","last_change":"2023-10-16T23:27:40.743576+0000","last_active":"2023-10-16T23:27:41.697202+0000","last_peered":"2023-10-16T23:27:41.697202+0000","last_clean":"2023-10-16T23:27:41.697202+0000","last_became_active":"2023-10-16T23:27:40.743293+0000","last_became_peered":"2023-10-16T23:27:40.743293+0000","last_unstale":"2023-10-16T23:27:41.697202+0000","last_undegraded":"2023-10-16T23:27:41.697202+0000","last_fullsized":"2023-10-16T23:27:41.697202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:14.359461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641711+0000","last_change":"2023-10-16T23:27:40.332668+0000","last_active":"2023-10-16T23:27:42.641711+0000","last_peered":"2023-10-16T23:27:42.641711+0000","last_clean":"2023-10-16T23:27:42.641711+0000","last_became_active":"2023-10-16T23:27:40.332084+0000","last_became_peered":"2023-10-16T23:27:40.332084+0000","last_unstale":"2023-10-16T23:27:42.641711+0000","last_undegraded":"2023-10-16T23:27:42.641711+0000","last_fullsized":"2023-10-16T23:27:42.641711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:14.260980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:40.698418+0000","last_change":"2023-10-16T23:27:36.281494+0000","last_active":"2023-10-16T23:27:40.698418+0000","last_peered":"2023-10-16T23:27:40.698418+0000","last_clean":"2023-10-16T23:27:40.698418+0000","last_became_active":"2023-10-16T23:27:36.280600+0000","last_became_peered":"2023-10-16T23:27:36.280600+0000","last_unstale":"2023-10-16T23:27:40.698418+0000","last_undegraded":"2023-10-16T23:27:40.698418+0000","last_fullsized":"2023-10-16T23:27:40.698418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:42:59.057101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702504+0000","last_change":"2023-10-16T23:27:40.756574+0000","last_active":"2023-10-16T23:27:41.702504+0000","last_peered":"2023-10-16T23:27:41.702504+0000","last_clean":"2023-10-16T23:27:41.702504+0000","last_became_active":"2023-10-16T23:27:40.755830+0000","last_became_peered":"2023-10-16T23:27:40.755830+0000","last_unstale":"2023-10-16T23:27:41.702504+0000","last_undegraded":"2023-10-16T23:27:41.702504+0000","last_fullsized":"2023-10-16T23:27:41.702504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:55:29.771781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704462+0000","last_change":"2023-10-16T23:27:40.745793+0000","last_active":"2023-10-16T23:27:41.704462+0000","last_peered":"2023-10-16T23:27:41.704462+0000","last_clean":"2023-10-16T23:27:41.704462+0000","last_became_active":"2023-10-16T23:27:40.745143+0000","last_became_peered":"2023-10-16T23:27:40.745143+0000","last_unstale":"2023-10-16T23:27:41.704462+0000","last_undegraded":"2023-10-16T23:27:41.704462+0000","last_fullsized":"2023-10-16T23:27:41.704462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:10:37.103208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704642+0000","last_change":"2023-10-16T23:27:40.352546+0000","last_active":"2023-10-16T23:27:41.704642+0000","last_peered":"2023-10-16T23:27:41.704642+0000","last_clean":"2023-10-16T23:27:41.704642+0000","last_became_active":"2023-10-16T23:27:40.351687+0000","last_became_peered":"2023-10-16T23:27:40.351687+0000","last_unstale":"2023-10-16T23:27:41.704642+0000","last_undegraded":"2023-10-16T23:27:41.704642+0000","last_fullsized":"2023-10-16T23:27:41.704642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:14.260980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478618+0000","last_change":"2023-10-16T23:27:40.727602+0000","last_active":"2023-10-16T23:27:42.478618+0000","last_peered":"2023-10-16T23:27:42.478618+0000","last_clean":"2023-10-16T23:27:42.478618+0000","last_became_active":"2023-10-16T23:27:40.727288+0000","last_became_peered":"2023-10-16T23:27:40.727288+0000","last_unstale":"2023-10-16T23:27:42.478618+0000","last_undegraded":"2023-10-16T23:27:42.478618+0000","last_fullsized":"2023-10-16T23:27:42.478618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:56:41.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302861+0000","last_change":"2023-10-16T23:27:40.332379+0000","last_active":"2023-10-16T23:27:42.302861+0000","last_peered":"2023-10-16T23:27:42.302861+0000","last_clean":"2023-10-16T23:27:42.302861+0000","last_became_active":"2023-10-16T23:27:40.331517+0000","last_became_peered":"2023-10-16T23:27:40.331517+0000","last_unstale":"2023-10-16T23:27:42.302861+0000","last_undegraded":"2023-10-16T23:27:42.302861+0000","last_fullsized":"2023-10-16T23:27:42.302861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:55.534068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952318+0000","last_change":"2023-10-16T23:27:40.336300+0000","last_active":"2023-10-16T23:27:41.952318+0000","last_peered":"2023-10-16T23:27:41.952318+0000","last_clean":"2023-10-16T23:27:41.952318+0000","last_became_active":"2023-10-16T23:27:40.333012+0000","last_became_peered":"2023-10-16T23:27:40.333012+0000","last_unstale":"2023-10-16T23:27:41.952318+0000","last_undegraded":"2023-10-16T23:27:41.952318+0000","last_fullsized":"2023-10-16T23:27:41.952318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697630+0000","last_change":"2023-10-16T23:27:40.760984+0000","last_active":"2023-10-16T23:27:41.697630+0000","last_peered":"2023-10-16T23:27:41.697630+0000","last_clean":"2023-10-16T23:27:41.697630+0000","last_became_active":"2023-10-16T23:27:40.760680+0000","last_became_peered":"2023-10-16T23:27:40.760680+0000","last_unstale":"2023-10-16T23:27:41.697630+0000","last_undegraded":"2023-10-16T23:27:41.697630+0000","last_fullsized":"2023-10-16T23:27:41.697630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:04.722168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642505+0000","last_change":"2023-10-16T23:27:40.339159+0000","last_active":"2023-10-16T23:27:42.642505+0000","last_peered":"2023-10-16T23:27:42.642505+0000","last_clean":"2023-10-16T23:27:42.642505+0000","last_became_active":"2023-10-16T23:27:40.338706+0000","last_became_peered":"2023-10-16T23:27:40.338706+0000","last_unstale":"2023-10-16T23:27:42.642505+0000","last_undegraded":"2023-10-16T23:27:42.642505+0000","last_fullsized":"2023-10-16T23:27:42.642505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:33:08.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697208+0000","last_change":"2023-10-16T23:27:40.713138+0000","last_active":"2023-10-16T23:27:41.697208+0000","last_peered":"2023-10-16T23:27:41.697208+0000","last_clean":"2023-10-16T23:27:41.697208+0000","last_became_active":"2023-10-16T23:27:40.712756+0000","last_became_peered":"2023-10-16T23:27:40.712756+0000","last_unstale":"2023-10-16T23:27:41.697208+0000","last_undegraded":"2023-10-16T23:27:41.697208+0000","last_fullsized":"2023-10-16T23:27:41.697208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:19:17.463284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.703371+0000","last_change":"2023-10-16T23:27:40.756418+0000","last_active":"2023-10-16T23:27:41.703371+0000","last_peered":"2023-10-16T23:27:41.703371+0000","last_clean":"2023-10-16T23:27:41.703371+0000","last_became_active":"2023-10-16T23:27:40.755714+0000","last_became_peered":"2023-10-16T23:27:40.755714+0000","last_unstale":"2023-10-16T23:27:41.703371+0000","last_undegraded":"2023-10-16T23:27:41.703371+0000","last_fullsized":"2023-10-16T23:27:41.703371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:56.634821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697319+0000","last_change":"2023-10-16T23:27:40.332275+0000","last_active":"2023-10-16T23:27:41.697319+0000","last_peered":"2023-10-16T23:27:41.697319+0000","last_clean":"2023-10-16T23:27:41.697319+0000","last_became_active":"2023-10-16T23:27:40.331428+0000","last_became_peered":"2023-10-16T23:27:40.331428+0000","last_unstale":"2023-10-16T23:27:41.697319+0000","last_undegraded":"2023-10-16T23:27:41.697319+0000","last_fullsized":"2023-10-16T23:27:41.697319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.641125+0000","last_change":"2023-10-16T23:27:40.761081+0000","last_active":"2023-10-16T23:27:42.641125+0000","last_peered":"2023-10-16T23:27:42.641125+0000","last_clean":"2023-10-16T23:27:42.641125+0000","last_became_active":"2023-10-16T23:27:40.760779+0000","last_became_peered":"2023-10-16T23:27:40.760779+0000","last_unstale":"2023-10-16T23:27:42.641125+0000","last_undegraded":"2023-10-16T23:27:42.641125+0000","last_fullsized":"2023-10-16T23:27:42.641125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:31.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.478605+0000","last_change":"2023-10-16T23:27:40.318419+0000","last_active":"2023-10-16T23:27:42.478605+0000","last_peered":"2023-10-16T23:27:42.478605+0000","last_clean":"2023-10-16T23:27:42.478605+0000","last_became_active":"2023-10-16T23:27:40.317622+0000","last_became_peered":"2023-10-16T23:27:40.317622+0000","last_unstale":"2023-10-16T23:27:42.478605+0000","last_undegraded":"2023-10-16T23:27:42.478605+0000","last_fullsized":"2023-10-16T23:27:42.478605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.698467+0000","last_change":"2023-10-16T23:27:40.706263+0000","last_active":"2023-10-16T23:27:41.698467+0000","last_peered":"2023-10-16T23:27:41.698467+0000","last_clean":"2023-10-16T23:27:41.698467+0000","last_became_active":"2023-10-16T23:27:40.705956+0000","last_became_peered":"2023-10-16T23:27:40.705956+0000","last_unstale":"2023-10-16T23:27:41.698467+0000","last_undegraded":"2023-10-16T23:27:41.698467+0000","last_fullsized":"2023-10-16T23:27:41.698467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.703994+0000","last_change":"2023-10-16T23:27:40.344965+0000","last_active":"2023-10-16T23:27:41.703994+0000","last_peered":"2023-10-16T23:27:41.703994+0000","last_clean":"2023-10-16T23:27:41.703994+0000","last_became_active":"2023-10-16T23:27:40.344158+0000","last_became_peered":"2023-10-16T23:27:40.344158+0000","last_unstale":"2023-10-16T23:27:41.703994+0000","last_undegraded":"2023-10-16T23:27:41.703994+0000","last_fullsized":"2023-10-16T23:27:41.703994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:04.095452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.302083+0000","last_change":"2023-10-16T23:27:40.713594+0000","last_active":"2023-10-16T23:27:42.302083+0000","last_peered":"2023-10-16T23:27:42.302083+0000","last_clean":"2023-10-16T23:27:42.302083+0000","last_became_active":"2023-10-16T23:27:40.712632+0000","last_became_peered":"2023-10-16T23:27:40.712632+0000","last_unstale":"2023-10-16T23:27:42.302083+0000","last_undegraded":"2023-10-16T23:27:42.302083+0000","last_fullsized":"2023-10-16T23:27:42.302083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:52.368847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642366+0000","last_change":"2023-10-16T23:27:40.357300+0000","last_active":"2023-10-16T23:27:42.642366+0000","last_peered":"2023-10-16T23:27:42.642366+0000","last_clean":"2023-10-16T23:27:42.642366+0000","last_became_active":"2023-10-16T23:27:40.356809+0000","last_became_peered":"2023-10-16T23:27:40.356809+0000","last_unstale":"2023-10-16T23:27:42.642366+0000","last_undegraded":"2023-10-16T23:27:42.642366+0000","last_fullsized":"2023-10-16T23:27:42.642366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.704165+0000","last_change":"2023-10-16T23:27:40.726018+0000","last_active":"2023-10-16T23:27:41.704165+0000","last_peered":"2023-10-16T23:27:41.704165+0000","last_clean":"2023-10-16T23:27:41.704165+0000","last_became_active":"2023-10-16T23:27:40.724910+0000","last_became_peered":"2023-10-16T23:27:40.724910+0000","last_unstale":"2023-10-16T23:27:41.704165+0000","last_undegraded":"2023-10-16T23:27:41.704165+0000","last_fullsized":"2023-10-16T23:27:41.704165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:25:34.841325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.951808+0000","last_change":"2023-10-16T23:27:40.345785+0000","last_active":"2023-10-16T23:27:41.951808+0000","last_peered":"2023-10-16T23:27:41.951808+0000","last_clean":"2023-10-16T23:27:41.951808+0000","last_became_active":"2023-10-16T23:27:40.344531+0000","last_became_peered":"2023-10-16T23:27:40.344531+0000","last_unstale":"2023-10-16T23:27:41.951808+0000","last_undegraded":"2023-10-16T23:27:41.951808+0000","last_fullsized":"2023-10-16T23:27:41.951808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:55.630817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702429+0000","last_change":"2023-10-16T23:27:40.720573+0000","last_active":"2023-10-16T23:27:41.702429+0000","last_peered":"2023-10-16T23:27:41.702429+0000","last_clean":"2023-10-16T23:27:41.702429+0000","last_became_active":"2023-10-16T23:27:40.719758+0000","last_became_peered":"2023-10-16T23:27:40.719758+0000","last_unstale":"2023-10-16T23:27:41.702429+0000","last_undegraded":"2023-10-16T23:27:41.702429+0000","last_fullsized":"2023-10-16T23:27:41.702429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:27:29.534374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.952407+0000","last_change":"2023-10-16T23:27:40.345400+0000","last_active":"2023-10-16T23:27:41.952407+0000","last_peered":"2023-10-16T23:27:41.952407+0000","last_clean":"2023-10-16T23:27:41.952407+0000","last_became_active":"2023-10-16T23:27:40.344589+0000","last_became_peered":"2023-10-16T23:27:40.344589+0000","last_unstale":"2023-10-16T23:27:41.952407+0000","last_undegraded":"2023-10-16T23:27:41.952407+0000","last_fullsized":"2023-10-16T23:27:41.952407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:15:23.173526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.697731+0000","last_change":"2023-10-16T23:27:40.711211+0000","last_active":"2023-10-16T23:27:41.697731+0000","last_peered":"2023-10-16T23:27:41.697731+0000","last_clean":"2023-10-16T23:27:41.697731+0000","last_became_active":"2023-10-16T23:27:40.705936+0000","last_became_peered":"2023-10-16T23:27:40.705936+0000","last_unstale":"2023-10-16T23:27:41.697731+0000","last_undegraded":"2023-10-16T23:27:41.697731+0000","last_fullsized":"2023-10-16T23:27:41.697731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.699046+0000","last_change":"2023-10-16T23:27:40.323626+0000","last_active":"2023-10-16T23:27:41.699046+0000","last_peered":"2023-10-16T23:27:41.699046+0000","last_clean":"2023-10-16T23:27:41.699046+0000","last_became_active":"2023-10-16T23:27:40.323352+0000","last_became_peered":"2023-10-16T23:27:40.323352+0000","last_unstale":"2023-10-16T23:27:41.699046+0000","last_undegraded":"2023-10-16T23:27:41.699046+0000","last_fullsized":"2023-10-16T23:27:41.699046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:33:08.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:41.702217+0000","last_change":"2023-10-16T23:27:40.749109+0000","last_active":"2023-10-16T23:27:41.702217+0000","last_peered":"2023-10-16T23:27:41.702217+0000","last_clean":"2023-10-16T23:27:41.702217+0000","last_became_active":"2023-10-16T23:27:40.748525+0000","last_became_peered":"2023-10-16T23:27:40.748525+0000","last_unstale":"2023-10-16T23:27:41.702217+0000","last_undegraded":"2023-10-16T23:27:41.702217+0000","last_fullsized":"2023-10-16T23:27:41.702217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:10:38.468420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:42.642507+0000","last_change":"2023-10-16T23:27:40.338946+0000","last_active":"2023-10-16T23:27:42.642507+0000","last_peered":"2023-10-16T23:27:42.642507+0000","last_clean":"2023-10-16T23:27:42.642507+0000","last_became_active":"2023-10-16T23:27:40.338565+0000","last_became_peered":"2023-10-16T23:27:40.338565+0000","last_unstale":"2023-10-16T23:27:42.642507+0000","last_undegraded":"2023-10-16T23:27:42.642507+0000","last_fullsized":"2023-10-16T23:27:42.642507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:55.630817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":90844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":91496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":92464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]}]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":249856,"data_stored":90934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":90844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]}]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":824,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":843776,"data_stored":681794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":868352,"data_stored":682992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31288,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340552,"statfs":{"total":96636764160,"available":96604725248,"internally_reserved":0,"allocated":245760,"data_stored":90844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3580000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T23:27:53.862 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-16T23:27:53.862 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-16T23:27:53.863 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-16T23:27:53.863 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-16T23:27:54.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.012+0000 7f91d7be1640 1 Processor -- start 2023-10-16T23:27:54.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.012+0000 7f91d7be1640 1 -- start start 2023-10-16T23:27:54.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.012+0000 7f91d7be1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91d00c1130 0x7f91d00b8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.012+0000 7f91d7be1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f91d014c520 0x7f91d014c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.012+0000 7f91d7be1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f91d014cec0 0x7f91d00b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.012+0000 7f91d7be1640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d00b3ca0 con 0x7f91d014c520 2023-10-16T23:27:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.012+0000 7f91d7be1640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d00b40c0 con 0x7f91d014cec0 2023-10-16T23:27:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.012+0000 7f91d7be1640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d00b7ce0 con 0x7f91d00c1130 2023-10-16T23:27:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.012+0000 7f91d517c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f91d014c520 0x7f91d014c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.012+0000 7f91d517c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f91d014c520 0x7f91d014c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55956/0 (socket says 172.21.15.12:55956) 2023-10-16T23:27:54.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.012+0000 7f91d517c640 1 -- 172.21.15.12:0/3712245787 learned_addr learned my addr 172.21.15.12:0/3712245787 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:54.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.012+0000 7f91d617e640 1 --2- 172.21.15.12:0/3712245787 >> v2:172.21.15.31:3300/0 conn(0x7f91d014cec0 0x7f91d00b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.012+0000 7f91d597d640 1 --2- 172.21.15.12:0/3712245787 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91d00c1130 0x7f91d00b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.012+0000 7f91d517c640 1 -- 172.21.15.12:0/3712245787 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91d00c1130 msgr2=0x7f91d00b8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:54.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.012+0000 7f91d517c640 1 --2- 172.21.15.12:0/3712245787 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91d00c1130 0x7f91d00b8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.012+0000 7f91d517c640 1 -- 172.21.15.12:0/3712245787 >> v2:172.21.15.31:3300/0 conn(0x7f91d014cec0 msgr2=0x7f91d00b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.012+0000 7f91d517c640 1 --2- 172.21.15.12:0/3712245787 >> v2:172.21.15.31:3300/0 conn(0x7f91d014cec0 0x7f91d00b9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.012+0000 7f91d517c640 1 -- 172.21.15.12:0/3712245787 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d00c1510 con 0x7f91d014c520 2023-10-16T23:27:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.012+0000 7f91d617e640 1 --2- 172.21.15.12:0/3712245787 >> v2:172.21.15.31:3300/0 conn(0x7f91d014cec0 0x7f91d00b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:54.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.016+0000 7f91d517c640 1 --2- 172.21.15.12:0/3712245787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91d014c520 0x7f91d014c980 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f91d00b7820 tx=0x7f91c401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c7acef253a1647 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:54.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.016+0000 7f91d497b640 1 -- 172.21.15.12:0/3712245787 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c40a5750 con 0x7f91d014c520 2023-10-16T23:27:54.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.016+0000 7f91d497b640 1 -- 172.21.15.12:0/3712245787 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c40a58b0 con 0x7f91d014c520 2023-10-16T23:27:54.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.016+0000 7f91d497b640 1 -- 172.21.15.12:0/3712245787 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c40a5c40 con 0x7f91d014c520 2023-10-16T23:27:54.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.016+0000 7f91d7be1640 1 -- 172.21.15.12:0/3712245787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91d014c520 msgr2=0x7f91d014c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:54.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.016+0000 7f91d7be1640 1 --2- 172.21.15.12:0/3712245787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91d014c520 0x7f91d014c980 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f91d00b7820 tx=0x7f91c401c8b0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.016+0000 7f91d7be1640 1 -- 172.21.15.12:0/3712245787 shutdown_connections 2023-10-16T23:27:54.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.016+0000 7f91d7be1640 1 --2- 172.21.15.12:0/3712245787 >> v2:172.21.15.31:3300/0 conn(0x7f91d014cec0 0x7f91d00b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.016+0000 7f91d7be1640 1 --2- 172.21.15.12:0/3712245787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91d014c520 0x7f91d014c980 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.016+0000 7f91d7be1640 1 --2- 172.21.15.12:0/3712245787 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91d00c1130 0x7f91d00b8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.016+0000 7f91d7be1640 1 -- 172.21.15.12:0/3712245787 >> 172.21.15.12:0/3712245787 conn(0x7f91d006ba20 msgr2=0x7f91d00c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:54.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.016+0000 7f91d7be1640 1 -- 172.21.15.12:0/3712245787 shutdown_connections 2023-10-16T23:27:54.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.016+0000 7f91d7be1640 1 -- 172.21.15.12:0/3712245787 wait complete. 2023-10-16T23:27:54.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.016+0000 7f91d7be1640 1 Processor -- start 2023-10-16T23:27:54.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.016+0000 7f91d7be1640 1 -- start start 2023-10-16T23:27:54.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91d7be1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91d00c1130 0x7f91d01458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91d7be1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91d014c520 0x7f91d00be5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91d7be1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91d014cec0 0x7f91d00b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91d7be1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d0146ac0 con 0x7f91d014cec0 2023-10-16T23:27:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91d7be1640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d01eb280 con 0x7f91d00c1130 2023-10-16T23:27:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91d7be1640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d00b5640 con 0x7f91d014c520 2023-10-16T23:27:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91d617e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91d014cec0 0x7f91d00b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91d617e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91d014cec0 0x7f91d00b4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55960/0 (socket says 172.21.15.12:55960) 2023-10-16T23:27:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91d617e640 1 -- 172.21.15.12:0/3573525394 learned_addr learned my addr 172.21.15.12:0/3573525394 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91d517c640 1 --2- 172.21.15.12:0/3573525394 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91d014c520 0x7f91d00be5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91d597d640 1 --2- 172.21.15.12:0/3573525394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91d00c1130 0x7f91d01458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91d617e640 1 -- 172.21.15.12:0/3573525394 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91d014c520 msgr2=0x7f91d00be5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91d617e640 1 --2- 172.21.15.12:0/3573525394 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91d014c520 0x7f91d00be5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91d617e640 1 -- 172.21.15.12:0/3573525394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91d00c1130 msgr2=0x7f91d01458d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91d617e640 1 --2- 172.21.15.12:0/3573525394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91d00c1130 0x7f91d01458d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91d617e640 1 -- 172.21.15.12:0/3573525394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c4009b30 con 0x7f91d014cec0 2023-10-16T23:27:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91d517c640 1 --2- 172.21.15.12:0/3573525394 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91d014c520 0x7f91d00be5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91d617e640 1 --2- 172.21.15.12:0/3573525394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91d014cec0 0x7f91d00b4200 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f91cc00c5c0 tx=0x7f91cc00ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:54.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91c27fc640 1 -- 172.21.15.12:0/3573525394 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc011800 con 0x7f91d014cec0 2023-10-16T23:27:54.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91c27fc640 1 -- 172.21.15.12:0/3573525394 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91cc011980 con 0x7f91d014cec0 2023-10-16T23:27:54.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91c27fc640 1 -- 172.21.15.12:0/3573525394 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc011d30 con 0x7f91d014cec0 2023-10-16T23:27:54.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91d7be1640 1 -- 172.21.15.12:0/3573525394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d00b5920 con 0x7f91d014cec0 2023-10-16T23:27:54.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91d7be1640 1 -- 172.21.15.12:0/3573525394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d00c04f0 con 0x7f91d014cec0 2023-10-16T23:27:54.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91d7be1640 1 -- 172.21.15.12:0/3573525394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d00673a0 con 0x7f91d014cec0 2023-10-16T23:27:54.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91c27fc640 1 -- 172.21.15.12:0/3573525394 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f91cc022350 con 0x7f91d014cec0 2023-10-16T23:27:54.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91c27fc640 1 --2- 172.21.15.12:0/3573525394 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f91b4065e90 0x7f91b4068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91c27fc640 1 -- 172.21.15.12:0/3573525394 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f91cc083850 con 0x7f91d014cec0 2023-10-16T23:27:54.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.020+0000 7f91d597d640 1 --2- 172.21.15.12:0/3573525394 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f91b4065e90 0x7f91b4068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.024+0000 7f91d597d640 1 --2- 172.21.15.12:0/3573525394 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f91b4065e90 0x7f91b4068350 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f91c800b7e0 tx=0x7f91c8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:54.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.024+0000 7f91c27fc640 1 -- 172.21.15.12:0/3573525394 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f91cc050f30 con 0x7f91d014cec0 2023-10-16T23:27:54.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.208+0000 7f91d7be1640 1 -- 172.21.15.12:0/3573525394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f91d0146430 con 0x7f91d014cec0 2023-10-16T23:27:54.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.208+0000 7f91c27fc640 1 -- 172.21.15.12:0/3573525394 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f91cc01f080 con 0x7f91d014cec0 2023-10-16T23:27:54.211 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:54.211 INFO:teuthology.orchestra.run.smithi012.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-16T23:27:54.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.208+0000 7f91d7be1640 1 -- 172.21.15.12:0/3573525394 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f91b4065e90 msgr2=0x7f91b4068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:54.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.208+0000 7f91d7be1640 1 --2- 172.21.15.12:0/3573525394 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f91b4065e90 0x7f91b4068350 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f91c800b7e0 tx=0x7f91c8008040 comp rx=0 tx=0).stop 2023-10-16T23:27:54.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.208+0000 7f91d7be1640 1 -- 172.21.15.12:0/3573525394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91d014cec0 msgr2=0x7f91d00b4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:54.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.208+0000 7f91d7be1640 1 --2- 172.21.15.12:0/3573525394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91d014cec0 0x7f91d00b4200 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f91cc00c5c0 tx=0x7f91cc00ca80 comp rx=0 tx=0).stop 2023-10-16T23:27:54.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.208+0000 7f91d7be1640 1 -- 172.21.15.12:0/3573525394 shutdown_connections 2023-10-16T23:27:54.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.208+0000 7f91d7be1640 1 --2- 172.21.15.12:0/3573525394 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f91b4065e90 0x7f91b4068350 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.208+0000 7f91d7be1640 1 --2- 172.21.15.12:0/3573525394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91d014cec0 0x7f91d00b4200 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.208+0000 7f91d7be1640 1 --2- 172.21.15.12:0/3573525394 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91d014c520 0x7f91d00be5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.208+0000 7f91d7be1640 1 --2- 172.21.15.12:0/3573525394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91d00c1130 0x7f91d01458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.208+0000 7f91d7be1640 1 -- 172.21.15.12:0/3573525394 >> 172.21.15.12:0/3573525394 conn(0x7f91d006ba20 msgr2=0x7f91d00badd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:54.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.208+0000 7f91d7be1640 1 -- 172.21.15.12:0/3573525394 shutdown_connections 2023-10-16T23:27:54.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.208+0000 7f91d7be1640 1 -- 172.21.15.12:0/3573525394 wait complete. 2023-10-16T23:27:54.228 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-16T23:27:54.229 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T23:27:54.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.348+0000 7f16a6e2a640 1 Processor -- start 2023-10-16T23:27:54.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.348+0000 7f16a6e2a640 1 -- start start 2023-10-16T23:27:54.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.352+0000 7f16a6e2a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f16a00c1950 0x7f16a00c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.352+0000 7f16a6e2a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16a006e770 0x7f16a0152a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.352+0000 7f16a6e2a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a00c01e0 con 0x7f16a00bfc30 2023-10-16T23:27:54.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.352+0000 7f16a6e2a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a00b85b0 con 0x7f16a00c1950 2023-10-16T23:27:54.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.352+0000 7f16a6e2a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a00b8120 con 0x7f16a006e770 2023-10-16T23:27:54.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.352+0000 7f16a4bc6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f16a00c1950 0x7f16a00c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.352+0000 7f16a53c7640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f16a00bfc30 0x7f16a0152f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38300/0 (socket says 172.21.15.12:38300) 2023-10-16T23:27:54.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.352+0000 7f16a53c7640 1 -- 172.21.15.12:0/3177351190 learned_addr learned my addr 172.21.15.12:0/3177351190 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:54.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.352+0000 7f169ffff640 1 --2- 172.21.15.12:0/3177351190 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16a006e770 0x7f16a0152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.352+0000 7f16a4bc6640 1 -- 172.21.15.12:0/3177351190 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16a006e770 msgr2=0x7f16a0152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:54.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.352+0000 7f16a4bc6640 1 --2- 172.21.15.12:0/3177351190 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16a006e770 0x7f16a0152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.352+0000 7f169f7fe640 1 -- 172.21.15.12:0/3177351190 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701454259 0 0) 0x7f16a00c01e0 con 0x7f16a00bfc30 2023-10-16T23:27:54.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.352+0000 7f16a4bc6640 1 -- 172.21.15.12:0/3177351190 >> v1:172.21.15.12:6789/0 conn(0x7f16a00bfc30 legacy=0x7f16a0152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:54.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.352+0000 7f16a4bc6640 1 -- 172.21.15.12:0/3177351190 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a00b7db0 con 0x7f16a00c1950 2023-10-16T23:27:54.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.352+0000 7f16a4bc6640 1 --2- 172.21.15.12:0/3177351190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16a00c1950 0x7f16a00c1d30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1698009d90 tx=0x7f169801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bcb1ddcd90113d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:54.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.352+0000 7f169f7fe640 1 -- 172.21.15.12:0/3177351190 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16980a59a0 con 0x7f16a00c1950 2023-10-16T23:27:54.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.352+0000 7f169f7fe640 1 -- 172.21.15.12:0/3177351190 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16980a5b00 con 0x7f16a00c1950 2023-10-16T23:27:54.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.352+0000 7f169f7fe640 1 -- 172.21.15.12:0/3177351190 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16980a5e90 con 0x7f16a00c1950 2023-10-16T23:27:54.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.352+0000 7f16a6e2a640 1 -- 172.21.15.12:0/3177351190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16a00c1950 msgr2=0x7f16a00c1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:54.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.352+0000 7f16a6e2a640 1 --2- 172.21.15.12:0/3177351190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16a00c1950 0x7f16a00c1d30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1698009d90 tx=0x7f169801c8c0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.352+0000 7f16a6e2a640 1 -- 172.21.15.12:0/3177351190 shutdown_connections 2023-10-16T23:27:54.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.352+0000 7f16a6e2a640 1 --2- 172.21.15.12:0/3177351190 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16a006e770 0x7f16a0152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.352+0000 7f16a6e2a640 1 --2- 172.21.15.12:0/3177351190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16a00c1950 0x7f16a00c1d30 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.352+0000 7f16a6e2a640 1 -- 172.21.15.12:0/3177351190 >> 172.21.15.12:0/3177351190 conn(0x7f16a006b5d0 msgr2=0x7f16a006b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:54.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.352+0000 7f16a6e2a640 1 -- 172.21.15.12:0/3177351190 shutdown_connections 2023-10-16T23:27:54.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.352+0000 7f16a6e2a640 1 -- 172.21.15.12:0/3177351190 wait complete. 2023-10-16T23:27:54.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.356+0000 7f16a6e2a640 1 Processor -- start 2023-10-16T23:27:54.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.356+0000 7f16a6e2a640 1 -- start start 2023-10-16T23:27:54.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.356+0000 7f16a6e2a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16a006e770 0x7f16a00bd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.356+0000 7f16a6e2a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16a00bfc30 0x7f16a00b9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.356+0000 7f16a6e2a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16a00c1950 0x7f16a00ba370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.356+0000 7f16a6e2a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a00c2b00 con 0x7f16a006e770 2023-10-16T23:27:54.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.356+0000 7f16a6e2a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a00bd890 con 0x7f16a00bfc30 2023-10-16T23:27:54.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.356+0000 7f16a6e2a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a00c32d0 con 0x7f16a00c1950 2023-10-16T23:27:54.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.356+0000 7f16a4bc6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16a006e770 0x7f16a00bd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.356+0000 7f16a4bc6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16a006e770 0x7f16a00bd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55974/0 (socket says 172.21.15.12:55974) 2023-10-16T23:27:54.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.356+0000 7f16a4bc6640 1 -- 172.21.15.12:0/291008935 learned_addr learned my addr 172.21.15.12:0/291008935 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:54.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.356+0000 7f16a53c7640 1 --2- 172.21.15.12:0/291008935 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16a00c1950 0x7f16a00ba370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.356+0000 7f169ffff640 1 --2- 172.21.15.12:0/291008935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16a00bfc30 0x7f16a00b9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.356+0000 7f16a4bc6640 1 -- 172.21.15.12:0/291008935 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16a00c1950 msgr2=0x7f16a00ba370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:54.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.356+0000 7f16a4bc6640 1 --2- 172.21.15.12:0/291008935 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16a00c1950 0x7f16a00ba370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.356+0000 7f16a4bc6640 1 -- 172.21.15.12:0/291008935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16a00bfc30 msgr2=0x7f16a00b9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:54.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.356+0000 7f16a4bc6640 1 --2- 172.21.15.12:0/291008935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16a00bfc30 0x7f16a00b9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.356+0000 7f16a4bc6640 1 -- 172.21.15.12:0/291008935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1698009a70 con 0x7f16a006e770 2023-10-16T23:27:54.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.356+0000 7f169ffff640 1 --2- 172.21.15.12:0/291008935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16a00bfc30 0x7f16a00b9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:54.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.356+0000 7f16a4bc6640 1 --2- 172.21.15.12:0/291008935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16a006e770 0x7f16a00bd350 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f169801a4f0 tx=0x7f16a00bf190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:54.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.360+0000 7f169d7fa640 1 -- 172.21.15.12:0/291008935 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16980adbf0 con 0x7f16a006e770 2023-10-16T23:27:54.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.360+0000 7f169d7fa640 1 -- 172.21.15.12:0/291008935 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16980add70 con 0x7f16a006e770 2023-10-16T23:27:54.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.360+0000 7f16a6e2a640 1 -- 172.21.15.12:0/291008935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a00c3590 con 0x7f16a006e770 2023-10-16T23:27:54.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.360+0000 7f169d7fa640 1 -- 172.21.15.12:0/291008935 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16980b6640 con 0x7f16a006e770 2023-10-16T23:27:54.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.360+0000 7f16a6e2a640 1 -- 172.21.15.12:0/291008935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a00ba8b0 con 0x7f16a006e770 2023-10-16T23:27:54.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.360+0000 7f16a6e2a640 1 -- 172.21.15.12:0/291008935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a00673a0 con 0x7f16a006e770 2023-10-16T23:27:54.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.360+0000 7f169d7fa640 1 -- 172.21.15.12:0/291008935 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f16980b4040 con 0x7f16a006e770 2023-10-16T23:27:54.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.360+0000 7f169d7fa640 1 --2- 172.21.15.12:0/291008935 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1680065e90 0x7f1680068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.360+0000 7f169d7fa640 1 -- 172.21.15.12:0/291008935 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f169811e080 con 0x7f16a006e770 2023-10-16T23:27:54.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.360+0000 7f169ffff640 1 --2- 172.21.15.12:0/291008935 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1680065e90 0x7f1680068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.364+0000 7f169ffff640 1 --2- 172.21.15.12:0/291008935 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1680065e90 0x7f1680068350 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f16a006bd00 tx=0x7f1688008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:54.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.364+0000 7f169d7fa640 1 -- 172.21.15.12:0/291008935 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f169814f040 con 0x7f16a006e770 2023-10-16T23:27:54.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.516+0000 7f16a6e2a640 1 -- 172.21.15.12:0/291008935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16a0066e40 con 0x7f16a006e770 2023-10-16T23:27:54.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.520+0000 7f169d7fa640 1 -- 172.21.15.12:0/291008935 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17763 (secure 0 0 0) 0x7f16980eb7e0 con 0x7f16a006e770 2023-10-16T23:27:54.522 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:54.523 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"fsid":"0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51","created":"2023-10-16T23:27:16.468087+0000","modified":"2023-10-16T23:27:41.690088+0000","last_up_change":"2023-10-16T23:27:28.136202+0000","last_in_change":"2023-10-16T23:27:18.793212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T23:27:27.354025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-16T23:27:34.786446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-16T23:27:39.130341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-16T23:27:39.674572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73e70f98-6f5e-4464-b34e-931faac41cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":38075},{"type":"v1","addr":"172.21.15.12:6814","nonce":38075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":38075},{"type":"v1","addr":"172.21.15.12:6819","nonce":38075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":38075},{"type":"v1","addr":"172.21.15.12:6827","nonce":38075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":38075},{"type":"v1","addr":"172.21.15.12:6823","nonce":38075}]},"public_addr":"172.21.15.12:6814/38075","cluster_addr":"172.21.15.12:6819/38075","heartbeat_back_addr":"172.21.15.12:6827/38075","heartbeat_front_addr":"172.21.15.12:6823/38075","state":["exists","up"]},{"osd":1,"uuid":"ff722efe-b3f9-4cc0-bbde-f4d4d8055a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":38076},{"type":"v1","addr":"172.21.15.12:6811","nonce":38076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":38076},{"type":"v1","addr":"172.21.15.12:6818","nonce":38076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":38076},{"type":"v1","addr":"172.21.15.12:6831","nonce":38076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":38076},{"type":"v1","addr":"172.21.15.12:6825","nonce":38076}]},"public_addr":"172.21.15.12:6811/38076","cluster_addr":"172.21.15.12:6818/38076","heartbeat_back_addr":"172.21.15.12:6831/38076","heartbeat_front_addr":"172.21.15.12:6825/38076","state":["exists","up"]},{"osd":2,"uuid":"9baf25db-dce0-4065-90d6-f35867286be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6809","nonce":38073},{"type":"v1","addr":"172.21.15.12:6810","nonce":38073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":38073},{"type":"v1","addr":"172.21.15.12:6817","nonce":38073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":38073},{"type":"v1","addr":"172.21.15.12:6830","nonce":38073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":38073},{"type":"v1","addr":"172.21.15.12:6826","nonce":38073}]},"public_addr":"172.21.15.12:6810/38073","cluster_addr":"172.21.15.12:6817/38073","heartbeat_back_addr":"172.21.15.12:6830/38073","heartbeat_front_addr":"172.21.15.12:6826/38073","state":["exists","up"]},{"osd":3,"uuid":"8a620ad3-2294-470d-8a8c-66f177f5fbe7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":38074},{"type":"v1","addr":"172.21.15.12:6801","nonce":38074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":38074},{"type":"v1","addr":"172.21.15.12:6803","nonce":38074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":38074},{"type":"v1","addr":"172.21.15.12:6807","nonce":38074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":38074},{"type":"v1","addr":"172.21.15.12:6805","nonce":38074}]},"public_addr":"172.21.15.12:6801/38074","cluster_addr":"172.21.15.12:6803/38074","heartbeat_back_addr":"172.21.15.12:6807/38074","heartbeat_front_addr":"172.21.15.12:6805/38074","state":["exists","up"]},{"osd":4,"uuid":"a8824d77-7405-40f5-9234-60889802b184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":38266},{"type":"v1","addr":"172.21.15.31:6817","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":38266},{"type":"v1","addr":"172.21.15.31:6819","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":38266},{"type":"v1","addr":"172.21.15.31:6823","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":38266},{"type":"v1","addr":"172.21.15.31:6821","nonce":38266}]},"public_addr":"172.21.15.31:6817/38266","cluster_addr":"172.21.15.31:6819/38266","heartbeat_back_addr":"172.21.15.31:6823/38266","heartbeat_front_addr":"172.21.15.31:6821/38266","state":["exists","up"]},{"osd":5,"uuid":"3bb01192-a47c-48e9-9662-285e3f6f4b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":38264},{"type":"v1","addr":"172.21.15.31:6807","nonce":38264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":38264},{"type":"v1","addr":"172.21.15.31:6811","nonce":38264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":38264},{"type":"v1","addr":"172.21.15.31:6815","nonce":38264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":38264},{"type":"v1","addr":"172.21.15.31:6813","nonce":38264}]},"public_addr":"172.21.15.31:6807/38264","cluster_addr":"172.21.15.31:6811/38264","heartbeat_back_addr":"172.21.15.31:6815/38264","heartbeat_front_addr":"172.21.15.31:6813/38264","state":["exists","up"]},{"osd":6,"uuid":"1e2d18e4-73e6-4a37-826c-35eca4d96935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":38263},{"type":"v1","addr":"172.21.15.31:6825","nonce":38263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":38263},{"type":"v1","addr":"172.21.15.31:6827","nonce":38263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":38263},{"type":"v1","addr":"172.21.15.31:6831","nonce":38263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":38263},{"type":"v1","addr":"172.21.15.31:6829","nonce":38263}]},"public_addr":"172.21.15.31:6825/38263","cluster_addr":"172.21.15.31:6827/38263","heartbeat_back_addr":"172.21.15.31:6831/38263","heartbeat_front_addr":"172.21.15.31:6829/38263","state":["exists","up"]},{"osd":7,"uuid":"e0f369c0-562b-4440-a5aa-12275c29412b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":38265},{"type":"v1","addr":"172.21.15.31:6801","nonce":38265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":38265},{"type":"v1","addr":"172.21.15.31:6803","nonce":38265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":38265},{"type":"v1","addr":"172.21.15.31:6810","nonce":38265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":38265},{"type":"v1","addr":"172.21.15.31:6806","nonce":38265}]},"public_addr":"172.21.15.31:6801/38265","cluster_addr":"172.21.15.31:6803/38265","heartbeat_back_addr":"172.21.15.31:6810/38265","heartbeat_front_addr":"172.21.15.31:6806/38265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.411815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.372565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.209700+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.414619+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.316843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.300348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.359800+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.219854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T23:27:54.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.520+0000 7f16a6e2a640 1 -- 172.21.15.12:0/291008935 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1680065e90 msgr2=0x7f1680068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:54.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.520+0000 7f16a6e2a640 1 --2- 172.21.15.12:0/291008935 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1680065e90 0x7f1680068350 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f16a006bd00 tx=0x7f1688008040 comp rx=0 tx=0).stop 2023-10-16T23:27:54.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.520+0000 7f16a6e2a640 1 -- 172.21.15.12:0/291008935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16a006e770 msgr2=0x7f16a00bd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:54.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.520+0000 7f16a6e2a640 1 --2- 172.21.15.12:0/291008935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16a006e770 0x7f16a00bd350 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f169801a4f0 tx=0x7f16a00bf190 comp rx=0 tx=0).stop 2023-10-16T23:27:54.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.520+0000 7f16a6e2a640 1 -- 172.21.15.12:0/291008935 shutdown_connections 2023-10-16T23:27:54.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.520+0000 7f16a6e2a640 1 --2- 172.21.15.12:0/291008935 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1680065e90 0x7f1680068350 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.520+0000 7f16a6e2a640 1 --2- 172.21.15.12:0/291008935 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f16a00c1950 0x7f16a00ba370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.520+0000 7f16a6e2a640 1 --2- 172.21.15.12:0/291008935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16a00bfc30 0x7f16a00b9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.520+0000 7f16a6e2a640 1 --2- 172.21.15.12:0/291008935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16a006e770 0x7f16a00bd350 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.520+0000 7f16a6e2a640 1 -- 172.21.15.12:0/291008935 >> 172.21.15.12:0/291008935 conn(0x7f16a006b5d0 msgr2=0x7f16a0152e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:54.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.520+0000 7f16a6e2a640 1 -- 172.21.15.12:0/291008935 shutdown_connections 2023-10-16T23:27:54.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.520+0000 7f16a6e2a640 1 -- 172.21.15.12:0/291008935 wait complete. 2023-10-16T23:27:54.540 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T23:27:27.354025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-16T23:27:34.786446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T23:27:39.130341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T23:27:39.674572+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T23:27:54.541 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T23:27:54.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f366af06640 1 Processor -- start 2023-10-16T23:27:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f366af06640 1 -- start start 2023-10-16T23:27:54.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f366af06640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f366414cad0 0x7f36640b9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f366af06640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36641502d0 con 0x7f366414fd80 2023-10-16T23:27:54.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f366af06640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f366406fcf0 con 0x7f366406d080 2023-10-16T23:27:54.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f366af06640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36640700d0 con 0x7f366414cad0 2023-10-16T23:27:54.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f36694a3640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f366414fd80 0x7f36640bd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38302/0 (socket says 172.21.15.12:38302) 2023-10-16T23:27:54.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f36694a3640 1 -- 172.21.15.12:0/1610026130 learned_addr learned my addr 172.21.15.12:0/1610026130 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:54.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f3663fff640 1 --2- 172.21.15.12:0/1610026130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f366414cad0 0x7f36640b9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f36637fe640 1 -- 172.21.15.12:0/1610026130 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858964079 0 0) 0x7f36641502d0 con 0x7f366414fd80 2023-10-16T23:27:54.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f36637fe640 1 -- 172.21.15.12:0/1610026130 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3650003530 con 0x7f366414fd80 2023-10-16T23:27:54.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f36637fe640 1 -- 172.21.15.12:0/1610026130 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3008201963 0 0) 0x7f3650003530 con 0x7f366414fd80 2023-10-16T23:27:54.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f36637fe640 1 -- 172.21.15.12:0/1610026130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f366414cad0 msgr2=0x7f36640b9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:54.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f36637fe640 1 --2- 172.21.15.12:0/1610026130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f366414cad0 0x7f36640b9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f36637fe640 1 -- 172.21.15.12:0/1610026130 >> v1:172.21.15.31:6789/0 conn(0x7f366406d080 legacy=0x7f366414c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:54.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f36637fe640 1 -- 172.21.15.12:0/1610026130 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366406dda0 con 0x7f366414fd80 2023-10-16T23:27:54.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f36637fe640 1 -- 172.21.15.12:0/1610026130 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7f365c001680 con 0x7f366414fd80 2023-10-16T23:27:54.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f36637fe640 1 -- 172.21.15.12:0/1610026130 >> v1:172.21.15.12:6789/0 conn(0x7f366414fd80 legacy=0x7f36640bd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:54.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f36637fe640 1 --2- 172.21.15.12:0/1610026130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f366414cad0 0x7f36500039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f36637fe640 1 --2- 172.21.15.12:0/1610026130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3650003f30 0x7f36500047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f36637fe640 1 --2- 172.21.15.12:0/1610026130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3650004d10 0x7f3650005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f36637fe640 1 -- 172.21.15.12:0/1610026130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36640700d0 con 0x7f3650003f30 2023-10-16T23:27:54.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f36637fe640 1 -- 172.21.15.12:0/1610026130 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365000bb20 con 0x7f3650004d10 2023-10-16T23:27:54.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f36637fe640 1 -- 172.21.15.12:0/1610026130 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365000bce0 con 0x7f366414cad0 2023-10-16T23:27:54.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f3663fff640 1 --2- 172.21.15.12:0/1610026130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3650003f30 0x7f36500047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f3668ca2640 1 --2- 172.21.15.12:0/1610026130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f366414cad0 0x7f36500039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f36694a3640 1 --2- 172.21.15.12:0/1610026130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3650004d10 0x7f3650005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f3663fff640 1 -- 172.21.15.12:0/1610026130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f366414cad0 msgr2=0x7f36500039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:54.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f3663fff640 1 --2- 172.21.15.12:0/1610026130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f366414cad0 0x7f36500039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f3663fff640 1 -- 172.21.15.12:0/1610026130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3650004d10 msgr2=0x7f3650005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:54.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f3663fff640 1 --2- 172.21.15.12:0/1610026130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3650004d10 0x7f3650005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f3663fff640 1 -- 172.21.15.12:0/1610026130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3650003530 con 0x7f3650003f30 2023-10-16T23:27:54.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.656+0000 7f36694a3640 1 --2- 172.21.15.12:0/1610026130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3650004d10 0x7f3650005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:27:54.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.660+0000 7f3663fff640 1 --2- 172.21.15.12:0/1610026130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3650003f30 0x7f36500047d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f364c009ae0 tx=0x7f364c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=908bbcc1c9fe35e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:54.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.660+0000 7f36637fe640 1 -- 172.21.15.12:0/1610026130 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c0a5530 con 0x7f3650003f30 2023-10-16T23:27:54.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.660+0000 7f36637fe640 1 -- 172.21.15.12:0/1610026130 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364c0a5690 con 0x7f3650003f30 2023-10-16T23:27:54.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.660+0000 7f36637fe640 1 -- 172.21.15.12:0/1610026130 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c0a5a40 con 0x7f3650003f30 2023-10-16T23:27:54.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.660+0000 7f366af06640 1 -- 172.21.15.12:0/1610026130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3650003f30 msgr2=0x7f36500047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:54.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.660+0000 7f366af06640 1 --2- 172.21.15.12:0/1610026130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3650003f30 0x7f36500047d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f364c009ae0 tx=0x7f364c01ca50 comp rx=0 tx=0).stop 2023-10-16T23:27:54.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.660+0000 7f36694a3640 1 -- 172.21.15.12:0/1610026130 reap_dead start 2023-10-16T23:27:54.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.660+0000 7f366af06640 1 -- 172.21.15.12:0/1610026130 shutdown_connections 2023-10-16T23:27:54.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.660+0000 7f366af06640 1 -- 172.21.15.12:0/1610026130 >> 172.21.15.12:0/1610026130 conn(0x7f36640c2a70 msgr2=0x7f36640c2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:54.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.660+0000 7f366af06640 1 -- 172.21.15.12:0/1610026130 shutdown_connections 2023-10-16T23:27:54.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.660+0000 7f366af06640 1 -- 172.21.15.12:0/1610026130 wait complete. 2023-10-16T23:27:54.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.660+0000 7f366af06640 1 Processor -- start 2023-10-16T23:27:54.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.660+0000 7f366af06640 1 -- start start 2023-10-16T23:27:54.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f366af06640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3650003f30 0x7f36641eb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f366af06640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36640c1c20 0x7f3664140490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f366af06640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36641409d0 0x7f3664157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f366af06640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3664143300 con 0x7f36640c1c20 2023-10-16T23:27:54.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f366af06640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36641eb7e0 con 0x7f3650003f30 2023-10-16T23:27:54.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f366af06640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3664159a10 con 0x7f36641409d0 2023-10-16T23:27:54.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f3663fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36640c1c20 0x7f3664140490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f3663fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36640c1c20 0x7f3664140490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55978/0 (socket says 172.21.15.12:55978) 2023-10-16T23:27:54.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f3663fff640 1 -- 172.21.15.12:0/1934076504 learned_addr learned my addr 172.21.15.12:0/1934076504 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:54.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f36694a3640 1 --2- 172.21.15.12:0/1934076504 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36641409d0 0x7f3664157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f3668ca2640 1 --2- 172.21.15.12:0/1934076504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3650003f30 0x7f36641eb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f3663fff640 1 -- 172.21.15.12:0/1934076504 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36641409d0 msgr2=0x7f3664157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:54.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f3663fff640 1 --2- 172.21.15.12:0/1934076504 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36641409d0 0x7f3664157ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f3663fff640 1 -- 172.21.15.12:0/1934076504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3650003f30 msgr2=0x7f36641eb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:54.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f3663fff640 1 --2- 172.21.15.12:0/1934076504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3650003f30 0x7f36641eb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f3663fff640 1 -- 172.21.15.12:0/1934076504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36641593c0 con 0x7f36640c1c20 2023-10-16T23:27:54.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f3663fff640 1 --2- 172.21.15.12:0/1934076504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36640c1c20 0x7f3664140490 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f364c0b0040 tx=0x7f3650005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:54.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f36617fa640 1 -- 172.21.15.12:0/1934076504 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c0a5d80 con 0x7f36640c1c20 2023-10-16T23:27:54.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f36617fa640 1 -- 172.21.15.12:0/1934076504 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364c004020 con 0x7f36640c1c20 2023-10-16T23:27:54.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f366af06640 1 -- 172.21.15.12:0/1934076504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36641596a0 con 0x7f36640c1c20 2023-10-16T23:27:54.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f36617fa640 1 -- 172.21.15.12:0/1934076504 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c0043d0 con 0x7f36640c1c20 2023-10-16T23:27:54.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f366af06640 1 -- 172.21.15.12:0/1934076504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3664140e50 con 0x7f36640c1c20 2023-10-16T23:27:54.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f366af06640 1 -- 172.21.15.12:0/1934076504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3664159860 con 0x7f36640c1c20 2023-10-16T23:27:54.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f36617fa640 1 -- 172.21.15.12:0/1934076504 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f364c0b4040 con 0x7f36640c1c20 2023-10-16T23:27:54.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f36617fa640 1 --2- 172.21.15.12:0/1934076504 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3644065e90 0x7f3644068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f36617fa640 1 -- 172.21.15.12:0/1934076504 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f364c11d350 con 0x7f36640c1c20 2023-10-16T23:27:54.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.664+0000 7f3668ca2640 1 --2- 172.21.15.12:0/1934076504 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3644065e90 0x7f3644068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.668+0000 7f3668ca2640 1 --2- 172.21.15.12:0/1934076504 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3644065e90 0x7f3644068350 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f36641e8660 tx=0x7f3654009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:54.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.668+0000 7f36617fa640 1 -- 172.21.15.12:0/1934076504 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f364c0eab50 con 0x7f36640c1c20 2023-10-16T23:27:54.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.816+0000 7f366af06640 1 -- 172.21.15.12:0/1934076504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3664159220 con 0x7f36640c1c20 2023-10-16T23:27:54.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.820+0000 7f36617fa640 1 -- 172.21.15.12:0/1934076504 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3664159220 con 0x7f36640c1c20 2023-10-16T23:27:54.822 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-16T23:27:54.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.820+0000 7f366af06640 1 -- 172.21.15.12:0/1934076504 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3644065e90 msgr2=0x7f3644068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:54.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.820+0000 7f366af06640 1 --2- 172.21.15.12:0/1934076504 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3644065e90 0x7f3644068350 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f36641e8660 tx=0x7f3654009040 comp rx=0 tx=0).stop 2023-10-16T23:27:54.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.820+0000 7f366af06640 1 -- 172.21.15.12:0/1934076504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36640c1c20 msgr2=0x7f3664140490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:54.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.820+0000 7f366af06640 1 --2- 172.21.15.12:0/1934076504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36640c1c20 0x7f3664140490 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f364c0b0040 tx=0x7f3650005800 comp rx=0 tx=0).stop 2023-10-16T23:27:54.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.820+0000 7f366af06640 1 -- 172.21.15.12:0/1934076504 shutdown_connections 2023-10-16T23:27:54.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.820+0000 7f366af06640 1 --2- 172.21.15.12:0/1934076504 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3644065e90 0x7f3644068350 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.820+0000 7f366af06640 1 --2- 172.21.15.12:0/1934076504 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f36641409d0 0x7f3664157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.820+0000 7f366af06640 1 --2- 172.21.15.12:0/1934076504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36640c1c20 0x7f3664140490 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.820+0000 7f366af06640 1 --2- 172.21.15.12:0/1934076504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3650003f30 0x7f36641eb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.820+0000 7f366af06640 1 -- 172.21.15.12:0/1934076504 >> 172.21.15.12:0/1934076504 conn(0x7f36640c2a70 msgr2=0x7f36641493c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:54.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.820+0000 7f366af06640 1 -- 172.21.15.12:0/1934076504 shutdown_connections 2023-10-16T23:27:54.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.820+0000 7f366af06640 1 -- 172.21.15.12:0/1934076504 wait complete. 2023-10-16T23:27:54.839 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-16T23:27:54.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.964+0000 7fd4be6db640 1 Processor -- start 2023-10-16T23:27:54.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.964+0000 7fd4be6db640 1 -- start start 2023-10-16T23:27:54.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.968+0000 7fd4be6db640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd4b80c12a0 0x7fd4b8146c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.968+0000 7fd4be6db640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd4b80bbe00 0x7fd4b8147150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.968+0000 7fd4be6db640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd4b8150880 0x7fd4b8150c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.968+0000 7fd4be6db640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b80bc8e0 con 0x7fd4b80bbe00 2023-10-16T23:27:54.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.968+0000 7fd4be6db640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b80b3f40 con 0x7fd4b8150880 2023-10-16T23:27:54.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.968+0000 7fd4be6db640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b80b4220 con 0x7fd4b80c12a0 2023-10-16T23:27:54.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.968+0000 7fd4b77fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd4b80bbe00 0x7fd4b8147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.968+0000 7fd4b77fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd4b80bbe00 0x7fd4b8147150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55988/0 (socket says 172.21.15.12:55988) 2023-10-16T23:27:54.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.968+0000 7fd4b77fe640 1 -- 172.21.15.12:0/2067400005 learned_addr learned my addr 172.21.15.12:0/2067400005 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:54.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.968+0000 7fd4b7fff640 1 --2- 172.21.15.12:0/2067400005 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd4b80c12a0 0x7fd4b8146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.968+0000 7fd4bcc78640 1 --2- 172.21.15.12:0/2067400005 >> v2:172.21.15.31:3300/0 conn(0x7fd4b8150880 0x7fd4b8150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.968+0000 7fd4b77fe640 1 -- 172.21.15.12:0/2067400005 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd4b80c12a0 msgr2=0x7fd4b8146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:54.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.968+0000 7fd4b77fe640 1 --2- 172.21.15.12:0/2067400005 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd4b80c12a0 0x7fd4b8146c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.968+0000 7fd4b77fe640 1 -- 172.21.15.12:0/2067400005 >> v2:172.21.15.31:3300/0 conn(0x7fd4b8150880 msgr2=0x7fd4b8150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:54.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.968+0000 7fd4b77fe640 1 --2- 172.21.15.12:0/2067400005 >> v2:172.21.15.31:3300/0 conn(0x7fd4b8150880 0x7fd4b8150c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.968+0000 7fd4b77fe640 1 -- 172.21.15.12:0/2067400005 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b8147690 con 0x7fd4b80bbe00 2023-10-16T23:27:54.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.968+0000 7fd4bcc78640 1 --2- 172.21.15.12:0/2067400005 >> v2:172.21.15.31:3300/0 conn(0x7fd4b8150880 0x7fd4b8150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:54.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.968+0000 7fd4b77fe640 1 --2- 172.21.15.12:0/2067400005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4b80bbe00 0x7fd4b8147150 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd4b806b1e0 tx=0x7fd4a001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b44569672102f2e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:54.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.968+0000 7fd4b6ffd640 1 -- 172.21.15.12:0/2067400005 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a00ab600 con 0x7fd4b80bbe00 2023-10-16T23:27:54.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.968+0000 7fd4b6ffd640 1 -- 172.21.15.12:0/2067400005 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a00a7050 con 0x7fd4b80bbe00 2023-10-16T23:27:54.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.968+0000 7fd4b6ffd640 1 -- 172.21.15.12:0/2067400005 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a00ab980 con 0x7fd4b80bbe00 2023-10-16T23:27:54.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.968+0000 7fd4be6db640 1 -- 172.21.15.12:0/2067400005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4b80bbe00 msgr2=0x7fd4b8147150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:54.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.968+0000 7fd4be6db640 1 --2- 172.21.15.12:0/2067400005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4b80bbe00 0x7fd4b8147150 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd4b806b1e0 tx=0x7fd4a001c500 comp rx=0 tx=0).stop 2023-10-16T23:27:54.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4be6db640 1 -- 172.21.15.12:0/2067400005 shutdown_connections 2023-10-16T23:27:54.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4be6db640 1 --2- 172.21.15.12:0/2067400005 >> v2:172.21.15.31:3300/0 conn(0x7fd4b8150880 0x7fd4b8150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4be6db640 1 --2- 172.21.15.12:0/2067400005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4b80bbe00 0x7fd4b8147150 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4be6db640 1 --2- 172.21.15.12:0/2067400005 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd4b80c12a0 0x7fd4b8146c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4be6db640 1 -- 172.21.15.12:0/2067400005 >> 172.21.15.12:0/2067400005 conn(0x7fd4b806bb10 msgr2=0x7fd4b80c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:54.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4be6db640 1 -- 172.21.15.12:0/2067400005 shutdown_connections 2023-10-16T23:27:54.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4be6db640 1 -- 172.21.15.12:0/2067400005 wait complete. 2023-10-16T23:27:54.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4be6db640 1 Processor -- start 2023-10-16T23:27:54.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4be6db640 1 -- start start 2023-10-16T23:27:54.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4be6db640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4b80bbe00 0x7fd4b80b6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4be6db640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd4b80c12a0 0x7fd4b81432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4be6db640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4b8150880 0x7fd4b81ea850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4be6db640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b81566b0 con 0x7fd4b80bbe00 2023-10-16T23:27:54.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4be6db640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b8157870 con 0x7fd4b8150880 2023-10-16T23:27:54.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4be6db640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b81575d0 con 0x7fd4b80c12a0 2023-10-16T23:27:54.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4b7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4b80bbe00 0x7fd4b80b6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4b7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4b80bbe00 0x7fd4b80b6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55990/0 (socket says 172.21.15.12:55990) 2023-10-16T23:27:54.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4b7fff640 1 -- 172.21.15.12:0/704342612 learned_addr learned my addr 172.21.15.12:0/704342612 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:54.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4b77fe640 1 --2- 172.21.15.12:0/704342612 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd4b80c12a0 0x7fd4b81432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4bcc78640 1 --2- 172.21.15.12:0/704342612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4b8150880 0x7fd4b81ea850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4b7fff640 1 -- 172.21.15.12:0/704342612 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd4b80c12a0 msgr2=0x7fd4b81432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:54.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4b7fff640 1 --2- 172.21.15.12:0/704342612 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd4b80c12a0 0x7fd4b81432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4b7fff640 1 -- 172.21.15.12:0/704342612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4b8150880 msgr2=0x7fd4b81ea850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:54.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4b7fff640 1 --2- 172.21.15.12:0/704342612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4b8150880 0x7fd4b81ea850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:54.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4b7fff640 1 -- 172.21.15.12:0/704342612 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a00094d0 con 0x7fd4b80bbe00 2023-10-16T23:27:54.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4b77fe640 1 --2- 172.21.15.12:0/704342612 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd4b80c12a0 0x7fd4b81432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:54.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4bcc78640 1 --2- 172.21.15.12:0/704342612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4b8150880 0x7fd4b81ea850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:54.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4b7fff640 1 --2- 172.21.15.12:0/704342612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4b80bbe00 0x7fd4b80b6bb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0007e90 tx=0x7fd4b000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:54.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4b4ff9640 1 -- 172.21.15.12:0/704342612 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0014620 con 0x7fd4b80bbe00 2023-10-16T23:27:54.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4b4ff9640 1 -- 172.21.15.12:0/704342612 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b0014780 con 0x7fd4b80bbe00 2023-10-16T23:27:54.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4b4ff9640 1 -- 172.21.15.12:0/704342612 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0014b30 con 0x7fd4b80bbe00 2023-10-16T23:27:54.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4be6db640 1 -- 172.21.15.12:0/704342612 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b806e880 con 0x7fd4b80bbe00 2023-10-16T23:27:54.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.972+0000 7fd4be6db640 1 -- 172.21.15.12:0/704342612 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b8070550 con 0x7fd4b80bbe00 2023-10-16T23:27:54.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.976+0000 7fd4be6db640 1 -- 172.21.15.12:0/704342612 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b80673a0 con 0x7fd4b80bbe00 2023-10-16T23:27:54.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.976+0000 7fd4b4ff9640 1 -- 172.21.15.12:0/704342612 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fd4b0014c90 con 0x7fd4b80bbe00 2023-10-16T23:27:54.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.976+0000 7fd4b4ff9640 1 --2- 172.21.15.12:0/704342612 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd498065e60 0x7fd498068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:54.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.976+0000 7fd4b4ff9640 1 -- 172.21.15.12:0/704342612 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd4b0084210 con 0x7fd4b80bbe00 2023-10-16T23:27:54.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.976+0000 7fd4b77fe640 1 --2- 172.21.15.12:0/704342612 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd498065e60 0x7fd498068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:54.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.976+0000 7fd4b77fe640 1 --2- 172.21.15.12:0/704342612 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd498065e60 0x7fd498068320 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd4a00ad000 tx=0x7fd4a0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:54.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:54.980+0000 7fd4b4ff9640 1 -- 172.21.15.12:0/704342612 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fd4b0051850 con 0x7fd4b80bbe00 2023-10-16T23:27:55.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.128+0000 7fd4be6db640 1 -- 172.21.15.12:0/704342612 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd4b8146410 con 0x7fd4b80bbe00 2023-10-16T23:27:55.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.132+0000 7fd4b4ff9640 1 -- 172.21.15.12:0/704342612 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd4b0009a20 con 0x7fd4b80bbe00 2023-10-16T23:27:55.134 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-10-16T23:27:55.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.132+0000 7fd4be6db640 1 -- 172.21.15.12:0/704342612 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd498065e60 msgr2=0x7fd498068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:55.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.132+0000 7fd4be6db640 1 --2- 172.21.15.12:0/704342612 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd498065e60 0x7fd498068320 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd4a00ad000 tx=0x7fd4a0008040 comp rx=0 tx=0).stop 2023-10-16T23:27:55.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.132+0000 7fd4be6db640 1 -- 172.21.15.12:0/704342612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4b80bbe00 msgr2=0x7fd4b80b6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:55.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.132+0000 7fd4be6db640 1 --2- 172.21.15.12:0/704342612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4b80bbe00 0x7fd4b80b6bb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0007e90 tx=0x7fd4b000e4b0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.132+0000 7fd4be6db640 1 -- 172.21.15.12:0/704342612 shutdown_connections 2023-10-16T23:27:55.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.132+0000 7fd4be6db640 1 --2- 172.21.15.12:0/704342612 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd498065e60 0x7fd498068320 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.132+0000 7fd4be6db640 1 --2- 172.21.15.12:0/704342612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4b8150880 0x7fd4b81ea850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.132+0000 7fd4be6db640 1 --2- 172.21.15.12:0/704342612 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd4b80c12a0 0x7fd4b81432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.132+0000 7fd4be6db640 1 --2- 172.21.15.12:0/704342612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4b80bbe00 0x7fd4b80b6bb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.132+0000 7fd4be6db640 1 -- 172.21.15.12:0/704342612 >> 172.21.15.12:0/704342612 conn(0x7fd4b806bb10 msgr2=0x7fd4b80b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:55.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.132+0000 7fd4be6db640 1 -- 172.21.15.12:0/704342612 shutdown_connections 2023-10-16T23:27:55.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.132+0000 7fd4be6db640 1 -- 172.21.15.12:0/704342612 wait complete. 2023-10-16T23:27:55.152 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T23:27:55.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.276+0000 7efeadcdd640 1 Processor -- start 2023-10-16T23:27:55.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.276+0000 7efeadcdd640 1 -- start start 2023-10-16T23:27:55.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.276+0000 7efeadcdd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efea80c12a0 0x7efea8146c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:55.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.276+0000 7efeadcdd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efea80bbe00 0x7efea8147150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:55.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.276+0000 7efeadcdd640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea80bc8e0 con 0x7efea8150880 2023-10-16T23:27:55.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.276+0000 7efeadcdd640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea80b3f40 con 0x7efea80bbe00 2023-10-16T23:27:55.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.276+0000 7efeadcdd640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea80b4220 con 0x7efea80c12a0 2023-10-16T23:27:55.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.276+0000 7efea7fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efea8150880 0x7efea8150cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38318/0 (socket says 172.21.15.12:38318) 2023-10-16T23:27:55.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.276+0000 7efea7fff640 1 -- 172.21.15.12:0/2427006562 learned_addr learned my addr 172.21.15.12:0/2427006562 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:55.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.276+0000 7efea6ffd640 1 --2- 172.21.15.12:0/2427006562 >> v2:172.21.15.12:3300/0 conn(0x7efea80bbe00 0x7efea8147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:55.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.276+0000 7efea77fe640 1 --2- 172.21.15.12:0/2427006562 >> v2:172.21.15.31:3300/0 conn(0x7efea80c12a0 0x7efea8146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:55.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.276+0000 7efea67fc640 1 -- 172.21.15.12:0/2427006562 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670995510 0 0) 0x7efea80bc8e0 con 0x7efea8150880 2023-10-16T23:27:55.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.276+0000 7efea67fc640 1 -- 172.21.15.12:0/2427006562 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe94003530 con 0x7efea8150880 2023-10-16T23:27:55.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.276+0000 7efea6ffd640 1 -- 172.21.15.12:0/2427006562 >> v2:172.21.15.31:3300/0 conn(0x7efea80c12a0 msgr2=0x7efea8146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:55.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.276+0000 7efea6ffd640 1 --2- 172.21.15.12:0/2427006562 >> v2:172.21.15.31:3300/0 conn(0x7efea80c12a0 0x7efea8146c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.276+0000 7efea6ffd640 1 -- 172.21.15.12:0/2427006562 >> v1:172.21.15.12:6789/0 conn(0x7efea8150880 legacy=0x7efea8150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:55.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.276+0000 7efea6ffd640 1 -- 172.21.15.12:0/2427006562 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea8147690 con 0x7efea80bbe00 2023-10-16T23:27:55.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efea6ffd640 1 --2- 172.21.15.12:0/2427006562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efea80bbe00 0x7efea8147150 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efea806e680 tx=0x7efe9001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2720a54a84059278 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:55.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efea67fc640 1 -- 172.21.15.12:0/2427006562 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe900a58e0 con 0x7efea80bbe00 2023-10-16T23:27:55.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efea67fc640 1 -- 172.21.15.12:0/2427006562 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe900a5a40 con 0x7efea80bbe00 2023-10-16T23:27:55.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efea67fc640 1 -- 172.21.15.12:0/2427006562 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe900a5dd0 con 0x7efea80bbe00 2023-10-16T23:27:55.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efeadcdd640 1 -- 172.21.15.12:0/2427006562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efea80bbe00 msgr2=0x7efea8147150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:55.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efeadcdd640 1 --2- 172.21.15.12:0/2427006562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efea80bbe00 0x7efea8147150 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efea806e680 tx=0x7efe9001c910 comp rx=0 tx=0).stop 2023-10-16T23:27:55.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efeadcdd640 1 -- 172.21.15.12:0/2427006562 shutdown_connections 2023-10-16T23:27:55.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efeadcdd640 1 --2- 172.21.15.12:0/2427006562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efea80bbe00 0x7efea8147150 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efeadcdd640 1 --2- 172.21.15.12:0/2427006562 >> v2:172.21.15.31:3300/0 conn(0x7efea80c12a0 0x7efea8146c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efeadcdd640 1 -- 172.21.15.12:0/2427006562 >> 172.21.15.12:0/2427006562 conn(0x7efea806bb10 msgr2=0x7efea80c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:55.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efeadcdd640 1 -- 172.21.15.12:0/2427006562 shutdown_connections 2023-10-16T23:27:55.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efeadcdd640 1 -- 172.21.15.12:0/2427006562 wait complete. 2023-10-16T23:27:55.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efeadcdd640 1 Processor -- start 2023-10-16T23:27:55.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efeadcdd640 1 -- start start 2023-10-16T23:27:55.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efeadcdd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efea80bbe00 0x7efea8150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:55.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efeadcdd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efea80c12a0 0x7efea8140530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:55.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efeadcdd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efea8150880 0x7efea81e53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:55.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efeadcdd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea8144060 con 0x7efea8150880 2023-10-16T23:27:55.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efeadcdd640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea8142b90 con 0x7efea80bbe00 2023-10-16T23:27:55.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efeadcdd640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea813f580 con 0x7efea80c12a0 2023-10-16T23:27:55.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efea7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efea8150880 0x7efea81e53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:55.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efea7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efea8150880 0x7efea81e53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56002/0 (socket says 172.21.15.12:56002) 2023-10-16T23:27:55.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efea7fff640 1 -- 172.21.15.12:0/3588435246 learned_addr learned my addr 172.21.15.12:0/3588435246 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:55.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efea6ffd640 1 --2- 172.21.15.12:0/3588435246 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efea80c12a0 0x7efea8140530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:55.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efea77fe640 1 --2- 172.21.15.12:0/3588435246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efea80bbe00 0x7efea8150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:55.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efea7fff640 1 -- 172.21.15.12:0/3588435246 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efea80c12a0 msgr2=0x7efea8140530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:55.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efea7fff640 1 --2- 172.21.15.12:0/3588435246 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efea80c12a0 0x7efea8140530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efea7fff640 1 -- 172.21.15.12:0/3588435246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efea80bbe00 msgr2=0x7efea8150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:55.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efea7fff640 1 --2- 172.21.15.12:0/3588435246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efea80bbe00 0x7efea8150150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.280+0000 7efea7fff640 1 -- 172.21.15.12:0/3588435246 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe90009a70 con 0x7efea8150880 2023-10-16T23:27:55.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.284+0000 7efea7fff640 1 --2- 172.21.15.12:0/3588435246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efea8150880 0x7efea81e53d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efea000c3c0 tx=0x7efea000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:55.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.284+0000 7efe9ffff640 1 -- 172.21.15.12:0/3588435246 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea0005cf0 con 0x7efea8150880 2023-10-16T23:27:55.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.284+0000 7efe9ffff640 1 -- 172.21.15.12:0/3588435246 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea0005e50 con 0x7efea8150880 2023-10-16T23:27:55.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.284+0000 7efeadcdd640 1 -- 172.21.15.12:0/3588435246 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea8142820 con 0x7efea8150880 2023-10-16T23:27:55.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.284+0000 7efe9ffff640 1 -- 172.21.15.12:0/3588435246 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea0007310 con 0x7efea8150880 2023-10-16T23:27:55.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.284+0000 7efeadcdd640 1 -- 172.21.15.12:0/3588435246 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea81e5ae0 con 0x7efea8150880 2023-10-16T23:27:55.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.284+0000 7efeadcdd640 1 -- 172.21.15.12:0/3588435246 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea8150690 con 0x7efea8150880 2023-10-16T23:27:55.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.284+0000 7efe9ffff640 1 -- 172.21.15.12:0/3588435246 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7efea0007470 con 0x7efea8150880 2023-10-16T23:27:55.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.284+0000 7efe9ffff640 1 --2- 172.21.15.12:0/3588435246 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efe88065e60 0x7efe88068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:55.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.284+0000 7efe9ffff640 1 -- 172.21.15.12:0/3588435246 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efea0082d20 con 0x7efea8150880 2023-10-16T23:27:55.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.284+0000 7efea77fe640 1 --2- 172.21.15.12:0/3588435246 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efe88065e60 0x7efe88068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:55.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.284+0000 7efea77fe640 1 --2- 172.21.15.12:0/3588435246 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efe88065e60 0x7efe88068320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efe98009af0 tx=0x7efe98008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:55.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.288+0000 7efe9ffff640 1 -- 172.21.15.12:0/3588435246 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7efea0050370 con 0x7efea8150880 2023-10-16T23:27:55.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.448+0000 7efeadcdd640 1 -- 172.21.15.12:0/3588435246 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efea80673a0 con 0x7efea8150880 2023-10-16T23:27:55.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.448+0000 7efe9ffff640 1 -- 172.21.15.12:0/3588435246 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7efea0053990 con 0x7efea8150880 2023-10-16T23:27:55.452 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-16T23:27:55.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.452+0000 7efeadcdd640 1 -- 172.21.15.12:0/3588435246 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efe88065e60 msgr2=0x7efe88068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:55.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.452+0000 7efeadcdd640 1 --2- 172.21.15.12:0/3588435246 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efe88065e60 0x7efe88068320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efe98009af0 tx=0x7efe98008040 comp rx=0 tx=0).stop 2023-10-16T23:27:55.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.452+0000 7efeadcdd640 1 -- 172.21.15.12:0/3588435246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efea8150880 msgr2=0x7efea81e53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.452+0000 7efeadcdd640 1 --2- 172.21.15.12:0/3588435246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efea8150880 0x7efea81e53d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efea000c3c0 tx=0x7efea000c880 comp rx=0 tx=0).stop 2023-10-16T23:27:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.452+0000 7efeadcdd640 1 -- 172.21.15.12:0/3588435246 shutdown_connections 2023-10-16T23:27:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.452+0000 7efeadcdd640 1 --2- 172.21.15.12:0/3588435246 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efe88065e60 0x7efe88068320 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.452+0000 7efeadcdd640 1 --2- 172.21.15.12:0/3588435246 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efea8150880 0x7efea81e53d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.452+0000 7efeadcdd640 1 --2- 172.21.15.12:0/3588435246 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efea80c12a0 0x7efea8140530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.452+0000 7efeadcdd640 1 --2- 172.21.15.12:0/3588435246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efea80bbe00 0x7efea8150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.452+0000 7efeadcdd640 1 -- 172.21.15.12:0/3588435246 >> 172.21.15.12:0/3588435246 conn(0x7efea806bb10 msgr2=0x7efea8146100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:55.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.452+0000 7efeadcdd640 1 -- 172.21.15.12:0/3588435246 shutdown_connections 2023-10-16T23:27:55.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.452+0000 7efeadcdd640 1 -- 172.21.15.12:0/3588435246 wait complete. 2023-10-16T23:27:55.476 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T23:27:55.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.604+0000 7eff23e41640 1 Processor -- start 2023-10-16T23:27:55.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.604+0000 7eff23e41640 1 -- start start 2023-10-16T23:27:55.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.604+0000 7eff23e41640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7eff1c14eba0 0x7eff1c14ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:55.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.604+0000 7eff23e41640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7eff1c0705d0 0x7eff1c0c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:55.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.604+0000 7eff23e41640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1c06f130 con 0x7eff1c06e6d0 2023-10-16T23:27:55.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.604+0000 7eff23e41640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1c070da0 con 0x7eff1c0705d0 2023-10-16T23:27:55.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.604+0000 7eff23e41640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1c0b86f0 con 0x7eff1c14eba0 2023-10-16T23:27:55.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.604+0000 7eff223de640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7eff1c0705d0 0x7eff1c0c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:55.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.604+0000 7eff223de640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7eff1c0705d0 0x7eff1c0c1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56008/0 (socket says 172.21.15.12:56008) 2023-10-16T23:27:55.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.604+0000 7eff223de640 1 -- 172.21.15.12:0/412095935 learned_addr learned my addr 172.21.15.12:0/412095935 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:55.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.604+0000 7eff21bdd640 1 --2- 172.21.15.12:0/412095935 >> v2:172.21.15.31:3300/0 conn(0x7eff1c14eba0 0x7eff1c14ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:55.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.604+0000 7eff223de640 1 -- 172.21.15.12:0/412095935 >> v2:172.21.15.31:3300/0 conn(0x7eff1c14eba0 msgr2=0x7eff1c14ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:55.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.604+0000 7eff223de640 1 --2- 172.21.15.12:0/412095935 >> v2:172.21.15.31:3300/0 conn(0x7eff1c14eba0 0x7eff1c14ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.604+0000 7eff223de640 1 -- 172.21.15.12:0/412095935 >> v1:172.21.15.12:6789/0 conn(0x7eff1c06e6d0 legacy=0x7eff1c152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:55.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.604+0000 7eff223de640 1 -- 172.21.15.12:0/412095935 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c0709e0 con 0x7eff1c0705d0 2023-10-16T23:27:55.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.604+0000 7eff21bdd640 1 --2- 172.21.15.12:0/412095935 >> v2:172.21.15.31:3300/0 conn(0x7eff1c14eba0 0x7eff1c14ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:55.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.604+0000 7eff223de640 1 --2- 172.21.15.12:0/412095935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff1c0705d0 0x7eff1c0c1c90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0c0710 tx=0x7eff1401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe3be79324d5420e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:55.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.604+0000 7eff20bdb640 1 -- 172.21.15.12:0/412095935 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff140a5660 con 0x7eff1c0705d0 2023-10-16T23:27:55.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff20bdb640 1 -- 172.21.15.12:0/412095935 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff140a57c0 con 0x7eff1c0705d0 2023-10-16T23:27:55.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff20bdb640 1 -- 172.21.15.12:0/412095935 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff140a5b50 con 0x7eff1c0705d0 2023-10-16T23:27:55.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff23e41640 1 -- 172.21.15.12:0/412095935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff1c0705d0 msgr2=0x7eff1c0c1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:55.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff23e41640 1 --2- 172.21.15.12:0/412095935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff1c0705d0 0x7eff1c0c1c90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0c0710 tx=0x7eff1401c8b0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff23e41640 1 -- 172.21.15.12:0/412095935 shutdown_connections 2023-10-16T23:27:55.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff23e41640 1 --2- 172.21.15.12:0/412095935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff1c0705d0 0x7eff1c0c1c90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff23e41640 1 --2- 172.21.15.12:0/412095935 >> v2:172.21.15.31:3300/0 conn(0x7eff1c14eba0 0x7eff1c14ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff23e41640 1 -- 172.21.15.12:0/412095935 >> 172.21.15.12:0/412095935 conn(0x7eff1c06b800 msgr2=0x7eff1c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:55.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff23e41640 1 -- 172.21.15.12:0/412095935 shutdown_connections 2023-10-16T23:27:55.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff23e41640 1 -- 172.21.15.12:0/412095935 wait complete. 2023-10-16T23:27:55.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff23e41640 1 Processor -- start 2023-10-16T23:27:55.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff23e41640 1 -- start start 2023-10-16T23:27:55.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff23e41640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff1c06e6d0 0x7eff1c143980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:55.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff23e41640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff1c0705d0 0x7eff1c0c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:55.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff23e41640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff1c14eba0 0x7eff1c0b8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:55.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff23e41640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c14dd90 con 0x7eff1c0705d0 2023-10-16T23:27:55.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff23e41640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c143ec0 con 0x7eff1c14eba0 2023-10-16T23:27:55.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff23e41640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c1eb7f0 con 0x7eff1c06e6d0 2023-10-16T23:27:55.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff213dc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff1c0705d0 0x7eff1c0c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:55.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff213dc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff1c0705d0 0x7eff1c0c50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56012/0 (socket says 172.21.15.12:56012) 2023-10-16T23:27:55.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff213dc640 1 -- 172.21.15.12:0/4263470484 learned_addr learned my addr 172.21.15.12:0/4263470484 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:55.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff223de640 1 --2- 172.21.15.12:0/4263470484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff1c14eba0 0x7eff1c0b8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:55.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff21bdd640 1 --2- 172.21.15.12:0/4263470484 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff1c06e6d0 0x7eff1c143980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:55.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff213dc640 1 -- 172.21.15.12:0/4263470484 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff1c06e6d0 msgr2=0x7eff1c143980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:55.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff213dc640 1 --2- 172.21.15.12:0/4263470484 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff1c06e6d0 0x7eff1c143980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff213dc640 1 -- 172.21.15.12:0/4263470484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff1c14eba0 msgr2=0x7eff1c0b8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:55.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff213dc640 1 --2- 172.21.15.12:0/4263470484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff1c14eba0 0x7eff1c0b8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff213dc640 1 -- 172.21.15.12:0/4263470484 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff14009b30 con 0x7eff1c0705d0 2023-10-16T23:27:55.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff213dc640 1 --2- 172.21.15.12:0/4263470484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff1c0705d0 0x7eff1c0c50a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00c500 tx=0x7eff0c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:55.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff127fc640 1 -- 172.21.15.12:0/4263470484 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c005220 con 0x7eff1c0705d0 2023-10-16T23:27:55.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff127fc640 1 -- 172.21.15.12:0/4263470484 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c005380 con 0x7eff1c0705d0 2023-10-16T23:27:55.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff127fc640 1 -- 172.21.15.12:0/4263470484 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c007270 con 0x7eff1c0705d0 2023-10-16T23:27:55.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff23e41640 1 -- 172.21.15.12:0/4263470484 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1c14dfe0 con 0x7eff1c0705d0 2023-10-16T23:27:55.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.608+0000 7eff23e41640 1 -- 172.21.15.12:0/4263470484 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1c14d0f0 con 0x7eff1c0705d0 2023-10-16T23:27:55.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.612+0000 7eff23e41640 1 -- 172.21.15.12:0/4263470484 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1c0b9a80 con 0x7eff1c0705d0 2023-10-16T23:27:55.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.612+0000 7eff127fc640 1 -- 172.21.15.12:0/4263470484 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7eff0c0073d0 con 0x7eff1c0705d0 2023-10-16T23:27:55.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.612+0000 7eff127fc640 1 --2- 172.21.15.12:0/4263470484 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7eff00065e60 0x7eff00068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:55.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.612+0000 7eff127fc640 1 -- 172.21.15.12:0/4263470484 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7eff0c083210 con 0x7eff1c0705d0 2023-10-16T23:27:55.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.612+0000 7eff21bdd640 1 --2- 172.21.15.12:0/4263470484 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7eff00065e60 0x7eff00068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:55.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.612+0000 7eff21bdd640 1 --2- 172.21.15.12:0/4263470484 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7eff00065e60 0x7eff00068320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7eff18006fd0 tx=0x7eff18008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:55.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.616+0000 7eff127fc640 1 -- 172.21.15.12:0/4263470484 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7eff0c0507d0 con 0x7eff1c0705d0 2023-10-16T23:27:55.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.768+0000 7eff23e41640 1 -- 172.21.15.12:0/4263470484 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff1c0673a0 con 0x7eff1c0705d0 2023-10-16T23:27:55.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.772+0000 7eff127fc640 1 -- 172.21.15.12:0/4263470484 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7eff0c053df0 con 0x7eff1c0705d0 2023-10-16T23:27:55.774 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-16T23:27:55.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.772+0000 7eff23e41640 1 -- 172.21.15.12:0/4263470484 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7eff00065e60 msgr2=0x7eff00068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:55.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.772+0000 7eff23e41640 1 --2- 172.21.15.12:0/4263470484 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7eff00065e60 0x7eff00068320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7eff18006fd0 tx=0x7eff18008040 comp rx=0 tx=0).stop 2023-10-16T23:27:55.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.772+0000 7eff23e41640 1 -- 172.21.15.12:0/4263470484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff1c0705d0 msgr2=0x7eff1c0c50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:55.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.772+0000 7eff23e41640 1 --2- 172.21.15.12:0/4263470484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff1c0705d0 0x7eff1c0c50a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00c500 tx=0x7eff0c00c9c0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.772+0000 7eff23e41640 1 -- 172.21.15.12:0/4263470484 shutdown_connections 2023-10-16T23:27:55.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.772+0000 7eff23e41640 1 --2- 172.21.15.12:0/4263470484 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7eff00065e60 0x7eff00068320 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.772+0000 7eff23e41640 1 --2- 172.21.15.12:0/4263470484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff1c14eba0 0x7eff1c0b8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.772+0000 7eff23e41640 1 --2- 172.21.15.12:0/4263470484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff1c0705d0 0x7eff1c0c50a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.772+0000 7eff23e41640 1 --2- 172.21.15.12:0/4263470484 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff1c06e6d0 0x7eff1c143980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.772+0000 7eff23e41640 1 -- 172.21.15.12:0/4263470484 >> 172.21.15.12:0/4263470484 conn(0x7eff1c06b800 msgr2=0x7eff1c148d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:55.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.772+0000 7eff23e41640 1 -- 172.21.15.12:0/4263470484 shutdown_connections 2023-10-16T23:27:55.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.772+0000 7eff23e41640 1 -- 172.21.15.12:0/4263470484 wait complete. 2023-10-16T23:27:55.792 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T23:27:55.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63e5b10640 1 Processor -- start 2023-10-16T23:27:55.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63e5b10640 1 -- start start 2023-10-16T23:27:55.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63e5b10640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63e00a85e0 0x7f63e00b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:55.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63e5b10640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e00a7470 con 0x7f63e00bf740 2023-10-16T23:27:55.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63e5b10640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e014d750 con 0x7f63e00b9290 2023-10-16T23:27:55.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63e5b10640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00b9980 con 0x7f63e00a85e0 2023-10-16T23:27:55.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63df7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f63e00bf740 0x7f63e014dbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38344/0 (socket says 172.21.15.12:38344) 2023-10-16T23:27:55.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63df7fe640 1 -- 172.21.15.12:0/2031458254 learned_addr learned my addr 172.21.15.12:0/2031458254 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:55.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63deffd640 1 --2- 172.21.15.12:0/2031458254 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63e00a85e0 0x7f63e00b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:55.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63de7fc640 1 -- 172.21.15.12:0/2031458254 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3144691104 0 0) 0x7f63e00a7470 con 0x7f63e00bf740 2023-10-16T23:27:55.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63de7fc640 1 -- 172.21.15.12:0/2031458254 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63c8003530 con 0x7f63e00bf740 2023-10-16T23:27:55.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63de7fc640 1 -- 172.21.15.12:0/2031458254 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2660083720 0 0) 0x7f63c8003530 con 0x7f63e00bf740 2023-10-16T23:27:55.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63de7fc640 1 -- 172.21.15.12:0/2031458254 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63e00a85e0 msgr2=0x7f63e00b7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:55.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63de7fc640 1 --2- 172.21.15.12:0/2031458254 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63e00a85e0 0x7f63e00b7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63de7fc640 1 -- 172.21.15.12:0/2031458254 >> v1:172.21.15.31:6789/0 conn(0x7f63e00b9290 legacy=0x7f63e0136080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:55.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63de7fc640 1 -- 172.21.15.12:0/2031458254 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e00b7ff0 con 0x7f63e00bf740 2023-10-16T23:27:55.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63de7fc640 1 -- 172.21.15.12:0/2031458254 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7f63d0001680 con 0x7f63e00bf740 2023-10-16T23:27:55.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63de7fc640 1 -- 172.21.15.12:0/2031458254 >> v1:172.21.15.12:6789/0 conn(0x7f63e00bf740 legacy=0x7f63e014dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:55.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63de7fc640 1 --2- 172.21.15.12:0/2031458254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63c80039b0 0x7f63c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:55.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63de7fc640 1 --2- 172.21.15.12:0/2031458254 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63e00a85e0 0x7f63c80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:55.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63de7fc640 1 --2- 172.21.15.12:0/2031458254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63c8004d10 0x7f63c8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:55.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63de7fc640 1 -- 172.21.15.12:0/2031458254 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c800ba40 con 0x7f63c80039b0 2023-10-16T23:27:55.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63de7fc640 1 -- 172.21.15.12:0/2031458254 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c800bb80 con 0x7f63c8004d10 2023-10-16T23:27:55.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63de7fc640 1 -- 172.21.15.12:0/2031458254 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c800bcf0 con 0x7f63e00a85e0 2023-10-16T23:27:55.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63df7fe640 1 --2- 172.21.15.12:0/2031458254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63c80039b0 0x7f63c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:55.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63deffd640 1 --2- 172.21.15.12:0/2031458254 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63e00a85e0 0x7f63c80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:55.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63df7fe640 1 -- 172.21.15.12:0/2031458254 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63e00a85e0 msgr2=0x7f63c80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:55.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63dffff640 1 --2- 172.21.15.12:0/2031458254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63c8004d10 0x7f63c8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:55.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63df7fe640 1 --2- 172.21.15.12:0/2031458254 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63e00a85e0 0x7f63c80047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63df7fe640 1 -- 172.21.15.12:0/2031458254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63c8004d10 msgr2=0x7f63c8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:55.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63df7fe640 1 --2- 172.21.15.12:0/2031458254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63c8004d10 0x7f63c8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63df7fe640 1 -- 172.21.15.12:0/2031458254 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c8003530 con 0x7f63c80039b0 2023-10-16T23:27:55.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.908+0000 7f63dffff640 1 --2- 172.21.15.12:0/2031458254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63c8004d10 0x7f63c8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:55.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.912+0000 7f63df7fe640 1 --2- 172.21.15.12:0/2031458254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63c80039b0 0x7f63c8003d90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f63d0001ec0 tx=0x7f63d001d180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c172636576c5f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:55.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.912+0000 7f63de7fc640 1 -- 172.21.15.12:0/2031458254 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d00a5c60 con 0x7f63c80039b0 2023-10-16T23:27:55.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.912+0000 7f63de7fc640 1 -- 172.21.15.12:0/2031458254 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d00a5de0 con 0x7f63c80039b0 2023-10-16T23:27:55.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.912+0000 7f63de7fc640 1 -- 172.21.15.12:0/2031458254 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d0005b20 con 0x7f63c80039b0 2023-10-16T23:27:55.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.912+0000 7f63e5b10640 1 -- 172.21.15.12:0/2031458254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63c80039b0 msgr2=0x7f63c8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:55.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.912+0000 7f63e5b10640 1 --2- 172.21.15.12:0/2031458254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63c80039b0 0x7f63c8003d90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f63d0001ec0 tx=0x7f63d001d180 comp rx=0 tx=0).stop 2023-10-16T23:27:55.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.912+0000 7f63dffff640 1 -- 172.21.15.12:0/2031458254 reap_dead start 2023-10-16T23:27:55.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.912+0000 7f63e5b10640 1 -- 172.21.15.12:0/2031458254 shutdown_connections 2023-10-16T23:27:55.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.912+0000 7f63e5b10640 1 -- 172.21.15.12:0/2031458254 >> 172.21.15.12:0/2031458254 conn(0x7f63e00c2b50 msgr2=0x7f63e00c2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:55.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.912+0000 7f63e5b10640 1 -- 172.21.15.12:0/2031458254 shutdown_connections 2023-10-16T23:27:55.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.912+0000 7f63e5b10640 1 -- 172.21.15.12:0/2031458254 wait complete. 2023-10-16T23:27:55.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.912+0000 7f63e5b10640 1 Processor -- start 2023-10-16T23:27:55.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.912+0000 7f63e5b10640 1 -- start start 2023-10-16T23:27:55.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63e5b10640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63c80039b0 0x7f63e01e52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:55.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63e5b10640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63e014cb30 0x7f63e014ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:55.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63e5b10640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63e012e0a0 0x7f63e012e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:55.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63e5b10640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e01e8900 con 0x7f63e012e0a0 2023-10-16T23:27:55.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63e5b10640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00baaa0 con 0x7f63e014cb30 2023-10-16T23:27:55.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63e5b10640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00bad40 con 0x7f63c80039b0 2023-10-16T23:27:55.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63dffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63e012e0a0 0x7f63e012e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:55.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63dffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63e012e0a0 0x7f63e012e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56024/0 (socket says 172.21.15.12:56024) 2023-10-16T23:27:55.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63dffff640 1 -- 172.21.15.12:0/60599861 learned_addr learned my addr 172.21.15.12:0/60599861 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:55.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63df7fe640 1 --2- 172.21.15.12:0/60599861 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63c80039b0 0x7f63e01e52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:55.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63deffd640 1 --2- 172.21.15.12:0/60599861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63e014cb30 0x7f63e014ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:55.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63dffff640 1 -- 172.21.15.12:0/60599861 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63c80039b0 msgr2=0x7f63e01e52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:55.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63dffff640 1 --2- 172.21.15.12:0/60599861 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63c80039b0 0x7f63e01e52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63dffff640 1 -- 172.21.15.12:0/60599861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63e014cb30 msgr2=0x7f63e014ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:55.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63dffff640 1 --2- 172.21.15.12:0/60599861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63e014cb30 0x7f63e014ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:55.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63dffff640 1 -- 172.21.15.12:0/60599861 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e01e63f0 con 0x7f63e012e0a0 2023-10-16T23:27:55.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63deffd640 1 --2- 172.21.15.12:0/60599861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63e014cb30 0x7f63e014ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:55.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63dffff640 1 --2- 172.21.15.12:0/60599861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63e012e0a0 0x7f63e012e520 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f63e00c38d0 tx=0x7f63d800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:55.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63c7fff640 1 -- 172.21.15.12:0/60599861 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d8006d60 con 0x7f63e012e0a0 2023-10-16T23:27:55.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63c7fff640 1 -- 172.21.15.12:0/60599861 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d8003980 con 0x7f63e012e0a0 2023-10-16T23:27:55.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63e5b10640 1 -- 172.21.15.12:0/60599861 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e0157aa0 con 0x7f63e012e0a0 2023-10-16T23:27:55.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63c7fff640 1 -- 172.21.15.12:0/60599861 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d8003d30 con 0x7f63e012e0a0 2023-10-16T23:27:55.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63e5b10640 1 -- 172.21.15.12:0/60599861 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e012f180 con 0x7f63e012e0a0 2023-10-16T23:27:55.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63e5b10640 1 -- 172.21.15.12:0/60599861 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e00673a0 con 0x7f63e012e0a0 2023-10-16T23:27:55.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63c7fff640 1 -- 172.21.15.12:0/60599861 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f63d8005070 con 0x7f63e012e0a0 2023-10-16T23:27:55.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63c7fff640 1 --2- 172.21.15.12:0/60599861 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f63cc065e60 0x7f63cc068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:55.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63c7fff640 1 -- 172.21.15.12:0/60599861 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f63d80835e0 con 0x7f63e012e0a0 2023-10-16T23:27:55.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.916+0000 7f63df7fe640 1 --2- 172.21.15.12:0/60599861 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f63cc065e60 0x7f63cc068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:55.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.920+0000 7f63df7fe640 1 --2- 172.21.15.12:0/60599861 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f63cc065e60 0x7f63cc068320 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f63d00aa000 tx=0x7f63d00a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:55.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:55.920+0000 7f63c7fff640 1 -- 172.21.15.12:0/60599861 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f63d8050cc0 con 0x7f63e012e0a0 2023-10-16T23:27:56.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.108+0000 7f63e5b10640 1 -- 172.21.15.12:0/60599861 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63e00c0bf0 con 0x7f63e012e0a0 2023-10-16T23:27:56.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.108+0000 7f63c7fff640 1 -- 172.21.15.12:0/60599861 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3127 (secure 0 0 0) 0x7f63d801ce80 con 0x7f63e012e0a0 2023-10-16T23:27:56.111 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:56.112 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3365013557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3365013557},{"type":"v1","addr":"172.21.15.31:6835","nonce":3365013557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T23:27:40.686789+0000","modified":"2023-10-16T23:27:43.696789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6833/593938276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":593938276},{"type":"v1","addr":"172.21.15.12:6833","nonce":593938276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T23:27:56.112 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2023-10-16T23:27:56.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.108+0000 7f63e5b10640 1 -- 172.21.15.12:0/60599861 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f63cc065e60 msgr2=0x7f63cc068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:56.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.108+0000 7f63e5b10640 1 --2- 172.21.15.12:0/60599861 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f63cc065e60 0x7f63cc068320 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f63d00aa000 tx=0x7f63d00a7070 comp rx=0 tx=0).stop 2023-10-16T23:27:56.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.108+0000 7f63e5b10640 1 -- 172.21.15.12:0/60599861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63e012e0a0 msgr2=0x7f63e012e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:56.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.108+0000 7f63e5b10640 1 --2- 172.21.15.12:0/60599861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63e012e0a0 0x7f63e012e520 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f63e00c38d0 tx=0x7f63d800dc00 comp rx=0 tx=0).stop 2023-10-16T23:27:56.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.108+0000 7f63e5b10640 1 -- 172.21.15.12:0/60599861 shutdown_connections 2023-10-16T23:27:56.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.108+0000 7f63e5b10640 1 --2- 172.21.15.12:0/60599861 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f63cc065e60 0x7f63cc068320 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:56.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.108+0000 7f63e5b10640 1 --2- 172.21.15.12:0/60599861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63e012e0a0 0x7f63e012e520 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:56.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.108+0000 7f63e5b10640 1 --2- 172.21.15.12:0/60599861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63e014cb30 0x7f63e014ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:56.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.108+0000 7f63e5b10640 1 --2- 172.21.15.12:0/60599861 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63c80039b0 0x7f63e01e52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:56.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.108+0000 7f63e5b10640 1 -- 172.21.15.12:0/60599861 >> 172.21.15.12:0/60599861 conn(0x7f63e00c2b50 msgr2=0x7f63e01341d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:56.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.108+0000 7f63e5b10640 1 -- 172.21.15.12:0/60599861 shutdown_connections 2023-10-16T23:27:56.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.108+0000 7f63e5b10640 1 -- 172.21.15.12:0/60599861 wait complete. 2023-10-16T23:27:56.129 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T23:27:56.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.244+0000 7fd524d18640 1 Processor -- start 2023-10-16T23:27:56.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.248+0000 7fd524d18640 1 -- start start 2023-10-16T23:27:56.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.248+0000 7fd524d18640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd520071510 0x7fd52014b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:56.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.248+0000 7fd524d18640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd520150240 0x7fd52014bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:56.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.248+0000 7fd524d18640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd52006f350 con 0x7fd5200c1130 2023-10-16T23:27:56.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.248+0000 7fd524d18640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd52006f630 con 0x7fd520071510 2023-10-16T23:27:56.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.248+0000 7fd524d18640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd52014f610 con 0x7fd520150240 2023-10-16T23:27:56.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.248+0000 7fd51dd9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd520071510 0x7fd52014b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:56.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.248+0000 7fd51dd9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd520071510 0x7fd52014b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56040/0 (socket says 172.21.15.12:56040) 2023-10-16T23:27:56.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.248+0000 7fd51dd9b640 1 -- 172.21.15.12:0/1728664646 learned_addr learned my addr 172.21.15.12:0/1728664646 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:56.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.248+0000 7fd51ed9d640 1 --2- 172.21.15.12:0/1728664646 >> v2:172.21.15.31:3300/0 conn(0x7fd520150240 0x7fd52014bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:56.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.248+0000 7fd51dd9b640 1 -- 172.21.15.12:0/1728664646 >> v2:172.21.15.31:3300/0 conn(0x7fd520150240 msgr2=0x7fd52014bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:56.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.248+0000 7fd51dd9b640 1 --2- 172.21.15.12:0/1728664646 >> v2:172.21.15.31:3300/0 conn(0x7fd520150240 0x7fd52014bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:56.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.248+0000 7fd51dd9b640 1 -- 172.21.15.12:0/1728664646 >> v1:172.21.15.31:6789/0 conn(0x7fd5200c1130 legacy=0x7fd52014fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:56.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.248+0000 7fd51dd9b640 1 -- 172.21.15.12:0/1728664646 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5200baac0 con 0x7fd520071510 2023-10-16T23:27:56.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.248+0000 7fd51dd9b640 1 --2- 172.21.15.12:0/1728664646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd520071510 0x7fd52014b630 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd5200b4280 tx=0x7fd51401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b9434ce900a4e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:56.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.248+0000 7fd51d59a640 1 -- 172.21.15.12:0/1728664646 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5140a5870 con 0x7fd520071510 2023-10-16T23:27:56.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.248+0000 7fd51d59a640 1 -- 172.21.15.12:0/1728664646 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5140a59d0 con 0x7fd520071510 2023-10-16T23:27:56.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.248+0000 7fd51d59a640 1 -- 172.21.15.12:0/1728664646 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5140a5d60 con 0x7fd520071510 2023-10-16T23:27:56.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd524d18640 1 -- 172.21.15.12:0/1728664646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd520071510 msgr2=0x7fd52014b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:56.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd524d18640 1 --2- 172.21.15.12:0/1728664646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd520071510 0x7fd52014b630 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd5200b4280 tx=0x7fd51401c990 comp rx=0 tx=0).stop 2023-10-16T23:27:56.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd524d18640 1 -- 172.21.15.12:0/1728664646 shutdown_connections 2023-10-16T23:27:56.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd524d18640 1 --2- 172.21.15.12:0/1728664646 >> v2:172.21.15.31:3300/0 conn(0x7fd520150240 0x7fd52014bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:56.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd524d18640 1 --2- 172.21.15.12:0/1728664646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd520071510 0x7fd52014b630 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:56.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd524d18640 1 -- 172.21.15.12:0/1728664646 >> 172.21.15.12:0/1728664646 conn(0x7fd52006ba20 msgr2=0x7fd5200c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:56.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd524d18640 1 -- 172.21.15.12:0/1728664646 shutdown_connections 2023-10-16T23:27:56.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd524d18640 1 -- 172.21.15.12:0/1728664646 wait complete. 2023-10-16T23:27:56.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd524d18640 1 Processor -- start 2023-10-16T23:27:56.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd524d18640 1 -- start start 2023-10-16T23:27:56.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd524d18640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd520071510 0x7fd5201429f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:56.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd524d18640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5200c1130 0x7fd5200b4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:56.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd524d18640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd520150240 0x7fd52013e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:56.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd524d18640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5200b6890 con 0x7fd520150240 2023-10-16T23:27:56.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd524d18640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5200b4e90 con 0x7fd5200c1130 2023-10-16T23:27:56.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd524d18640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5200b6240 con 0x7fd520071510 2023-10-16T23:27:56.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd51ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd520150240 0x7fd52013e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:56.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd51ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd520150240 0x7fd52013e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56050/0 (socket says 172.21.15.12:56050) 2023-10-16T23:27:56.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd51ed9d640 1 -- 172.21.15.12:0/2640370973 learned_addr learned my addr 172.21.15.12:0/2640370973 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:56.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd51dd9b640 1 --2- 172.21.15.12:0/2640370973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5200c1130 0x7fd5200b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:56.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd51e59c640 1 --2- 172.21.15.12:0/2640370973 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd520071510 0x7fd5201429f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:56.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd51ed9d640 1 -- 172.21.15.12:0/2640370973 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd520071510 msgr2=0x7fd5201429f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:56.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd51ed9d640 1 --2- 172.21.15.12:0/2640370973 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd520071510 0x7fd5201429f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:56.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd51ed9d640 1 -- 172.21.15.12:0/2640370973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5200c1130 msgr2=0x7fd5200b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:56.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd51ed9d640 1 --2- 172.21.15.12:0/2640370973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5200c1130 0x7fd5200b4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:56.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd51ed9d640 1 -- 172.21.15.12:0/2640370973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd514009b30 con 0x7fd520150240 2023-10-16T23:27:56.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd51ed9d640 1 --2- 172.21.15.12:0/2640370973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd520150240 0x7fd52013e8b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd51800d590 tx=0x7fd51800da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:56.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd50effd640 1 -- 172.21.15.12:0/2640370973 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5180125f0 con 0x7fd520150240 2023-10-16T23:27:56.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd50effd640 1 -- 172.21.15.12:0/2640370973 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd518012770 con 0x7fd520150240 2023-10-16T23:27:56.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd50effd640 1 -- 172.21.15.12:0/2640370973 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd518012b20 con 0x7fd520150240 2023-10-16T23:27:56.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd524d18640 1 -- 172.21.15.12:0/2640370973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5200b6520 con 0x7fd520150240 2023-10-16T23:27:56.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd524d18640 1 -- 172.21.15.12:0/2640370973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5200b6d20 con 0x7fd520150240 2023-10-16T23:27:56.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.252+0000 7fd524d18640 1 -- 172.21.15.12:0/2640370973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5200b6a40 con 0x7fd520150240 2023-10-16T23:27:56.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.256+0000 7fd50effd640 1 -- 172.21.15.12:0/2640370973 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fd518012c80 con 0x7fd520150240 2023-10-16T23:27:56.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.256+0000 7fd50effd640 1 --2- 172.21.15.12:0/2640370973 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd500065e60 0x7fd500068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:56.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.256+0000 7fd50effd640 1 -- 172.21.15.12:0/2640370973 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd518083c60 con 0x7fd520150240 2023-10-16T23:27:56.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.256+0000 7fd51e59c640 1 --2- 172.21.15.12:0/2640370973 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd500065e60 0x7fd500068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:56.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.256+0000 7fd51e59c640 1 --2- 172.21.15.12:0/2640370973 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd500065e60 0x7fd500068320 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd510003d60 tx=0x7fd510009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:56.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.260+0000 7fd50effd640 1 -- 172.21.15.12:0/2640370973 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fd5200b6a40 con 0x7fd520150240 2023-10-16T23:27:56.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.412+0000 7fd524d18640 1 -- 172.21.15.12:0/2640370973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5200b6a40 con 0x7fd520150240 2023-10-16T23:27:56.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.416+0000 7fd50effd640 1 -- 172.21.15.12:0/2640370973 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17763 (secure 0 0 0) 0x7fd5200b6a40 con 0x7fd520150240 2023-10-16T23:27:56.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:56.420 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"fsid":"0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51","created":"2023-10-16T23:27:16.468087+0000","modified":"2023-10-16T23:27:41.690088+0000","last_up_change":"2023-10-16T23:27:28.136202+0000","last_in_change":"2023-10-16T23:27:18.793212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T23:27:27.354025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-16T23:27:34.786446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-16T23:27:39.130341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-16T23:27:39.674572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73e70f98-6f5e-4464-b34e-931faac41cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":38075},{"type":"v1","addr":"172.21.15.12:6814","nonce":38075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":38075},{"type":"v1","addr":"172.21.15.12:6819","nonce":38075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":38075},{"type":"v1","addr":"172.21.15.12:6827","nonce":38075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":38075},{"type":"v1","addr":"172.21.15.12:6823","nonce":38075}]},"public_addr":"172.21.15.12:6814/38075","cluster_addr":"172.21.15.12:6819/38075","heartbeat_back_addr":"172.21.15.12:6827/38075","heartbeat_front_addr":"172.21.15.12:6823/38075","state":["exists","up"]},{"osd":1,"uuid":"ff722efe-b3f9-4cc0-bbde-f4d4d8055a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":38076},{"type":"v1","addr":"172.21.15.12:6811","nonce":38076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":38076},{"type":"v1","addr":"172.21.15.12:6818","nonce":38076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":38076},{"type":"v1","addr":"172.21.15.12:6831","nonce":38076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":38076},{"type":"v1","addr":"172.21.15.12:6825","nonce":38076}]},"public_addr":"172.21.15.12:6811/38076","cluster_addr":"172.21.15.12:6818/38076","heartbeat_back_addr":"172.21.15.12:6831/38076","heartbeat_front_addr":"172.21.15.12:6825/38076","state":["exists","up"]},{"osd":2,"uuid":"9baf25db-dce0-4065-90d6-f35867286be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6809","nonce":38073},{"type":"v1","addr":"172.21.15.12:6810","nonce":38073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":38073},{"type":"v1","addr":"172.21.15.12:6817","nonce":38073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":38073},{"type":"v1","addr":"172.21.15.12:6830","nonce":38073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":38073},{"type":"v1","addr":"172.21.15.12:6826","nonce":38073}]},"public_addr":"172.21.15.12:6810/38073","cluster_addr":"172.21.15.12:6817/38073","heartbeat_back_addr":"172.21.15.12:6830/38073","heartbeat_front_addr":"172.21.15.12:6826/38073","state":["exists","up"]},{"osd":3,"uuid":"8a620ad3-2294-470d-8a8c-66f177f5fbe7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":38074},{"type":"v1","addr":"172.21.15.12:6801","nonce":38074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":38074},{"type":"v1","addr":"172.21.15.12:6803","nonce":38074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":38074},{"type":"v1","addr":"172.21.15.12:6807","nonce":38074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":38074},{"type":"v1","addr":"172.21.15.12:6805","nonce":38074}]},"public_addr":"172.21.15.12:6801/38074","cluster_addr":"172.21.15.12:6803/38074","heartbeat_back_addr":"172.21.15.12:6807/38074","heartbeat_front_addr":"172.21.15.12:6805/38074","state":["exists","up"]},{"osd":4,"uuid":"a8824d77-7405-40f5-9234-60889802b184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":38266},{"type":"v1","addr":"172.21.15.31:6817","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":38266},{"type":"v1","addr":"172.21.15.31:6819","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":38266},{"type":"v1","addr":"172.21.15.31:6823","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":38266},{"type":"v1","addr":"172.21.15.31:6821","nonce":38266}]},"public_addr":"172.21.15.31:6817/38266","cluster_addr":"172.21.15.31:6819/38266","heartbeat_back_addr":"172.21.15.31:6823/38266","heartbeat_front_addr":"172.21.15.31:6821/38266","state":["exists","up"]},{"osd":5,"uuid":"3bb01192-a47c-48e9-9662-285e3f6f4b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":38264},{"type":"v1","addr":"172.21.15.31:6807","nonce":38264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":38264},{"type":"v1","addr":"172.21.15.31:6811","nonce":38264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":38264},{"type":"v1","addr":"172.21.15.31:6815","nonce":38264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":38264},{"type":"v1","addr":"172.21.15.31:6813","nonce":38264}]},"public_addr":"172.21.15.31:6807/38264","cluster_addr":"172.21.15.31:6811/38264","heartbeat_back_addr":"172.21.15.31:6815/38264","heartbeat_front_addr":"172.21.15.31:6813/38264","state":["exists","up"]},{"osd":6,"uuid":"1e2d18e4-73e6-4a37-826c-35eca4d96935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":38263},{"type":"v1","addr":"172.21.15.31:6825","nonce":38263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":38263},{"type":"v1","addr":"172.21.15.31:6827","nonce":38263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":38263},{"type":"v1","addr":"172.21.15.31:6831","nonce":38263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":38263},{"type":"v1","addr":"172.21.15.31:6829","nonce":38263}]},"public_addr":"172.21.15.31:6825/38263","cluster_addr":"172.21.15.31:6827/38263","heartbeat_back_addr":"172.21.15.31:6831/38263","heartbeat_front_addr":"172.21.15.31:6829/38263","state":["exists","up"]},{"osd":7,"uuid":"e0f369c0-562b-4440-a5aa-12275c29412b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":38265},{"type":"v1","addr":"172.21.15.31:6801","nonce":38265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":38265},{"type":"v1","addr":"172.21.15.31:6803","nonce":38265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":38265},{"type":"v1","addr":"172.21.15.31:6810","nonce":38265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":38265},{"type":"v1","addr":"172.21.15.31:6806","nonce":38265}]},"public_addr":"172.21.15.31:6801/38265","cluster_addr":"172.21.15.31:6803/38265","heartbeat_back_addr":"172.21.15.31:6810/38265","heartbeat_front_addr":"172.21.15.31:6806/38265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.411815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.372565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.209700+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.414619+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.316843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.300348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.359800+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.219854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T23:27:56.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.416+0000 7fd524d18640 1 -- 172.21.15.12:0/2640370973 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd500065e60 msgr2=0x7fd500068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.420+0000 7fd524d18640 1 --2- 172.21.15.12:0/2640370973 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd500065e60 0x7fd500068320 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd510003d60 tx=0x7fd510009040 comp rx=0 tx=0).stop 2023-10-16T23:27:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.420+0000 7fd524d18640 1 -- 172.21.15.12:0/2640370973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd520150240 msgr2=0x7fd52013e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.420+0000 7fd524d18640 1 --2- 172.21.15.12:0/2640370973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd520150240 0x7fd52013e8b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd51800d590 tx=0x7fd51800da50 comp rx=0 tx=0).stop 2023-10-16T23:27:56.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.420+0000 7fd524d18640 1 -- 172.21.15.12:0/2640370973 shutdown_connections 2023-10-16T23:27:56.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.420+0000 7fd524d18640 1 --2- 172.21.15.12:0/2640370973 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd500065e60 0x7fd500068320 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:56.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.420+0000 7fd524d18640 1 --2- 172.21.15.12:0/2640370973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd520150240 0x7fd52013e8b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:56.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.420+0000 7fd524d18640 1 --2- 172.21.15.12:0/2640370973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5200c1130 0x7fd5200b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:56.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.420+0000 7fd524d18640 1 --2- 172.21.15.12:0/2640370973 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd520071510 0x7fd5201429f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:56.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.420+0000 7fd524d18640 1 -- 172.21.15.12:0/2640370973 >> 172.21.15.12:0/2640370973 conn(0x7fd52006ba20 msgr2=0x7fd5200c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:56.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.420+0000 7fd524d18640 1 -- 172.21.15.12:0/2640370973 shutdown_connections 2023-10-16T23:27:56.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.420+0000 7fd524d18640 1 -- 172.21.15.12:0/2640370973 wait complete. 2023-10-16T23:27:56.437 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T23:27:27.354025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-16T23:27:34.786446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T23:27:39.130341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T23:27:39.674572+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T23:27:56.438 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T23:27:56.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.556+0000 7f27faf74640 1 Processor -- start 2023-10-16T23:27:56.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.556+0000 7f27faf74640 1 -- start start 2023-10-16T23:27:56.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.556+0000 7f27faf74640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f27f414f970 0x7f27f40bbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:56.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.556+0000 7f27faf74640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f414bb00 con 0x7f27f406ed20 2023-10-16T23:27:56.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.556+0000 7f27faf74640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f414bda0 con 0x7f27f4070e20 2023-10-16T23:27:56.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.556+0000 7f27faf74640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f414c080 con 0x7f27f414f970 2023-10-16T23:27:56.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.556+0000 7f27f9511640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f27f414f970 0x7f27f40bbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:56.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.556+0000 7f27f8d10640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f27f406ed20 0x7f27f414c5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38348/0 (socket says 172.21.15.12:38348) 2023-10-16T23:27:56.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.556+0000 7f27f8d10640 1 -- 172.21.15.12:0/843740730 learned_addr learned my addr 172.21.15.12:0/843740730 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:56.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.556+0000 7f27f9511640 1 -- 172.21.15.12:0/843740730 >> v1:172.21.15.31:6789/0 conn(0x7f27f4070e20 legacy=0x7f27f40baf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:56.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.556+0000 7f27f9511640 1 -- 172.21.15.12:0/843740730 >> v1:172.21.15.12:6789/0 conn(0x7f27f406ed20 legacy=0x7f27f414c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:56.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.556+0000 7f27f9511640 1 -- 172.21.15.12:0/843740730 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f414fd90 con 0x7f27f414f970 2023-10-16T23:27:56.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.556+0000 7f27f9511640 1 --2- 172.21.15.12:0/843740730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27f414f970 0x7f27f40bbcb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f27ec009d90 tx=0x7f27ec01d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930c265f3928587c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:56.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.556+0000 7f27f37fe640 1 -- 172.21.15.12:0/843740730 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec0a9650 con 0x7f27f414f970 2023-10-16T23:27:56.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27f37fe640 1 -- 172.21.15.12:0/843740730 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ec0a97b0 con 0x7f27f414f970 2023-10-16T23:27:56.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27f37fe640 1 -- 172.21.15.12:0/843740730 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec0a9b40 con 0x7f27f414f970 2023-10-16T23:27:56.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27faf74640 1 -- 172.21.15.12:0/843740730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27f414f970 msgr2=0x7f27f40bbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:56.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27faf74640 1 --2- 172.21.15.12:0/843740730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27f414f970 0x7f27f40bbcb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f27ec009d90 tx=0x7f27ec01d990 comp rx=0 tx=0).stop 2023-10-16T23:27:56.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27faf74640 1 -- 172.21.15.12:0/843740730 shutdown_connections 2023-10-16T23:27:56.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27faf74640 1 --2- 172.21.15.12:0/843740730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27f414f970 0x7f27f40bbcb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:56.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27faf74640 1 -- 172.21.15.12:0/843740730 >> 172.21.15.12:0/843740730 conn(0x7f27f406bb10 msgr2=0x7f27f40c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:56.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27faf74640 1 -- 172.21.15.12:0/843740730 shutdown_connections 2023-10-16T23:27:56.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27faf74640 1 -- 172.21.15.12:0/843740730 wait complete. 2023-10-16T23:27:56.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27faf74640 1 Processor -- start 2023-10-16T23:27:56.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27faf74640 1 -- start start 2023-10-16T23:27:56.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27faf74640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27f406ed20 0x7f27f4156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:56.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27faf74640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27f4070e20 0x7f27f40b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:56.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27faf74640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27f414f970 0x7f27f41ec2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:56.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27faf74640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f41ebe60 con 0x7f27f4070e20 2023-10-16T23:27:56.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27faf74640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f41565c0 con 0x7f27f414f970 2023-10-16T23:27:56.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27faf74640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f40b0c80 con 0x7f27f406ed20 2023-10-16T23:27:56.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27f3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27f4070e20 0x7f27f40b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:56.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27f3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27f4070e20 0x7f27f40b0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56072/0 (socket says 172.21.15.12:56072) 2023-10-16T23:27:56.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27f3fff640 1 -- 172.21.15.12:0/778883581 learned_addr learned my addr 172.21.15.12:0/778883581 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:56.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27f8d10640 1 --2- 172.21.15.12:0/778883581 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27f406ed20 0x7f27f4156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:56.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27f9511640 1 --2- 172.21.15.12:0/778883581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27f414f970 0x7f27f41ec2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:56.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27f3fff640 1 -- 172.21.15.12:0/778883581 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27f406ed20 msgr2=0x7f27f4156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:56.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27f3fff640 1 --2- 172.21.15.12:0/778883581 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27f406ed20 0x7f27f4156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:56.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27f3fff640 1 -- 172.21.15.12:0/778883581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27f414f970 msgr2=0x7f27f41ec2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:56.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27f3fff640 1 --2- 172.21.15.12:0/778883581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27f414f970 0x7f27f41ec2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:56.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27f3fff640 1 -- 172.21.15.12:0/778883581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec009a70 con 0x7f27f4070e20 2023-10-16T23:27:56.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27f9511640 1 --2- 172.21.15.12:0/778883581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27f414f970 0x7f27f41ec2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:56.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27f3fff640 1 --2- 172.21.15.12:0/778883581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27f4070e20 0x7f27f40b0f60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f27e000c450 tx=0x7f27e000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:56.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27f17fa640 1 -- 172.21.15.12:0/778883581 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0012830 con 0x7f27f4070e20 2023-10-16T23:27:56.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27f17fa640 1 -- 172.21.15.12:0/778883581 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e00129b0 con 0x7f27f4070e20 2023-10-16T23:27:56.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27faf74640 1 -- 172.21.15.12:0/778883581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f40b0930 con 0x7f27f4070e20 2023-10-16T23:27:56.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27f17fa640 1 -- 172.21.15.12:0/778883581 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0012d60 con 0x7f27f4070e20 2023-10-16T23:27:56.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.560+0000 7f27faf74640 1 -- 172.21.15.12:0/778883581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f40b14a0 con 0x7f27f4070e20 2023-10-16T23:27:56.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.564+0000 7f27faf74640 1 -- 172.21.15.12:0/778883581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f40673a0 con 0x7f27f4070e20 2023-10-16T23:27:56.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.564+0000 7f27f17fa640 1 -- 172.21.15.12:0/778883581 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f27e001c460 con 0x7f27f4070e20 2023-10-16T23:27:56.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.564+0000 7f27f17fa640 1 --2- 172.21.15.12:0/778883581 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f27d8065e90 0x7f27d8068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:56.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.564+0000 7f27f17fa640 1 -- 172.21.15.12:0/778883581 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f27e0083690 con 0x7f27f4070e20 2023-10-16T23:27:56.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.564+0000 7f27f8d10640 1 --2- 172.21.15.12:0/778883581 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f27d8065e90 0x7f27d8068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:56.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.564+0000 7f27f8d10640 1 --2- 172.21.15.12:0/778883581 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f27d8065e90 0x7f27d8068350 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f27e8005890 tx=0x7f27e8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:56.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.568+0000 7f27f17fa640 1 -- 172.21.15.12:0/778883581 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f27e0050ce0 con 0x7f27f4070e20 2023-10-16T23:27:56.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.724+0000 7f27faf74640 1 -- 172.21.15.12:0/778883581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27f41ebc20 con 0x7f27f4070e20 2023-10-16T23:27:56.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.724+0000 7f27f17fa640 1 -- 172.21.15.12:0/778883581 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f27e0054300 con 0x7f27f4070e20 2023-10-16T23:27:56.729 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-16T23:27:56.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.728+0000 7f27faf74640 1 -- 172.21.15.12:0/778883581 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f27d8065e90 msgr2=0x7f27d8068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:56.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.728+0000 7f27faf74640 1 --2- 172.21.15.12:0/778883581 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f27d8065e90 0x7f27d8068350 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f27e8005890 tx=0x7f27e8009040 comp rx=0 tx=0).stop 2023-10-16T23:27:56.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.728+0000 7f27faf74640 1 -- 172.21.15.12:0/778883581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27f4070e20 msgr2=0x7f27f40b0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:56.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.728+0000 7f27faf74640 1 --2- 172.21.15.12:0/778883581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27f4070e20 0x7f27f40b0f60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f27e000c450 tx=0x7f27e000c910 comp rx=0 tx=0).stop 2023-10-16T23:27:56.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.728+0000 7f27faf74640 1 -- 172.21.15.12:0/778883581 shutdown_connections 2023-10-16T23:27:56.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.728+0000 7f27faf74640 1 --2- 172.21.15.12:0/778883581 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f27d8065e90 0x7f27d8068350 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:56.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.728+0000 7f27faf74640 1 --2- 172.21.15.12:0/778883581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27f414f970 0x7f27f41ec2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:56.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.728+0000 7f27faf74640 1 --2- 172.21.15.12:0/778883581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27f4070e20 0x7f27f40b0f60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:56.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.728+0000 7f27faf74640 1 --2- 172.21.15.12:0/778883581 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f27f406ed20 0x7f27f4156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:56.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.728+0000 7f27faf74640 1 -- 172.21.15.12:0/778883581 >> 172.21.15.12:0/778883581 conn(0x7f27f406bb10 msgr2=0x7f27f414aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:56.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.728+0000 7f27faf74640 1 -- 172.21.15.12:0/778883581 shutdown_connections 2023-10-16T23:27:56.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.728+0000 7f27faf74640 1 -- 172.21.15.12:0/778883581 wait complete. 2023-10-16T23:27:56.748 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-16T23:27:56.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.872+0000 7efd9b18e640 1 Processor -- start 2023-10-16T23:27:56.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.872+0000 7efd9b18e640 1 -- start start 2023-10-16T23:27:56.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd9b18e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd9414fd80 0x7efd940b9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:56.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd9b18e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd941502d0 con 0x7efd9406d080 2023-10-16T23:27:56.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd9b18e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd9406fcf0 con 0x7efd9414cad0 2023-10-16T23:27:56.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd9b18e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd940700d0 con 0x7efd9414fd80 2023-10-16T23:27:56.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd98f2a640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efd9406d080 0x7efd9414c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38356/0 (socket says 172.21.15.12:38356) 2023-10-16T23:27:56.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd98f2a640 1 -- 172.21.15.12:0/1458466343 learned_addr learned my addr 172.21.15.12:0/1458466343 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:56.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd9972b640 1 --2- 172.21.15.12:0/1458466343 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd9414fd80 0x7efd940b9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:56.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd937fe640 1 -- 172.21.15.12:0/1458466343 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2909528826 0 0) 0x7efd941502d0 con 0x7efd9406d080 2023-10-16T23:27:56.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd937fe640 1 -- 172.21.15.12:0/1458466343 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd84003530 con 0x7efd9406d080 2023-10-16T23:27:56.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd937fe640 1 -- 172.21.15.12:0/1458466343 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3807971167 0 0) 0x7efd84003530 con 0x7efd9406d080 2023-10-16T23:27:56.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd937fe640 1 -- 172.21.15.12:0/1458466343 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd9414fd80 msgr2=0x7efd940b9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:56.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd937fe640 1 --2- 172.21.15.12:0/1458466343 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd9414fd80 0x7efd940b9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:56.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd937fe640 1 -- 172.21.15.12:0/1458466343 >> v1:172.21.15.31:6789/0 conn(0x7efd9414cad0 legacy=0x7efd940bd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:56.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd937fe640 1 -- 172.21.15.12:0/1458466343 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9406dda0 con 0x7efd9406d080 2023-10-16T23:27:56.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd937fe640 1 -- 172.21.15.12:0/1458466343 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7efd88001680 con 0x7efd9406d080 2023-10-16T23:27:56.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd937fe640 1 -- 172.21.15.12:0/1458466343 >> v1:172.21.15.12:6789/0 conn(0x7efd9406d080 legacy=0x7efd9414c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:56.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd937fe640 1 --2- 172.21.15.12:0/1458466343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd840039b0 0x7efd84003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:56.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd937fe640 1 --2- 172.21.15.12:0/1458466343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd840047d0 0x7efd84004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:56.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd937fe640 1 --2- 172.21.15.12:0/1458466343 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd9414fd80 0x7efd840051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:56.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd937fe640 1 -- 172.21.15.12:0/1458466343 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd940700d0 con 0x7efd840039b0 2023-10-16T23:27:56.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd937fe640 1 -- 172.21.15.12:0/1458466343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8400bac0 con 0x7efd840047d0 2023-10-16T23:27:56.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd937fe640 1 -- 172.21.15.12:0/1458466343 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8400bc80 con 0x7efd9414fd80 2023-10-16T23:27:56.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd98f2a640 1 --2- 172.21.15.12:0/1458466343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd840039b0 0x7efd84003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:56.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd9972b640 1 --2- 172.21.15.12:0/1458466343 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd9414fd80 0x7efd840051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:56.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd98f2a640 1 -- 172.21.15.12:0/1458466343 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd9414fd80 msgr2=0x7efd840051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:56.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd98f2a640 1 --2- 172.21.15.12:0/1458466343 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd9414fd80 0x7efd840051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:56.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd93fff640 1 --2- 172.21.15.12:0/1458466343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd840047d0 0x7efd84004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:56.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd98f2a640 1 -- 172.21.15.12:0/1458466343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd840047d0 msgr2=0x7efd84004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:56.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd98f2a640 1 --2- 172.21.15.12:0/1458466343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd840047d0 0x7efd84004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:56.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd98f2a640 1 -- 172.21.15.12:0/1458466343 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd84003530 con 0x7efd840039b0 2023-10-16T23:27:56.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.876+0000 7efd93fff640 1 --2- 172.21.15.12:0/1458466343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd840047d0 0x7efd84004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:56.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd98f2a640 1 --2- 172.21.15.12:0/1458466343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd840039b0 0x7efd84003dd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efd8800c1c0 tx=0x7efd8801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603a5ade2d5f891f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:56.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd937fe640 1 -- 172.21.15.12:0/1458466343 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd88005ae0 con 0x7efd840039b0 2023-10-16T23:27:56.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd937fe640 1 -- 172.21.15.12:0/1458466343 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd88005c40 con 0x7efd840039b0 2023-10-16T23:27:56.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd937fe640 1 -- 172.21.15.12:0/1458466343 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd880a5810 con 0x7efd840039b0 2023-10-16T23:27:56.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd9b18e640 1 -- 172.21.15.12:0/1458466343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd840039b0 msgr2=0x7efd84003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:56.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd9b18e640 1 --2- 172.21.15.12:0/1458466343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd840039b0 0x7efd84003dd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efd8800c1c0 tx=0x7efd8801cc20 comp rx=0 tx=0).stop 2023-10-16T23:27:56.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd9972b640 1 -- 172.21.15.12:0/1458466343 reap_dead start 2023-10-16T23:27:56.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd9b18e640 1 -- 172.21.15.12:0/1458466343 shutdown_connections 2023-10-16T23:27:56.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd9b18e640 1 -- 172.21.15.12:0/1458466343 >> 172.21.15.12:0/1458466343 conn(0x7efd940c2a70 msgr2=0x7efd940c2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:56.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd9b18e640 1 -- 172.21.15.12:0/1458466343 shutdown_connections 2023-10-16T23:27:56.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd9b18e640 1 -- 172.21.15.12:0/1458466343 wait complete. 2023-10-16T23:27:56.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd9b18e640 1 Processor -- start 2023-10-16T23:27:56.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd9b18e640 1 -- start start 2023-10-16T23:27:56.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd9b18e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd840039b0 0x7efd940c1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:56.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd9b18e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd9414ec70 0x7efd940bc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:56.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd9b18e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd940bcc90 0x7efd940bc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:56.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd9b18e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9414f170 con 0x7efd9414ec70 2023-10-16T23:27:56.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd9b18e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd940bcad0 con 0x7efd840039b0 2023-10-16T23:27:56.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd9b18e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9414d840 con 0x7efd940bcc90 2023-10-16T23:27:56.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd93fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd9414ec70 0x7efd940bc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:56.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd93fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd9414ec70 0x7efd940bc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56088/0 (socket says 172.21.15.12:56088) 2023-10-16T23:27:56.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd93fff640 1 -- 172.21.15.12:0/3653875365 learned_addr learned my addr 172.21.15.12:0/3653875365 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:56.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd98f2a640 1 --2- 172.21.15.12:0/3653875365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd840039b0 0x7efd940c1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:56.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd9972b640 1 --2- 172.21.15.12:0/3653875365 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd940bcc90 0x7efd940bc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:56.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd93fff640 1 -- 172.21.15.12:0/3653875365 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd940bcc90 msgr2=0x7efd940bc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:56.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd93fff640 1 --2- 172.21.15.12:0/3653875365 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd940bcc90 0x7efd940bc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:56.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd93fff640 1 -- 172.21.15.12:0/3653875365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd840039b0 msgr2=0x7efd940c1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:56.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd93fff640 1 --2- 172.21.15.12:0/3653875365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd840039b0 0x7efd940c1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:56.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd93fff640 1 -- 172.21.15.12:0/3653875365 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd940c2160 con 0x7efd9414ec70 2023-10-16T23:27:56.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd93fff640 1 --2- 172.21.15.12:0/3653875365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd9414ec70 0x7efd940bc050 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efd8000d770 tx=0x7efd8000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:56.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd917fa640 1 -- 172.21.15.12:0/3653875365 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd80005270 con 0x7efd9414ec70 2023-10-16T23:27:56.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd917fa640 1 -- 172.21.15.12:0/3653875365 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd800053f0 con 0x7efd9414ec70 2023-10-16T23:27:56.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd917fa640 1 -- 172.21.15.12:0/3653875365 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8000b890 con 0x7efd9414ec70 2023-10-16T23:27:56.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd9b18e640 1 -- 172.21.15.12:0/3653875365 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd9414dac0 con 0x7efd9414ec70 2023-10-16T23:27:56.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.880+0000 7efd9b18e640 1 -- 172.21.15.12:0/3653875365 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd940c2540 con 0x7efd9414ec70 2023-10-16T23:27:56.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.884+0000 7efd9b18e640 1 -- 172.21.15.12:0/3653875365 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd941e77a0 con 0x7efd9414ec70 2023-10-16T23:27:56.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.884+0000 7efd917fa640 1 -- 172.21.15.12:0/3653875365 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7efd8000b9f0 con 0x7efd9414ec70 2023-10-16T23:27:56.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.884+0000 7efd917fa640 1 --2- 172.21.15.12:0/3653875365 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efd78065e60 0x7efd78068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:56.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.884+0000 7efd917fa640 1 -- 172.21.15.12:0/3653875365 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efd80083790 con 0x7efd9414ec70 2023-10-16T23:27:56.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.884+0000 7efd98f2a640 1 --2- 172.21.15.12:0/3653875365 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efd78065e60 0x7efd78068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:56.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.884+0000 7efd98f2a640 1 --2- 172.21.15.12:0/3653875365 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efd78065e60 0x7efd78068320 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efd880ab000 tx=0x7efd880a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:56.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:56.888+0000 7efd917fa640 1 -- 172.21.15.12:0/3653875365 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7efd941e77a0 con 0x7efd9414ec70 2023-10-16T23:27:57.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.044+0000 7efd9b18e640 1 -- 172.21.15.12:0/3653875365 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efd941e77a0 con 0x7efd9414ec70 2023-10-16T23:27:57.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.044+0000 7efd917fa640 1 -- 172.21.15.12:0/3653875365 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7efd941e77a0 con 0x7efd9414ec70 2023-10-16T23:27:57.050 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-10-16T23:27:57.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.048+0000 7efd9b18e640 1 -- 172.21.15.12:0/3653875365 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efd78065e60 msgr2=0x7efd78068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:57.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.048+0000 7efd9b18e640 1 --2- 172.21.15.12:0/3653875365 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efd78065e60 0x7efd78068320 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efd880ab000 tx=0x7efd880a7070 comp rx=0 tx=0).stop 2023-10-16T23:27:57.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.048+0000 7efd9b18e640 1 -- 172.21.15.12:0/3653875365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd9414ec70 msgr2=0x7efd940bc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:57.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.048+0000 7efd9b18e640 1 --2- 172.21.15.12:0/3653875365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd9414ec70 0x7efd940bc050 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efd8000d770 tx=0x7efd8000dc30 comp rx=0 tx=0).stop 2023-10-16T23:27:57.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.048+0000 7efd9b18e640 1 -- 172.21.15.12:0/3653875365 shutdown_connections 2023-10-16T23:27:57.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.048+0000 7efd9b18e640 1 --2- 172.21.15.12:0/3653875365 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efd78065e60 0x7efd78068320 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.048+0000 7efd9b18e640 1 --2- 172.21.15.12:0/3653875365 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd940bcc90 0x7efd940bc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.048+0000 7efd9b18e640 1 --2- 172.21.15.12:0/3653875365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd9414ec70 0x7efd940bc050 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.048+0000 7efd9b18e640 1 --2- 172.21.15.12:0/3653875365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd840039b0 0x7efd940c1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.048+0000 7efd9b18e640 1 -- 172.21.15.12:0/3653875365 >> 172.21.15.12:0/3653875365 conn(0x7efd940c2a70 msgr2=0x7efd9414b600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:57.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.048+0000 7efd9b18e640 1 -- 172.21.15.12:0/3653875365 shutdown_connections 2023-10-16T23:27:57.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.048+0000 7efd9b18e640 1 -- 172.21.15.12:0/3653875365 wait complete. 2023-10-16T23:27:57.069 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T23:27:57.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.188+0000 7fcbc417f640 1 Processor -- start 2023-10-16T23:27:57.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.188+0000 7fcbc417f640 1 -- start start 2023-10-16T23:27:57.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.188+0000 7fcbc417f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcbbc0c12a0 0x7fcbbc0bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:57.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.188+0000 7fcbc417f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcbbc070800 0x7fcbbc14e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:57.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.188+0000 7fcbc417f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcbbc0b3f70 0x7fcbbc14ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:57.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.188+0000 7fcbc417f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbbc14f3d0 con 0x7fcbbc070800 2023-10-16T23:27:57.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.188+0000 7fcbc417f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbbc153580 con 0x7fcbbc0c12a0 2023-10-16T23:27:57.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.188+0000 7fcbc417f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc153860 con 0x7fcbbc0b3f70 2023-10-16T23:27:57.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.188+0000 7fcbc171a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcbbc070800 0x7fcbbc14e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:57.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.188+0000 7fcbc171a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcbbc070800 0x7fcbbc14e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56098/0 (socket says 172.21.15.12:56098) 2023-10-16T23:27:57.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.188+0000 7fcbc171a640 1 -- 172.21.15.12:0/2484195051 learned_addr learned my addr 172.21.15.12:0/2484195051 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:57.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.188+0000 7fcbc271c640 1 --2- 172.21.15.12:0/2484195051 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcbbc0b3f70 0x7fcbbc14ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:57.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.188+0000 7fcbc1f1b640 1 --2- 172.21.15.12:0/2484195051 >> v2:172.21.15.31:3300/0 conn(0x7fcbbc0c12a0 0x7fcbbc0bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:57.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.188+0000 7fcbc171a640 1 -- 172.21.15.12:0/2484195051 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcbbc0b3f70 msgr2=0x7fcbbc14ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:57.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.188+0000 7fcbc171a640 1 --2- 172.21.15.12:0/2484195051 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcbbc0b3f70 0x7fcbbc14ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.188+0000 7fcbc171a640 1 -- 172.21.15.12:0/2484195051 >> v2:172.21.15.31:3300/0 conn(0x7fcbbc0c12a0 msgr2=0x7fcbbc0bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:57.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.188+0000 7fcbc171a640 1 --2- 172.21.15.12:0/2484195051 >> v2:172.21.15.31:3300/0 conn(0x7fcbbc0c12a0 0x7fcbbc0bcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.188+0000 7fcbc171a640 1 -- 172.21.15.12:0/2484195051 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbbc0c1680 con 0x7fcbbc070800 2023-10-16T23:27:57.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc171a640 1 --2- 172.21.15.12:0/2484195051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbbc070800 0x7fcbbc14e950 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc0bc790 tx=0x7fcbac01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adcb691353941999 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:57.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc0f19640 1 -- 172.21.15.12:0/2484195051 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac0ab600 con 0x7fcbbc070800 2023-10-16T23:27:57.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc0f19640 1 -- 172.21.15.12:0/2484195051 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbac0a7050 con 0x7fcbbc070800 2023-10-16T23:27:57.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc0f19640 1 -- 172.21.15.12:0/2484195051 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac0ab980 con 0x7fcbbc070800 2023-10-16T23:27:57.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc417f640 1 -- 172.21.15.12:0/2484195051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbbc070800 msgr2=0x7fcbbc14e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:57.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc417f640 1 --2- 172.21.15.12:0/2484195051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbbc070800 0x7fcbbc14e950 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc0bc790 tx=0x7fcbac01c500 comp rx=0 tx=0).stop 2023-10-16T23:27:57.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc417f640 1 -- 172.21.15.12:0/2484195051 shutdown_connections 2023-10-16T23:27:57.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc417f640 1 --2- 172.21.15.12:0/2484195051 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcbbc0b3f70 0x7fcbbc14ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc417f640 1 --2- 172.21.15.12:0/2484195051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbbc070800 0x7fcbbc14e950 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc417f640 1 --2- 172.21.15.12:0/2484195051 >> v2:172.21.15.31:3300/0 conn(0x7fcbbc0c12a0 0x7fcbbc0bcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc417f640 1 -- 172.21.15.12:0/2484195051 >> 172.21.15.12:0/2484195051 conn(0x7fcbbc06bb10 msgr2=0x7fcbbc0c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:57.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc417f640 1 -- 172.21.15.12:0/2484195051 shutdown_connections 2023-10-16T23:27:57.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc417f640 1 -- 172.21.15.12:0/2484195051 wait complete. 2023-10-16T23:27:57.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc417f640 1 Processor -- start 2023-10-16T23:27:57.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc417f640 1 -- start start 2023-10-16T23:27:57.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc417f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcbbc070800 0x7fcbbc14a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:57.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc417f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbbc0b3f70 0x7fcbbc151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:57.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc417f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbbc0c12a0 0x7fcbbc0b6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:57.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc417f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc0bb600 con 0x7fcbbc0c12a0 2023-10-16T23:27:57.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc417f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc0bb8e0 con 0x7fcbbc0b3f70 2023-10-16T23:27:57.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc417f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc14b060 con 0x7fcbbc070800 2023-10-16T23:27:57.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc271c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbbc0c12a0 0x7fcbbc0b6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:57.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc271c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbbc0c12a0 0x7fcbbc0b6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56108/0 (socket says 172.21.15.12:56108) 2023-10-16T23:27:57.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc271c640 1 -- 172.21.15.12:0/3424170103 learned_addr learned my addr 172.21.15.12:0/3424170103 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:57.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc171a640 1 --2- 172.21.15.12:0/3424170103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbbc0b3f70 0x7fcbbc151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:57.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc1f1b640 1 --2- 172.21.15.12:0/3424170103 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcbbc070800 0x7fcbbc14a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:57.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc271c640 1 -- 172.21.15.12:0/3424170103 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcbbc070800 msgr2=0x7fcbbc14a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:57.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc271c640 1 --2- 172.21.15.12:0/3424170103 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcbbc070800 0x7fcbbc14a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc271c640 1 -- 172.21.15.12:0/3424170103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbbc0b3f70 msgr2=0x7fcbbc151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:57.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.192+0000 7fcbc271c640 1 --2- 172.21.15.12:0/3424170103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbbc0b3f70 0x7fcbbc151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.196+0000 7fcbc271c640 1 -- 172.21.15.12:0/3424170103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac0094d0 con 0x7fcbbc0c12a0 2023-10-16T23:27:57.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.196+0000 7fcbc171a640 1 --2- 172.21.15.12:0/3424170103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbbc0b3f70 0x7fcbbc151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:57.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.196+0000 7fcbc1f1b640 1 --2- 172.21.15.12:0/3424170103 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcbbc070800 0x7fcbbc14a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:57.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.196+0000 7fcbc271c640 1 --2- 172.21.15.12:0/3424170103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbbc0c12a0 0x7fcbbc0b6e70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4007e90 tx=0x7fcbb400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:57.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.196+0000 7fcbb27fc640 1 -- 172.21.15.12:0/3424170103 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb4014420 con 0x7fcbbc0c12a0 2023-10-16T23:27:57.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.196+0000 7fcbb27fc640 1 -- 172.21.15.12:0/3424170103 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb40145a0 con 0x7fcbbc0c12a0 2023-10-16T23:27:57.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.196+0000 7fcbb27fc640 1 -- 172.21.15.12:0/3424170103 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb4014950 con 0x7fcbbc0c12a0 2023-10-16T23:27:57.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.196+0000 7fcbc417f640 1 -- 172.21.15.12:0/3424170103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbbc0bbd70 con 0x7fcbbc0c12a0 2023-10-16T23:27:57.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.196+0000 7fcbc417f640 1 -- 172.21.15.12:0/3424170103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbbc14ac10 con 0x7fcbbc0c12a0 2023-10-16T23:27:57.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.196+0000 7fcbc417f640 1 -- 172.21.15.12:0/3424170103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbbc14aec0 con 0x7fcbbc0c12a0 2023-10-16T23:27:57.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.196+0000 7fcbb27fc640 1 -- 172.21.15.12:0/3424170103 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fcbb4014ab0 con 0x7fcbbc0c12a0 2023-10-16T23:27:57.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.196+0000 7fcbb27fc640 1 --2- 172.21.15.12:0/3424170103 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fcba0065e60 0x7fcba0068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:57.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.196+0000 7fcbb27fc640 1 -- 172.21.15.12:0/3424170103 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcbb4084160 con 0x7fcbbc0c12a0 2023-10-16T23:27:57.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.196+0000 7fcbc1f1b640 1 --2- 172.21.15.12:0/3424170103 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fcba0065e60 0x7fcba0068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:57.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.196+0000 7fcbc1f1b640 1 --2- 172.21.15.12:0/3424170103 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fcba0065e60 0x7fcba0068320 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcbb80097a0 tx=0x7fcbb8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:57.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.200+0000 7fcbb27fc640 1 -- 172.21.15.12:0/3424170103 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fcbbc14aec0 con 0x7fcbbc0c12a0 2023-10-16T23:27:57.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.352+0000 7fcbc417f640 1 -- 172.21.15.12:0/3424170103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcbbc14aec0 con 0x7fcbbc0c12a0 2023-10-16T23:27:57.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.352+0000 7fcbb27fc640 1 -- 172.21.15.12:0/3424170103 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcbbc14aec0 con 0x7fcbbc0c12a0 2023-10-16T23:27:57.357 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-16T23:27:57.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.356+0000 7fcbc417f640 1 -- 172.21.15.12:0/3424170103 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fcba0065e60 msgr2=0x7fcba0068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:57.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.356+0000 7fcbc417f640 1 --2- 172.21.15.12:0/3424170103 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fcba0065e60 0x7fcba0068320 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcbb80097a0 tx=0x7fcbb8008040 comp rx=0 tx=0).stop 2023-10-16T23:27:57.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.356+0000 7fcbc417f640 1 -- 172.21.15.12:0/3424170103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbbc0c12a0 msgr2=0x7fcbbc0b6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:57.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.356+0000 7fcbc417f640 1 --2- 172.21.15.12:0/3424170103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbbc0c12a0 0x7fcbbc0b6e70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4007e90 tx=0x7fcbb400e4b0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.356+0000 7fcbc417f640 1 -- 172.21.15.12:0/3424170103 shutdown_connections 2023-10-16T23:27:57.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.356+0000 7fcbc417f640 1 --2- 172.21.15.12:0/3424170103 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fcba0065e60 0x7fcba0068320 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.356+0000 7fcbc417f640 1 --2- 172.21.15.12:0/3424170103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbbc0c12a0 0x7fcbbc0b6e70 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.356+0000 7fcbc417f640 1 --2- 172.21.15.12:0/3424170103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbbc0b3f70 0x7fcbbc151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.356+0000 7fcbc417f640 1 --2- 172.21.15.12:0/3424170103 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcbbc070800 0x7fcbbc14a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.356+0000 7fcbc417f640 1 -- 172.21.15.12:0/3424170103 >> 172.21.15.12:0/3424170103 conn(0x7fcbbc06bb10 msgr2=0x7fcbbc148420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:57.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.356+0000 7fcbc417f640 1 -- 172.21.15.12:0/3424170103 shutdown_connections 2023-10-16T23:27:57.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.356+0000 7fcbc417f640 1 -- 172.21.15.12:0/3424170103 wait complete. 2023-10-16T23:27:57.374 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T23:27:57.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.500+0000 7f7367eb5640 1 Processor -- start 2023-10-16T23:27:57.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.500+0000 7f7367eb5640 1 -- start start 2023-10-16T23:27:57.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.500+0000 7f7367eb5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73600c12a0 0x7f73600bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:57.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.500+0000 7f7367eb5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7360070800 0x7f736014e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:57.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.500+0000 7f7367eb5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f73600b3f70 0x7f736014ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:57.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.500+0000 7f7367eb5640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f736014f3d0 con 0x7f73600b3f70 2023-10-16T23:27:57.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.500+0000 7f7367eb5640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7360153580 con 0x7f7360070800 2023-10-16T23:27:57.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.500+0000 7f7367eb5640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7360153860 con 0x7f73600c12a0 2023-10-16T23:27:57.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.500+0000 7f7366452640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f73600b3f70 0x7f736014ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:57.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.500+0000 7f7366452640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f73600b3f70 0x7f736014ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56114/0 (socket says 172.21.15.12:56114) 2023-10-16T23:27:57.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.500+0000 7f7366452640 1 -- 172.21.15.12:0/3699897772 learned_addr learned my addr 172.21.15.12:0/3699897772 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:57.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.500+0000 7f7365c51640 1 --2- 172.21.15.12:0/3699897772 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73600c12a0 0x7f73600bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:57.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.500+0000 7f7365450640 1 --2- 172.21.15.12:0/3699897772 >> v2:172.21.15.31:3300/0 conn(0x7f7360070800 0x7f736014e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:57.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.500+0000 7f7366452640 1 -- 172.21.15.12:0/3699897772 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73600c12a0 msgr2=0x7f73600bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:57.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.500+0000 7f7366452640 1 --2- 172.21.15.12:0/3699897772 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73600c12a0 0x7f73600bcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.500+0000 7f7366452640 1 -- 172.21.15.12:0/3699897772 >> v2:172.21.15.31:3300/0 conn(0x7f7360070800 msgr2=0x7f736014e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:57.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.500+0000 7f7366452640 1 --2- 172.21.15.12:0/3699897772 >> v2:172.21.15.31:3300/0 conn(0x7f7360070800 0x7f736014e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.500+0000 7f7366452640 1 -- 172.21.15.12:0/3699897772 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73600c1680 con 0x7f73600b3f70 2023-10-16T23:27:57.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7366452640 1 --2- 172.21.15.12:0/3699897772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73600b3f70 0x7f736014ee90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f736006b0a0 tx=0x7f735c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e4750c29f042a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:57.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7364c4f640 1 -- 172.21.15.12:0/3699897772 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c0ab600 con 0x7f73600b3f70 2023-10-16T23:27:57.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7364c4f640 1 -- 172.21.15.12:0/3699897772 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735c0a7050 con 0x7f73600b3f70 2023-10-16T23:27:57.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7364c4f640 1 -- 172.21.15.12:0/3699897772 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c0ab980 con 0x7f73600b3f70 2023-10-16T23:27:57.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7367eb5640 1 -- 172.21.15.12:0/3699897772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73600b3f70 msgr2=0x7f736014ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:57.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7367eb5640 1 --2- 172.21.15.12:0/3699897772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73600b3f70 0x7f736014ee90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f736006b0a0 tx=0x7f735c01c500 comp rx=0 tx=0).stop 2023-10-16T23:27:57.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7367eb5640 1 -- 172.21.15.12:0/3699897772 shutdown_connections 2023-10-16T23:27:57.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7367eb5640 1 --2- 172.21.15.12:0/3699897772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73600b3f70 0x7f736014ee90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7367eb5640 1 --2- 172.21.15.12:0/3699897772 >> v2:172.21.15.31:3300/0 conn(0x7f7360070800 0x7f736014e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7367eb5640 1 --2- 172.21.15.12:0/3699897772 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73600c12a0 0x7f73600bcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7367eb5640 1 -- 172.21.15.12:0/3699897772 >> 172.21.15.12:0/3699897772 conn(0x7f736006bb10 msgr2=0x7f73600c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:57.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7367eb5640 1 -- 172.21.15.12:0/3699897772 shutdown_connections 2023-10-16T23:27:57.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7367eb5640 1 -- 172.21.15.12:0/3699897772 wait complete. 2023-10-16T23:27:57.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7367eb5640 1 Processor -- start 2023-10-16T23:27:57.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7367eb5640 1 -- start start 2023-10-16T23:27:57.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7367eb5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7360070800 0x7f7360143470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:57.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7367eb5640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73600b3f70 0x7f73600b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:57.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7367eb5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73600c12a0 0x7f73600b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:57.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7367eb5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73600b54a0 con 0x7f7360070800 2023-10-16T23:27:57.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7367eb5640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73601418b0 con 0x7f73600c12a0 2023-10-16T23:27:57.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7367eb5640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7360153100 con 0x7f73600b3f70 2023-10-16T23:27:57.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7365c51640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7360070800 0x7f7360143470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:57.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7365c51640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7360070800 0x7f7360143470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56124/0 (socket says 172.21.15.12:56124) 2023-10-16T23:27:57.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7365c51640 1 -- 172.21.15.12:0/3365350952 learned_addr learned my addr 172.21.15.12:0/3365350952 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:57.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7365450640 1 --2- 172.21.15.12:0/3365350952 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73600b3f70 0x7f73600b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:57.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7366452640 1 --2- 172.21.15.12:0/3365350952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73600c12a0 0x7f73600b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:57.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7365c51640 1 -- 172.21.15.12:0/3365350952 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73600b3f70 msgr2=0x7f73600b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:57.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7365c51640 1 --2- 172.21.15.12:0/3365350952 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73600b3f70 0x7f73600b4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7365c51640 1 -- 172.21.15.12:0/3365350952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73600c12a0 msgr2=0x7f73600b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:57.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.504+0000 7f7365c51640 1 --2- 172.21.15.12:0/3365350952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73600c12a0 0x7f73600b4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.508+0000 7f7365c51640 1 -- 172.21.15.12:0/3365350952 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735c0094d0 con 0x7f7360070800 2023-10-16T23:27:57.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.508+0000 7f7366452640 1 --2- 172.21.15.12:0/3365350952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73600c12a0 0x7f73600b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:57.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.508+0000 7f7365c51640 1 --2- 172.21.15.12:0/3365350952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7360070800 0x7f7360143470 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7358007e70 tx=0x7f735800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:57.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.508+0000 7f73567fc640 1 -- 172.21.15.12:0/3365350952 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7358014420 con 0x7f7360070800 2023-10-16T23:27:57.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.508+0000 7f73567fc640 1 -- 172.21.15.12:0/3365350952 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7358014580 con 0x7f7360070800 2023-10-16T23:27:57.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.508+0000 7f73567fc640 1 -- 172.21.15.12:0/3365350952 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7358014930 con 0x7f7360070800 2023-10-16T23:27:57.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.508+0000 7f7367eb5640 1 -- 172.21.15.12:0/3365350952 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73600b6cf0 con 0x7f7360070800 2023-10-16T23:27:57.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.508+0000 7f7367eb5640 1 -- 172.21.15.12:0/3365350952 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73600b6f60 con 0x7f7360070800 2023-10-16T23:27:57.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.508+0000 7f7367eb5640 1 -- 172.21.15.12:0/3365350952 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73601439b0 con 0x7f7360070800 2023-10-16T23:27:57.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.508+0000 7f73567fc640 1 -- 172.21.15.12:0/3365350952 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f7358014a90 con 0x7f7360070800 2023-10-16T23:27:57.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.508+0000 7f73567fc640 1 --2- 172.21.15.12:0/3365350952 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7344065e90 0x7f7344068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:57.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.508+0000 7f73567fc640 1 -- 172.21.15.12:0/3365350952 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f73580840b0 con 0x7f7360070800 2023-10-16T23:27:57.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.508+0000 7f7365450640 1 --2- 172.21.15.12:0/3365350952 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7344065e90 0x7f7344068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:57.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.508+0000 7f7365450640 1 --2- 172.21.15.12:0/3365350952 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7344065e90 0x7f7344068350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7360152130 tx=0x7f7350008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:57.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.512+0000 7f73567fc640 1 -- 172.21.15.12:0/3365350952 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f73580516f0 con 0x7f7360070800 2023-10-16T23:27:57.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.668+0000 7f7367eb5640 1 -- 172.21.15.12:0/3365350952 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f73600673a0 con 0x7f7360070800 2023-10-16T23:27:57.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.668+0000 7f73567fc640 1 -- 172.21.15.12:0/3365350952 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7358054d10 con 0x7f7360070800 2023-10-16T23:27:57.672 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-16T23:27:57.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.672+0000 7f7367eb5640 1 -- 172.21.15.12:0/3365350952 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7344065e90 msgr2=0x7f7344068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:57.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.672+0000 7f7367eb5640 1 --2- 172.21.15.12:0/3365350952 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7344065e90 0x7f7344068350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7360152130 tx=0x7f7350008040 comp rx=0 tx=0).stop 2023-10-16T23:27:57.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.672+0000 7f7367eb5640 1 -- 172.21.15.12:0/3365350952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7360070800 msgr2=0x7f7360143470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:57.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.672+0000 7f7367eb5640 1 --2- 172.21.15.12:0/3365350952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7360070800 0x7f7360143470 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7358007e70 tx=0x7f735800e4b0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.672+0000 7f7367eb5640 1 -- 172.21.15.12:0/3365350952 shutdown_connections 2023-10-16T23:27:57.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.672+0000 7f7367eb5640 1 --2- 172.21.15.12:0/3365350952 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7344065e90 0x7f7344068350 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.672+0000 7f7367eb5640 1 --2- 172.21.15.12:0/3365350952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73600c12a0 0x7f73600b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.672+0000 7f7367eb5640 1 --2- 172.21.15.12:0/3365350952 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f73600b3f70 0x7f73600b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.672+0000 7f7367eb5640 1 --2- 172.21.15.12:0/3365350952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7360070800 0x7f7360143470 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.672+0000 7f7367eb5640 1 -- 172.21.15.12:0/3365350952 >> 172.21.15.12:0/3365350952 conn(0x7f736006bb10 msgr2=0x7f7360146b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:57.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.672+0000 7f7367eb5640 1 -- 172.21.15.12:0/3365350952 shutdown_connections 2023-10-16T23:27:57.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.672+0000 7f7367eb5640 1 -- 172.21.15.12:0/3365350952 wait complete. 2023-10-16T23:27:57.689 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T23:27:57.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0b497c640 1 Processor -- start 2023-10-16T23:27:57.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0b497c640 1 -- start start 2023-10-16T23:27:57.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0b497c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe0b006e770 0x7fe0b00bb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:57.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0b497c640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b01533b0 con 0x7fe0b00ba440 2023-10-16T23:27:57.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0b497c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b00b3c50 con 0x7fe0b00c1130 2023-10-16T23:27:57.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0b497c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b00b3f30 con 0x7fe0b006e770 2023-10-16T23:27:57.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0aed9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe0b00ba440 0x7fe0b014fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38360/0 (socket says 172.21.15.12:38360) 2023-10-16T23:27:57.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0aed9d640 1 -- 172.21.15.12:0/439925704 learned_addr learned my addr 172.21.15.12:0/439925704 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:57.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0add9b640 1 --2- 172.21.15.12:0/439925704 >> v2:172.21.15.31:3300/0 conn(0x7fe0b006e770 0x7fe0b00bb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:57.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0ad59a640 1 -- 172.21.15.12:0/439925704 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955581407 0 0) 0x7fe0b01533b0 con 0x7fe0b00ba440 2023-10-16T23:27:57.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0ad59a640 1 -- 172.21.15.12:0/439925704 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe098003530 con 0x7fe0b00ba440 2023-10-16T23:27:57.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0ad59a640 1 -- 172.21.15.12:0/439925704 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3293937327 0 0) 0x7fe098003530 con 0x7fe0b00ba440 2023-10-16T23:27:57.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0ad59a640 1 -- 172.21.15.12:0/439925704 >> v2:172.21.15.31:3300/0 conn(0x7fe0b006e770 msgr2=0x7fe0b00bb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:57.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0ad59a640 1 --2- 172.21.15.12:0/439925704 >> v2:172.21.15.31:3300/0 conn(0x7fe0b006e770 0x7fe0b00bb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0ad59a640 1 -- 172.21.15.12:0/439925704 >> v1:172.21.15.31:6789/0 conn(0x7fe0b00c1130 legacy=0x7fe0b00bae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0ad59a640 1 -- 172.21.15.12:0/439925704 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b0153870 con 0x7fe0b00ba440 2023-10-16T23:27:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0ad59a640 1 -- 172.21.15.12:0/439925704 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7fe0a8001a00 con 0x7fe0b00ba440 2023-10-16T23:27:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0ad59a640 1 -- 172.21.15.12:0/439925704 >> v1:172.21.15.12:6789/0 conn(0x7fe0b00ba440 legacy=0x7fe0b014fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0ad59a640 1 --2- 172.21.15.12:0/439925704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe098003980 0x7fe098003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:57.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0ad59a640 1 --2- 172.21.15.12:0/439925704 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0980047d0 0x7fe098004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:57.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0ad59a640 1 --2- 172.21.15.12:0/439925704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe098005190 0x7fe09800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:57.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0ad59a640 1 -- 172.21.15.12:0/439925704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b00b3f30 con 0x7fe098003980 2023-10-16T23:27:57.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0ad59a640 1 -- 172.21.15.12:0/439925704 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09800c030 con 0x7fe098005190 2023-10-16T23:27:57.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0ad59a640 1 -- 172.21.15.12:0/439925704 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09800c1f0 con 0x7fe0980047d0 2023-10-16T23:27:57.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0ae59c640 1 --2- 172.21.15.12:0/439925704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe098003980 0x7fe098003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:57.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0aed9d640 1 --2- 172.21.15.12:0/439925704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe098005190 0x7fe09800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:57.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0add9b640 1 --2- 172.21.15.12:0/439925704 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0980047d0 0x7fe098004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:57.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0ae59c640 1 -- 172.21.15.12:0/439925704 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0980047d0 msgr2=0x7fe098004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:57.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0ae59c640 1 --2- 172.21.15.12:0/439925704 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0980047d0 0x7fe098004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0ae59c640 1 -- 172.21.15.12:0/439925704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe098005190 msgr2=0x7fe09800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:57.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0ae59c640 1 --2- 172.21.15.12:0/439925704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe098005190 0x7fe09800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0ae59c640 1 -- 172.21.15.12:0/439925704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe098003530 con 0x7fe098003980 2023-10-16T23:27:57.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0aed9d640 1 --2- 172.21.15.12:0/439925704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe098005190 0x7fe09800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:57.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.808+0000 7fe0aed9d640 1 -- 172.21.15.12:0/439925704 reap_dead start 2023-10-16T23:27:57.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.812+0000 7fe0ae59c640 1 --2- 172.21.15.12:0/439925704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe098003980 0x7fe098003da0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0001780 tx=0x7fe0a001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd1180649c019d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:57.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.812+0000 7fe0ad59a640 1 -- 172.21.15.12:0/439925704 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a00052d0 con 0x7fe098003980 2023-10-16T23:27:57.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.812+0000 7fe0ad59a640 1 -- 172.21.15.12:0/439925704 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a00a7050 con 0x7fe098003980 2023-10-16T23:27:57.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.812+0000 7fe0ad59a640 1 -- 172.21.15.12:0/439925704 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0003600 con 0x7fe098003980 2023-10-16T23:27:57.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.812+0000 7fe0b497c640 1 -- 172.21.15.12:0/439925704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe098003980 msgr2=0x7fe098003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:57.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.812+0000 7fe0b497c640 1 --2- 172.21.15.12:0/439925704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe098003980 0x7fe098003da0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0001780 tx=0x7fe0a001c3e0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.812+0000 7fe0b497c640 1 -- 172.21.15.12:0/439925704 shutdown_connections 2023-10-16T23:27:57.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.812+0000 7fe0b497c640 1 --2- 172.21.15.12:0/439925704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe098003980 0x7fe098003da0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.812+0000 7fe0b497c640 1 -- 172.21.15.12:0/439925704 >> 172.21.15.12:0/439925704 conn(0x7fe0b006ba20 msgr2=0x7fe0b00c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:57.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.812+0000 7fe0b497c640 1 -- 172.21.15.12:0/439925704 shutdown_connections 2023-10-16T23:27:57.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.812+0000 7fe0b497c640 1 -- 172.21.15.12:0/439925704 wait complete. 2023-10-16T23:27:57.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.812+0000 7fe0b497c640 1 Processor -- start 2023-10-16T23:27:57.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.812+0000 7fe0b497c640 1 -- start start 2023-10-16T23:27:57.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe0b497c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe098003980 0x7fe0b00b9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe0b497c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0b0149f30 0x7fe0b01491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe0b497c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0b00b6db0 0x7fe0b01dd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe0b497c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b0152030 con 0x7fe098003980 2023-10-16T23:27:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe0b497c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b014a410 con 0x7fe0b00b6db0 2023-10-16T23:27:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe0b497c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b014a9f0 con 0x7fe0b0149f30 2023-10-16T23:27:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe0ae59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe098003980 0x7fe0b00b9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe0ae59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe098003980 0x7fe0b00b9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56142/0 (socket says 172.21.15.12:56142) 2023-10-16T23:27:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe0ae59c640 1 -- 172.21.15.12:0/3295893932 learned_addr learned my addr 172.21.15.12:0/3295893932 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:57.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe0add9b640 1 --2- 172.21.15.12:0/3295893932 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0b0149f30 0x7fe0b01491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:57.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe0aed9d640 1 --2- 172.21.15.12:0/3295893932 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0b00b6db0 0x7fe0b01dd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:57.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe0ae59c640 1 -- 172.21.15.12:0/3295893932 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0b0149f30 msgr2=0x7fe0b01491a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:57.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe0ae59c640 1 --2- 172.21.15.12:0/3295893932 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0b0149f30 0x7fe0b01491a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe0ae59c640 1 -- 172.21.15.12:0/3295893932 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0b00b6db0 msgr2=0x7fe0b01dd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:57.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe0ae59c640 1 --2- 172.21.15.12:0/3295893932 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0b00b6db0 0x7fe0b01dd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe0ae59c640 1 -- 172.21.15.12:0/3295893932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b00bac30 con 0x7fe098003980 2023-10-16T23:27:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe0aed9d640 1 --2- 172.21.15.12:0/3295893932 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0b00b6db0 0x7fe0b01dd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe0ae59c640 1 --2- 172.21.15.12:0/3295893932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe098003980 0x7fe0b00b9ad0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe0a001c210 tx=0x7fe098005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe09effd640 1 -- 172.21.15.12:0/3295893932 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a00072f0 con 0x7fe098003980 2023-10-16T23:27:57.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe09effd640 1 -- 172.21.15.12:0/3295893932 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a0007450 con 0x7fe098003980 2023-10-16T23:27:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe09effd640 1 -- 172.21.15.12:0/3295893932 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a00067e0 con 0x7fe098003980 2023-10-16T23:27:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe0b497c640 1 -- 172.21.15.12:0/3295893932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b00ba010 con 0x7fe098003980 2023-10-16T23:27:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe0b497c640 1 -- 172.21.15.12:0/3295893932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b014ac40 con 0x7fe098003980 2023-10-16T23:27:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe0b497c640 1 -- 172.21.15.12:0/3295893932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b00673a0 con 0x7fe098003980 2023-10-16T23:27:57.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe09effd640 1 -- 172.21.15.12:0/3295893932 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fe0a0006940 con 0x7fe098003980 2023-10-16T23:27:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe09effd640 1 --2- 172.21.15.12:0/3295893932 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe090065e60 0x7fe090068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe09effd640 1 -- 172.21.15.12:0/3295893932 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe0a011d8b0 con 0x7fe098003980 2023-10-16T23:27:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.816+0000 7fe0add9b640 1 --2- 172.21.15.12:0/3295893932 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe090065e60 0x7fe090068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:57.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.820+0000 7fe0add9b640 1 --2- 172.21.15.12:0/3295893932 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe090065e60 0x7fe090068320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0151900 tx=0x7fe0a4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:57.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:57.820+0000 7fe09effd640 1 -- 172.21.15.12:0/3295893932 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fe0a00eea00 con 0x7fe098003980 2023-10-16T23:27:58.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.008+0000 7fe0b497c640 1 -- 172.21.15.12:0/3295893932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0b00ba200 con 0x7fe098003980 2023-10-16T23:27:58.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.008+0000 7fe09effd640 1 -- 172.21.15.12:0/3295893932 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3127 (secure 0 0 0) 0x7fe0a00b8c50 con 0x7fe098003980 2023-10-16T23:27:58.012 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:58.013 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3365013557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3365013557},{"type":"v1","addr":"172.21.15.31:6835","nonce":3365013557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T23:27:40.686789+0000","modified":"2023-10-16T23:27:43.696789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6833/593938276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":593938276},{"type":"v1","addr":"172.21.15.12:6833","nonce":593938276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T23:27:58.013 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2023-10-16T23:27:58.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.012+0000 7fe0b497c640 1 -- 172.21.15.12:0/3295893932 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe090065e60 msgr2=0x7fe090068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:58.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.012+0000 7fe0b497c640 1 --2- 172.21.15.12:0/3295893932 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe090065e60 0x7fe090068320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0151900 tx=0x7fe0a4008040 comp rx=0 tx=0).stop 2023-10-16T23:27:58.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.012+0000 7fe0b497c640 1 -- 172.21.15.12:0/3295893932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe098003980 msgr2=0x7fe0b00b9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:58.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.012+0000 7fe0b497c640 1 --2- 172.21.15.12:0/3295893932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe098003980 0x7fe0b00b9ad0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe0a001c210 tx=0x7fe098005800 comp rx=0 tx=0).stop 2023-10-16T23:27:58.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.012+0000 7fe0b497c640 1 -- 172.21.15.12:0/3295893932 shutdown_connections 2023-10-16T23:27:58.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.012+0000 7fe0b497c640 1 --2- 172.21.15.12:0/3295893932 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe090065e60 0x7fe090068320 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.012+0000 7fe0b497c640 1 --2- 172.21.15.12:0/3295893932 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0b00b6db0 0x7fe0b01dd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.012+0000 7fe0b497c640 1 --2- 172.21.15.12:0/3295893932 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0b0149f30 0x7fe0b01491a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.012+0000 7fe0b497c640 1 --2- 172.21.15.12:0/3295893932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe098003980 0x7fe0b00b9ad0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.012+0000 7fe0b497c640 1 -- 172.21.15.12:0/3295893932 >> 172.21.15.12:0/3295893932 conn(0x7fe0b006ba20 msgr2=0x7fe0b00c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:58.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.012+0000 7fe0b497c640 1 -- 172.21.15.12:0/3295893932 shutdown_connections 2023-10-16T23:27:58.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.012+0000 7fe0b497c640 1 -- 172.21.15.12:0/3295893932 wait complete. 2023-10-16T23:27:58.032 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T23:27:58.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.152+0000 7ff453364640 1 Processor -- start 2023-10-16T23:27:58.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff453364640 1 -- start start 2023-10-16T23:27:58.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff453364640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff44c0c1130 0x7ff44c0b8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:58.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff453364640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44c14d0c0 con 0x7ff44c0b9f40 2023-10-16T23:27:58.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff453364640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44c0b40c0 con 0x7ff44c14c520 2023-10-16T23:27:58.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff453364640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44c0b3ca0 con 0x7ff44c0c1130 2023-10-16T23:27:58.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff451901640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff44c0b9f40 0x7ff44c0ba370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45714/0 (socket says 172.21.15.12:45714) 2023-10-16T23:27:58.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff451901640 1 -- 172.21.15.12:0/1796842222 learned_addr learned my addr 172.21.15.12:0/1796842222 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:58.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff451100640 1 --2- 172.21.15.12:0/1796842222 >> v2:172.21.15.31:3300/0 conn(0x7ff44c0c1130 0x7ff44c0b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:58.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff443fff640 1 -- 172.21.15.12:0/1796842222 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822025692 0 0) 0x7ff44c14d0c0 con 0x7ff44c0b9f40 2023-10-16T23:27:58.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff443fff640 1 -- 172.21.15.12:0/1796842222 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff438003530 con 0x7ff44c0b9f40 2023-10-16T23:27:58.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff443fff640 1 -- 172.21.15.12:0/1796842222 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1562833540 0 0) 0x7ff438003530 con 0x7ff44c0b9f40 2023-10-16T23:27:58.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff443fff640 1 -- 172.21.15.12:0/1796842222 >> v2:172.21.15.31:3300/0 conn(0x7ff44c0c1130 msgr2=0x7ff44c0b8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:58.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff443fff640 1 --2- 172.21.15.12:0/1796842222 >> v2:172.21.15.31:3300/0 conn(0x7ff44c0c1130 0x7ff44c0b8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff443fff640 1 -- 172.21.15.12:0/1796842222 >> v1:172.21.15.31:6789/0 conn(0x7ff44c14c520 legacy=0x7ff44c14c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:58.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff443fff640 1 -- 172.21.15.12:0/1796842222 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44c0b7ce0 con 0x7ff44c0b9f40 2023-10-16T23:27:58.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff443fff640 1 -- 172.21.15.12:0/1796842222 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7ff444001a00 con 0x7ff44c0b9f40 2023-10-16T23:27:58.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff443fff640 1 -- 172.21.15.12:0/1796842222 >> v1:172.21.15.12:6789/0 conn(0x7ff44c0b9f40 legacy=0x7ff44c0ba370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:58.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff443fff640 1 --2- 172.21.15.12:0/1796842222 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff438003980 0x7ff438003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:58.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff443fff640 1 --2- 172.21.15.12:0/1796842222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4380047d0 0x7ff438004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:58.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff443fff640 1 --2- 172.21.15.12:0/1796842222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4380052b0 0x7ff43800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:58.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff443fff640 1 -- 172.21.15.12:0/1796842222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c0b3ca0 con 0x7ff4380047d0 2023-10-16T23:27:58.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff443fff640 1 -- 172.21.15.12:0/1796842222 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43800c180 con 0x7ff4380052b0 2023-10-16T23:27:58.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff443fff640 1 -- 172.21.15.12:0/1796842222 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff43800c340 con 0x7ff438003980 2023-10-16T23:27:58.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff4508ff640 1 --2- 172.21.15.12:0/1796842222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4380047d0 0x7ff438004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:58.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff451100640 1 --2- 172.21.15.12:0/1796842222 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff438003980 0x7ff438003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:58.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff451901640 1 --2- 172.21.15.12:0/1796842222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4380052b0 0x7ff43800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:58.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff4508ff640 1 -- 172.21.15.12:0/1796842222 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff438003980 msgr2=0x7ff438003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:58.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff4508ff640 1 --2- 172.21.15.12:0/1796842222 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff438003980 0x7ff438003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff4508ff640 1 -- 172.21.15.12:0/1796842222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4380052b0 msgr2=0x7ff43800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:58.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff4508ff640 1 --2- 172.21.15.12:0/1796842222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4380052b0 0x7ff43800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff451901640 1 -- 172.21.15.12:0/1796842222 reap_dead start 2023-10-16T23:27:58.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff4508ff640 1 -- 172.21.15.12:0/1796842222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff438003530 con 0x7ff4380047d0 2023-10-16T23:27:58.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.156+0000 7ff451100640 1 --2- 172.21.15.12:0/1796842222 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff438003980 0x7ff438003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:58.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff4508ff640 1 --2- 172.21.15.12:0/1796842222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4380047d0 0x7ff438004c50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff43c001750 tx=0x7ff43c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9f7d6277471ad1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:58.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff443fff640 1 -- 172.21.15.12:0/1796842222 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c0052d0 con 0x7ff4380047d0 2023-10-16T23:27:58.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff443fff640 1 -- 172.21.15.12:0/1796842222 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43c0a7050 con 0x7ff4380047d0 2023-10-16T23:27:58.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff443fff640 1 -- 172.21.15.12:0/1796842222 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c003600 con 0x7ff4380047d0 2023-10-16T23:27:58.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff453364640 1 -- 172.21.15.12:0/1796842222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4380047d0 msgr2=0x7ff438004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:58.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff453364640 1 --2- 172.21.15.12:0/1796842222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4380047d0 0x7ff438004c50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff43c001750 tx=0x7ff43c01c3a0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff453364640 1 -- 172.21.15.12:0/1796842222 shutdown_connections 2023-10-16T23:27:58.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff453364640 1 --2- 172.21.15.12:0/1796842222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4380047d0 0x7ff438004c50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff453364640 1 -- 172.21.15.12:0/1796842222 >> 172.21.15.12:0/1796842222 conn(0x7ff44c06ba20 msgr2=0x7ff44c0c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:58.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff453364640 1 -- 172.21.15.12:0/1796842222 shutdown_connections 2023-10-16T23:27:58.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff453364640 1 -- 172.21.15.12:0/1796842222 wait complete. 2023-10-16T23:27:58.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff453364640 1 Processor -- start 2023-10-16T23:27:58.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff453364640 1 -- start start 2023-10-16T23:27:58.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff453364640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4380047d0 0x7ff44c142c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:58.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff453364640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff44c147210 0x7ff44c1e90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:58.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff453364640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff44c0b6720 0x7ff44c14fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:58.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff453364640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c147900 con 0x7ff4380047d0 2023-10-16T23:27:58.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff453364640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c151680 con 0x7ff44c0b6720 2023-10-16T23:27:58.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff453364640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c1431b0 con 0x7ff44c147210 2023-10-16T23:27:58.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff451100640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4380047d0 0x7ff44c142c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:58.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff451100640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4380047d0 0x7ff44c142c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41508/0 (socket says 172.21.15.12:41508) 2023-10-16T23:27:58.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff451100640 1 -- 172.21.15.12:0/3766406264 learned_addr learned my addr 172.21.15.12:0/3766406264 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:58.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff4508ff640 1 --2- 172.21.15.12:0/3766406264 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff44c147210 0x7ff44c1e90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:58.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff451901640 1 --2- 172.21.15.12:0/3766406264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff44c0b6720 0x7ff44c14fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:58.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff451100640 1 -- 172.21.15.12:0/3766406264 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff44c147210 msgr2=0x7ff44c1e90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:58.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff451100640 1 --2- 172.21.15.12:0/3766406264 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff44c147210 0x7ff44c1e90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff451100640 1 -- 172.21.15.12:0/3766406264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff44c0b6720 msgr2=0x7ff44c14fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:58.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff451100640 1 --2- 172.21.15.12:0/3766406264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff44c0b6720 0x7ff44c14fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff451100640 1 -- 172.21.15.12:0/3766406264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44c0b8480 con 0x7ff4380047d0 2023-10-16T23:27:58.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff451100640 1 --2- 172.21.15.12:0/3766406264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4380047d0 0x7ff44c142c70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff4480107f0 tx=0x7ff448010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:58.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.160+0000 7ff441ffb640 1 -- 172.21.15.12:0/3766406264 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff448004220 con 0x7ff4380047d0 2023-10-16T23:27:58.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.164+0000 7ff441ffb640 1 -- 172.21.15.12:0/3766406264 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff448004380 con 0x7ff4380047d0 2023-10-16T23:27:58.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.164+0000 7ff453364640 1 -- 172.21.15.12:0/3766406264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff44c1e9620 con 0x7ff4380047d0 2023-10-16T23:27:58.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.164+0000 7ff441ffb640 1 -- 172.21.15.12:0/3766406264 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44800eb20 con 0x7ff4380047d0 2023-10-16T23:27:58.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.164+0000 7ff453364640 1 -- 172.21.15.12:0/3766406264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff44c151160 con 0x7ff4380047d0 2023-10-16T23:27:58.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.164+0000 7ff453364640 1 -- 172.21.15.12:0/3766406264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff44c0673a0 con 0x7ff4380047d0 2023-10-16T23:27:58.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.164+0000 7ff441ffb640 1 -- 172.21.15.12:0/3766406264 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7ff44800ec80 con 0x7ff4380047d0 2023-10-16T23:27:58.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.164+0000 7ff441ffb640 1 --2- 172.21.15.12:0/3766406264 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7ff430065e60 0x7ff430068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:58.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.164+0000 7ff441ffb640 1 -- 172.21.15.12:0/3766406264 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff448083860 con 0x7ff4380047d0 2023-10-16T23:27:58.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.164+0000 7ff4508ff640 1 --2- 172.21.15.12:0/3766406264 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7ff430065e60 0x7ff430068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:58.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.164+0000 7ff4508ff640 1 --2- 172.21.15.12:0/3766406264 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7ff430065e60 0x7ff430068320 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff4380057b0 tx=0x7ff43c0011a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:58.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.168+0000 7ff441ffb640 1 -- 172.21.15.12:0/3766406264 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7ff448050f40 con 0x7ff4380047d0 2023-10-16T23:27:58.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.324+0000 7ff453364640 1 -- 172.21.15.12:0/3766406264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff44c0c0090 con 0x7ff4380047d0 2023-10-16T23:27:58.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.324+0000 7ff441ffb640 1 -- 172.21.15.12:0/3766406264 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17763 (secure 0 0 0) 0x7ff4480044f0 con 0x7ff4380047d0 2023-10-16T23:27:58.327 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:58.328 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"fsid":"0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51","created":"2023-10-16T23:27:16.468087+0000","modified":"2023-10-16T23:27:41.690088+0000","last_up_change":"2023-10-16T23:27:28.136202+0000","last_in_change":"2023-10-16T23:27:18.793212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T23:27:27.354025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-16T23:27:34.786446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-16T23:27:39.130341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-16T23:27:39.674572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73e70f98-6f5e-4464-b34e-931faac41cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":38075},{"type":"v1","addr":"172.21.15.12:6814","nonce":38075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":38075},{"type":"v1","addr":"172.21.15.12:6819","nonce":38075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":38075},{"type":"v1","addr":"172.21.15.12:6827","nonce":38075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":38075},{"type":"v1","addr":"172.21.15.12:6823","nonce":38075}]},"public_addr":"172.21.15.12:6814/38075","cluster_addr":"172.21.15.12:6819/38075","heartbeat_back_addr":"172.21.15.12:6827/38075","heartbeat_front_addr":"172.21.15.12:6823/38075","state":["exists","up"]},{"osd":1,"uuid":"ff722efe-b3f9-4cc0-bbde-f4d4d8055a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":38076},{"type":"v1","addr":"172.21.15.12:6811","nonce":38076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":38076},{"type":"v1","addr":"172.21.15.12:6818","nonce":38076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":38076},{"type":"v1","addr":"172.21.15.12:6831","nonce":38076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":38076},{"type":"v1","addr":"172.21.15.12:6825","nonce":38076}]},"public_addr":"172.21.15.12:6811/38076","cluster_addr":"172.21.15.12:6818/38076","heartbeat_back_addr":"172.21.15.12:6831/38076","heartbeat_front_addr":"172.21.15.12:6825/38076","state":["exists","up"]},{"osd":2,"uuid":"9baf25db-dce0-4065-90d6-f35867286be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6809","nonce":38073},{"type":"v1","addr":"172.21.15.12:6810","nonce":38073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":38073},{"type":"v1","addr":"172.21.15.12:6817","nonce":38073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":38073},{"type":"v1","addr":"172.21.15.12:6830","nonce":38073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":38073},{"type":"v1","addr":"172.21.15.12:6826","nonce":38073}]},"public_addr":"172.21.15.12:6810/38073","cluster_addr":"172.21.15.12:6817/38073","heartbeat_back_addr":"172.21.15.12:6830/38073","heartbeat_front_addr":"172.21.15.12:6826/38073","state":["exists","up"]},{"osd":3,"uuid":"8a620ad3-2294-470d-8a8c-66f177f5fbe7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":38074},{"type":"v1","addr":"172.21.15.12:6801","nonce":38074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":38074},{"type":"v1","addr":"172.21.15.12:6803","nonce":38074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":38074},{"type":"v1","addr":"172.21.15.12:6807","nonce":38074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":38074},{"type":"v1","addr":"172.21.15.12:6805","nonce":38074}]},"public_addr":"172.21.15.12:6801/38074","cluster_addr":"172.21.15.12:6803/38074","heartbeat_back_addr":"172.21.15.12:6807/38074","heartbeat_front_addr":"172.21.15.12:6805/38074","state":["exists","up"]},{"osd":4,"uuid":"a8824d77-7405-40f5-9234-60889802b184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":38266},{"type":"v1","addr":"172.21.15.31:6817","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":38266},{"type":"v1","addr":"172.21.15.31:6819","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":38266},{"type":"v1","addr":"172.21.15.31:6823","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":38266},{"type":"v1","addr":"172.21.15.31:6821","nonce":38266}]},"public_addr":"172.21.15.31:6817/38266","cluster_addr":"172.21.15.31:6819/38266","heartbeat_back_addr":"172.21.15.31:6823/38266","heartbeat_front_addr":"172.21.15.31:6821/38266","state":["exists","up"]},{"osd":5,"uuid":"3bb01192-a47c-48e9-9662-285e3f6f4b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":38264},{"type":"v1","addr":"172.21.15.31:6807","nonce":38264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":38264},{"type":"v1","addr":"172.21.15.31:6811","nonce":38264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":38264},{"type":"v1","addr":"172.21.15.31:6815","nonce":38264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":38264},{"type":"v1","addr":"172.21.15.31:6813","nonce":38264}]},"public_addr":"172.21.15.31:6807/38264","cluster_addr":"172.21.15.31:6811/38264","heartbeat_back_addr":"172.21.15.31:6815/38264","heartbeat_front_addr":"172.21.15.31:6813/38264","state":["exists","up"]},{"osd":6,"uuid":"1e2d18e4-73e6-4a37-826c-35eca4d96935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":38263},{"type":"v1","addr":"172.21.15.31:6825","nonce":38263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":38263},{"type":"v1","addr":"172.21.15.31:6827","nonce":38263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":38263},{"type":"v1","addr":"172.21.15.31:6831","nonce":38263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":38263},{"type":"v1","addr":"172.21.15.31:6829","nonce":38263}]},"public_addr":"172.21.15.31:6825/38263","cluster_addr":"172.21.15.31:6827/38263","heartbeat_back_addr":"172.21.15.31:6831/38263","heartbeat_front_addr":"172.21.15.31:6829/38263","state":["exists","up"]},{"osd":7,"uuid":"e0f369c0-562b-4440-a5aa-12275c29412b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":38265},{"type":"v1","addr":"172.21.15.31:6801","nonce":38265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":38265},{"type":"v1","addr":"172.21.15.31:6803","nonce":38265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":38265},{"type":"v1","addr":"172.21.15.31:6810","nonce":38265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":38265},{"type":"v1","addr":"172.21.15.31:6806","nonce":38265}]},"public_addr":"172.21.15.31:6801/38265","cluster_addr":"172.21.15.31:6803/38265","heartbeat_back_addr":"172.21.15.31:6810/38265","heartbeat_front_addr":"172.21.15.31:6806/38265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.411815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.372565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.209700+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.414619+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.316843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.300348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.359800+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.219854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T23:27:58.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.328+0000 7ff453364640 1 -- 172.21.15.12:0/3766406264 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7ff430065e60 msgr2=0x7ff430068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:58.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.328+0000 7ff453364640 1 --2- 172.21.15.12:0/3766406264 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7ff430065e60 0x7ff430068320 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff4380057b0 tx=0x7ff43c0011a0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.328+0000 7ff453364640 1 -- 172.21.15.12:0/3766406264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4380047d0 msgr2=0x7ff44c142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:58.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.328+0000 7ff453364640 1 --2- 172.21.15.12:0/3766406264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4380047d0 0x7ff44c142c70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff4480107f0 tx=0x7ff448010cb0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.328+0000 7ff453364640 1 -- 172.21.15.12:0/3766406264 shutdown_connections 2023-10-16T23:27:58.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.328+0000 7ff453364640 1 --2- 172.21.15.12:0/3766406264 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7ff430065e60 0x7ff430068320 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.328+0000 7ff453364640 1 --2- 172.21.15.12:0/3766406264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff44c0b6720 0x7ff44c14fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.328+0000 7ff453364640 1 --2- 172.21.15.12:0/3766406264 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff44c147210 0x7ff44c1e90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.328+0000 7ff453364640 1 --2- 172.21.15.12:0/3766406264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4380047d0 0x7ff44c142c70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.328+0000 7ff453364640 1 -- 172.21.15.12:0/3766406264 >> 172.21.15.12:0/3766406264 conn(0x7ff44c06ba20 msgr2=0x7ff44c14b190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:58.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.328+0000 7ff453364640 1 -- 172.21.15.12:0/3766406264 shutdown_connections 2023-10-16T23:27:58.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.328+0000 7ff453364640 1 -- 172.21.15.12:0/3766406264 wait complete. 2023-10-16T23:27:58.347 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T23:27:58.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.464+0000 7f4daf804640 1 Processor -- start 2023-10-16T23:27:58.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.464+0000 7f4daf804640 1 -- start start 2023-10-16T23:27:58.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.464+0000 7f4daf804640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4da80c1130 0x7f4da80bae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:58.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.464+0000 7f4daf804640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4da806e770 0x7f4da80bb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:58.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.464+0000 7f4daf804640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da81533b0 con 0x7f4da80ba440 2023-10-16T23:27:58.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.464+0000 7f4daf804640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da80b3c50 con 0x7f4da80c1130 2023-10-16T23:27:58.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.464+0000 7f4daf804640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da80b3f30 con 0x7f4da806e770 2023-10-16T23:27:58.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.464+0000 7f4dad5a0640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4da80c1130 0x7f4da80bae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:58.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.464+0000 7f4dadda1640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4da80ba440 0x7f4da814ea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45716/0 (socket says 172.21.15.12:45716) 2023-10-16T23:27:58.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.464+0000 7f4dadda1640 1 -- 172.21.15.12:0/383865012 learned_addr learned my addr 172.21.15.12:0/383865012 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:58.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.464+0000 7f4dacd9f640 1 --2- 172.21.15.12:0/383865012 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4da806e770 0x7f4da80bb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:58.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.464+0000 7f4dad5a0640 1 -- 172.21.15.12:0/383865012 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4da806e770 msgr2=0x7f4da80bb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:58.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.464+0000 7f4dad5a0640 1 --2- 172.21.15.12:0/383865012 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4da806e770 0x7f4da80bb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.464+0000 7f4dad5a0640 1 -- 172.21.15.12:0/383865012 >> v1:172.21.15.12:6789/0 conn(0x7f4da80ba440 legacy=0x7f4da814ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:58.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.464+0000 7f4dad5a0640 1 -- 172.21.15.12:0/383865012 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da8153870 con 0x7f4da80c1130 2023-10-16T23:27:58.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4dad5a0640 1 --2- 172.21.15.12:0/383865012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4da80c1130 0x7f4da80bae10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4d980097c0 tx=0x7f4d9801c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d55b1ba54e136f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:58.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4d9ffff640 1 -- 172.21.15.12:0/383865012 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d980ab600 con 0x7f4da80c1130 2023-10-16T23:27:58.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4d9ffff640 1 -- 172.21.15.12:0/383865012 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d980a7050 con 0x7f4da80c1130 2023-10-16T23:27:58.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4d9ffff640 1 -- 172.21.15.12:0/383865012 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d980ab980 con 0x7f4da80c1130 2023-10-16T23:27:58.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4daf804640 1 -- 172.21.15.12:0/383865012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4da80c1130 msgr2=0x7f4da80bae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:58.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4daf804640 1 --2- 172.21.15.12:0/383865012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4da80c1130 0x7f4da80bae10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4d980097c0 tx=0x7f4d9801c310 comp rx=0 tx=0).stop 2023-10-16T23:27:58.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4daf804640 1 -- 172.21.15.12:0/383865012 shutdown_connections 2023-10-16T23:27:58.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4daf804640 1 --2- 172.21.15.12:0/383865012 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4da806e770 0x7f4da80bb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4daf804640 1 --2- 172.21.15.12:0/383865012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4da80c1130 0x7f4da80bae10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4daf804640 1 -- 172.21.15.12:0/383865012 >> 172.21.15.12:0/383865012 conn(0x7f4da806ba20 msgr2=0x7f4da80c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:58.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4daf804640 1 -- 172.21.15.12:0/383865012 shutdown_connections 2023-10-16T23:27:58.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4daf804640 1 -- 172.21.15.12:0/383865012 wait complete. 2023-10-16T23:27:58.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4daf804640 1 Processor -- start 2023-10-16T23:27:58.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4daf804640 1 -- start start 2023-10-16T23:27:58.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4daf804640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4da806e770 0x7f4da80b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:58.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4daf804640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4da80ba440 0x7f4da814acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:58.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4daf804640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4da80c1130 0x7f4da81511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:58.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4daf804640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da80b5c10 con 0x7f4da80ba440 2023-10-16T23:27:58.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4daf804640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da80b6f80 con 0x7f4da80c1130 2023-10-16T23:27:58.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4daf804640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da8149130 con 0x7f4da806e770 2023-10-16T23:27:58.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4dacd9f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4da80ba440 0x7f4da814acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:58.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4dacd9f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4da80ba440 0x7f4da814acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41516/0 (socket says 172.21.15.12:41516) 2023-10-16T23:27:58.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4dacd9f640 1 -- 172.21.15.12:0/3254741423 learned_addr learned my addr 172.21.15.12:0/3254741423 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:58.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4dad5a0640 1 --2- 172.21.15.12:0/3254741423 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4da806e770 0x7f4da80b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:58.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4dadda1640 1 --2- 172.21.15.12:0/3254741423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4da80c1130 0x7f4da81511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:58.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4dacd9f640 1 -- 172.21.15.12:0/3254741423 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4da806e770 msgr2=0x7f4da80b6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:58.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4dacd9f640 1 --2- 172.21.15.12:0/3254741423 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4da806e770 0x7f4da80b6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4dacd9f640 1 -- 172.21.15.12:0/3254741423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4da80c1130 msgr2=0x7f4da81511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:58.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4dacd9f640 1 --2- 172.21.15.12:0/3254741423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4da80c1130 0x7f4da81511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4dacd9f640 1 -- 172.21.15.12:0/3254741423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d98009420 con 0x7f4da80ba440 2023-10-16T23:27:58.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4dacd9f640 1 --2- 172.21.15.12:0/3254741423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4da80ba440 0x7f4da814acf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4da400d800 tx=0x7f4da400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:58.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.468+0000 7f4d9dffb640 1 -- 172.21.15.12:0/3254741423 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da400b6c0 con 0x7f4da80ba440 2023-10-16T23:27:58.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.472+0000 7f4d9dffb640 1 -- 172.21.15.12:0/3254741423 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da400b820 con 0x7f4da80ba440 2023-10-16T23:27:58.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.472+0000 7f4daf804640 1 -- 172.21.15.12:0/3254741423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da81e4120 con 0x7f4da80ba440 2023-10-16T23:27:58.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.472+0000 7f4d9dffb640 1 -- 172.21.15.12:0/3254741423 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da400bb90 con 0x7f4da80ba440 2023-10-16T23:27:58.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.472+0000 7f4daf804640 1 -- 172.21.15.12:0/3254741423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da8149380 con 0x7f4da80ba440 2023-10-16T23:27:58.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.472+0000 7f4daf804640 1 -- 172.21.15.12:0/3254741423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da80673a0 con 0x7f4da80ba440 2023-10-16T23:27:58.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.472+0000 7f4d9dffb640 1 -- 172.21.15.12:0/3254741423 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f4da400bcf0 con 0x7f4da80ba440 2023-10-16T23:27:58.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.472+0000 7f4d9dffb640 1 --2- 172.21.15.12:0/3254741423 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4d8c065e60 0x7f4d8c068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:58.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.472+0000 7f4d9dffb640 1 -- 172.21.15.12:0/3254741423 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4da4083d00 con 0x7f4da80ba440 2023-10-16T23:27:58.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.472+0000 7f4dad5a0640 1 --2- 172.21.15.12:0/3254741423 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4d8c065e60 0x7f4d8c068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:58.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.472+0000 7f4dad5a0640 1 --2- 172.21.15.12:0/3254741423 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4d8c065e60 0x7f4d8c068320 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4d980ad000 tx=0x7f4d98008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:58.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.476+0000 7f4d9dffb640 1 -- 172.21.15.12:0/3254741423 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f4da40513e0 con 0x7f4da80ba440 2023-10-16T23:27:58.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.660+0000 7f4daf804640 1 -- 172.21.15.12:0/3254741423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4da80ba200 con 0x7f4da80ba440 2023-10-16T23:27:58.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.660+0000 7f4d9dffb640 1 -- 172.21.15.12:0/3254741423 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3127 (secure 0 0 0) 0x7f4da4054a00 con 0x7f4da80ba440 2023-10-16T23:27:58.663 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:27:58.663 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3365013557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3365013557},{"type":"v1","addr":"172.21.15.31:6835","nonce":3365013557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T23:27:40.686789+0000","modified":"2023-10-16T23:27:43.696789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6833/593938276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":593938276},{"type":"v1","addr":"172.21.15.12:6833","nonce":593938276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T23:27:58.663 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2023-10-16T23:27:58.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.660+0000 7f4daf804640 1 -- 172.21.15.12:0/3254741423 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4d8c065e60 msgr2=0x7f4d8c068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:58.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.660+0000 7f4daf804640 1 --2- 172.21.15.12:0/3254741423 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4d8c065e60 0x7f4d8c068320 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4d980ad000 tx=0x7f4d98008040 comp rx=0 tx=0).stop 2023-10-16T23:27:58.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.660+0000 7f4daf804640 1 -- 172.21.15.12:0/3254741423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4da80ba440 msgr2=0x7f4da814acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:58.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.660+0000 7f4daf804640 1 --2- 172.21.15.12:0/3254741423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4da80ba440 0x7f4da814acf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4da400d800 tx=0x7f4da400dcc0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.660+0000 7f4daf804640 1 -- 172.21.15.12:0/3254741423 shutdown_connections 2023-10-16T23:27:58.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.660+0000 7f4daf804640 1 --2- 172.21.15.12:0/3254741423 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4d8c065e60 0x7f4d8c068320 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.660+0000 7f4daf804640 1 --2- 172.21.15.12:0/3254741423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4da80c1130 0x7f4da81511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.660+0000 7f4daf804640 1 --2- 172.21.15.12:0/3254741423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4da80ba440 0x7f4da814acf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.660+0000 7f4daf804640 1 --2- 172.21.15.12:0/3254741423 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4da806e770 0x7f4da80b6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:58.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.660+0000 7f4daf804640 1 -- 172.21.15.12:0/3254741423 >> 172.21.15.12:0/3254741423 conn(0x7f4da806ba20 msgr2=0x7f4da80bf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:58.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.660+0000 7f4daf804640 1 -- 172.21.15.12:0/3254741423 shutdown_connections 2023-10-16T23:27:58.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:58.660+0000 7f4daf804640 1 -- 172.21.15.12:0/3254741423 wait complete. 2023-10-16T23:27:58.881 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T23:27:40.686789+0000', 'modified': '2023-10-16T23:27:43.696789+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6833/593938276', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6832', 'nonce': 593938276}, {'type': 'v1', 'addr': '172.21.15.12:6833', 'nonce': 593938276}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-16T23:27:58.882 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T23:27:58.882 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-16T23:27:59.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.012+0000 7f50ee29f640 1 Processor -- start 2023-10-16T23:27:59.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.012+0000 7f50ee29f640 1 -- start start 2023-10-16T23:27:59.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.012+0000 7f50ee29f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f50e80c1130 0x7f50e80b8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:59.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.012+0000 7f50ee29f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50e814c520 0x7f50e814c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:59.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.012+0000 7f50ee29f640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e80b40c0 con 0x7f50e814cec0 2023-10-16T23:27:59.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.012+0000 7f50ee29f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e80b3ca0 con 0x7f50e80c1130 2023-10-16T23:27:59.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.012+0000 7f50ee29f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e80b7ce0 con 0x7f50e814c520 2023-10-16T23:27:59.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.012+0000 7f50e7fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f50e80c1130 0x7f50e80b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:59.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.012+0000 7f50e77fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50e814c520 0x7f50e814c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:59.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.012+0000 7f50ec83c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f50e814cec0 0x7f50e80b9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:59176/0 (socket says 172.21.15.12:59176) 2023-10-16T23:27:59.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.012+0000 7f50ec83c640 1 -- 172.21.15.12:0/2771277149 learned_addr learned my addr 172.21.15.12:0/2771277149 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:27:59.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.012+0000 7f50e7fff640 1 --2- 172.21.15.12:0/2771277149 >> v2:172.21.15.31:3300/0 conn(0x7f50e80c1130 0x7f50e80b8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:43108/0 (socket says 172.21.15.12:43108) 2023-10-16T23:27:59.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.012+0000 7f50e7fff640 1 -- 172.21.15.12:0/2771277149 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50e814c520 msgr2=0x7f50e814c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:59.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.012+0000 7f50e7fff640 1 --2- 172.21.15.12:0/2771277149 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50e814c520 0x7f50e814c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.012+0000 7f50e7fff640 1 -- 172.21.15.12:0/2771277149 >> v1:172.21.15.31:6789/0 conn(0x7f50e814cec0 legacy=0x7f50e80b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:59.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.012+0000 7f50e7fff640 1 -- 172.21.15.12:0/2771277149 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e80c1510 con 0x7f50e80c1130 2023-10-16T23:27:59.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.012+0000 7f50e77fe640 1 --2- 172.21.15.12:0/2771277149 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50e814c520 0x7f50e814c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T23:27:59.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.016+0000 7f50e7fff640 1 --2- 172.21.15.12:0/2771277149 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50e80c1130 0x7f50e80b8630 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f50d80097c0 tx=0x7f50d801c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=158634b7e5c5bceb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:59.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.016+0000 7f50e6ffd640 1 -- 172.21.15.12:0/2771277149 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e80bac70 con 0x7f50e80c1130 2023-10-16T23:27:59.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.016+0000 7f50e6ffd640 1 -- 172.21.15.12:0/2771277149 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d80ad680 con 0x7f50e80c1130 2023-10-16T23:27:59.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.016+0000 7f50e6ffd640 1 -- 172.21.15.12:0/2771277149 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d80ada10 con 0x7f50e80c1130 2023-10-16T23:27:59.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.016+0000 7f50ee29f640 1 -- 172.21.15.12:0/2771277149 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50e80c1130 msgr2=0x7f50e80b8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:59.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.016+0000 7f50ee29f640 1 --2- 172.21.15.12:0/2771277149 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50e80c1130 0x7f50e80b8630 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f50d80097c0 tx=0x7f50d801c360 comp rx=0 tx=0).stop 2023-10-16T23:27:59.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.016+0000 7f50ee29f640 1 -- 172.21.15.12:0/2771277149 shutdown_connections 2023-10-16T23:27:59.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.016+0000 7f50ee29f640 1 --2- 172.21.15.12:0/2771277149 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50e814c520 0x7f50e814c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.016+0000 7f50ee29f640 1 --2- 172.21.15.12:0/2771277149 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50e80c1130 0x7f50e80b8630 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.016+0000 7f50ee29f640 1 -- 172.21.15.12:0/2771277149 >> 172.21.15.12:0/2771277149 conn(0x7f50e806ba20 msgr2=0x7f50e80c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:59.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.016+0000 7f50ee29f640 1 -- 172.21.15.12:0/2771277149 shutdown_connections 2023-10-16T23:27:59.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.016+0000 7f50ee29f640 1 -- 172.21.15.12:0/2771277149 wait complete. 2023-10-16T23:27:59.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.016+0000 7f50ee29f640 1 Processor -- start 2023-10-16T23:27:59.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.016+0000 7f50ee29f640 1 -- start start 2023-10-16T23:27:59.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.016+0000 7f50ee29f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50e80c1130 0x7f50e81471c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:59.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50ee29f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50e814c520 0x7f50e8140f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:59.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50ee29f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50e814cec0 0x7f50e81e8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:59.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50ee29f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e813de80 con 0x7f50e814cec0 2023-10-16T23:27:59.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50ee29f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e81414c0 con 0x7f50e80c1130 2023-10-16T23:27:59.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50ee29f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e8140550 con 0x7f50e814c520 2023-10-16T23:27:59.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50ec83c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50e814cec0 0x7f50e81e8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:59.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50ec83c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50e814cec0 0x7f50e81e8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41522/0 (socket says 172.21.15.12:41522) 2023-10-16T23:27:59.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50ec83c640 1 -- 172.21.15.12:0/1707382940 learned_addr learned my addr 172.21.15.12:0/1707382940 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:59.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50e7fff640 1 --2- 172.21.15.12:0/1707382940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50e80c1130 0x7f50e81471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:59.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50e77fe640 1 --2- 172.21.15.12:0/1707382940 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50e814c520 0x7f50e8140f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:59.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50ec83c640 1 -- 172.21.15.12:0/1707382940 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50e814c520 msgr2=0x7f50e8140f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:59.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50ec83c640 1 --2- 172.21.15.12:0/1707382940 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50e814c520 0x7f50e8140f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50ec83c640 1 -- 172.21.15.12:0/1707382940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50e80c1130 msgr2=0x7f50e81471c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:59.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50ec83c640 1 --2- 172.21.15.12:0/1707382940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50e80c1130 0x7f50e81471c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50ec83c640 1 -- 172.21.15.12:0/1707382940 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50dc009420 con 0x7f50e814cec0 2023-10-16T23:27:59.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50e7fff640 1 --2- 172.21.15.12:0/1707382940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50e80c1130 0x7f50e81471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:27:59.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50e77fe640 1 --2- 172.21.15.12:0/1707382940 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50e814c520 0x7f50e8140f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:27:59.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50ec83c640 1 --2- 172.21.15.12:0/1707382940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50e814cec0 0x7f50e81e8640 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f50e000caf0 tx=0x7f50e000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:59.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50e4ff9640 1 -- 172.21.15.12:0/1707382940 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e000aca0 con 0x7f50e814cec0 2023-10-16T23:27:59.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50e4ff9640 1 -- 172.21.15.12:0/1707382940 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e000ae00 con 0x7f50e814cec0 2023-10-16T23:27:59.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50ee29f640 1 -- 172.21.15.12:0/1707382940 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d8009420 con 0x7f50e814cec0 2023-10-16T23:27:59.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50e4ff9640 1 -- 172.21.15.12:0/1707382940 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e0012600 con 0x7f50e814cec0 2023-10-16T23:27:59.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50ee29f640 1 -- 172.21.15.12:0/1707382940 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e813e080 con 0x7f50e814cec0 2023-10-16T23:27:59.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50e4ff9640 1 -- 172.21.15.12:0/1707382940 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f50e0007070 con 0x7f50e814cec0 2023-10-16T23:27:59.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50e4ff9640 1 --2- 172.21.15.12:0/1707382940 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f50d4065e90 0x7f50d4068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:59.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50e4ff9640 1 -- 172.21.15.12:0/1707382940 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f50e0083680 con 0x7f50e814cec0 2023-10-16T23:27:59.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50e7fff640 1 --2- 172.21.15.12:0/1707382940 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f50d4065e90 0x7f50d4068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:59.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.020+0000 7f50f13c4000 1 Processor -- start 2023-10-16T23:27:59.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50f13c4000 1 -- start start 2023-10-16T23:27:59.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50e7fff640 1 --2- 172.21.15.12:0/1707382940 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f50d4065e90 0x7f50d4068350 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f50d80af000 tx=0x7f50d8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:59.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50f13c4000 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 0x5649aa824fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:59.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50f13c4000 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5649aa8254e0 0x5649aa7f0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:59.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50f13c4000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5649aa7f05c0 0x5649aa7f09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:59.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50f13c4000 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649aa6b3ac0 con 0x5649aa824bc0 2023-10-16T23:27:59.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50f13c4000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649aa641290 con 0x5649aa7f05c0 2023-10-16T23:27:59.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50f13c4000 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649aa63e860 con 0x5649aa8254e0 2023-10-16T23:27:59.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50e7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 0x5649aa824fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:59.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50e7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 0x5649aa824fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41528/0 (socket says 172.21.15.12:41528) 2023-10-16T23:27:59.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50e7fff640 1 -- 172.21.15.12:0/2314883191 learned_addr learned my addr 172.21.15.12:0/2314883191 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:59.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50e77fe640 1 --2- 172.21.15.12:0/2314883191 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5649aa8254e0 0x5649aa7f0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:59.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50ec83c640 1 --2- 172.21.15.12:0/2314883191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5649aa7f05c0 0x5649aa7f09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:59.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50e7fff640 1 -- 172.21.15.12:0/2314883191 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5649aa8254e0 msgr2=0x5649aa7f0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:59.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50e7fff640 1 --2- 172.21.15.12:0/2314883191 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5649aa8254e0 0x5649aa7f0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50e7fff640 1 -- 172.21.15.12:0/2314883191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5649aa7f05c0 msgr2=0x5649aa7f09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:59.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50e7fff640 1 --2- 172.21.15.12:0/2314883191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5649aa7f05c0 0x5649aa7f09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50e7fff640 1 -- 172.21.15.12:0/2314883191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649aa336890 con 0x5649aa824bc0 2023-10-16T23:27:59.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50ec83c640 1 --2- 172.21.15.12:0/2314883191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5649aa7f05c0 0x5649aa7f09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:59.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50e7fff640 1 --2- 172.21.15.12:0/2314883191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 0x5649aa824fa0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f50d801c3a0 tx=0x7f50d8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7cfc0c911d9cd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:59.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50cdffb640 1 -- 172.21.15.12:0/2314883191 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d80b7b60 con 0x5649aa824bc0 2023-10-16T23:27:59.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50cdffb640 1 -- 172.21.15.12:0/2314883191 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d80bd070 con 0x5649aa824bc0 2023-10-16T23:27:59.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50cdffb640 1 -- 172.21.15.12:0/2314883191 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d80c3430 con 0x5649aa824bc0 2023-10-16T23:27:59.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50f13c4000 1 -- 172.21.15.12:0/2314883191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 msgr2=0x5649aa824fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:59.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50f13c4000 1 --2- 172.21.15.12:0/2314883191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 0x5649aa824fa0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f50d801c3a0 tx=0x7f50d8004740 comp rx=0 tx=0).stop 2023-10-16T23:27:59.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50f13c4000 1 -- 172.21.15.12:0/2314883191 shutdown_connections 2023-10-16T23:27:59.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50f13c4000 1 --2- 172.21.15.12:0/2314883191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5649aa7f05c0 0x5649aa7f09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50f13c4000 1 --2- 172.21.15.12:0/2314883191 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5649aa8254e0 0x5649aa7f0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50f13c4000 1 --2- 172.21.15.12:0/2314883191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 0x5649aa824fa0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50f13c4000 1 -- 172.21.15.12:0/2314883191 >> 172.21.15.12:0/2314883191 conn(0x5649aa7e8160 msgr2=0x5649aa7ea550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:59.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50f13c4000 1 -- 172.21.15.12:0/2314883191 shutdown_connections 2023-10-16T23:27:59.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50f13c4000 1 -- 172.21.15.12:0/2314883191 wait complete. 2023-10-16T23:27:59.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50f13c4000 1 -- start start 2023-10-16T23:27:59.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50f13c4000 1 Processor -- start 2023-10-16T23:27:59.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50f13c4000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5649aa7f05c0 0x5649aa823c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:59.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50f13c4000 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 0x5649aa824160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:59.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50f13c4000 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5649aa8254e0 0x5649aa825ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:59.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50f13c4000 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649aa63a150 con 0x5649aa824bc0 2023-10-16T23:27:59.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50f13c4000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649aa5d9360 con 0x5649aa7f05c0 2023-10-16T23:27:59.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50f13c4000 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649aa5f77d0 con 0x5649aa8254e0 2023-10-16T23:27:59.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50f13c4000 10 client.0 _ll_register_callbacks cb 0x5649aa62ef40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T23:27:59.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50e77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 0x5649aa824160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:59.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50e77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 0x5649aa824160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41544/0 (socket says 172.21.15.12:41544) 2023-10-16T23:27:59.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.024+0000 7f50e77fe640 1 -- 172.21.15.12:0/3963803221 learned_addr learned my addr 172.21.15.12:0/3963803221 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:59.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50ec83c640 1 --2- 172.21.15.12:0/3963803221 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5649aa8254e0 0x5649aa825ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:59.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50e7fff640 1 --2- 172.21.15.12:0/3963803221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5649aa7f05c0 0x5649aa823c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:59.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50e77fe640 1 -- 172.21.15.12:0/3963803221 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5649aa8254e0 msgr2=0x5649aa825ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:59.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50e77fe640 1 --2- 172.21.15.12:0/3963803221 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5649aa8254e0 0x5649aa825ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50e77fe640 1 -- 172.21.15.12:0/3963803221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5649aa7f05c0 msgr2=0x5649aa823c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:59.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50e77fe640 1 --2- 172.21.15.12:0/3963803221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5649aa7f05c0 0x5649aa823c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50e77fe640 1 -- 172.21.15.12:0/3963803221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e80c1510 con 0x5649aa824bc0 2023-10-16T23:27:59.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50ec83c640 1 --2- 172.21.15.12:0/3963803221 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5649aa8254e0 0x5649aa825ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:27:59.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50e77fe640 1 --2- 172.21.15.12:0/3963803221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 0x5649aa824160 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f50dc009fd0 tx=0x7f50dc013770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19185ef4b9e0fa8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:59.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-16T23:27:59.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50c6ffd640 1 -- 172.21.15.12:0/3963803221 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc0098a0 con 0x5649aa824bc0 2023-10-16T23:27:59.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50c6ffd640 1 -- 172.21.15.12:0/3963803221 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f50dc016670 con 0x5649aa824bc0 2023-10-16T23:27:59.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50f13c4000 1 -- 172.21.15.12:0/3963803221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5649aa638aa0 con 0x5649aa824bc0 2023-10-16T23:27:59.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50c6ffd640 1 -- 172.21.15.12:0/3963803221 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50dc0059a0 con 0x5649aa824bc0 2023-10-16T23:27:59.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50f13c4000 10 client.4722 fetch_fsmap learned FSMap version 7 2023-10-16T23:27:59.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50f13c4000 1 -- 172.21.15.12:0/3963803221 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5649aa5ff210 con 0x5649aa824bc0 2023-10-16T23:27:59.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50c6ffd640 1 -- 172.21.15.12:0/3963803221 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5649aa638aa0 con 0x5649aa824bc0 2023-10-16T23:27:59.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50c6ffd640 1 -- 172.21.15.12:0/3963803221 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 7) v1 ==== 2016+0+0 (secure 0 0 0) 0x7f50dc005b00 con 0x5649aa824bc0 2023-10-16T23:27:59.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50f13c4000 10 client.4722 fetch_fsmap finished waiting for FSMap version 7 2023-10-16T23:27:59.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50f13c4000 10 client.4722 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-16T23:27:59.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50f13c4000 20 client.4722 populate_metadata read hostname 'smithi012' 2023-10-16T23:27:59.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50f13c4000 1 --2- 172.21.15.12:0/3963803221 >> [v2:172.21.15.12:6832/593938276,v1:172.21.15.12:6833/593938276] conn(0x5649aa826840 0x5649aa826c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:59.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50f13c4000 4 client.4722 mds_command: new command op to 4281 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-16T23:27:59.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50f13c4000 1 -- 172.21.15.12:0/3963803221 --> [v2:172.21.15.12:6832/593938276,v1:172.21.15.12:6833/593938276] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5649aa669090 con 0x5649aa826840 2023-10-16T23:27:59.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50e7fff640 1 --2- 172.21.15.12:0/3963803221 >> [v2:172.21.15.12:6832/593938276,v1:172.21.15.12:6833/593938276] conn(0x5649aa826840 0x5649aa826c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:59.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50c6ffd640 10 client.4722 ms_handle_connect on v2:172.21.15.12:6832/593938276 2023-10-16T23:27:59.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50e7fff640 1 --2- 172.21.15.12:0/3963803221 >> [v2:172.21.15.12:6832/593938276,v1:172.21.15.12:6833/593938276] conn(0x5649aa826840 0x5649aa826c20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a8e3bef75c93e9f server_cookie=c6f1396ef223d0e in_seq=0 out_seq=0 2023-10-16T23:27:59.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50c6ffd640 1 -- 172.21.15.12:0/3963803221 <== mds.0 v2:172.21.15.12:6832/593938276 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17627 (crc 0 0 0) 0x5649aa669090 con 0x5649aa826840 2023-10-16T23:27:59.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50c6ffd640 10 client.4722 handle_command_reply: tid=0 2023-10-16T23:27:59.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50f13c4000 1 client.4722 shutdown 2023-10-16T23:27:59.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50f13c4000 1 -- 172.21.15.12:0/3963803221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 msgr2=0x5649aa824160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:59.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50f13c4000 1 --2- 172.21.15.12:0/3963803221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 0x5649aa824160 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f50dc009fd0 tx=0x7f50dc013770 comp rx=0 tx=0).stop 2023-10-16T23:27:59.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50f13c4000 1 -- 172.21.15.12:0/3963803221 shutdown_connections 2023-10-16T23:27:59.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50f13c4000 1 --2- 172.21.15.12:0/3963803221 >> [v2:172.21.15.12:6832/593938276,v1:172.21.15.12:6833/593938276] conn(0x5649aa826840 0x5649aa826c20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50f13c4000 1 --2- 172.21.15.12:0/3963803221 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5649aa8254e0 0x5649aa825ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50f13c4000 1 --2- 172.21.15.12:0/3963803221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 0x5649aa824160 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50f13c4000 1 --2- 172.21.15.12:0/3963803221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5649aa7f05c0 0x5649aa823c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50f13c4000 1 -- 172.21.15.12:0/3963803221 >> 172.21.15.12:0/3963803221 conn(0x5649aa7e8160 msgr2=0x5649aa7ea550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:59.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50c6ffd640 0 client.4722 ms_handle_reset on v2:172.21.15.12:6832/593938276 2023-10-16T23:27:59.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50f13c4000 1 -- 172.21.15.12:0/3963803221 shutdown_connections 2023-10-16T23:27:59.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50f13c4000 1 -- 172.21.15.12:0/3963803221 wait complete. 2023-10-16T23:27:59.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.028+0000 7f50f13c4000 20 client.4722 trim_cache size 0 max 16384 2023-10-16T23:27:59.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50f13c4000 1 Processor -- start 2023-10-16T23:27:59.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50f13c4000 1 -- start start 2023-10-16T23:27:59.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50f13c4000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5649aa7f05c0 0x5649aa8842b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:59.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50f13c4000 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 0x5649aa8847f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:59.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50f13c4000 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5649aa8254e0 0x5649aa884d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:59.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50f13c4000 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649aa2f7940 con 0x5649aa824bc0 2023-10-16T23:27:59.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50f13c4000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649aa5ed9e0 con 0x5649aa7f05c0 2023-10-16T23:27:59.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50f13c4000 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649aa642520 con 0x5649aa8254e0 2023-10-16T23:27:59.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50e77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 0x5649aa8847f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:59.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50e77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 0x5649aa8847f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41560/0 (socket says 172.21.15.12:41560) 2023-10-16T23:27:59.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50e77fe640 1 -- 172.21.15.12:0/1357592444 learned_addr learned my addr 172.21.15.12:0/1357592444 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:59.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50e7fff640 1 --2- 172.21.15.12:0/1357592444 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5649aa7f05c0 0x5649aa8842b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:59.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50ec83c640 1 --2- 172.21.15.12:0/1357592444 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5649aa8254e0 0x5649aa884d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:59.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50e77fe640 1 -- 172.21.15.12:0/1357592444 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5649aa8254e0 msgr2=0x5649aa884d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:59.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50e77fe640 1 --2- 172.21.15.12:0/1357592444 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5649aa8254e0 0x5649aa884d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50e77fe640 1 -- 172.21.15.12:0/1357592444 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5649aa7f05c0 msgr2=0x5649aa8842b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:59.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50e77fe640 1 --2- 172.21.15.12:0/1357592444 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5649aa7f05c0 0x5649aa8842b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50e77fe640 1 -- 172.21.15.12:0/1357592444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649aa5e5360 con 0x5649aa824bc0 2023-10-16T23:27:59.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50e77fe640 1 --2- 172.21.15.12:0/1357592444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 0x5649aa8847f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f50dc0137b0 tx=0x7f50dc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca660e673ae23edf server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:59.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50ce7fc640 1 -- 172.21.15.12:0/1357592444 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc009a90 con 0x5649aa824bc0 2023-10-16T23:27:59.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50ce7fc640 1 -- 172.21.15.12:0/1357592444 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50dc0059a0 con 0x5649aa824bc0 2023-10-16T23:27:59.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50ce7fc640 1 -- 172.21.15.12:0/1357592444 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc004040 con 0x5649aa824bc0 2023-10-16T23:27:59.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50f13c4000 1 -- 172.21.15.12:0/1357592444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 msgr2=0x5649aa8847f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:59.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50f13c4000 1 --2- 172.21.15.12:0/1357592444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 0x5649aa8847f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f50dc0137b0 tx=0x7f50dc011000 comp rx=0 tx=0).stop 2023-10-16T23:27:59.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50f13c4000 1 -- 172.21.15.12:0/1357592444 shutdown_connections 2023-10-16T23:27:59.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50f13c4000 1 --2- 172.21.15.12:0/1357592444 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5649aa8254e0 0x5649aa884d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50f13c4000 1 --2- 172.21.15.12:0/1357592444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 0x5649aa8847f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50f13c4000 1 --2- 172.21.15.12:0/1357592444 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5649aa7f05c0 0x5649aa8842b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50f13c4000 1 -- 172.21.15.12:0/1357592444 >> 172.21.15.12:0/1357592444 conn(0x5649aa7e8160 msgr2=0x5649aa835fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:59.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50f13c4000 1 -- 172.21.15.12:0/1357592444 shutdown_connections 2023-10-16T23:27:59.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.044+0000 7f50f13c4000 1 -- 172.21.15.12:0/1357592444 wait complete. 2023-10-16T23:27:59.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 1 -- start start 2023-10-16T23:27:59.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 1 Processor -- start 2023-10-16T23:27:59.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5649aa7f05c0 0x5649aa883740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:59.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 0x5649aa883c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:59.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5649aa8254e0 0x5649aa8844c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:59.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649aa63ccb0 con 0x5649aa824bc0 2023-10-16T23:27:59.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649aa825d20 con 0x5649aa8254e0 2023-10-16T23:27:59.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649aa6346d0 con 0x5649aa7f05c0 2023-10-16T23:27:59.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 10 client.0 _ll_register_callbacks cb 0x5649aa5f7a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T23:27:59.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50e77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 0x5649aa883c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:59.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50e77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 0x5649aa883c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41574/0 (socket says 172.21.15.12:41574) 2023-10-16T23:27:59.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50e77fe640 1 -- 172.21.15.12:0/3225755345 learned_addr learned my addr 172.21.15.12:0/3225755345 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:59.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50e7fff640 1 --2- 172.21.15.12:0/3225755345 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5649aa7f05c0 0x5649aa883740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:59.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50ec83c640 1 --2- 172.21.15.12:0/3225755345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5649aa8254e0 0x5649aa8844c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:59.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50e77fe640 1 -- 172.21.15.12:0/3225755345 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5649aa7f05c0 msgr2=0x5649aa883740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:59.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50e77fe640 1 --2- 172.21.15.12:0/3225755345 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5649aa7f05c0 0x5649aa883740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50e77fe640 1 -- 172.21.15.12:0/3225755345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5649aa8254e0 msgr2=0x5649aa8844c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:59.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50e77fe640 1 --2- 172.21.15.12:0/3225755345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5649aa8254e0 0x5649aa8844c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50e77fe640 1 -- 172.21.15.12:0/3225755345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5649aa5ff210 con 0x5649aa824bc0 2023-10-16T23:27:59.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50e77fe640 1 --2- 172.21.15.12:0/3225755345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 0x5649aa883c80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f50dc000c10 tx=0x7f50dc0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9adc663e0c09b250 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:59.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-16T23:27:59.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50c6ffd640 1 -- 172.21.15.12:0/3225755345 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc004450 con 0x5649aa824bc0 2023-10-16T23:27:59.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50c6ffd640 1 -- 172.21.15.12:0/3225755345 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f50dc016830 con 0x5649aa824bc0 2023-10-16T23:27:59.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 1 -- 172.21.15.12:0/3225755345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5649aa8241b0 con 0x5649aa824bc0 2023-10-16T23:27:59.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50c6ffd640 1 -- 172.21.15.12:0/3225755345 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50dc0169f0 con 0x5649aa824bc0 2023-10-16T23:27:59.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 10 client.4728 fetch_fsmap learned FSMap version 7 2023-10-16T23:27:59.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 1 -- 172.21.15.12:0/3225755345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5649aa336cc0 con 0x5649aa824bc0 2023-10-16T23:27:59.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50c6ffd640 1 -- 172.21.15.12:0/3225755345 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5649aa8241b0 con 0x5649aa824bc0 2023-10-16T23:27:59.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50c6ffd640 1 -- 172.21.15.12:0/3225755345 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 7) v1 ==== 2016+0+0 (secure 0 0 0) 0x7f50dc016b50 con 0x5649aa824bc0 2023-10-16T23:27:59.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 10 client.4728 fetch_fsmap finished waiting for FSMap version 7 2023-10-16T23:27:59.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 10 client.4728 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-16T23:27:59.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 20 client.4728 populate_metadata read hostname 'smithi012' 2023-10-16T23:27:59.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 1 --2- 172.21.15.12:0/3225755345 >> [v2:172.21.15.12:6832/593938276,v1:172.21.15.12:6833/593938276] conn(0x5649aa884e80 0x5649aa885260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:59.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 4 client.4728 mds_command: new command op to 4281 tid=0[{"prefix": "status"}] 2023-10-16T23:27:59.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 1 -- 172.21.15.12:0/3225755345 --> [v2:172.21.15.12:6832/593938276,v1:172.21.15.12:6833/593938276] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5649aa5ffc00 con 0x5649aa884e80 2023-10-16T23:27:59.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50e7fff640 1 --2- 172.21.15.12:0/3225755345 >> [v2:172.21.15.12:6832/593938276,v1:172.21.15.12:6833/593938276] conn(0x5649aa884e80 0x5649aa885260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:59.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50c6ffd640 10 client.4728 ms_handle_connect on v2:172.21.15.12:6832/593938276 2023-10-16T23:27:59.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50e7fff640 1 --2- 172.21.15.12:0/3225755345 >> [v2:172.21.15.12:6832/593938276,v1:172.21.15.12:6833/593938276] conn(0x5649aa884e80 0x5649aa885260 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f76d696282ad5ff server_cookie=fc089628bf563783 in_seq=0 out_seq=0 2023-10-16T23:27:59.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50c6ffd640 1 -- 172.21.15.12:0/3225755345 <== mds.0 v2:172.21.15.12:6832/593938276 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x5649aa5ffc00 con 0x5649aa884e80 2023-10-16T23:27:59.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50c6ffd640 10 client.4728 handle_command_reply: tid=0 2023-10-16T23:27:59.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 1 client.4728 shutdown 2023-10-16T23:27:59.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 1 -- 172.21.15.12:0/3225755345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 msgr2=0x5649aa883c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:59.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 1 --2- 172.21.15.12:0/3225755345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 0x5649aa883c80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f50dc000c10 tx=0x7f50dc0046d0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 1 -- 172.21.15.12:0/3225755345 shutdown_connections 2023-10-16T23:27:59.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 1 --2- 172.21.15.12:0/3225755345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5649aa8254e0 0x5649aa8844c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 1 --2- 172.21.15.12:0/3225755345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649aa824bc0 0x5649aa883c80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 1 --2- 172.21.15.12:0/3225755345 >> [v2:172.21.15.12:6832/593938276,v1:172.21.15.12:6833/593938276] conn(0x5649aa884e80 0x5649aa885260 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 1 --2- 172.21.15.12:0/3225755345 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x5649aa7f05c0 0x5649aa883740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50c6ffd640 0 client.4728 ms_handle_reset on v2:172.21.15.12:6832/593938276 2023-10-16T23:27:59.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 1 -- 172.21.15.12:0/3225755345 >> 172.21.15.12:0/3225755345 conn(0x5649aa7e8160 msgr2=0x5649aa836680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:59.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 1 -- 172.21.15.12:0/3225755345 shutdown_connections 2023-10-16T23:27:59.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 1 -- 172.21.15.12:0/3225755345 wait complete. 2023-10-16T23:27:59.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50f13c4000 20 client.4728 trim_cache size 0 max 16384 2023-10-16T23:27:59.073 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-16T23:27:59.074 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51", 2023-10-16T23:27:59.074 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2023-10-16T23:27:59.074 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4281, 2023-10-16T23:27:59.074 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2023-10-16T23:27:59.074 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2023-10-16T23:27:59.075 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2023-10-16T23:27:59.075 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 18.361513754000001, 2023-10-16T23:27:59.075 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 7, 2023-10-16T23:27:59.075 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 24, 2023-10-16T23:27:59.075 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 24, 2023-10-16T23:27:59.075 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 22.66259509 2023-10-16T23:27:59.076 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-16T23:27:59.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50ee29f640 1 -- 172.21.15.12:0/1707382940 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f50d4065e90 msgr2=0x7f50d4068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:59.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50ee29f640 1 --2- 172.21.15.12:0/1707382940 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f50d4065e90 0x7f50d4068350 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f50d80af000 tx=0x7f50d8008040 comp rx=0 tx=0).stop 2023-10-16T23:27:59.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50ee29f640 1 -- 172.21.15.12:0/1707382940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50e814cec0 msgr2=0x7f50e81e8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:59.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50ee29f640 1 --2- 172.21.15.12:0/1707382940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50e814cec0 0x7f50e81e8640 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f50e000caf0 tx=0x7f50e000a060 comp rx=0 tx=0).stop 2023-10-16T23:27:59.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50ee29f640 1 -- 172.21.15.12:0/1707382940 shutdown_connections 2023-10-16T23:27:59.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50ee29f640 1 --2- 172.21.15.12:0/1707382940 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f50d4065e90 0x7f50d4068350 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50ee29f640 1 --2- 172.21.15.12:0/1707382940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f50e814cec0 0x7f50e81e8640 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50ee29f640 1 --2- 172.21.15.12:0/1707382940 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50e814c520 0x7f50e8140f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50ee29f640 1 --2- 172.21.15.12:0/1707382940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50e80c1130 0x7f50e81471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50ee29f640 1 -- 172.21.15.12:0/1707382940 >> 172.21.15.12:0/1707382940 conn(0x7f50e806ba20 msgr2=0x7f50e80bb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:59.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50ee29f640 1 -- 172.21.15.12:0/1707382940 shutdown_connections 2023-10-16T23:27:59.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.048+0000 7f50ee29f640 1 -- 172.21.15.12:0/1707382940 wait complete. 2023-10-16T23:27:59.080 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-16T23:27:59.101 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-16T23:27:59.102 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}, 'client.2': {}} 2023-10-16T23:27:59.102 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-16T23:27:59.103 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T23:27:59.103 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T23:27:59.103 INFO:tasks.ceph_fuse:client.1 config is {} 2023-10-16T23:27:59.104 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T23:27:59.104 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-16T23:27:59.104 INFO:tasks.ceph_fuse:client.2 config is {} 2023-10-16T23:27:59.104 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T23:27:59.105 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-16T23:27:59.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:27:59.105 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-10-16T23:27:59.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:27:59.113 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2023-10-16T23:27:59.173 INFO:teuthology.orchestra.run.smithi072.stderr:Cannot find device "ceph-brx" 2023-10-16T23:27:59.174 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T23:27:59.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:27:59.175 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2023-10-16T23:27:59.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:27:59.182 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link delete ceph-brx 2023-10-16T23:27:59.238 INFO:teuthology.orchestra.run.smithi138.stderr:Cannot find device "ceph-brx" 2023-10-16T23:27:59.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T23:27:59.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:27:59.240 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2023-10-16T23:27:59.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:27:59.247 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2023-10-16T23:27:59.306 INFO:teuthology.orchestra.run.smithi033.stderr:Cannot find device "ceph-brx" 2023-10-16T23:27:59.307 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T23:27:59.308 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-16T23:27:59.308 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T23:27:59.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.440+0000 7f0bcb7a8640 1 Processor -- start 2023-10-16T23:27:59.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.440+0000 7f0bcb7a8640 1 -- start start 2023-10-16T23:27:59.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.440+0000 7f0bcb7a8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bc40c1130 0x7f0bc40b8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:59.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.440+0000 7f0bcb7a8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0bc414c520 0x7f0bc414c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:59.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.440+0000 7f0bcb7a8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc40b40c0 con 0x7f0bc414cec0 2023-10-16T23:27:59.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.440+0000 7f0bcb7a8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc40b3ca0 con 0x7f0bc414c520 2023-10-16T23:27:59.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.440+0000 7f0bcb7a8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc40b7ce0 con 0x7f0bc40c1130 2023-10-16T23:27:59.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.440+0000 7f0bc9544640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bc40c1130 0x7f0bc40b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:59.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.440+0000 7f0bc8d43640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0bc414c520 0x7f0bc414c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:59.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.440+0000 7f0bc9544640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bc40c1130 0x7f0bc40b8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:46036/0 (socket says 172.21.15.12:46036) 2023-10-16T23:27:59.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.440+0000 7f0bc9544640 1 -- 172.21.15.12:0/1226260337 learned_addr learned my addr 172.21.15.12:0/1226260337 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:59.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.440+0000 7f0bc9544640 1 -- 172.21.15.12:0/1226260337 >> v2:172.21.15.31:3300/0 conn(0x7f0bc414c520 msgr2=0x7f0bc414c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:27:59.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.440+0000 7f0bc9544640 1 --2- 172.21.15.12:0/1226260337 >> v2:172.21.15.31:3300/0 conn(0x7f0bc414c520 0x7f0bc414c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.440+0000 7f0bc9544640 1 -- 172.21.15.12:0/1226260337 >> v1:172.21.15.31:6789/0 conn(0x7f0bc414cec0 legacy=0x7f0bc40b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:59.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.440+0000 7f0bc9544640 1 -- 172.21.15.12:0/1226260337 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc40c1510 con 0x7f0bc40c1130 2023-10-16T23:27:59.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.444+0000 7f0bc9544640 1 --2- 172.21.15.12:0/1226260337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bc40c1130 0x7f0bc40b8630 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0009870 tx=0x7f0bc001c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d98757e7a31e90af server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:59.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.444+0000 7f0bbbfff640 1 -- 172.21.15.12:0/1226260337 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc40bac70 con 0x7f0bc40c1130 2023-10-16T23:27:59.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.444+0000 7f0bbbfff640 1 -- 172.21.15.12:0/1226260337 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc00a7070 con 0x7f0bc40c1130 2023-10-16T23:27:59.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.444+0000 7f0bbbfff640 1 -- 172.21.15.12:0/1226260337 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc00ab860 con 0x7f0bc40c1130 2023-10-16T23:27:59.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.444+0000 7f0bcb7a8640 1 -- 172.21.15.12:0/1226260337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bc40c1130 msgr2=0x7f0bc40b8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:59.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.444+0000 7f0bcb7a8640 1 --2- 172.21.15.12:0/1226260337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bc40c1130 0x7f0bc40b8630 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0009870 tx=0x7f0bc001c420 comp rx=0 tx=0).stop 2023-10-16T23:27:59.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.444+0000 7f0bcb7a8640 1 -- 172.21.15.12:0/1226260337 shutdown_connections 2023-10-16T23:27:59.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.444+0000 7f0bcb7a8640 1 --2- 172.21.15.12:0/1226260337 >> v2:172.21.15.31:3300/0 conn(0x7f0bc414c520 0x7f0bc414c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.444+0000 7f0bcb7a8640 1 --2- 172.21.15.12:0/1226260337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bc40c1130 0x7f0bc40b8630 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.444+0000 7f0bcb7a8640 1 -- 172.21.15.12:0/1226260337 >> 172.21.15.12:0/1226260337 conn(0x7f0bc406ba20 msgr2=0x7f0bc40c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:59.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.444+0000 7f0bcb7a8640 1 -- 172.21.15.12:0/1226260337 shutdown_connections 2023-10-16T23:27:59.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.444+0000 7f0bcb7a8640 1 -- 172.21.15.12:0/1226260337 wait complete. 2023-10-16T23:27:59.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.444+0000 7f0bcb7a8640 1 Processor -- start 2023-10-16T23:27:59.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.444+0000 7f0bcb7a8640 1 -- start start 2023-10-16T23:27:59.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bcb7a8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0bc40c1130 0x7f0bc4132a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:59.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bcb7a8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bc414c520 0x7f0bc406f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:59.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bcb7a8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bc414cec0 0x7f0bc406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:59.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bcb7a8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc4140ae0 con 0x7f0bc40c1130 2023-10-16T23:27:59.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bcb7a8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc40bf6c0 con 0x7f0bc414cec0 2023-10-16T23:27:59.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bcb7a8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc40bf070 con 0x7f0bc414c520 2023-10-16T23:27:59.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bc9544640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0bc40c1130 0x7f0bc4132a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bc9544640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0bc40c1130 0x7f0bc4132a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41576/0 (socket says 172.21.15.12:41576) 2023-10-16T23:27:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bc9544640 1 -- 172.21.15.12:0/501280935 learned_addr learned my addr 172.21.15.12:0/501280935 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:27:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bc9d45640 1 --2- 172.21.15.12:0/501280935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bc414cec0 0x7f0bc406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bc8d43640 1 --2- 172.21.15.12:0/501280935 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bc414c520 0x7f0bc406f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bc9544640 1 -- 172.21.15.12:0/501280935 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bc414c520 msgr2=0x7f0bc406f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:59.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bc9544640 1 --2- 172.21.15.12:0/501280935 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bc414c520 0x7f0bc406f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bc9544640 1 -- 172.21.15.12:0/501280935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bc414cec0 msgr2=0x7f0bc406f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:59.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bc9544640 1 --2- 172.21.15.12:0/501280935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bc414cec0 0x7f0bc406f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bc9544640 1 -- 172.21.15.12:0/501280935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc00094d0 con 0x7f0bc40c1130 2023-10-16T23:27:59.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bc9544640 1 --2- 172.21.15.12:0/501280935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0bc40c1130 0x7f0bc4132a80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0bc001a050 tx=0x7f0bc001ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:59.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bb9ffb640 1 -- 172.21.15.12:0/501280935 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc00abea0 con 0x7f0bc40c1130 2023-10-16T23:27:59.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bb9ffb640 1 -- 172.21.15.12:0/501280935 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc00be3f0 con 0x7f0bc40c1130 2023-10-16T23:27:59.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bcb7a8640 1 -- 172.21.15.12:0/501280935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc40bf350 con 0x7f0bc40c1130 2023-10-16T23:27:59.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bb9ffb640 1 -- 172.21.15.12:0/501280935 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc00be7a0 con 0x7f0bc40c1130 2023-10-16T23:27:59.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bcb7a8640 1 -- 172.21.15.12:0/501280935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc41413e0 con 0x7f0bc40c1130 2023-10-16T23:27:59.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bcb7a8640 1 -- 172.21.15.12:0/501280935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc40673a0 con 0x7f0bc40c1130 2023-10-16T23:27:59.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bb9ffb640 1 -- 172.21.15.12:0/501280935 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f0bc00b43f0 con 0x7f0bc40c1130 2023-10-16T23:27:59.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bb9ffb640 1 --2- 172.21.15.12:0/501280935 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f0ba8065e60 0x7f0ba8068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:27:59.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bb9ffb640 1 -- 172.21.15.12:0/501280935 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0bc011dc90 con 0x7f0bc40c1130 2023-10-16T23:27:59.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.448+0000 7f0bc8d43640 1 --2- 172.21.15.12:0/501280935 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f0ba8065e60 0x7f0ba8068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:27:59.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.452+0000 7f0bc8d43640 1 --2- 172.21.15.12:0/501280935 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f0ba8065e60 0x7f0ba8068320 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40705a0 tx=0x7f0bb4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:27:59.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.452+0000 7f0bb9ffb640 1 -- 172.21.15.12:0/501280935 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f0bc00eb300 con 0x7f0bc40c1130 2023-10-16T23:27:59.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.644+0000 7f0bcb7a8640 1 -- 172.21.15.12:0/501280935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0bc4070e90 con 0x7f0bc40c1130 2023-10-16T23:27:59.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.644+0000 7f0bb9ffb640 1 -- 172.21.15.12:0/501280935 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0bc00c4070 con 0x7f0bc40c1130 2023-10-16T23:27:59.648 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T23:27:59.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.648+0000 7f0bcb7a8640 1 -- 172.21.15.12:0/501280935 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f0ba8065e60 msgr2=0x7f0ba8068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:59.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.648+0000 7f0bcb7a8640 1 --2- 172.21.15.12:0/501280935 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f0ba8065e60 0x7f0ba8068320 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40705a0 tx=0x7f0bb4008040 comp rx=0 tx=0).stop 2023-10-16T23:27:59.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.648+0000 7f0bcb7a8640 1 -- 172.21.15.12:0/501280935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0bc40c1130 msgr2=0x7f0bc4132a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:27:59.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.648+0000 7f0bcb7a8640 1 --2- 172.21.15.12:0/501280935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0bc40c1130 0x7f0bc4132a80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0bc001a050 tx=0x7f0bc001ac60 comp rx=0 tx=0).stop 2023-10-16T23:27:59.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.648+0000 7f0bcb7a8640 1 -- 172.21.15.12:0/501280935 shutdown_connections 2023-10-16T23:27:59.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.648+0000 7f0bcb7a8640 1 --2- 172.21.15.12:0/501280935 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f0ba8065e60 0x7f0ba8068320 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.648+0000 7f0bcb7a8640 1 --2- 172.21.15.12:0/501280935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bc414cec0 0x7f0bc406f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.648+0000 7f0bcb7a8640 1 --2- 172.21.15.12:0/501280935 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0bc414c520 0x7f0bc406f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.648+0000 7f0bcb7a8640 1 --2- 172.21.15.12:0/501280935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0bc40c1130 0x7f0bc4132a80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:27:59.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.648+0000 7f0bcb7a8640 1 -- 172.21.15.12:0/501280935 >> 172.21.15.12:0/501280935 conn(0x7f0bc406ba20 msgr2=0x7f0bc4149810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:27:59.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.648+0000 7f0bcb7a8640 1 -- 172.21.15.12:0/501280935 shutdown_connections 2023-10-16T23:27:59.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:27:59.648+0000 7f0bcb7a8640 1 -- 172.21.15.12:0/501280935 wait complete. 2023-10-16T23:27:59.667 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T23:27:59.668 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T23:27:59.668 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2023-10-16T23:27:59.668 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-16T23:27:59.668 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T23:27:59.669 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T23:27:59.669 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T23:27:59.669 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T23:27:59.669 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T23:27:59.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:27:59.670 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2023-10-16T23:27:59.677 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T23:27:59.677 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T23:27:59.677 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T23:27:59.677 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-16T23:27:59.677 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2023-10-16T23:27:59.678 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-16T23:27:59.678 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-16T23:27:59.678 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2023-10-16T23:27:59.678 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2023-10-16T23:27:59.679 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-16T23:27:59.679 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2023-10-16T23:27:59.679 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2023-10-16T23:27:59.679 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T23:27:59.679 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2023-10-16T23:27:59.680 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2023-10-16T23:27:59.680 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-16T23:27:59.680 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42420sec preferred_lft 42420sec 2023-10-16T23:27:59.680 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2023-10-16T23:27:59.680 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-16T23:27:59.680 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-16T23:27:59.681 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2023-10-16T23:27:59.681 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2023-10-16T23:27:59.681 INFO:teuthology.orchestra.run.smithi033.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-16T23:27:59.681 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 02:42:59:e0:97:a8 brd ff:ff:ff:ff:ff:ff 2023-10-16T23:27:59.681 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-16T23:27:59.682 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-16T23:27:59.682 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-16T23:27:59.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:27:59.683 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2023-10-16T23:27:59.683 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2023-10-16T23:27:59.683 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add name ceph-brx type bridge 2023-10-16T23:27:59.684 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr flush dev ceph-brx 2023-10-16T23:27:59.684 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set ceph-brx up 2023-10-16T23:27:59.684 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-16T23:27:59.684 DEBUG:teuthology.orchestra.run.smithi033:> ') 2023-10-16T23:27:59.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:27:59.766 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T23:27:59.818 INFO:teuthology.orchestra.run.smithi033.stdout:1 2023-10-16T23:27:59.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:27:59.820 DEBUG:teuthology.orchestra.run.smithi033:> route 2023-10-16T23:27:59.881 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2023-10-16T23:27:59.882 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T23:27:59.882 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-16T23:27:59.882 INFO:teuthology.orchestra.run.smithi033.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-16T23:27:59.882 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-16T23:27:59.882 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T23:27:59.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:27:59.883 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2023-10-16T23:27:59.884 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2023-10-16T23:27:59.884 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-16T23:27:59.884 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-16T23:27:59.885 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-16T23:27:59.885 DEBUG:teuthology.orchestra.run.smithi033:> ') 2023-10-16T23:27:59.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:27:59.961 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2023-10-16T23:28:00.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:00.015 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list-id 2023-10-16T23:28:00.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:00.062 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2023-10-16T23:28:00.063 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2023-10-16T23:28:00.063 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T23:28:00.063 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-16T23:28:00.064 DEBUG:teuthology.orchestra.run.smithi033:> ') 2023-10-16T23:28:00.130 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-16T23:28:00.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:00.131 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2023-10-16T23:28:00.132 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2023-10-16T23:28:00.132 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-16T23:28:00.132 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-16T23:28:00.132 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-16T23:28:00.133 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-16T23:28:00.133 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-16T23:28:00.133 DEBUG:teuthology.orchestra.run.smithi033:> ') 2023-10-16T23:28:00.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:00.243 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2023-10-16T23:28:00.243 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2023-10-16T23:28:00.244 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2023-10-16T23:28:00.244 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set dev brx.0 master ceph-brx 2023-10-16T23:28:00.244 DEBUG:teuthology.orchestra.run.smithi033:> ') 2023-10-16T23:28:00.265 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-16T23:28:00.265 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T23:28:00.265 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-16T23:28:00.313 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-16T23:28:00.314 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T23:28:00.314 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-16T23:28:00.365 DEBUG:teuthology.orchestra.run.smithi033:> sudo modprobe fuse 2023-10-16T23:28:00.420 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-16T23:28:00.420 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-16T23:28:00.474 INFO:teuthology.orchestra.run.smithi033.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-16T23:28:00.475 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-16T23:28:00.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:00.476 DEBUG:teuthology.orchestra.run.smithi033:> ls /sys/fs/fuse/connections 2023-10-16T23:28:00.522 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-16T23:28:00.522 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-16T23:28:00.571 DEBUG:teuthology.orchestra.run.smithi033:> sudo modprobe fuse 2023-10-16T23:28:00.585 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-16T23:28:00.585 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-16T23:28:00.643 INFO:teuthology.orchestra.run.smithi033.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-16T23:28:00.644 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-16T23:28:00.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:00.645 DEBUG:teuthology.orchestra.run.smithi033:> ls /sys/fs/fuse/connections 2023-10-16T23:28:00.693 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi033.stderr:2023-10-16T23:28:00.689+0000 7f4587ee1580 -1 init, newargv = 0x55fa2ee4cb70 newargc=15 2023-10-16T23:28:00.694 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi033.stderr:ceph-fuse[33279]: starting ceph client 2023-10-16T23:28:00.704 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi033.stderr:ceph-fuse[33279]: starting fuse 2023-10-16T23:28:01.798 DEBUG:teuthology.orchestra.run.smithi033:> sudo modprobe fuse 2023-10-16T23:28:01.815 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-16T23:28:01.815 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-16T23:28:01.868 INFO:teuthology.orchestra.run.smithi033.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-16T23:28:01.870 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-16T23:28:01.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:01.871 DEBUG:teuthology.orchestra.run.smithi033:> ls /sys/fs/fuse/connections 2023-10-16T23:28:01.918 INFO:teuthology.orchestra.run.smithi033.stdout:45 2023-10-16T23:28:01.918 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-16T23:28:01.918 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-16T23:28:01.919 DEBUG:teuthology.orchestra.run.smithi033:> import glob 2023-10-16T23:28:01.919 DEBUG:teuthology.orchestra.run.smithi033:> import re 2023-10-16T23:28:01.919 DEBUG:teuthology.orchestra.run.smithi033:> import os 2023-10-16T23:28:01.920 DEBUG:teuthology.orchestra.run.smithi033:> import subprocess 2023-10-16T23:28:01.920 DEBUG:teuthology.orchestra.run.smithi033:> 2023-10-16T23:28:01.920 DEBUG:teuthology.orchestra.run.smithi033:> def _find_admin_socket(client_name): 2023-10-16T23:28:01.921 DEBUG:teuthology.orchestra.run.smithi033:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-16T23:28:01.921 DEBUG:teuthology.orchestra.run.smithi033:> files = glob.glob(asok_path) 2023-10-16T23:28:01.921 DEBUG:teuthology.orchestra.run.smithi033:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-16T23:28:01.921 DEBUG:teuthology.orchestra.run.smithi033:> 2023-10-16T23:28:01.922 DEBUG:teuthology.orchestra.run.smithi033:> # Given a non-glob path, it better be there 2023-10-16T23:28:01.922 DEBUG:teuthology.orchestra.run.smithi033:> if "*" not in asok_path: 2023-10-16T23:28:01.922 DEBUG:teuthology.orchestra.run.smithi033:> assert(len(files) == 1) 2023-10-16T23:28:01.923 DEBUG:teuthology.orchestra.run.smithi033:> return files[0] 2023-10-16T23:28:01.923 DEBUG:teuthology.orchestra.run.smithi033:> 2023-10-16T23:28:01.923 DEBUG:teuthology.orchestra.run.smithi033:> for f in files: 2023-10-16T23:28:01.923 DEBUG:teuthology.orchestra.run.smithi033:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-16T23:28:01.924 DEBUG:teuthology.orchestra.run.smithi033:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-16T23:28:01.924 DEBUG:teuthology.orchestra.run.smithi033:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-16T23:28:01.924 DEBUG:teuthology.orchestra.run.smithi033:> contents = proc_f.read() 2023-10-16T23:28:01.924 DEBUG:teuthology.orchestra.run.smithi033:> if mountpoint in contents: 2023-10-16T23:28:01.925 DEBUG:teuthology.orchestra.run.smithi033:> return f 2023-10-16T23:28:01.925 DEBUG:teuthology.orchestra.run.smithi033:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-16T23:28:01.925 DEBUG:teuthology.orchestra.run.smithi033:> 2023-10-16T23:28:01.926 DEBUG:teuthology.orchestra.run.smithi033:> print(_find_admin_socket("client.0")) 2023-10-16T23:28:01.926 DEBUG:teuthology.orchestra.run.smithi033:> ' 2023-10-16T23:28:02.041 INFO:teuthology.orchestra.run.smithi033.stdout:/var/run/ceph/ceph-client.0.33279.asok 2023-10-16T23:28:02.221 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33279.asok 2023-10-16T23:28:02.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:02.222 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33279.asok status 2023-10-16T23:28:02.380 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-16T23:28:02.381 INFO:teuthology.orchestra.run.smithi033.stdout: "metadata": { 2023-10-16T23:28:02.381 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_sha1": "ab9fe43522bc41de59746200b95f65d4fbcccffe", 2023-10-16T23:28:02.381 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_version": "ceph version 18.2.0-668-gab9fe435 (ab9fe43522bc41de59746200b95f65d4fbcccffe) reef (stable)", 2023-10-16T23:28:02.381 INFO:teuthology.orchestra.run.smithi033.stdout: "entity_id": "0", 2023-10-16T23:28:02.382 INFO:teuthology.orchestra.run.smithi033.stdout: "hostname": "smithi033", 2023-10-16T23:28:02.382 INFO:teuthology.orchestra.run.smithi033.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-16T23:28:02.382 INFO:teuthology.orchestra.run.smithi033.stdout: "pid": "33279", 2023-10-16T23:28:02.382 INFO:teuthology.orchestra.run.smithi033.stdout: "root": "/" 2023-10-16T23:28:02.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-16T23:28:02.383 INFO:teuthology.orchestra.run.smithi033.stdout: "dentry_count": 0, 2023-10-16T23:28:02.383 INFO:teuthology.orchestra.run.smithi033.stdout: "dentry_pinned_count": 0, 2023-10-16T23:28:02.383 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 4484, 2023-10-16T23:28:02.383 INFO:teuthology.orchestra.run.smithi033.stdout: "inst": { 2023-10-16T23:28:02.383 INFO:teuthology.orchestra.run.smithi033.stdout: "name": { 2023-10-16T23:28:02.384 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "client", 2023-10-16T23:28:02.384 INFO:teuthology.orchestra.run.smithi033.stdout: "num": 4484 2023-10-16T23:28:02.384 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-16T23:28:02.384 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": { 2023-10-16T23:28:02.384 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v1", 2023-10-16T23:28:02.385 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:0", 2023-10-16T23:28:02.385 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 3741123822 2023-10-16T23:28:02.385 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-16T23:28:02.385 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-16T23:28:02.385 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": { 2023-10-16T23:28:02.386 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v1", 2023-10-16T23:28:02.386 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:0", 2023-10-16T23:28:02.386 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 3741123822 2023-10-16T23:28:02.386 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-16T23:28:02.386 INFO:teuthology.orchestra.run.smithi033.stdout: "inst_str": "client.4484 172.21.15.33:0/3741123822", 2023-10-16T23:28:02.387 INFO:teuthology.orchestra.run.smithi033.stdout: "addr_str": "172.21.15.33:0/3741123822", 2023-10-16T23:28:02.387 INFO:teuthology.orchestra.run.smithi033.stdout: "inode_count": 1, 2023-10-16T23:28:02.387 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_epoch": 7, 2023-10-16T23:28:02.387 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_epoch": 24, 2023-10-16T23:28:02.387 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_epoch_barrier": 0, 2023-10-16T23:28:02.387 INFO:teuthology.orchestra.run.smithi033.stdout: "blocklisted": false, 2023-10-16T23:28:02.388 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs" 2023-10-16T23:28:02.388 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-16T23:28:02.395 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T23:28:02.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f96117a3640 1 Processor -- start 2023-10-16T23:28:02.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f96117a3640 1 -- start start 2023-10-16T23:28:02.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f96117a3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f960c0bc930 0x7f960c0c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:02.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f96117a3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f960c0c1410 0x7f960c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:02.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f96117a3640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960c071410 con 0x7f960c153080 2023-10-16T23:28:02.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f96117a3640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f960c06eb50 con 0x7f960c0bc930 2023-10-16T23:28:02.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f96117a3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c1577f0 con 0x7f960c0c1410 2023-10-16T23:28:02.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f960affd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f960c153080 0x7f960c153460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45722/0 (socket says 172.21.15.12:45722) 2023-10-16T23:28:02.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f960affd640 1 -- 172.21.15.12:0/548466573 learned_addr learned my addr 172.21.15.12:0/548466573 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:02.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f960b7fe640 1 --2- 172.21.15.12:0/548466573 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f960c0c1410 0x7f960c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:02.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f960a7fc640 1 --2- 172.21.15.12:0/548466573 >> v2:172.21.15.31:3300/0 conn(0x7f960c0bc930 0x7f960c0c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:02.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f9609ffb640 1 -- 172.21.15.12:0/548466573 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2748440962 0 0) 0x7f960c071410 con 0x7f960c153080 2023-10-16T23:28:02.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f9609ffb640 1 -- 172.21.15.12:0/548466573 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95f4003530 con 0x7f960c153080 2023-10-16T23:28:02.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f9609ffb640 1 -- 172.21.15.12:0/548466573 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 935445817 0 0) 0x7f95f4003530 con 0x7f960c153080 2023-10-16T23:28:02.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f9609ffb640 1 -- 172.21.15.12:0/548466573 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f960c0c1410 msgr2=0x7f960c06ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:02.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f9609ffb640 1 --2- 172.21.15.12:0/548466573 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f960c0c1410 0x7f960c06ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:02.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f9609ffb640 1 -- 172.21.15.12:0/548466573 >> v2:172.21.15.31:3300/0 conn(0x7f960c0bc930 msgr2=0x7f960c0c0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:02.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f9609ffb640 1 --2- 172.21.15.12:0/548466573 >> v2:172.21.15.31:3300/0 conn(0x7f960c0bc930 0x7f960c0c0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:02.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f9609ffb640 1 -- 172.21.15.12:0/548466573 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c157ad0 con 0x7f960c153080 2023-10-16T23:28:02.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f9609ffb640 1 -- 172.21.15.12:0/548466573 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7f95fc001680 con 0x7f960c153080 2023-10-16T23:28:02.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f9609ffb640 1 -- 172.21.15.12:0/548466573 >> v1:172.21.15.12:6789/0 conn(0x7f960c153080 legacy=0x7f960c153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:02.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f9609ffb640 1 --2- 172.21.15.12:0/548466573 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f960c0c1410 0x7f95f4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:02.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f9609ffb640 1 --2- 172.21.15.12:0/548466573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f4003f00 0x7f95f40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:02.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f9609ffb640 1 --2- 172.21.15.12:0/548466573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95f4004d10 0x7f95f4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:02.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f9609ffb640 1 -- 172.21.15.12:0/548466573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c1577f0 con 0x7f95f4004d10 2023-10-16T23:28:02.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f9609ffb640 1 -- 172.21.15.12:0/548466573 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f400b990 con 0x7f95f4003f00 2023-10-16T23:28:02.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f9609ffb640 1 -- 172.21.15.12:0/548466573 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f400bad0 con 0x7f960c0c1410 2023-10-16T23:28:02.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f960b7fe640 1 --2- 172.21.15.12:0/548466573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95f4004d10 0x7f95f4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:02.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f960affd640 1 --2- 172.21.15.12:0/548466573 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f960c0c1410 0x7f95f4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:02.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f960a7fc640 1 --2- 172.21.15.12:0/548466573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f4003f00 0x7f95f40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:02.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f960b7fe640 1 -- 172.21.15.12:0/548466573 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f960c0c1410 msgr2=0x7f95f4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:02.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f960b7fe640 1 --2- 172.21.15.12:0/548466573 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f960c0c1410 0x7f95f4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:02.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f960b7fe640 1 -- 172.21.15.12:0/548466573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f4003f00 msgr2=0x7f95f40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:02.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f960b7fe640 1 --2- 172.21.15.12:0/548466573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f4003f00 0x7f95f40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:02.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f960b7fe640 1 -- 172.21.15.12:0/548466573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f4003530 con 0x7f95f4004d10 2023-10-16T23:28:02.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f960a7fc640 1 --2- 172.21.15.12:0/548466573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f4003f00 0x7f95f40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:28:02.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.528+0000 7f960affd640 1 --2- 172.21.15.12:0/548466573 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f960c0c1410 0x7f95f4003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:28:02.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.532+0000 7f960b7fe640 1 --2- 172.21.15.12:0/548466573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95f4004d10 0x7f95f4005190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f960c0c1820 tx=0x7f960401cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a757562e13ef2d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:02.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.532+0000 7f9609ffb640 1 -- 172.21.15.12:0/548466573 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96040a5bd0 con 0x7f95f4004d10 2023-10-16T23:28:02.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.532+0000 7f9609ffb640 1 -- 172.21.15.12:0/548466573 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960400f040 con 0x7f95f4004d10 2023-10-16T23:28:02.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.532+0000 7f9609ffb640 1 -- 172.21.15.12:0/548466573 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96040ad440 con 0x7f95f4004d10 2023-10-16T23:28:02.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.532+0000 7f96117a3640 1 -- 172.21.15.12:0/548466573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95f4004d10 msgr2=0x7f95f4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:02.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.532+0000 7f96117a3640 1 --2- 172.21.15.12:0/548466573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95f4004d10 0x7f95f4005190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f960c0c1820 tx=0x7f960401cb60 comp rx=0 tx=0).stop 2023-10-16T23:28:02.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.532+0000 7f960b7fe640 1 -- 172.21.15.12:0/548466573 reap_dead start 2023-10-16T23:28:02.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.532+0000 7f96117a3640 1 -- 172.21.15.12:0/548466573 shutdown_connections 2023-10-16T23:28:02.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.532+0000 7f96117a3640 1 -- 172.21.15.12:0/548466573 >> 172.21.15.12:0/548466573 conn(0x7f960c06ba20 msgr2=0x7f960c0c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:02.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.532+0000 7f96117a3640 1 -- 172.21.15.12:0/548466573 shutdown_connections 2023-10-16T23:28:02.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.532+0000 7f96117a3640 1 -- 172.21.15.12:0/548466573 wait complete. 2023-10-16T23:28:02.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.532+0000 7f96117a3640 1 Processor -- start 2023-10-16T23:28:02.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.532+0000 7f96117a3640 1 -- start start 2023-10-16T23:28:02.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f96117a3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f4004d10 0x7f960c143b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:02.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f96117a3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f960c144040 0x7f960c0b7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:02.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f96117a3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f960c0b84d0 0x7f960c1e7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:02.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f96117a3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c0ba130 con 0x7f960c144040 2023-10-16T23:28:02.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f96117a3640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c0b9660 con 0x7f95f4004d10 2023-10-16T23:28:02.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f96117a3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c0ba380 con 0x7f960c0b84d0 2023-10-16T23:28:02.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f960a7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f960c144040 0x7f960c0b7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:02.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f960a7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f960c144040 0x7f960c0b7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41604/0 (socket says 172.21.15.12:41604) 2023-10-16T23:28:02.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f960a7fc640 1 -- 172.21.15.12:0/528911604 learned_addr learned my addr 172.21.15.12:0/528911604 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:02.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f960affd640 1 --2- 172.21.15.12:0/528911604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f4004d10 0x7f960c143b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:02.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f960b7fe640 1 --2- 172.21.15.12:0/528911604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f960c0b84d0 0x7f960c1e7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:02.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f960a7fc640 1 -- 172.21.15.12:0/528911604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f960c0b84d0 msgr2=0x7f960c1e7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:02.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f960a7fc640 1 --2- 172.21.15.12:0/528911604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f960c0b84d0 0x7f960c1e7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:02.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f960a7fc640 1 -- 172.21.15.12:0/528911604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f4004d10 msgr2=0x7f960c143b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:02.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f960a7fc640 1 --2- 172.21.15.12:0/528911604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f4004d10 0x7f960c143b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:02.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f960a7fc640 1 -- 172.21.15.12:0/528911604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c0703b0 con 0x7f960c144040 2023-10-16T23:28:02.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f960affd640 1 --2- 172.21.15.12:0/528911604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f4004d10 0x7f960c143b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:02.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f960b7fe640 1 --2- 172.21.15.12:0/528911604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f960c0b84d0 0x7f960c1e7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:02.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f960a7fc640 1 --2- 172.21.15.12:0/528911604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f960c144040 0x7f960c0b7f90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9600009160 tx=0x7f9600011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:02.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f95f37fe640 1 -- 172.21.15.12:0/528911604 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600004220 con 0x7f960c144040 2023-10-16T23:28:02.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f95f37fe640 1 -- 172.21.15.12:0/528911604 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9600004380 con 0x7f960c144040 2023-10-16T23:28:02.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f95f37fe640 1 -- 172.21.15.12:0/528911604 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600015890 con 0x7f960c144040 2023-10-16T23:28:02.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f96117a3640 1 -- 172.21.15.12:0/528911604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960c0b8950 con 0x7f960c144040 2023-10-16T23:28:02.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f96117a3640 1 -- 172.21.15.12:0/528911604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960c14f4d0 con 0x7f960c144040 2023-10-16T23:28:02.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f96117a3640 1 -- 172.21.15.12:0/528911604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960c0673a0 con 0x7f960c144040 2023-10-16T23:28:02.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f95f37fe640 1 -- 172.21.15.12:0/528911604 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f96000159f0 con 0x7f960c144040 2023-10-16T23:28:02.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f95f37fe640 1 --2- 172.21.15.12:0/528911604 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f95f8065e60 0x7f95f8068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:02.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.536+0000 7f95f37fe640 1 -- 172.21.15.12:0/528911604 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9600083ca0 con 0x7f960c144040 2023-10-16T23:28:02.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.540+0000 7f960affd640 1 --2- 172.21.15.12:0/528911604 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f95f8065e60 0x7f95f8068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:02.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.540+0000 7f960affd640 1 --2- 172.21.15.12:0/528911604 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f95f8065e60 0x7f95f8068320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f95fc0017b0 tx=0x7f95fc001c70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:02.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.540+0000 7f95f37fe640 1 -- 172.21.15.12:0/528911604 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f9600051380 con 0x7f960c144040 2023-10-16T23:28:02.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.732+0000 7f96117a3640 1 -- 172.21.15.12:0/528911604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f960c066e40 con 0x7f960c144040 2023-10-16T23:28:02.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.732+0000 7f95f37fe640 1 -- 172.21.15.12:0/528911604 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9600022060 con 0x7f960c144040 2023-10-16T23:28:02.735 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T23:28:02.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.732+0000 7f96117a3640 1 -- 172.21.15.12:0/528911604 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f95f8065e60 msgr2=0x7f95f8068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:02.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.732+0000 7f96117a3640 1 --2- 172.21.15.12:0/528911604 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f95f8065e60 0x7f95f8068320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f95fc0017b0 tx=0x7f95fc001c70 comp rx=0 tx=0).stop 2023-10-16T23:28:02.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.732+0000 7f96117a3640 1 -- 172.21.15.12:0/528911604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f960c144040 msgr2=0x7f960c0b7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.732+0000 7f96117a3640 1 --2- 172.21.15.12:0/528911604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f960c144040 0x7f960c0b7f90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9600009160 tx=0x7f9600011a60 comp rx=0 tx=0).stop 2023-10-16T23:28:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.732+0000 7f96117a3640 1 -- 172.21.15.12:0/528911604 shutdown_connections 2023-10-16T23:28:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.732+0000 7f96117a3640 1 --2- 172.21.15.12:0/528911604 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f95f8065e60 0x7f95f8068320 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.732+0000 7f96117a3640 1 --2- 172.21.15.12:0/528911604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f960c0b84d0 0x7f960c1e7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:02.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.732+0000 7f96117a3640 1 --2- 172.21.15.12:0/528911604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f960c144040 0x7f960c0b7f90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:02.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.732+0000 7f96117a3640 1 --2- 172.21.15.12:0/528911604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f4004d10 0x7f960c143b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:02.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.732+0000 7f96117a3640 1 -- 172.21.15.12:0/528911604 >> 172.21.15.12:0/528911604 conn(0x7f960c06ba20 msgr2=0x7f960c0c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:02.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.732+0000 7f96117a3640 1 -- 172.21.15.12:0/528911604 shutdown_connections 2023-10-16T23:28:02.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:02.732+0000 7f96117a3640 1 -- 172.21.15.12:0/528911604 wait complete. 2023-10-16T23:28:02.754 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T23:28:02.754 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T23:28:02.755 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-10-16T23:28:02.755 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-16T23:28:02.755 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-16T23:28:02.755 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T23:28:02.756 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T23:28:02.756 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T23:28:02.756 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-16T23:28:02.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:02.757 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-10-16T23:28:02.763 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T23:28:02.764 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T23:28:02.764 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T23:28:02.764 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-16T23:28:02.764 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-10-16T23:28:02.765 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-16T23:28:02.765 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-16T23:28:02.765 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-10-16T23:28:02.765 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2023-10-16T23:28:02.765 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-16T23:28:02.766 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-10-16T23:28:02.766 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2023-10-16T23:28:02.766 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-16T23:28:02.766 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-10-16T23:28:02.766 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T23:28:02.767 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-10-16T23:28:02.767 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-16T23:28:02.767 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42433sec preferred_lft 42433sec 2023-10-16T23:28:02.767 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2023-10-16T23:28:02.767 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-16T23:28:02.768 INFO:teuthology.orchestra.run.smithi072.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-16T23:28:02.768 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 02:42:68:c2:10:d4 brd ff:ff:ff:ff:ff:ff 2023-10-16T23:28:02.768 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-16T23:28:02.769 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-16T23:28:02.769 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-16T23:28:02.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:02.770 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-16T23:28:02.770 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-16T23:28:02.770 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add name ceph-brx type bridge 2023-10-16T23:28:02.771 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr flush dev ceph-brx 2023-10-16T23:28:02.771 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set ceph-brx up 2023-10-16T23:28:02.771 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-16T23:28:02.771 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-16T23:28:02.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:02.854 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T23:28:02.864 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-16T23:28:02.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:02.866 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-10-16T23:28:02.932 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-10-16T23:28:02.933 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T23:28:02.933 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-16T23:28:02.933 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T23:28:02.933 INFO:teuthology.orchestra.run.smithi072.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-16T23:28:02.933 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T23:28:02.934 INFO:teuthology.orchestra.run.smithi072.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-16T23:28:02.934 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-16T23:28:02.934 INFO:teuthology.orchestra.run.smithi072.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-16T23:28:02.934 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T23:28:02.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:02.935 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-16T23:28:02.935 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-16T23:28:02.936 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T23:28:02.936 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T23:28:02.937 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T23:28:02.937 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-16T23:28:03.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:03.009 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-10-16T23:28:03.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:03.059 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2023-10-16T23:28:03.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:03.106 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-16T23:28:03.106 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-16T23:28:03.107 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T23:28:03.107 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-16T23:28:03.107 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-16T23:28:03.177 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-16T23:28:03.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:03.177 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-16T23:28:03.178 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-16T23:28:03.178 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-16T23:28:03.178 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-16T23:28:03.179 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-16T23:28:03.179 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-16T23:28:03.179 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-16T23:28:03.179 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-16T23:28:03.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:03.279 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-16T23:28:03.280 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-16T23:28:03.280 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-10-16T23:28:03.280 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.0 master ceph-brx 2023-10-16T23:28:03.281 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-16T23:28:03.300 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-16T23:28:03.300 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T23:28:03.300 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-16T23:28:03.345 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-16T23:28:03.346 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T23:28:03.346 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-16T23:28:03.392 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-10-16T23:28:03.448 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-16T23:28:03.449 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-16T23:28:03.504 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-16T23:28:03.505 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-16T23:28:03.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:03.506 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-10-16T23:28:03.553 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-16T23:28:03.553 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-16T23:28:03.598 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-10-16T23:28:03.613 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-16T23:28:03.613 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-16T23:28:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-16T23:28:03.673 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-16T23:28:03.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:03.674 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-10-16T23:28:03.694 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi072.stderr:2023-10-16T23:28:03.692+0000 7f83e4a57580 -1 init, newargv = 0x5645a4969ef0 newargc=15 2023-10-16T23:28:03.694 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi072.stderr:ceph-fuse[33388]: starting ceph client 2023-10-16T23:28:03.702 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi072.stderr:ceph-fuse[33388]: starting fuse 2023-10-16T23:28:04.800 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-10-16T23:28:04.815 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-16T23:28:04.816 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-16T23:28:04.867 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-16T23:28:04.868 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-16T23:28:04.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:04.870 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-10-16T23:28:04.917 INFO:teuthology.orchestra.run.smithi072.stdout:45 2023-10-16T23:28:04.917 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-16T23:28:04.918 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-16T23:28:04.918 DEBUG:teuthology.orchestra.run.smithi072:> import glob 2023-10-16T23:28:04.918 DEBUG:teuthology.orchestra.run.smithi072:> import re 2023-10-16T23:28:04.919 DEBUG:teuthology.orchestra.run.smithi072:> import os 2023-10-16T23:28:04.919 DEBUG:teuthology.orchestra.run.smithi072:> import subprocess 2023-10-16T23:28:04.919 DEBUG:teuthology.orchestra.run.smithi072:> 2023-10-16T23:28:04.920 DEBUG:teuthology.orchestra.run.smithi072:> def _find_admin_socket(client_name): 2023-10-16T23:28:04.920 DEBUG:teuthology.orchestra.run.smithi072:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-16T23:28:04.920 DEBUG:teuthology.orchestra.run.smithi072:> files = glob.glob(asok_path) 2023-10-16T23:28:04.920 DEBUG:teuthology.orchestra.run.smithi072:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-16T23:28:04.921 DEBUG:teuthology.orchestra.run.smithi072:> 2023-10-16T23:28:04.921 DEBUG:teuthology.orchestra.run.smithi072:> # Given a non-glob path, it better be there 2023-10-16T23:28:04.921 DEBUG:teuthology.orchestra.run.smithi072:> if "*" not in asok_path: 2023-10-16T23:28:04.922 DEBUG:teuthology.orchestra.run.smithi072:> assert(len(files) == 1) 2023-10-16T23:28:04.922 DEBUG:teuthology.orchestra.run.smithi072:> return files[0] 2023-10-16T23:28:04.922 DEBUG:teuthology.orchestra.run.smithi072:> 2023-10-16T23:28:04.923 DEBUG:teuthology.orchestra.run.smithi072:> for f in files: 2023-10-16T23:28:04.923 DEBUG:teuthology.orchestra.run.smithi072:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-16T23:28:04.923 DEBUG:teuthology.orchestra.run.smithi072:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-16T23:28:04.924 DEBUG:teuthology.orchestra.run.smithi072:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-16T23:28:04.924 DEBUG:teuthology.orchestra.run.smithi072:> contents = proc_f.read() 2023-10-16T23:28:04.924 DEBUG:teuthology.orchestra.run.smithi072:> if mountpoint in contents: 2023-10-16T23:28:04.924 DEBUG:teuthology.orchestra.run.smithi072:> return f 2023-10-16T23:28:04.925 DEBUG:teuthology.orchestra.run.smithi072:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-16T23:28:04.925 DEBUG:teuthology.orchestra.run.smithi072:> 2023-10-16T23:28:04.925 DEBUG:teuthology.orchestra.run.smithi072:> print(_find_admin_socket("client.1")) 2023-10-16T23:28:04.926 DEBUG:teuthology.orchestra.run.smithi072:> ' 2023-10-16T23:28:05.037 INFO:teuthology.orchestra.run.smithi072.stdout:/var/run/ceph/ceph-client.1.33388.asok 2023-10-16T23:28:05.219 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33388.asok 2023-10-16T23:28:05.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:05.220 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.33388.asok status 2023-10-16T23:28:05.374 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-10-16T23:28:05.375 INFO:teuthology.orchestra.run.smithi072.stdout: "metadata": { 2023-10-16T23:28:05.375 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_sha1": "ab9fe43522bc41de59746200b95f65d4fbcccffe", 2023-10-16T23:28:05.375 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 18.2.0-668-gab9fe435 (ab9fe43522bc41de59746200b95f65d4fbcccffe) reef (stable)", 2023-10-16T23:28:05.375 INFO:teuthology.orchestra.run.smithi072.stdout: "entity_id": "1", 2023-10-16T23:28:05.375 INFO:teuthology.orchestra.run.smithi072.stdout: "hostname": "smithi072", 2023-10-16T23:28:05.376 INFO:teuthology.orchestra.run.smithi072.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-16T23:28:05.376 INFO:teuthology.orchestra.run.smithi072.stdout: "pid": "33388", 2023-10-16T23:28:05.376 INFO:teuthology.orchestra.run.smithi072.stdout: "root": "/" 2023-10-16T23:28:05.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-16T23:28:05.376 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_count": 0, 2023-10-16T23:28:05.377 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_pinned_count": 0, 2023-10-16T23:28:05.377 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4493, 2023-10-16T23:28:05.377 INFO:teuthology.orchestra.run.smithi072.stdout: "inst": { 2023-10-16T23:28:05.377 INFO:teuthology.orchestra.run.smithi072.stdout: "name": { 2023-10-16T23:28:05.377 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "client", 2023-10-16T23:28:05.377 INFO:teuthology.orchestra.run.smithi072.stdout: "num": 4493 2023-10-16T23:28:05.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-16T23:28:05.378 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-10-16T23:28:05.378 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-10-16T23:28:05.378 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "172.21.15.72:0", 2023-10-16T23:28:05.378 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 871600094 2023-10-16T23:28:05.379 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-16T23:28:05.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-16T23:28:05.379 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-10-16T23:28:05.379 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-10-16T23:28:05.379 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "172.21.15.72:0", 2023-10-16T23:28:05.380 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 871600094 2023-10-16T23:28:05.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-16T23:28:05.380 INFO:teuthology.orchestra.run.smithi072.stdout: "inst_str": "client.4493 172.21.15.72:0/871600094", 2023-10-16T23:28:05.380 INFO:teuthology.orchestra.run.smithi072.stdout: "addr_str": "172.21.15.72:0/871600094", 2023-10-16T23:28:05.380 INFO:teuthology.orchestra.run.smithi072.stdout: "inode_count": 1, 2023-10-16T23:28:05.380 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_epoch": 7, 2023-10-16T23:28:05.381 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch": 24, 2023-10-16T23:28:05.381 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch_barrier": 0, 2023-10-16T23:28:05.381 INFO:teuthology.orchestra.run.smithi072.stdout: "blocklisted": false, 2023-10-16T23:28:05.382 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs" 2023-10-16T23:28:05.382 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-10-16T23:28:05.390 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T23:28:05.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.520+0000 7f5f153b9640 1 Processor -- start 2023-10-16T23:28:05.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.520+0000 7f5f153b9640 1 -- start start 2023-10-16T23:28:05.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.524+0000 7f5f153b9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f1014cc30 0x7f5f100ba650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:05.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.524+0000 7f5f153b9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f100b40c0 con 0x7f5f100c1130 2023-10-16T23:28:05.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.524+0000 7f5f153b9640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f100b7ce0 con 0x7f5f100b8630 2023-10-16T23:28:05.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.524+0000 7f5f153b9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f100b3ca0 con 0x7f5f1014cc30 2023-10-16T23:28:05.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.524+0000 7f5f0effd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5f100c1130 0x7f5f1014c520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45726/0 (socket says 172.21.15.12:45726) 2023-10-16T23:28:05.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.524+0000 7f5f0effd640 1 -- 172.21.15.12:0/1168408215 learned_addr learned my addr 172.21.15.12:0/1168408215 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:05.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.524+0000 7f5f0f7fe640 1 --2- 172.21.15.12:0/1168408215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f1014cc30 0x7f5f100ba650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:05.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.524+0000 7f5f0dffb640 1 -- 172.21.15.12:0/1168408215 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366790946 0 0) 0x7f5f100b40c0 con 0x7f5f100c1130 2023-10-16T23:28:05.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.524+0000 7f5f0dffb640 1 -- 172.21.15.12:0/1168408215 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5efc003530 con 0x7f5f100c1130 2023-10-16T23:28:05.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.524+0000 7f5f0dffb640 1 -- 172.21.15.12:0/1168408215 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784337102 0 0) 0x7f5f100b7ce0 con 0x7f5f100b8630 2023-10-16T23:28:05.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.524+0000 7f5f0dffb640 1 -- 172.21.15.12:0/1168408215 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f100b40c0 con 0x7f5f100b8630 2023-10-16T23:28:05.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.524+0000 7f5f0f7fe640 1 -- 172.21.15.12:0/1168408215 >> v1:172.21.15.31:6789/0 conn(0x7f5f100b8630 legacy=0x7f5f100b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:05.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.524+0000 7f5f0f7fe640 1 -- 172.21.15.12:0/1168408215 >> v1:172.21.15.12:6789/0 conn(0x7f5f100c1130 legacy=0x7f5f1014c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:05.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.524+0000 7f5f0f7fe640 1 -- 172.21.15.12:0/1168408215 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f100bab90 con 0x7f5f1014cc30 2023-10-16T23:28:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f0f7fe640 1 --2- 172.21.15.12:0/1168408215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f1014cc30 0x7f5f100ba650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5f080097f0 tx=0x7f5f0801c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=224893cf8c9e8ef2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f0dffb640 1 -- 172.21.15.12:0/1168408215 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f080ac620 con 0x7f5f1014cc30 2023-10-16T23:28:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f0dffb640 1 -- 172.21.15.12:0/1168408215 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f080ac780 con 0x7f5f1014cc30 2023-10-16T23:28:05.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f0dffb640 1 -- 172.21.15.12:0/1168408215 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f080acb10 con 0x7f5f1014cc30 2023-10-16T23:28:05.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f153b9640 1 -- 172.21.15.12:0/1168408215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f1014cc30 msgr2=0x7f5f100ba650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:05.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f153b9640 1 --2- 172.21.15.12:0/1168408215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f1014cc30 0x7f5f100ba650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5f080097f0 tx=0x7f5f0801c3a0 comp rx=0 tx=0).stop 2023-10-16T23:28:05.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f153b9640 1 -- 172.21.15.12:0/1168408215 shutdown_connections 2023-10-16T23:28:05.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f153b9640 1 --2- 172.21.15.12:0/1168408215 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f1014cc30 0x7f5f100ba650 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:05.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f153b9640 1 -- 172.21.15.12:0/1168408215 >> 172.21.15.12:0/1168408215 conn(0x7f5f1006ba20 msgr2=0x7f5f100c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:05.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f153b9640 1 -- 172.21.15.12:0/1168408215 shutdown_connections 2023-10-16T23:28:05.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f153b9640 1 -- 172.21.15.12:0/1168408215 wait complete. 2023-10-16T23:28:05.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f153b9640 1 Processor -- start 2023-10-16T23:28:05.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f153b9640 1 -- start start 2023-10-16T23:28:05.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f153b9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f100b8630 0x7f5f1013f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:05.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f153b9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f100c1130 0x7f5f101e8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:05.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f153b9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f1014cc30 0x7f5f10143a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:05.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f153b9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f101459e0 con 0x7f5f1014cc30 2023-10-16T23:28:05.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f153b9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1013f720 con 0x7f5f100c1130 2023-10-16T23:28:05.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f153b9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f101e8d80 con 0x7f5f100b8630 2023-10-16T23:28:05.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f0f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f1014cc30 0x7f5f10143a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:05.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f0f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f1014cc30 0x7f5f10143a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41620/0 (socket says 172.21.15.12:41620) 2023-10-16T23:28:05.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f0f7fe640 1 -- 172.21.15.12:0/2516687938 learned_addr learned my addr 172.21.15.12:0/2516687938 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:05.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f0f7fe640 1 -- 172.21.15.12:0/2516687938 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f100b8630 msgr2=0x7f5f1013f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:05.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f0f7fe640 1 --2- 172.21.15.12:0/2516687938 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f100b8630 0x7f5f1013f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:05.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f0f7fe640 1 -- 172.21.15.12:0/2516687938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f100c1130 msgr2=0x7f5f101e8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:05.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f0f7fe640 1 --2- 172.21.15.12:0/2516687938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f100c1130 0x7f5f101e8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:05.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f0f7fe640 1 -- 172.21.15.12:0/2516687938 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f08009420 con 0x7f5f1014cc30 2023-10-16T23:28:05.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f0f7fe640 1 --2- 172.21.15.12:0/2516687938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f1014cc30 0x7f5f10143a40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009740 tx=0x7f5f08019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:05.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f077fe640 1 -- 172.21.15.12:0/2516687938 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f080ac620 con 0x7f5f1014cc30 2023-10-16T23:28:05.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f077fe640 1 -- 172.21.15.12:0/2516687938 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f080b5410 con 0x7f5f1014cc30 2023-10-16T23:28:05.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.528+0000 7f5f153b9640 1 -- 172.21.15.12:0/2516687938 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f101e9000 con 0x7f5f1014cc30 2023-10-16T23:28:05.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.532+0000 7f5f077fe640 1 -- 172.21.15.12:0/2516687938 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f080b57c0 con 0x7f5f1014cc30 2023-10-16T23:28:05.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.532+0000 7f5f153b9640 1 -- 172.21.15.12:0/2516687938 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f1013fc60 con 0x7f5f1014cc30 2023-10-16T23:28:05.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.532+0000 7f5f153b9640 1 -- 172.21.15.12:0/2516687938 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f100673a0 con 0x7f5f1014cc30 2023-10-16T23:28:05.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.532+0000 7f5f077fe640 1 -- 172.21.15.12:0/2516687938 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f5f080b3040 con 0x7f5f1014cc30 2023-10-16T23:28:05.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.532+0000 7f5f077fe640 1 --2- 172.21.15.12:0/2516687938 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5ef0065e90 0x7f5ef0068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:05.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.532+0000 7f5f077fe640 1 -- 172.21.15.12:0/2516687938 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5f0811d680 con 0x7f5f1014cc30 2023-10-16T23:28:05.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.532+0000 7f5f0effd640 1 --2- 172.21.15.12:0/2516687938 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5ef0065e90 0x7f5ef0068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:05.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.532+0000 7f5f0effd640 1 --2- 172.21.15.12:0/2516687938 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5ef0065e90 0x7f5ef0068350 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5f00007fd0 tx=0x7f5f00007960 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:05.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.536+0000 7f5f077fe640 1 -- 172.21.15.12:0/2516687938 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f5f080eac30 con 0x7f5f1014cc30 2023-10-16T23:28:05.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.728+0000 7f5f153b9640 1 -- 172.21.15.12:0/2516687938 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5f101e94b0 con 0x7f5f1014cc30 2023-10-16T23:28:05.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.728+0000 7f5f077fe640 1 -- 172.21.15.12:0/2516687938 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5f080ee250 con 0x7f5f1014cc30 2023-10-16T23:28:05.730 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T23:28:05.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.728+0000 7f5f153b9640 1 -- 172.21.15.12:0/2516687938 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5ef0065e90 msgr2=0x7f5ef0068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:05.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.728+0000 7f5f153b9640 1 --2- 172.21.15.12:0/2516687938 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5ef0065e90 0x7f5ef0068350 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5f00007fd0 tx=0x7f5f00007960 comp rx=0 tx=0).stop 2023-10-16T23:28:05.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.728+0000 7f5f153b9640 1 -- 172.21.15.12:0/2516687938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f1014cc30 msgr2=0x7f5f10143a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:05.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.728+0000 7f5f153b9640 1 --2- 172.21.15.12:0/2516687938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f1014cc30 0x7f5f10143a40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009740 tx=0x7f5f08019140 comp rx=0 tx=0).stop 2023-10-16T23:28:05.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.728+0000 7f5f153b9640 1 -- 172.21.15.12:0/2516687938 shutdown_connections 2023-10-16T23:28:05.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.728+0000 7f5f153b9640 1 --2- 172.21.15.12:0/2516687938 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5ef0065e90 0x7f5ef0068350 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:05.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.728+0000 7f5f153b9640 1 --2- 172.21.15.12:0/2516687938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f1014cc30 0x7f5f10143a40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:05.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.728+0000 7f5f153b9640 1 --2- 172.21.15.12:0/2516687938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f100c1130 0x7f5f101e8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:05.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.728+0000 7f5f153b9640 1 --2- 172.21.15.12:0/2516687938 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f100b8630 0x7f5f1013f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:05.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.728+0000 7f5f153b9640 1 -- 172.21.15.12:0/2516687938 >> 172.21.15.12:0/2516687938 conn(0x7f5f1006ba20 msgr2=0x7f5f1014c490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:05.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.728+0000 7f5f153b9640 1 -- 172.21.15.12:0/2516687938 shutdown_connections 2023-10-16T23:28:05.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:05.728+0000 7f5f153b9640 1 -- 172.21.15.12:0/2516687938 wait complete. 2023-10-16T23:28:05.749 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T23:28:05.750 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T23:28:05.750 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi138.front.sepia.ceph.com 2023-10-16T23:28:05.750 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-16T23:28:05.750 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-16T23:28:05.751 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T23:28:05.751 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T23:28:05.751 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T23:28:05.752 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-16T23:28:05.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:05.752 DEBUG:teuthology.orchestra.run.smithi138:> ip addr 2023-10-16T23:28:05.759 INFO:teuthology.orchestra.run.smithi138.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T23:28:05.759 INFO:teuthology.orchestra.run.smithi138.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T23:28:05.759 INFO:teuthology.orchestra.run.smithi138.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T23:28:05.760 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-10-16T23:28:05.760 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 ::1/128 scope host 2023-10-16T23:28:05.760 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-10-16T23:28:05.760 INFO:teuthology.orchestra.run.smithi138.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-16T23:28:05.760 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7a brd ff:ff:ff:ff:ff:ff 2023-10-16T23:28:05.761 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f0 2023-10-16T23:28:05.761 INFO:teuthology.orchestra.run.smithi138.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-16T23:28:05.761 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7b brd ff:ff:ff:ff:ff:ff 2023-10-16T23:28:05.761 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f1 2023-10-16T23:28:05.761 INFO:teuthology.orchestra.run.smithi138.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-16T23:28:05.762 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:70 brd ff:ff:ff:ff:ff:ff 2023-10-16T23:28:05.762 INFO:teuthology.orchestra.run.smithi138.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T23:28:05.762 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:71 brd ff:ff:ff:ff:ff:ff 2023-10-16T23:28:05.762 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.21.15.138/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-16T23:28:05.762 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft 42418sec preferred_lft 42418sec 2023-10-16T23:28:05.763 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::ec4:7aff:fe88:6f71/64 scope link 2023-10-16T23:28:05.763 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-10-16T23:28:05.763 INFO:teuthology.orchestra.run.smithi138.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-16T23:28:05.763 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 02:42:7a:9a:48:e9 brd ff:ff:ff:ff:ff:ff 2023-10-16T23:28:05.763 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-16T23:28:05.764 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-10-16T23:28:05.764 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-16T23:28:05.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:05.765 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2023-10-16T23:28:05.765 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2023-10-16T23:28:05.765 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link add name ceph-brx type bridge 2023-10-16T23:28:05.766 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip addr flush dev ceph-brx 2023-10-16T23:28:05.766 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set ceph-brx up 2023-10-16T23:28:05.766 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-16T23:28:05.766 DEBUG:teuthology.orchestra.run.smithi138:> ') 2023-10-16T23:28:05.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:05.848 DEBUG:teuthology.orchestra.run.smithi138:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T23:28:05.903 INFO:teuthology.orchestra.run.smithi138.stdout:1 2023-10-16T23:28:05.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:05.905 DEBUG:teuthology.orchestra.run.smithi138:> route 2023-10-16T23:28:05.979 INFO:teuthology.orchestra.run.smithi138.stdout:Kernel IP routing table 2023-10-16T23:28:05.980 INFO:teuthology.orchestra.run.smithi138.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T23:28:05.980 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-16T23:28:05.980 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T23:28:05.980 INFO:teuthology.orchestra.run.smithi138.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-16T23:28:05.980 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T23:28:05.980 INFO:teuthology.orchestra.run.smithi138.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-16T23:28:05.981 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-16T23:28:05.981 INFO:teuthology.orchestra.run.smithi138.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-16T23:28:05.981 INFO:teuthology.orchestra.run.smithi138.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T23:28:05.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:05.982 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2023-10-16T23:28:05.982 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2023-10-16T23:28:05.982 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T23:28:05.982 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T23:28:05.983 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T23:28:05.983 DEBUG:teuthology.orchestra.run.smithi138:> ') 2023-10-16T23:28:06.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:06.056 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2023-10-16T23:28:06.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:06.105 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list-id 2023-10-16T23:28:06.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:06.153 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2023-10-16T23:28:06.153 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2023-10-16T23:28:06.153 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T23:28:06.153 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 0 2023-10-16T23:28:06.154 DEBUG:teuthology.orchestra.run.smithi138:> ') 2023-10-16T23:28:06.219 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.1/16 2023-10-16T23:28:06.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:06.219 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2023-10-16T23:28:06.220 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2023-10-16T23:28:06.220 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.0 2023-10-16T23:28:06.220 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-16T23:28:06.221 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-16T23:28:06.221 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-16T23:28:06.221 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-16T23:28:06.222 DEBUG:teuthology.orchestra.run.smithi138:> ') 2023-10-16T23:28:06.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:06.319 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2023-10-16T23:28:06.320 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2023-10-16T23:28:06.320 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set brx.0 up 2023-10-16T23:28:06.320 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set dev brx.0 master ceph-brx 2023-10-16T23:28:06.320 DEBUG:teuthology.orchestra.run.smithi138:> ') 2023-10-16T23:28:06.339 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-10-16T23:28:06.339 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T23:28:06.340 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-16T23:28:06.387 INFO:teuthology.orchestra.run.smithi138.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-16T23:28:06.388 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T23:28:06.388 DEBUG:teuthology.orchestra.run.smithi138:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-16T23:28:06.439 DEBUG:teuthology.orchestra.run.smithi138:> sudo modprobe fuse 2023-10-16T23:28:06.494 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-16T23:28:06.495 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-16T23:28:06.545 INFO:teuthology.orchestra.run.smithi138.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-16T23:28:06.547 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-16T23:28:06.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:06.548 DEBUG:teuthology.orchestra.run.smithi138:> ls /sys/fs/fuse/connections 2023-10-16T23:28:06.595 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-16T23:28:06.595 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-10-16T23:28:06.641 DEBUG:teuthology.orchestra.run.smithi138:> sudo modprobe fuse 2023-10-16T23:28:06.657 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-16T23:28:06.657 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-16T23:28:06.710 INFO:teuthology.orchestra.run.smithi138.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-16T23:28:06.711 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-16T23:28:06.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:06.712 DEBUG:teuthology.orchestra.run.smithi138:> ls /sys/fs/fuse/connections 2023-10-16T23:28:06.734 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi138.stderr:2023-10-16T23:28:06.730+0000 7fd7c243e580 -1 init, newargv = 0x55b6388eda60 newargc=15 2023-10-16T23:28:06.734 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi138.stderr:ceph-fuse[33334]: starting ceph client 2023-10-16T23:28:06.744 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi138.stderr:ceph-fuse[33334]: starting fuse 2023-10-16T23:28:07.840 DEBUG:teuthology.orchestra.run.smithi138:> sudo modprobe fuse 2023-10-16T23:28:07.857 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-16T23:28:07.857 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-16T23:28:07.910 INFO:teuthology.orchestra.run.smithi138.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-16T23:28:07.911 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-16T23:28:07.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:07.912 DEBUG:teuthology.orchestra.run.smithi138:> ls /sys/fs/fuse/connections 2023-10-16T23:28:07.960 INFO:teuthology.orchestra.run.smithi138.stdout:45 2023-10-16T23:28:07.960 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-16T23:28:07.961 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-16T23:28:07.961 DEBUG:teuthology.orchestra.run.smithi138:> import glob 2023-10-16T23:28:07.961 DEBUG:teuthology.orchestra.run.smithi138:> import re 2023-10-16T23:28:07.962 DEBUG:teuthology.orchestra.run.smithi138:> import os 2023-10-16T23:28:07.962 DEBUG:teuthology.orchestra.run.smithi138:> import subprocess 2023-10-16T23:28:07.962 DEBUG:teuthology.orchestra.run.smithi138:> 2023-10-16T23:28:07.963 DEBUG:teuthology.orchestra.run.smithi138:> def _find_admin_socket(client_name): 2023-10-16T23:28:07.963 DEBUG:teuthology.orchestra.run.smithi138:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-10-16T23:28:07.963 DEBUG:teuthology.orchestra.run.smithi138:> files = glob.glob(asok_path) 2023-10-16T23:28:07.964 DEBUG:teuthology.orchestra.run.smithi138:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-10-16T23:28:07.964 DEBUG:teuthology.orchestra.run.smithi138:> 2023-10-16T23:28:07.964 DEBUG:teuthology.orchestra.run.smithi138:> # Given a non-glob path, it better be there 2023-10-16T23:28:07.964 DEBUG:teuthology.orchestra.run.smithi138:> if "*" not in asok_path: 2023-10-16T23:28:07.965 DEBUG:teuthology.orchestra.run.smithi138:> assert(len(files) == 1) 2023-10-16T23:28:07.965 DEBUG:teuthology.orchestra.run.smithi138:> return files[0] 2023-10-16T23:28:07.965 DEBUG:teuthology.orchestra.run.smithi138:> 2023-10-16T23:28:07.966 DEBUG:teuthology.orchestra.run.smithi138:> for f in files: 2023-10-16T23:28:07.966 DEBUG:teuthology.orchestra.run.smithi138:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-16T23:28:07.966 DEBUG:teuthology.orchestra.run.smithi138:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-16T23:28:07.967 DEBUG:teuthology.orchestra.run.smithi138:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-16T23:28:07.967 DEBUG:teuthology.orchestra.run.smithi138:> contents = proc_f.read() 2023-10-16T23:28:07.967 DEBUG:teuthology.orchestra.run.smithi138:> if mountpoint in contents: 2023-10-16T23:28:07.967 DEBUG:teuthology.orchestra.run.smithi138:> return f 2023-10-16T23:28:07.968 DEBUG:teuthology.orchestra.run.smithi138:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-16T23:28:07.968 DEBUG:teuthology.orchestra.run.smithi138:> 2023-10-16T23:28:07.968 DEBUG:teuthology.orchestra.run.smithi138:> print(_find_admin_socket("client.2")) 2023-10-16T23:28:07.969 DEBUG:teuthology.orchestra.run.smithi138:> ' 2023-10-16T23:28:08.081 INFO:teuthology.orchestra.run.smithi138.stdout:/var/run/ceph/ceph-client.2.33334.asok 2023-10-16T23:28:08.263 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.33334.asok 2023-10-16T23:28:08.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:08.264 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.33334.asok status 2023-10-16T23:28:08.424 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2023-10-16T23:28:08.425 INFO:teuthology.orchestra.run.smithi138.stdout: "metadata": { 2023-10-16T23:28:08.425 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_sha1": "ab9fe43522bc41de59746200b95f65d4fbcccffe", 2023-10-16T23:28:08.425 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_version": "ceph version 18.2.0-668-gab9fe435 (ab9fe43522bc41de59746200b95f65d4fbcccffe) reef (stable)", 2023-10-16T23:28:08.425 INFO:teuthology.orchestra.run.smithi138.stdout: "entity_id": "2", 2023-10-16T23:28:08.425 INFO:teuthology.orchestra.run.smithi138.stdout: "hostname": "smithi138", 2023-10-16T23:28:08.425 INFO:teuthology.orchestra.run.smithi138.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-10-16T23:28:08.426 INFO:teuthology.orchestra.run.smithi138.stdout: "pid": "33334", 2023-10-16T23:28:08.426 INFO:teuthology.orchestra.run.smithi138.stdout: "root": "/" 2023-10-16T23:28:08.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2023-10-16T23:28:08.426 INFO:teuthology.orchestra.run.smithi138.stdout: "dentry_count": 0, 2023-10-16T23:28:08.426 INFO:teuthology.orchestra.run.smithi138.stdout: "dentry_pinned_count": 0, 2023-10-16T23:28:08.427 INFO:teuthology.orchestra.run.smithi138.stdout: "id": 4573, 2023-10-16T23:28:08.427 INFO:teuthology.orchestra.run.smithi138.stdout: "inst": { 2023-10-16T23:28:08.427 INFO:teuthology.orchestra.run.smithi138.stdout: "name": { 2023-10-16T23:28:08.427 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "client", 2023-10-16T23:28:08.427 INFO:teuthology.orchestra.run.smithi138.stdout: "num": 4573 2023-10-16T23:28:08.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2023-10-16T23:28:08.428 INFO:teuthology.orchestra.run.smithi138.stdout: "addr": { 2023-10-16T23:28:08.428 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "v1", 2023-10-16T23:28:08.428 INFO:teuthology.orchestra.run.smithi138.stdout: "addr": "172.21.15.138:0", 2023-10-16T23:28:08.428 INFO:teuthology.orchestra.run.smithi138.stdout: "nonce": 844838017 2023-10-16T23:28:08.428 INFO:teuthology.orchestra.run.smithi138.stdout: } 2023-10-16T23:28:08.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2023-10-16T23:28:08.429 INFO:teuthology.orchestra.run.smithi138.stdout: "addr": { 2023-10-16T23:28:08.429 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "v1", 2023-10-16T23:28:08.429 INFO:teuthology.orchestra.run.smithi138.stdout: "addr": "172.21.15.138:0", 2023-10-16T23:28:08.429 INFO:teuthology.orchestra.run.smithi138.stdout: "nonce": 844838017 2023-10-16T23:28:08.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2023-10-16T23:28:08.430 INFO:teuthology.orchestra.run.smithi138.stdout: "inst_str": "client.4573 172.21.15.138:0/844838017", 2023-10-16T23:28:08.430 INFO:teuthology.orchestra.run.smithi138.stdout: "addr_str": "172.21.15.138:0/844838017", 2023-10-16T23:28:08.430 INFO:teuthology.orchestra.run.smithi138.stdout: "inode_count": 1, 2023-10-16T23:28:08.430 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_epoch": 7, 2023-10-16T23:28:08.430 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_epoch": 24, 2023-10-16T23:28:08.431 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_epoch_barrier": 0, 2023-10-16T23:28:08.431 INFO:teuthology.orchestra.run.smithi138.stdout: "blocklisted": false, 2023-10-16T23:28:08.431 INFO:teuthology.orchestra.run.smithi138.stdout: "fs_name": "cephfs" 2023-10-16T23:28:08.431 INFO:teuthology.orchestra.run.smithi138.stdout:} 2023-10-16T23:28:08.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:08.440 DEBUG:teuthology.orchestra.run.smithi033:> stat --file-system '--printf=%T 2023-10-16T23:28:08.440 DEBUG:teuthology.orchestra.run.smithi033:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-16T23:28:08.447 INFO:teuthology.orchestra.run.smithi033.stdout:fuseblk 2023-10-16T23:28:08.448 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-16T23:28:08.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:08.448 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-16T23:28:08.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:08.506 DEBUG:teuthology.orchestra.run.smithi072:> stat --file-system '--printf=%T 2023-10-16T23:28:08.506 DEBUG:teuthology.orchestra.run.smithi072:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-16T23:28:08.514 INFO:teuthology.orchestra.run.smithi072.stdout:fuseblk 2023-10-16T23:28:08.515 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-16T23:28:08.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:08.515 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-16T23:28:08.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:08.577 DEBUG:teuthology.orchestra.run.smithi138:> stat --file-system '--printf=%T 2023-10-16T23:28:08.577 DEBUG:teuthology.orchestra.run.smithi138:> ' -- /home/ubuntu/cephtest/mnt.2 2023-10-16T23:28:08.585 INFO:teuthology.orchestra.run.smithi138.stdout:fuseblk 2023-10-16T23:28:08.586 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-10-16T23:28:08.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:08.586 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-16T23:28:08.641 INFO:teuthology.run_tasks:Running task pexec... 2023-10-16T23:28:08.652 INFO:teuthology.task.pexec:Executing custom commands... 2023-10-16T23:28:08.653 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi033.front.sepia.ceph.com 2023-10-16T23:28:08.653 DEBUG:teuthology.orchestra.run.smithi033:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-16T23:28:08.654 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi072.front.sepia.ceph.com 2023-10-16T23:28:08.654 DEBUG:teuthology.orchestra.run.smithi072:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-16T23:28:08.655 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi138.front.sepia.ceph.com 2023-10-16T23:28:08.655 DEBUG:teuthology.orchestra.run.smithi138:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-16T23:28:08.687 INFO:teuthology.orchestra.run.smithi033.stderr:--2023-10-16 23:28:08-- http://download.ceph.com/qa/ior.tbz2 2023-10-16T23:28:08.688 INFO:teuthology.orchestra.run.smithi033.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2023-10-16T23:28:08.690 INFO:teuthology.orchestra.run.smithi072.stderr:--2023-10-16 23:28:08-- http://download.ceph.com/qa/ior.tbz2 2023-10-16T23:28:08.692 INFO:teuthology.orchestra.run.smithi072.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2023-10-16T23:28:08.708 INFO:teuthology.orchestra.run.smithi138.stderr:--2023-10-16 23:28:08-- http://download.ceph.com/qa/ior.tbz2 2023-10-16T23:28:08.709 INFO:teuthology.orchestra.run.smithi033.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2023-10-16T23:28:08.709 INFO:teuthology.orchestra.run.smithi138.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2023-10-16T23:28:08.713 INFO:teuthology.orchestra.run.smithi072.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2023-10-16T23:28:08.729 INFO:teuthology.orchestra.run.smithi033.stderr:HTTP request sent, awaiting response... 404 Not Found 2023-10-16T23:28:08.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-16 23:28:08 ERROR 404: Not Found. 2023-10-16T23:28:08.730 INFO:teuthology.orchestra.run.smithi033.stderr: 2023-10-16T23:28:08.731 DEBUG:teuthology.orchestra.run:got remote process result: 8 2023-10-16T23:28:08.732 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/pexec.py", line 149, in task p.spawn(_exec_host, barrier, barrier_queue, remote[0], sudo, testdir, remote[1]) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/pexec.py", line 60, in _exec_host tor.wait([r]) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi033 with status 8: 'TESTDIR=/home/ubuntu/cephtest bash -s' 2023-10-16T23:28:08.801 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=b59c4ef01fcd4a3b9daf49243444c329 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/pexec.py", line 149, in task p.spawn(_exec_host, barrier, barrier_queue, remote[0], sudo, testdir, remote[1]) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/pexec.py", line 60, in _exec_host tor.wait([r]) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi033 with status 8: 'TESTDIR=/home/ubuntu/cephtest bash -s' 2023-10-16T23:28:08.804 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-16T23:28:08.814 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-16T23:28:08.814 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-16T23:28:08.815 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T23:28:08.830 DEBUG:teuthology.orchestra.run:got remote process result: 8 2023-10-16T23:28:08.831 DEBUG:teuthology.orchestra.run:got remote process result: 8 2023-10-16T23:28:08.831 INFO:teuthology.orchestra.run.smithi072.stderr:HTTP request sent, awaiting response... 404 Not Found 2023-10-16T23:28:08.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-16 23:28:08 ERROR 404: Not Found. 2023-10-16T23:28:08.832 INFO:teuthology.orchestra.run.smithi072.stderr: 2023-10-16T23:28:08.832 INFO:teuthology.orchestra.run.smithi138.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2023-10-16T23:28:08.833 INFO:teuthology.orchestra.run.smithi138.stderr:HTTP request sent, awaiting response... 404 Not Found 2023-10-16T23:28:08.833 INFO:teuthology.orchestra.run.smithi138.stderr:2023-10-16 23:28:08 ERROR 404: Not Found. 2023-10-16T23:28:08.833 INFO:teuthology.orchestra.run.smithi138.stderr: 2023-10-16T23:28:08.844 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-16T23:28:08.844 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T23:28:08.891 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T23:28:09.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.020+0000 7f25063f6640 1 Processor -- start 2023-10-16T23:28:09.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.020+0000 7f25063f6640 1 -- start start 2023-10-16T23:28:09.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.024+0000 7f25063f6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25000b8630 0x7f250014cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.024+0000 7f25063f6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f25000b9f40 0x7f25000ba390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.024+0000 7f25063f6640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25000b40c0 con 0x7f25000c1130 2023-10-16T23:28:09.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.024+0000 7f25063f6640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25000b3ca0 con 0x7f25000b9f40 2023-10-16T23:28:09.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.024+0000 7f25063f6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25000b8a90 con 0x7f25000b8630 2023-10-16T23:28:09.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.024+0000 7f2504993640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f25000b9f40 0x7f25000ba390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.024+0000 7f24fffff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f25000c1130 0x7f250014c520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46310/0 (socket says 172.21.15.12:46310) 2023-10-16T23:28:09.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.024+0000 7f24fffff640 1 -- 172.21.15.12:0/4028239284 learned_addr learned my addr 172.21.15.12:0/4028239284 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:09.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.024+0000 7f24ff7fe640 1 --2- 172.21.15.12:0/4028239284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25000b8630 0x7f250014cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.024+0000 7f2504993640 1 -- 172.21.15.12:0/4028239284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25000b8630 msgr2=0x7f250014cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:09.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.024+0000 7f2504993640 1 --2- 172.21.15.12:0/4028239284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25000b8630 0x7f250014cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.024+0000 7f2504993640 1 -- 172.21.15.12:0/4028239284 >> v1:172.21.15.12:6789/0 conn(0x7f25000c1130 legacy=0x7f250014c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:09.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.024+0000 7f2504993640 1 -- 172.21.15.12:0/4028239284 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25000b7ce0 con 0x7f25000b9f40 2023-10-16T23:28:09.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.024+0000 7f2504993640 1 --2- 172.21.15.12:0/4028239284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25000b9f40 0x7f25000ba390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f24f8009d90 tx=0x7f24f801c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f51bbc1c0ef555 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:09.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.024+0000 7f24feffd640 1 -- 172.21.15.12:0/4028239284 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f80a6700 con 0x7f25000b9f40 2023-10-16T23:28:09.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.024+0000 7f24feffd640 1 -- 172.21.15.12:0/4028239284 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f80a6860 con 0x7f25000b9f40 2023-10-16T23:28:09.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.024+0000 7f24feffd640 1 -- 172.21.15.12:0/4028239284 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f80a6bf0 con 0x7f25000b9f40 2023-10-16T23:28:09.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f25063f6640 1 -- 172.21.15.12:0/4028239284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25000b9f40 msgr2=0x7f25000ba390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:09.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f25063f6640 1 --2- 172.21.15.12:0/4028239284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25000b9f40 0x7f25000ba390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f24f8009d90 tx=0x7f24f801c830 comp rx=0 tx=0).stop 2023-10-16T23:28:09.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f25063f6640 1 -- 172.21.15.12:0/4028239284 shutdown_connections 2023-10-16T23:28:09.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f25063f6640 1 --2- 172.21.15.12:0/4028239284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25000b9f40 0x7f25000ba390 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f25063f6640 1 --2- 172.21.15.12:0/4028239284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25000b8630 0x7f250014cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f25063f6640 1 -- 172.21.15.12:0/4028239284 >> 172.21.15.12:0/4028239284 conn(0x7f250006ba20 msgr2=0x7f25000c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:09.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f25063f6640 1 -- 172.21.15.12:0/4028239284 shutdown_connections 2023-10-16T23:28:09.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f25063f6640 1 -- 172.21.15.12:0/4028239284 wait complete. 2023-10-16T23:28:09.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f25063f6640 1 Processor -- start 2023-10-16T23:28:09.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f25063f6640 1 -- start start 2023-10-16T23:28:09.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f25063f6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25000b8630 0x7f25001eb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f25063f6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25000b9f40 0x7f250006fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f25063f6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25000c1130 0x7f25001e7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f25063f6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25000b6ff0 con 0x7f25000c1130 2023-10-16T23:28:09.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f25063f6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250013ad50 con 0x7f25000b9f40 2023-10-16T23:28:09.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f25063f6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25001ea8e0 con 0x7f25000b8630 2023-10-16T23:28:09.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f2504993640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25000c1130 0x7f25001e7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f2504993640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25000c1130 0x7f25001e7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51470/0 (socket says 172.21.15.12:51470) 2023-10-16T23:28:09.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f2504993640 1 -- 172.21.15.12:0/3953056999 learned_addr learned my addr 172.21.15.12:0/3953056999 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:09.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f24fffff640 1 --2- 172.21.15.12:0/3953056999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25000b8630 0x7f25001eb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f24ff7fe640 1 --2- 172.21.15.12:0/3953056999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25000b9f40 0x7f250006fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f2504993640 1 -- 172.21.15.12:0/3953056999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25000b8630 msgr2=0x7f25001eb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:09.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f2504993640 1 --2- 172.21.15.12:0/3953056999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25000b8630 0x7f25001eb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f2504993640 1 -- 172.21.15.12:0/3953056999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25000b9f40 msgr2=0x7f250006fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:09.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f2504993640 1 --2- 172.21.15.12:0/3953056999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25000b9f40 0x7f250006fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f2504993640 1 -- 172.21.15.12:0/3953056999 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f8009a70 con 0x7f25000c1130 2023-10-16T23:28:09.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f24ff7fe640 1 --2- 172.21.15.12:0/3953056999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25000b9f40 0x7f250006fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:09.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f2504993640 1 --2- 172.21.15.12:0/3953056999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25000c1130 0x7f25001e7240 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f24f80b0040 tx=0x7f24f80195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:09.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f24fcff9640 1 -- 172.21.15.12:0/3953056999 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f80b8840 con 0x7f25000c1130 2023-10-16T23:28:09.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f24fcff9640 1 -- 172.21.15.12:0/3953056999 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f80b89a0 con 0x7f25000c1130 2023-10-16T23:28:09.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f24fcff9640 1 -- 172.21.15.12:0/3953056999 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f80b8d50 con 0x7f25000c1130 2023-10-16T23:28:09.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f25063f6640 1 -- 172.21.15.12:0/3953056999 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25000b8480 con 0x7f25000c1130 2023-10-16T23:28:09.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.028+0000 7f25063f6640 1 -- 172.21.15.12:0/3953056999 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25001eb620 con 0x7f25000c1130 2023-10-16T23:28:09.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.032+0000 7f25063f6640 1 -- 172.21.15.12:0/3953056999 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25000673a0 con 0x7f25000c1130 2023-10-16T23:28:09.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.032+0000 7f24fcff9640 1 -- 172.21.15.12:0/3953056999 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f24f80ae420 con 0x7f25000c1130 2023-10-16T23:28:09.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.032+0000 7f24fcff9640 1 --2- 172.21.15.12:0/3953056999 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f24ec065e60 0x7f24ec068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.032+0000 7f24fcff9640 1 -- 172.21.15.12:0/3953056999 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f24f80aa070 con 0x7f25000c1130 2023-10-16T23:28:09.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.032+0000 7f24fffff640 1 --2- 172.21.15.12:0/3953056999 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f24ec065e60 0x7f24ec068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.032+0000 7f24fffff640 1 --2- 172.21.15.12:0/3953056999 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f24ec065e60 0x7f24ec068320 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f24f0005890 tx=0x7f24f0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:09.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.036+0000 7f24fcff9640 1 -- 172.21.15.12:0/3953056999 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f24f80eca30 con 0x7f25000c1130 2023-10-16T23:28:09.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.192+0000 7f25063f6640 1 -- 172.21.15.12:0/3953056999 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25001ead90 con 0x7f25000c1130 2023-10-16T23:28:09.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.192+0000 7f24fcff9640 1 -- 172.21.15.12:0/3953056999 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17763 (secure 0 0 0) 0x7f24f80f0050 con 0x7f25000c1130 2023-10-16T23:28:09.198 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:28:09.198 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"fsid":"0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51","created":"2023-10-16T23:27:16.468087+0000","modified":"2023-10-16T23:27:41.690088+0000","last_up_change":"2023-10-16T23:27:28.136202+0000","last_in_change":"2023-10-16T23:27:18.793212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T23:27:27.354025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-16T23:27:34.786446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-16T23:27:39.130341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-16T23:27:39.674572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73e70f98-6f5e-4464-b34e-931faac41cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":38075},{"type":"v1","addr":"172.21.15.12:6814","nonce":38075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":38075},{"type":"v1","addr":"172.21.15.12:6819","nonce":38075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":38075},{"type":"v1","addr":"172.21.15.12:6827","nonce":38075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":38075},{"type":"v1","addr":"172.21.15.12:6823","nonce":38075}]},"public_addr":"172.21.15.12:6814/38075","cluster_addr":"172.21.15.12:6819/38075","heartbeat_back_addr":"172.21.15.12:6827/38075","heartbeat_front_addr":"172.21.15.12:6823/38075","state":["exists","up"]},{"osd":1,"uuid":"ff722efe-b3f9-4cc0-bbde-f4d4d8055a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":38076},{"type":"v1","addr":"172.21.15.12:6811","nonce":38076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":38076},{"type":"v1","addr":"172.21.15.12:6818","nonce":38076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":38076},{"type":"v1","addr":"172.21.15.12:6831","nonce":38076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":38076},{"type":"v1","addr":"172.21.15.12:6825","nonce":38076}]},"public_addr":"172.21.15.12:6811/38076","cluster_addr":"172.21.15.12:6818/38076","heartbeat_back_addr":"172.21.15.12:6831/38076","heartbeat_front_addr":"172.21.15.12:6825/38076","state":["exists","up"]},{"osd":2,"uuid":"9baf25db-dce0-4065-90d6-f35867286be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6809","nonce":38073},{"type":"v1","addr":"172.21.15.12:6810","nonce":38073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":38073},{"type":"v1","addr":"172.21.15.12:6817","nonce":38073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":38073},{"type":"v1","addr":"172.21.15.12:6830","nonce":38073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":38073},{"type":"v1","addr":"172.21.15.12:6826","nonce":38073}]},"public_addr":"172.21.15.12:6810/38073","cluster_addr":"172.21.15.12:6817/38073","heartbeat_back_addr":"172.21.15.12:6830/38073","heartbeat_front_addr":"172.21.15.12:6826/38073","state":["exists","up"]},{"osd":3,"uuid":"8a620ad3-2294-470d-8a8c-66f177f5fbe7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":38074},{"type":"v1","addr":"172.21.15.12:6801","nonce":38074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":38074},{"type":"v1","addr":"172.21.15.12:6803","nonce":38074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":38074},{"type":"v1","addr":"172.21.15.12:6807","nonce":38074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":38074},{"type":"v1","addr":"172.21.15.12:6805","nonce":38074}]},"public_addr":"172.21.15.12:6801/38074","cluster_addr":"172.21.15.12:6803/38074","heartbeat_back_addr":"172.21.15.12:6807/38074","heartbeat_front_addr":"172.21.15.12:6805/38074","state":["exists","up"]},{"osd":4,"uuid":"a8824d77-7405-40f5-9234-60889802b184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":38266},{"type":"v1","addr":"172.21.15.31:6817","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":38266},{"type":"v1","addr":"172.21.15.31:6819","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":38266},{"type":"v1","addr":"172.21.15.31:6823","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":38266},{"type":"v1","addr":"172.21.15.31:6821","nonce":38266}]},"public_addr":"172.21.15.31:6817/38266","cluster_addr":"172.21.15.31:6819/38266","heartbeat_back_addr":"172.21.15.31:6823/38266","heartbeat_front_addr":"172.21.15.31:6821/38266","state":["exists","up"]},{"osd":5,"uuid":"3bb01192-a47c-48e9-9662-285e3f6f4b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":38264},{"type":"v1","addr":"172.21.15.31:6807","nonce":38264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":38264},{"type":"v1","addr":"172.21.15.31:6811","nonce":38264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":38264},{"type":"v1","addr":"172.21.15.31:6815","nonce":38264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":38264},{"type":"v1","addr":"172.21.15.31:6813","nonce":38264}]},"public_addr":"172.21.15.31:6807/38264","cluster_addr":"172.21.15.31:6811/38264","heartbeat_back_addr":"172.21.15.31:6815/38264","heartbeat_front_addr":"172.21.15.31:6813/38264","state":["exists","up"]},{"osd":6,"uuid":"1e2d18e4-73e6-4a37-826c-35eca4d96935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":38263},{"type":"v1","addr":"172.21.15.31:6825","nonce":38263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":38263},{"type":"v1","addr":"172.21.15.31:6827","nonce":38263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":38263},{"type":"v1","addr":"172.21.15.31:6831","nonce":38263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":38263},{"type":"v1","addr":"172.21.15.31:6829","nonce":38263}]},"public_addr":"172.21.15.31:6825/38263","cluster_addr":"172.21.15.31:6827/38263","heartbeat_back_addr":"172.21.15.31:6831/38263","heartbeat_front_addr":"172.21.15.31:6829/38263","state":["exists","up"]},{"osd":7,"uuid":"e0f369c0-562b-4440-a5aa-12275c29412b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":38265},{"type":"v1","addr":"172.21.15.31:6801","nonce":38265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":38265},{"type":"v1","addr":"172.21.15.31:6803","nonce":38265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":38265},{"type":"v1","addr":"172.21.15.31:6810","nonce":38265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":38265},{"type":"v1","addr":"172.21.15.31:6806","nonce":38265}]},"public_addr":"172.21.15.31:6801/38265","cluster_addr":"172.21.15.31:6803/38265","heartbeat_back_addr":"172.21.15.31:6810/38265","heartbeat_front_addr":"172.21.15.31:6806/38265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.411815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.372565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.209700+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.414619+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.316843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.300348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.359800+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.219854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T23:28:09.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.196+0000 7f25063f6640 1 -- 172.21.15.12:0/3953056999 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f24ec065e60 msgr2=0x7f24ec068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:09.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.196+0000 7f25063f6640 1 --2- 172.21.15.12:0/3953056999 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f24ec065e60 0x7f24ec068320 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f24f0005890 tx=0x7f24f0009040 comp rx=0 tx=0).stop 2023-10-16T23:28:09.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.196+0000 7f25063f6640 1 -- 172.21.15.12:0/3953056999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25000c1130 msgr2=0x7f25001e7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:09.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.196+0000 7f25063f6640 1 --2- 172.21.15.12:0/3953056999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25000c1130 0x7f25001e7240 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f24f80b0040 tx=0x7f24f80195d0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.196+0000 7f25063f6640 1 -- 172.21.15.12:0/3953056999 shutdown_connections 2023-10-16T23:28:09.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.196+0000 7f25063f6640 1 --2- 172.21.15.12:0/3953056999 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f24ec065e60 0x7f24ec068320 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.196+0000 7f25063f6640 1 --2- 172.21.15.12:0/3953056999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25000c1130 0x7f25001e7240 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.196+0000 7f25063f6640 1 --2- 172.21.15.12:0/3953056999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25000b9f40 0x7f250006fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.196+0000 7f25063f6640 1 --2- 172.21.15.12:0/3953056999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25000b8630 0x7f25001eb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.196+0000 7f25063f6640 1 -- 172.21.15.12:0/3953056999 >> 172.21.15.12:0/3953056999 conn(0x7f250006ba20 msgr2=0x7f2500144ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:09.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.196+0000 7f25063f6640 1 -- 172.21.15.12:0/3953056999 shutdown_connections 2023-10-16T23:28:09.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.196+0000 7f25063f6640 1 -- 172.21.15.12:0/3953056999 wait complete. 2023-10-16T23:28:09.215 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T23:27:27.354025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-16T23:27:34.786446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T23:27:39.130341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T23:27:39.674572+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T23:28:09.216 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T23:28:09.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.336+0000 7f58f7d8c640 1 Processor -- start 2023-10-16T23:28:09.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.336+0000 7f58f7d8c640 1 -- start start 2023-10-16T23:28:09.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f7d8c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f58f0147320 0x7f58f0150f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f7d8c640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f00bc8e0 con 0x7f58f00c12a0 2023-10-16T23:28:09.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f7d8c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f0147750 con 0x7f58f00bbe00 2023-10-16T23:28:09.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f7d8c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f00b3f40 con 0x7f58f0147320 2023-10-16T23:28:09.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f5b28640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f58f00c12a0 0x7f58f0146c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46326/0 (socket says 172.21.15.12:46326) 2023-10-16T23:28:09.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f5b28640 1 -- 172.21.15.12:0/553876791 learned_addr learned my addr 172.21.15.12:0/553876791 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:09.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f6329640 1 --2- 172.21.15.12:0/553876791 >> v2:172.21.15.31:3300/0 conn(0x7f58f0147320 0x7f58f0150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f4b26640 1 -- 172.21.15.12:0/553876791 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685264483 0 0) 0x7f58f00bc8e0 con 0x7f58f00c12a0 2023-10-16T23:28:09.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f4b26640 1 -- 172.21.15.12:0/553876791 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58dc003530 con 0x7f58f00c12a0 2023-10-16T23:28:09.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f4b26640 1 -- 172.21.15.12:0/553876791 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2353494145 0 0) 0x7f58dc003530 con 0x7f58f00c12a0 2023-10-16T23:28:09.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f4b26640 1 -- 172.21.15.12:0/553876791 >> v2:172.21.15.31:3300/0 conn(0x7f58f0147320 msgr2=0x7f58f0150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:09.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f4b26640 1 --2- 172.21.15.12:0/553876791 >> v2:172.21.15.31:3300/0 conn(0x7f58f0147320 0x7f58f0150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f4b26640 1 -- 172.21.15.12:0/553876791 >> v1:172.21.15.31:6789/0 conn(0x7f58f00bbe00 legacy=0x7f58f0150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:09.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f4b26640 1 -- 172.21.15.12:0/553876791 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f00b4220 con 0x7f58f00c12a0 2023-10-16T23:28:09.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f4b26640 1 -- 172.21.15.12:0/553876791 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7f58e0001680 con 0x7f58f00c12a0 2023-10-16T23:28:09.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f4b26640 1 -- 172.21.15.12:0/553876791 >> v1:172.21.15.12:6789/0 conn(0x7f58f00c12a0 legacy=0x7f58f0146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:09.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f4b26640 1 --2- 172.21.15.12:0/553876791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58dc003980 0x7f58dc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f4b26640 1 --2- 172.21.15.12:0/553876791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58dc0047d0 0x7f58dc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f4b26640 1 --2- 172.21.15.12:0/553876791 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58dc005190 0x7f58dc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f4b26640 1 -- 172.21.15.12:0/553876791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f00b3f40 con 0x7f58dc003980 2023-10-16T23:28:09.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f4b26640 1 -- 172.21.15.12:0/553876791 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc00c030 con 0x7f58dc0047d0 2023-10-16T23:28:09.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f4b26640 1 -- 172.21.15.12:0/553876791 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc00c1f0 con 0x7f58dc005190 2023-10-16T23:28:09.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f5b28640 1 --2- 172.21.15.12:0/553876791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58dc003980 0x7f58dc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f5327640 1 --2- 172.21.15.12:0/553876791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58dc0047d0 0x7f58dc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f5b28640 1 -- 172.21.15.12:0/553876791 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58dc005190 msgr2=0x7f58dc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:09.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f5b28640 1 --2- 172.21.15.12:0/553876791 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58dc005190 0x7f58dc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f5b28640 1 -- 172.21.15.12:0/553876791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58dc0047d0 msgr2=0x7f58dc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:09.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f5b28640 1 --2- 172.21.15.12:0/553876791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58dc0047d0 0x7f58dc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f5b28640 1 -- 172.21.15.12:0/553876791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58dc003530 con 0x7f58dc003980 2023-10-16T23:28:09.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f5327640 1 --2- 172.21.15.12:0/553876791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58dc0047d0 0x7f58dc004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:09.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f6329640 1 -- 172.21.15.12:0/553876791 reap_dead start 2023-10-16T23:28:09.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f5b28640 1 --2- 172.21.15.12:0/553876791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58dc003980 0x7f58dc003da0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f58e000c210 tx=0x7f58e001cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80454165047de550 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:09.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f4b26640 1 -- 172.21.15.12:0/553876791 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e00058e0 con 0x7f58dc003980 2023-10-16T23:28:09.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f4b26640 1 -- 172.21.15.12:0/553876791 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e0005a60 con 0x7f58dc003980 2023-10-16T23:28:09.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.340+0000 7f58f4b26640 1 -- 172.21.15.12:0/553876791 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e0005e10 con 0x7f58dc003980 2023-10-16T23:28:09.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f7d8c640 1 -- 172.21.15.12:0/553876791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58dc003980 msgr2=0x7f58dc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:09.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f7d8c640 1 --2- 172.21.15.12:0/553876791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58dc003980 0x7f58dc003da0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f58e000c210 tx=0x7f58e001cbc0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f7d8c640 1 -- 172.21.15.12:0/553876791 shutdown_connections 2023-10-16T23:28:09.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f7d8c640 1 --2- 172.21.15.12:0/553876791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58dc003980 0x7f58dc003da0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f7d8c640 1 -- 172.21.15.12:0/553876791 >> 172.21.15.12:0/553876791 conn(0x7f58f006bb10 msgr2=0x7f58f00c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:09.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f7d8c640 1 -- 172.21.15.12:0/553876791 shutdown_connections 2023-10-16T23:28:09.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f7d8c640 1 -- 172.21.15.12:0/553876791 wait complete. 2023-10-16T23:28:09.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f7d8c640 1 Processor -- start 2023-10-16T23:28:09.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f7d8c640 1 -- start start 2023-10-16T23:28:09.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f7d8c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58dc003980 0x7f58f014caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f7d8c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58f014f570 0x7f58f014b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f7d8c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58f014e780 0x7f58f00be730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f7d8c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f013b730 con 0x7f58f014e780 2023-10-16T23:28:09.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f7d8c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f00c0710 con 0x7f58f014f570 2023-10-16T23:28:09.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f7d8c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f014cfe0 con 0x7f58dc003980 2023-10-16T23:28:09.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f6329640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58f014e780 0x7f58f00be730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f6329640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58f014e780 0x7f58f00be730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51490/0 (socket says 172.21.15.12:51490) 2023-10-16T23:28:09.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f6329640 1 -- 172.21.15.12:0/2080088987 learned_addr learned my addr 172.21.15.12:0/2080088987 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:09.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f5b28640 1 --2- 172.21.15.12:0/2080088987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58dc003980 0x7f58f014caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f5327640 1 --2- 172.21.15.12:0/2080088987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58f014f570 0x7f58f014b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f6329640 1 -- 172.21.15.12:0/2080088987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58dc003980 msgr2=0x7f58f014caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:09.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f6329640 1 --2- 172.21.15.12:0/2080088987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58dc003980 0x7f58f014caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f6329640 1 -- 172.21.15.12:0/2080088987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58f014f570 msgr2=0x7f58f014b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:09.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f6329640 1 --2- 172.21.15.12:0/2080088987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58f014f570 0x7f58f014b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f6329640 1 -- 172.21.15.12:0/2080088987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f0140ed0 con 0x7f58f014e780 2023-10-16T23:28:09.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f5327640 1 --2- 172.21.15.12:0/2080088987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58f014f570 0x7f58f014b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:09.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f6329640 1 --2- 172.21.15.12:0/2080088987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58f014e780 0x7f58f00be730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f58f00b9c00 tx=0x7f58e800ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:09.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58e67fc640 1 -- 172.21.15.12:0/2080088987 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e8010040 con 0x7f58f014e780 2023-10-16T23:28:09.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58e67fc640 1 -- 172.21.15.12:0/2080088987 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e800bb10 con 0x7f58f014e780 2023-10-16T23:28:09.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f7d8c640 1 -- 172.21.15.12:0/2080088987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f0141170 con 0x7f58f014e780 2023-10-16T23:28:09.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58e67fc640 1 -- 172.21.15.12:0/2080088987 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e8014400 con 0x7f58f014e780 2023-10-16T23:28:09.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f7d8c640 1 -- 172.21.15.12:0/2080088987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f013ec00 con 0x7f58f014e780 2023-10-16T23:28:09.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.344+0000 7f58f7d8c640 1 -- 172.21.15.12:0/2080088987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f0150010 con 0x7f58f014e780 2023-10-16T23:28:09.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.348+0000 7f58e67fc640 1 -- 172.21.15.12:0/2080088987 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f58e8014560 con 0x7f58f014e780 2023-10-16T23:28:09.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.348+0000 7f58e67fc640 1 --2- 172.21.15.12:0/2080088987 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f58d4065e60 0x7f58d4068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.348+0000 7f58e67fc640 1 -- 172.21.15.12:0/2080088987 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f58e8083e00 con 0x7f58f014e780 2023-10-16T23:28:09.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.348+0000 7f58f5b28640 1 --2- 172.21.15.12:0/2080088987 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f58d4065e60 0x7f58d4068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.348+0000 7f58f5b28640 1 --2- 172.21.15.12:0/2080088987 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f58d4065e60 0x7f58d4068320 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f58e00aa000 tx=0x7f58e0000ff0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:09.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.352+0000 7f58e67fc640 1 -- 172.21.15.12:0/2080088987 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f58f0150010 con 0x7f58f014e780 2023-10-16T23:28:09.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.516+0000 7f58f7d8c640 1 -- 172.21.15.12:0/2080088987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f58f0150010 con 0x7f58f014e780 2023-10-16T23:28:09.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.516+0000 7f58e67fc640 1 -- 172.21.15.12:0/2080088987 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f58f0150010 con 0x7f58f014e780 2023-10-16T23:28:09.519 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-16T23:28:09.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.516+0000 7f58f7d8c640 1 -- 172.21.15.12:0/2080088987 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f58d4065e60 msgr2=0x7f58d4068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:09.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.516+0000 7f58f7d8c640 1 --2- 172.21.15.12:0/2080088987 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f58d4065e60 0x7f58d4068320 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f58e00aa000 tx=0x7f58e0000ff0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.516+0000 7f58f7d8c640 1 -- 172.21.15.12:0/2080088987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58f014e780 msgr2=0x7f58f00be730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:09.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.516+0000 7f58f7d8c640 1 --2- 172.21.15.12:0/2080088987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58f014e780 0x7f58f00be730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f58f00b9c00 tx=0x7f58e800ef30 comp rx=0 tx=0).stop 2023-10-16T23:28:09.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.516+0000 7f58f7d8c640 1 -- 172.21.15.12:0/2080088987 shutdown_connections 2023-10-16T23:28:09.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.516+0000 7f58f7d8c640 1 --2- 172.21.15.12:0/2080088987 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f58d4065e60 0x7f58d4068320 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.516+0000 7f58f7d8c640 1 --2- 172.21.15.12:0/2080088987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58f014e780 0x7f58f00be730 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.516+0000 7f58f7d8c640 1 --2- 172.21.15.12:0/2080088987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58f014f570 0x7f58f014b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.516+0000 7f58f7d8c640 1 --2- 172.21.15.12:0/2080088987 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58dc003980 0x7f58f014caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.516+0000 7f58f7d8c640 1 -- 172.21.15.12:0/2080088987 >> 172.21.15.12:0/2080088987 conn(0x7f58f006bb10 msgr2=0x7f58f00b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:09.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.516+0000 7f58f7d8c640 1 -- 172.21.15.12:0/2080088987 shutdown_connections 2023-10-16T23:28:09.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.516+0000 7f58f7d8c640 1 -- 172.21.15.12:0/2080088987 wait complete. 2023-10-16T23:28:09.538 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-16T23:28:09.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.652+0000 7f4620197640 1 Processor -- start 2023-10-16T23:28:09.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.652+0000 7f4620197640 1 -- start start 2023-10-16T23:28:09.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.652+0000 7f4620197640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46180b3bb0 0x7f461814fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.652+0000 7f4620197640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4618150410 0x7f461814b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.652+0000 7f4620197640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4618070fe0 con 0x7f46180c12a0 2023-10-16T23:28:09.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.652+0000 7f4620197640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f461814f7a0 con 0x7f4618150410 2023-10-16T23:28:09.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.652+0000 7f4620197640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46180b37e0 con 0x7f46180b3bb0 2023-10-16T23:28:09.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.652+0000 7f461e734640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4618150410 0x7f461814b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.652+0000 7f461e734640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4618150410 0x7f461814b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51494/0 (socket says 172.21.15.12:51494) 2023-10-16T23:28:09.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.652+0000 7f461e734640 1 -- 172.21.15.12:0/258122505 learned_addr learned my addr 172.21.15.12:0/258122505 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:09.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.652+0000 7f461d732640 1 --2- 172.21.15.12:0/258122505 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46180b3bb0 0x7f461814fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.652+0000 7f461e734640 1 -- 172.21.15.12:0/258122505 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46180b3bb0 msgr2=0x7f461814fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:09.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.652+0000 7f461e734640 1 --2- 172.21.15.12:0/258122505 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46180b3bb0 0x7f461814fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.652+0000 7f461e734640 1 -- 172.21.15.12:0/258122505 >> v1:172.21.15.31:6789/0 conn(0x7f46180c12a0 legacy=0x7f46180b90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:09.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.652+0000 7f461e734640 1 -- 172.21.15.12:0/258122505 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461814f9b0 con 0x7f4618150410 2023-10-16T23:28:09.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.656+0000 7f461e734640 1 --2- 172.21.15.12:0/258122505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4618150410 0x7f461814b7a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4610009870 tx=0x7f461001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33dcee4e0bcf850b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:09.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.656+0000 7f461cf31640 1 -- 172.21.15.12:0/258122505 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46100ab600 con 0x7f4618150410 2023-10-16T23:28:09.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.656+0000 7f461cf31640 1 -- 172.21.15.12:0/258122505 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46100a7050 con 0x7f4618150410 2023-10-16T23:28:09.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.656+0000 7f461cf31640 1 -- 172.21.15.12:0/258122505 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46100ab980 con 0x7f4618150410 2023-10-16T23:28:09.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.656+0000 7f4620197640 1 -- 172.21.15.12:0/258122505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4618150410 msgr2=0x7f461814b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:09.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.656+0000 7f4620197640 1 --2- 172.21.15.12:0/258122505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4618150410 0x7f461814b7a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4610009870 tx=0x7f461001c470 comp rx=0 tx=0).stop 2023-10-16T23:28:09.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.656+0000 7f4620197640 1 -- 172.21.15.12:0/258122505 shutdown_connections 2023-10-16T23:28:09.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.656+0000 7f4620197640 1 --2- 172.21.15.12:0/258122505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4618150410 0x7f461814b7a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.656+0000 7f4620197640 1 --2- 172.21.15.12:0/258122505 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46180b3bb0 0x7f461814fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.656+0000 7f4620197640 1 -- 172.21.15.12:0/258122505 >> 172.21.15.12:0/258122505 conn(0x7f461806bb10 msgr2=0x7f46180c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:09.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.656+0000 7f4620197640 1 -- 172.21.15.12:0/258122505 shutdown_connections 2023-10-16T23:28:09.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.656+0000 7f4620197640 1 -- 172.21.15.12:0/258122505 wait complete. 2023-10-16T23:28:09.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.656+0000 7f4620197640 1 Processor -- start 2023-10-16T23:28:09.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.656+0000 7f4620197640 1 -- start start 2023-10-16T23:28:09.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f4620197640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46180b3bb0 0x7f461814d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f4620197640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46180c12a0 0x7f46181470f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f4620197640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46180b4bb0 0x7f4618147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f4620197640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46180b4720 con 0x7f46180b3bb0 2023-10-16T23:28:09.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f4620197640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461814de20 con 0x7f46180c12a0 2023-10-16T23:28:09.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f4620197640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4618147d00 con 0x7f46180b4bb0 2023-10-16T23:28:09.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f461df33640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46180b3bb0 0x7f461814d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f461df33640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46180b3bb0 0x7f461814d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51500/0 (socket says 172.21.15.12:51500) 2023-10-16T23:28:09.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f461df33640 1 -- 172.21.15.12:0/4247378128 learned_addr learned my addr 172.21.15.12:0/4247378128 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:09.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f461e734640 1 --2- 172.21.15.12:0/4247378128 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46180b4bb0 0x7f4618147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f461d732640 1 --2- 172.21.15.12:0/4247378128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46180c12a0 0x7f46181470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f461df33640 1 -- 172.21.15.12:0/4247378128 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46180b4bb0 msgr2=0x7f4618147630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:09.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f461df33640 1 --2- 172.21.15.12:0/4247378128 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46180b4bb0 0x7f4618147630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f461df33640 1 -- 172.21.15.12:0/4247378128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46180c12a0 msgr2=0x7f46181470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:09.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f461df33640 1 --2- 172.21.15.12:0/4247378128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46180c12a0 0x7f46181470f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f461df33640 1 -- 172.21.15.12:0/4247378128 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46100094d0 con 0x7f46180b3bb0 2023-10-16T23:28:09.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f461d732640 1 --2- 172.21.15.12:0/4247378128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46180c12a0 0x7f46181470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:09.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f461e734640 1 --2- 172.21.15.12:0/4247378128 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46180b4bb0 0x7f4618147630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:09.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f461df33640 1 --2- 172.21.15.12:0/4247378128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46180b3bb0 0x7f461814d8e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f460c00c450 tx=0x7f460c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:09.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f460a7fc640 1 -- 172.21.15.12:0/4247378128 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c012830 con 0x7f46180b3bb0 2023-10-16T23:28:09.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f460a7fc640 1 -- 172.21.15.12:0/4247378128 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460c0129b0 con 0x7f46180b3bb0 2023-10-16T23:28:09.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f4620197640 1 -- 172.21.15.12:0/4247378128 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46180b43b0 con 0x7f46180b3bb0 2023-10-16T23:28:09.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f460a7fc640 1 -- 172.21.15.12:0/4247378128 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c012d60 con 0x7f46180b3bb0 2023-10-16T23:28:09.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f4620197640 1 -- 172.21.15.12:0/4247378128 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46180bb1c0 con 0x7f46180b3bb0 2023-10-16T23:28:09.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f4620197640 1 -- 172.21.15.12:0/4247378128 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4618147b70 con 0x7f46180b3bb0 2023-10-16T23:28:09.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f460a7fc640 1 -- 172.21.15.12:0/4247378128 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f460c01c460 con 0x7f46180b3bb0 2023-10-16T23:28:09.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f460a7fc640 1 --2- 172.21.15.12:0/4247378128 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f45fc065e60 0x7f45fc068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f460a7fc640 1 -- 172.21.15.12:0/4247378128 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f460c0835c0 con 0x7f46180b3bb0 2023-10-16T23:28:09.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.660+0000 7f461d732640 1 --2- 172.21.15.12:0/4247378128 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f45fc065e60 0x7f45fc068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.664+0000 7f461d732640 1 --2- 172.21.15.12:0/4247378128 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f45fc065e60 0x7f45fc068320 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f46180b5a70 tx=0x7f46140074a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:09.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.664+0000 7f460a7fc640 1 -- 172.21.15.12:0/4247378128 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f460c050ca0 con 0x7f46180b3bb0 2023-10-16T23:28:09.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.816+0000 7f4620197640 1 -- 172.21.15.12:0/4247378128 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f46180673a0 con 0x7f46180b3bb0 2023-10-16T23:28:09.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.816+0000 7f460a7fc640 1 -- 172.21.15.12:0/4247378128 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f460c0542c0 con 0x7f46180b3bb0 2023-10-16T23:28:09.821 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-10-16T23:28:09.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.820+0000 7f4620197640 1 -- 172.21.15.12:0/4247378128 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f45fc065e60 msgr2=0x7f45fc068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:09.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.820+0000 7f4620197640 1 --2- 172.21.15.12:0/4247378128 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f45fc065e60 0x7f45fc068320 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f46180b5a70 tx=0x7f46140074a0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.820+0000 7f4620197640 1 -- 172.21.15.12:0/4247378128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46180b3bb0 msgr2=0x7f461814d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:09.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.820+0000 7f4620197640 1 --2- 172.21.15.12:0/4247378128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46180b3bb0 0x7f461814d8e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f460c00c450 tx=0x7f460c00c910 comp rx=0 tx=0).stop 2023-10-16T23:28:09.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.820+0000 7f4620197640 1 -- 172.21.15.12:0/4247378128 shutdown_connections 2023-10-16T23:28:09.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.820+0000 7f4620197640 1 --2- 172.21.15.12:0/4247378128 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f45fc065e60 0x7f45fc068320 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.820+0000 7f4620197640 1 --2- 172.21.15.12:0/4247378128 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f46180b4bb0 0x7f4618147630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.820+0000 7f4620197640 1 --2- 172.21.15.12:0/4247378128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46180c12a0 0x7f46181470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.820+0000 7f4620197640 1 --2- 172.21.15.12:0/4247378128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46180b3bb0 0x7f461814d8e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.820+0000 7f4620197640 1 -- 172.21.15.12:0/4247378128 >> 172.21.15.12:0/4247378128 conn(0x7f461806bb10 msgr2=0x7f46180c0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.820+0000 7f4620197640 1 -- 172.21.15.12:0/4247378128 shutdown_connections 2023-10-16T23:28:09.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.820+0000 7f4620197640 1 -- 172.21.15.12:0/4247378128 wait complete. 2023-10-16T23:28:09.838 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T23:28:09.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f425a7b1640 1 Processor -- start 2023-10-16T23:28:09.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f425a7b1640 1 -- start start 2023-10-16T23:28:09.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f425a7b1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42540a6e70 0x7f42540bffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f425a7b1640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f425406c920 0x7f425406fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f425a7b1640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42540bfcd0 con 0x7f4254070130 2023-10-16T23:28:09.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f425a7b1640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42540c13c0 con 0x7f425406c920 2023-10-16T23:28:09.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f425a7b1640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42540bf9f0 con 0x7f42540a6e70 2023-10-16T23:28:09.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f4258d4e640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4254070130 0x7f425414dc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46328/0 (socket says 172.21.15.12:46328) 2023-10-16T23:28:09.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f4258d4e640 1 -- 172.21.15.12:0/3940611355 learned_addr learned my addr 172.21.15.12:0/3940611355 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:09.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f4253fff640 1 --2- 172.21.15.12:0/3940611355 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42540a6e70 0x7f42540bffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f42537fe640 1 --2- 172.21.15.12:0/3940611355 >> v2:172.21.15.31:3300/0 conn(0x7f425406c920 0x7f425406fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f4252ffd640 1 -- 172.21.15.12:0/3940611355 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192603612 0 0) 0x7f42540bfcd0 con 0x7f4254070130 2023-10-16T23:28:09.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f4252ffd640 1 -- 172.21.15.12:0/3940611355 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f423c003530 con 0x7f4254070130 2023-10-16T23:28:09.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f4252ffd640 1 -- 172.21.15.12:0/3940611355 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 909376760 0 0) 0x7f423c003530 con 0x7f4254070130 2023-10-16T23:28:09.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f4252ffd640 1 -- 172.21.15.12:0/3940611355 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42540a6e70 msgr2=0x7f42540bffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:09.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f4252ffd640 1 --2- 172.21.15.12:0/3940611355 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42540a6e70 0x7f42540bffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f4252ffd640 1 -- 172.21.15.12:0/3940611355 >> v2:172.21.15.31:3300/0 conn(0x7f425406c920 msgr2=0x7f425406fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:09.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f4252ffd640 1 --2- 172.21.15.12:0/3940611355 >> v2:172.21.15.31:3300/0 conn(0x7f425406c920 0x7f425406fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f4252ffd640 1 -- 172.21.15.12:0/3940611355 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42540bdeb0 con 0x7f4254070130 2023-10-16T23:28:09.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f4252ffd640 1 -- 172.21.15.12:0/3940611355 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7f4244001680 con 0x7f4254070130 2023-10-16T23:28:09.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f42537fe640 1 --2- 172.21.15.12:0/3940611355 >> v2:172.21.15.31:3300/0 conn(0x7f425406c920 0x7f425406fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T23:28:09.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f4252ffd640 1 -- 172.21.15.12:0/3940611355 >> v1:172.21.15.12:6789/0 conn(0x7f4254070130 legacy=0x7f425414dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:09.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f4252ffd640 1 --2- 172.21.15.12:0/3940611355 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42540a6e70 0x7f423c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f4252ffd640 1 --2- 172.21.15.12:0/3940611355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f423c003f00 0x7f423c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f4252ffd640 1 --2- 172.21.15.12:0/3940611355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f423c004d10 0x7f423c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f4252ffd640 1 -- 172.21.15.12:0/3940611355 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42540c13c0 con 0x7f423c004d10 2023-10-16T23:28:09.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f4252ffd640 1 -- 172.21.15.12:0/3940611355 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42540bf9f0 con 0x7f423c003f00 2023-10-16T23:28:09.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f4252ffd640 1 -- 172.21.15.12:0/3940611355 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423c00b990 con 0x7f42540a6e70 2023-10-16T23:28:09.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f4258d4e640 1 --2- 172.21.15.12:0/3940611355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f423c004d10 0x7f423c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f4253fff640 1 --2- 172.21.15.12:0/3940611355 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42540a6e70 0x7f423c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f42537fe640 1 --2- 172.21.15.12:0/3940611355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f423c003f00 0x7f423c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f4258d4e640 1 -- 172.21.15.12:0/3940611355 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42540a6e70 msgr2=0x7f423c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:09.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f4258d4e640 1 --2- 172.21.15.12:0/3940611355 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f42540a6e70 0x7f423c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f4258d4e640 1 -- 172.21.15.12:0/3940611355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f423c003f00 msgr2=0x7f423c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:09.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f4258d4e640 1 --2- 172.21.15.12:0/3940611355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f423c003f00 0x7f423c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.964+0000 7f4258d4e640 1 -- 172.21.15.12:0/3940611355 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c003530 con 0x7f423c004d10 2023-10-16T23:28:09.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.968+0000 7f4258d4e640 1 --2- 172.21.15.12:0/3940611355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f423c004d10 0x7f423c005190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f424400c290 tx=0x7f424401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a43c72546a27ae server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:09.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.968+0000 7f4252ffd640 1 -- 172.21.15.12:0/3940611355 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42440a5950 con 0x7f423c004d10 2023-10-16T23:28:09.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.968+0000 7f4252ffd640 1 -- 172.21.15.12:0/3940611355 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42440a5ab0 con 0x7f423c004d10 2023-10-16T23:28:09.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.968+0000 7f4252ffd640 1 -- 172.21.15.12:0/3940611355 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42440a5e60 con 0x7f423c004d10 2023-10-16T23:28:09.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.968+0000 7f425a7b1640 1 -- 172.21.15.12:0/3940611355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f423c004d10 msgr2=0x7f423c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:09.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.968+0000 7f425a7b1640 1 --2- 172.21.15.12:0/3940611355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f423c004d10 0x7f423c005190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f424400c290 tx=0x7f424401cc80 comp rx=0 tx=0).stop 2023-10-16T23:28:09.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.968+0000 7f4258d4e640 1 -- 172.21.15.12:0/3940611355 reap_dead start 2023-10-16T23:28:09.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.968+0000 7f425a7b1640 1 -- 172.21.15.12:0/3940611355 shutdown_connections 2023-10-16T23:28:09.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.968+0000 7f425a7b1640 1 -- 172.21.15.12:0/3940611355 >> 172.21.15.12:0/3940611355 conn(0x7f42540c18f0 msgr2=0x7f42540c1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:09.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.968+0000 7f425a7b1640 1 -- 172.21.15.12:0/3940611355 shutdown_connections 2023-10-16T23:28:09.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.968+0000 7f425a7b1640 1 -- 172.21.15.12:0/3940611355 wait complete. 2023-10-16T23:28:09.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.972+0000 7f425a7b1640 1 Processor -- start 2023-10-16T23:28:09.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.972+0000 7f425a7b1640 1 -- start start 2023-10-16T23:28:09.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.972+0000 7f425a7b1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f423c004d10 0x7f4254148460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.972+0000 7f425a7b1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42541e56b0 0x7f42541e4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.972+0000 7f425a7b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42541e5150 0x7f42540b6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.972+0000 7f425a7b1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42540b7ef0 con 0x7f42541e5150 2023-10-16T23:28:09.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.972+0000 7f425a7b1640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42541e4220 con 0x7f42541e56b0 2023-10-16T23:28:09.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.972+0000 7f425a7b1640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42541e8710 con 0x7f423c004d10 2023-10-16T23:28:09.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.972+0000 7f4258d4e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42541e5150 0x7f42540b6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.972+0000 7f4258d4e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42541e5150 0x7f42540b6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51522/0 (socket says 172.21.15.12:51522) 2023-10-16T23:28:09.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.972+0000 7f4258d4e640 1 -- 172.21.15.12:0/1063732156 learned_addr learned my addr 172.21.15.12:0/1063732156 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:09.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.972+0000 7f42537fe640 1 --2- 172.21.15.12:0/1063732156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42541e56b0 0x7f42541e4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.972+0000 7f4253fff640 1 --2- 172.21.15.12:0/1063732156 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f423c004d10 0x7f4254148460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.972+0000 7f4258d4e640 1 -- 172.21.15.12:0/1063732156 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f423c004d10 msgr2=0x7f4254148460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:09.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.972+0000 7f4258d4e640 1 --2- 172.21.15.12:0/1063732156 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f423c004d10 0x7f4254148460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.972+0000 7f4258d4e640 1 -- 172.21.15.12:0/1063732156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42541e56b0 msgr2=0x7f42541e4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:09.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.972+0000 7f4258d4e640 1 --2- 172.21.15.12:0/1063732156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42541e56b0 0x7f42541e4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:09.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.972+0000 7f4258d4e640 1 -- 172.21.15.12:0/1063732156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42541e4410 con 0x7f42541e5150 2023-10-16T23:28:09.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.972+0000 7f4258d4e640 1 --2- 172.21.15.12:0/1063732156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42541e5150 0x7f42540b6870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4244007040 tx=0x7f423c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:09.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.972+0000 7f4250ff9640 1 -- 172.21.15.12:0/1063732156 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42440a5950 con 0x7f42541e5150 2023-10-16T23:28:09.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.972+0000 7f4250ff9640 1 -- 172.21.15.12:0/1063732156 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42440072f0 con 0x7f42541e5150 2023-10-16T23:28:09.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.972+0000 7f425a7b1640 1 -- 172.21.15.12:0/1063732156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42541e46f0 con 0x7f42541e5150 2023-10-16T23:28:09.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.972+0000 7f4250ff9640 1 -- 172.21.15.12:0/1063732156 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4244000e90 con 0x7f42541e5150 2023-10-16T23:28:09.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.972+0000 7f425a7b1640 1 -- 172.21.15.12:0/1063732156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42541e77b0 con 0x7f42541e5150 2023-10-16T23:28:09.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.972+0000 7f425a7b1640 1 -- 172.21.15.12:0/1063732156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42540673a0 con 0x7f42541e5150 2023-10-16T23:28:09.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.972+0000 7f4250ff9640 1 -- 172.21.15.12:0/1063732156 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f42440b5030 con 0x7f42541e5150 2023-10-16T23:28:09.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.976+0000 7f4250ff9640 1 --2- 172.21.15.12:0/1063732156 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4240065e90 0x7f4240068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:09.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.976+0000 7f4250ff9640 1 -- 172.21.15.12:0/1063732156 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f424411d5c0 con 0x7f42541e5150 2023-10-16T23:28:09.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.976+0000 7f4253fff640 1 --2- 172.21.15.12:0/1063732156 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4240065e90 0x7f4240068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:09.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.976+0000 7f4253fff640 1 --2- 172.21.15.12:0/1063732156 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4240065e90 0x7f4240068350 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f424c007520 tx=0x7f424c00b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:09.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:09.980+0000 7f4250ff9640 1 -- 172.21.15.12:0/1063732156 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f42440eabf0 con 0x7f42541e5150 2023-10-16T23:28:10.091 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:28:10.094 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:28:10.097 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:28:10.099 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:28:10.102 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:28:10.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.128+0000 7f425a7b1640 1 -- 172.21.15.12:0/1063732156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f42540a1250 con 0x7f42541e5150 2023-10-16T23:28:10.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.128+0000 7f4250ff9640 1 -- 172.21.15.12:0/1063732156 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f42440bd0a0 con 0x7f42541e5150 2023-10-16T23:28:10.131 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-16T23:28:10.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.128+0000 7f425a7b1640 1 -- 172.21.15.12:0/1063732156 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4240065e90 msgr2=0x7f4240068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:10.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.128+0000 7f425a7b1640 1 --2- 172.21.15.12:0/1063732156 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4240065e90 0x7f4240068350 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f424c007520 tx=0x7f424c00b040 comp rx=0 tx=0).stop 2023-10-16T23:28:10.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.128+0000 7f425a7b1640 1 -- 172.21.15.12:0/1063732156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42541e5150 msgr2=0x7f42540b6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:10.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.128+0000 7f425a7b1640 1 --2- 172.21.15.12:0/1063732156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42541e5150 0x7f42540b6870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4244007040 tx=0x7f423c005800 comp rx=0 tx=0).stop 2023-10-16T23:28:10.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.128+0000 7f425a7b1640 1 -- 172.21.15.12:0/1063732156 shutdown_connections 2023-10-16T23:28:10.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.128+0000 7f425a7b1640 1 --2- 172.21.15.12:0/1063732156 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4240065e90 0x7f4240068350 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.128+0000 7f425a7b1640 1 --2- 172.21.15.12:0/1063732156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42541e5150 0x7f42540b6870 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.128+0000 7f425a7b1640 1 --2- 172.21.15.12:0/1063732156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42541e56b0 0x7f42541e4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.128+0000 7f425a7b1640 1 --2- 172.21.15.12:0/1063732156 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f423c004d10 0x7f4254148460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.128+0000 7f425a7b1640 1 -- 172.21.15.12:0/1063732156 >> 172.21.15.12:0/1063732156 conn(0x7f42540c18f0 msgr2=0x7f425406d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:10.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.128+0000 7f425a7b1640 1 -- 172.21.15.12:0/1063732156 shutdown_connections 2023-10-16T23:28:10.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.128+0000 7f425a7b1640 1 -- 172.21.15.12:0/1063732156 wait complete. 2023-10-16T23:28:10.149 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T23:28:10.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.312+0000 7f72cd674640 1 Processor -- start 2023-10-16T23:28:10.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.312+0000 7f72cd674640 1 -- start start 2023-10-16T23:28:10.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.312+0000 7f72cd674640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f72c806cb00 0x7f72c806f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:10.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.312+0000 7f72cd674640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72c80a72d0 0x7f72c814e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:10.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.312+0000 7f72cd674640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c80bdeb0 con 0x7f72c80c1420 2023-10-16T23:28:10.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.312+0000 7f72cd674640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c8071570 con 0x7f72c806cb00 2023-10-16T23:28:10.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.312+0000 7f72cd674640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c806fde0 con 0x7f72c80a72d0 2023-10-16T23:28:10.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.312+0000 7f72c6ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f72c806cb00 0x7f72c806f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:10.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.312+0000 7f72c6ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f72c806cb00 0x7f72c806f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51524/0 (socket says 172.21.15.12:51524) 2023-10-16T23:28:10.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.312+0000 7f72c6ffd640 1 -- 172.21.15.12:0/988701049 learned_addr learned my addr 172.21.15.12:0/988701049 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:10.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.312+0000 7f72c77fe640 1 --2- 172.21.15.12:0/988701049 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72c80a72d0 0x7f72c814e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:10.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.312+0000 7f72c6ffd640 1 -- 172.21.15.12:0/988701049 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72c80a72d0 msgr2=0x7f72c814e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:10.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.312+0000 7f72c6ffd640 1 --2- 172.21.15.12:0/988701049 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72c80a72d0 0x7f72c814e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.312+0000 7f72c6ffd640 1 -- 172.21.15.12:0/988701049 >> v1:172.21.15.31:6789/0 conn(0x7f72c80c1420 legacy=0x7f72c806d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:10.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.312+0000 7f72c6ffd640 1 -- 172.21.15.12:0/988701049 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c806ff80 con 0x7f72c806cb00 2023-10-16T23:28:10.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.316+0000 7f72c6ffd640 1 --2- 172.21.15.12:0/988701049 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72c806cb00 0x7f72c806f8a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f72bc0098a0 tx=0x7f72bc01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce821ad4456faf6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:10.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.316+0000 7f72c5ffb640 1 -- 172.21.15.12:0/988701049 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc0a8990 con 0x7f72c806cb00 2023-10-16T23:28:10.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.316+0000 7f72c5ffb640 1 -- 172.21.15.12:0/988701049 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72bc0a8af0 con 0x7f72c806cb00 2023-10-16T23:28:10.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.316+0000 7f72c5ffb640 1 -- 172.21.15.12:0/988701049 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc0a8e80 con 0x7f72c806cb00 2023-10-16T23:28:10.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.316+0000 7f72cd674640 1 -- 172.21.15.12:0/988701049 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72c806cb00 msgr2=0x7f72c806f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:10.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.316+0000 7f72cd674640 1 --2- 172.21.15.12:0/988701049 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72c806cb00 0x7f72c806f8a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f72bc0098a0 tx=0x7f72bc01ecd0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.316+0000 7f72cd674640 1 -- 172.21.15.12:0/988701049 shutdown_connections 2023-10-16T23:28:10.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.316+0000 7f72cd674640 1 --2- 172.21.15.12:0/988701049 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72c80a72d0 0x7f72c814e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.316+0000 7f72cd674640 1 --2- 172.21.15.12:0/988701049 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72c806cb00 0x7f72c806f8a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.316+0000 7f72cd674640 1 -- 172.21.15.12:0/988701049 >> 172.21.15.12:0/988701049 conn(0x7f72c80c18f0 msgr2=0x7f72c80c1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:10.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.316+0000 7f72cd674640 1 -- 172.21.15.12:0/988701049 shutdown_connections 2023-10-16T23:28:10.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.316+0000 7f72cd674640 1 -- 172.21.15.12:0/988701049 wait complete. 2023-10-16T23:28:10.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.316+0000 7f72cd674640 1 Processor -- start 2023-10-16T23:28:10.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.316+0000 7f72cd674640 1 -- start start 2023-10-16T23:28:10.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.316+0000 7f72cd674640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72c806cb00 0x7f72c80b7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:10.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.316+0000 7f72cd674640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72c80a72d0 0x7f72c814d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:10.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.316+0000 7f72cd674640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72c806bdc0 0x7f72c80b8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:10.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.316+0000 7f72cd674640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c814e580 con 0x7f72c806cb00 2023-10-16T23:28:10.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.316+0000 7f72cd674640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c814e2a0 con 0x7f72c806bdc0 2023-10-16T23:28:10.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.316+0000 7f72cd674640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c814d770 con 0x7f72c80a72d0 2023-10-16T23:28:10.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.316+0000 7f72c6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72c806cb00 0x7f72c80b7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:10.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.316+0000 7f72c6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72c806cb00 0x7f72c80b7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51530/0 (socket says 172.21.15.12:51530) 2023-10-16T23:28:10.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.316+0000 7f72c6ffd640 1 -- 172.21.15.12:0/800053182 learned_addr learned my addr 172.21.15.12:0/800053182 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:10.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.320+0000 7f72c67fc640 1 --2- 172.21.15.12:0/800053182 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72c80a72d0 0x7f72c814d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:10.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.320+0000 7f72c77fe640 1 --2- 172.21.15.12:0/800053182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72c806bdc0 0x7f72c80b8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:10.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.320+0000 7f72c6ffd640 1 -- 172.21.15.12:0/800053182 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72c80a72d0 msgr2=0x7f72c814d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:10.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.320+0000 7f72c6ffd640 1 --2- 172.21.15.12:0/800053182 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72c80a72d0 0x7f72c814d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.320+0000 7f72c6ffd640 1 -- 172.21.15.12:0/800053182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72c806bdc0 msgr2=0x7f72c80b8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:10.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.320+0000 7f72c6ffd640 1 --2- 172.21.15.12:0/800053182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72c806bdc0 0x7f72c80b8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.320+0000 7f72c6ffd640 1 -- 172.21.15.12:0/800053182 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72bc0094d0 con 0x7f72c806cb00 2023-10-16T23:28:10.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.320+0000 7f72c67fc640 1 --2- 172.21.15.12:0/800053182 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72c80a72d0 0x7f72c814d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:10.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.320+0000 7f72c77fe640 1 --2- 172.21.15.12:0/800053182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72c806bdc0 0x7f72c80b8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:10.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.320+0000 7f72c6ffd640 1 --2- 172.21.15.12:0/800053182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72c806cb00 0x7f72c80b7310 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f72bc01d380 tx=0x7f72bc01ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:10.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.320+0000 7f72af7fe640 1 -- 172.21.15.12:0/800053182 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc0ba600 con 0x7f72c806cb00 2023-10-16T23:28:10.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.320+0000 7f72af7fe640 1 -- 172.21.15.12:0/800053182 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72bc0ba760 con 0x7f72c806cb00 2023-10-16T23:28:10.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.320+0000 7f72af7fe640 1 -- 172.21.15.12:0/800053182 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc0bab10 con 0x7f72c806cb00 2023-10-16T23:28:10.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.320+0000 7f72cd674640 1 -- 172.21.15.12:0/800053182 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c80b6df0 con 0x7f72c806cb00 2023-10-16T23:28:10.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.320+0000 7f72cd674640 1 -- 172.21.15.12:0/800053182 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c80b6a40 con 0x7f72c806cb00 2023-10-16T23:28:10.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.320+0000 7f72cd674640 1 -- 172.21.15.12:0/800053182 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c80b6c50 con 0x7f72c806cb00 2023-10-16T23:28:10.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.320+0000 7f72af7fe640 1 -- 172.21.15.12:0/800053182 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f72bc0bac70 con 0x7f72c806cb00 2023-10-16T23:28:10.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.320+0000 7f72af7fe640 1 --2- 172.21.15.12:0/800053182 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f72b4065e60 0x7f72b4068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:10.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.320+0000 7f72af7fe640 1 -- 172.21.15.12:0/800053182 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f72bc121c70 con 0x7f72c806cb00 2023-10-16T23:28:10.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.320+0000 7f72c67fc640 1 --2- 172.21.15.12:0/800053182 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f72b4065e60 0x7f72b4068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:10.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.320+0000 7f72c67fc640 1 --2- 172.21.15.12:0/800053182 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f72b4065e60 0x7f72b4068320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f72c81476e0 tx=0x7f72b8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:10.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.324+0000 7f72af7fe640 1 -- 172.21.15.12:0/800053182 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f72c80b6c50 con 0x7f72c806cb00 2023-10-16T23:28:10.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.480+0000 7f72cd674640 1 -- 172.21.15.12:0/800053182 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f72c80b6c50 con 0x7f72c806cb00 2023-10-16T23:28:10.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.480+0000 7f72af7fe640 1 -- 172.21.15.12:0/800053182 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f72c80b6c50 con 0x7f72c806cb00 2023-10-16T23:28:10.486 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-16T23:28:10.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.484+0000 7f72cd674640 1 -- 172.21.15.12:0/800053182 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f72b4065e60 msgr2=0x7f72b4068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:10.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.484+0000 7f72cd674640 1 --2- 172.21.15.12:0/800053182 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f72b4065e60 0x7f72b4068320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f72c81476e0 tx=0x7f72b8009040 comp rx=0 tx=0).stop 2023-10-16T23:28:10.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.484+0000 7f72cd674640 1 -- 172.21.15.12:0/800053182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72c806cb00 msgr2=0x7f72c80b7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:10.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.484+0000 7f72cd674640 1 --2- 172.21.15.12:0/800053182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72c806cb00 0x7f72c80b7310 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f72bc01d380 tx=0x7f72bc01ba70 comp rx=0 tx=0).stop 2023-10-16T23:28:10.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.484+0000 7f72cd674640 1 -- 172.21.15.12:0/800053182 shutdown_connections 2023-10-16T23:28:10.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.484+0000 7f72cd674640 1 --2- 172.21.15.12:0/800053182 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f72b4065e60 0x7f72b4068320 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.484+0000 7f72cd674640 1 --2- 172.21.15.12:0/800053182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72c806bdc0 0x7f72c80b8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.484+0000 7f72cd674640 1 --2- 172.21.15.12:0/800053182 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72c80a72d0 0x7f72c814d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.484+0000 7f72cd674640 1 --2- 172.21.15.12:0/800053182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72c806cb00 0x7f72c80b7310 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.484+0000 7f72cd674640 1 -- 172.21.15.12:0/800053182 >> 172.21.15.12:0/800053182 conn(0x7f72c80c18f0 msgr2=0x7f72c814fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:10.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.484+0000 7f72cd674640 1 -- 172.21.15.12:0/800053182 shutdown_connections 2023-10-16T23:28:10.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.484+0000 7f72cd674640 1 -- 172.21.15.12:0/800053182 wait complete. 2023-10-16T23:28:10.504 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T23:28:10.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.620+0000 7fc8aef87640 1 Processor -- start 2023-10-16T23:28:10.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.620+0000 7fc8aef87640 1 -- start start 2023-10-16T23:28:10.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.624+0000 7fc8aef87640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc8a8071510 0x7fc8a814b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:10.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.624+0000 7fc8aef87640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8a8150240 0x7fc8a814bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:10.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.624+0000 7fc8aef87640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a806f350 con 0x7fc8a80c1130 2023-10-16T23:28:10.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.624+0000 7fc8aef87640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a806f630 con 0x7fc8a8071510 2023-10-16T23:28:10.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.624+0000 7fc8aef87640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a814f610 con 0x7fc8a8150240 2023-10-16T23:28:10.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.624+0000 7fc89ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc8a8071510 0x7fc8a814b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:10.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.624+0000 7fc89ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc8a8071510 0x7fc8a814b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51542/0 (socket says 172.21.15.12:51542) 2023-10-16T23:28:10.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.624+0000 7fc89ffff640 1 -- 172.21.15.12:0/2496784384 learned_addr learned my addr 172.21.15.12:0/2496784384 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:10.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.624+0000 7fc8ad524640 1 --2- 172.21.15.12:0/2496784384 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8a8150240 0x7fc8a814bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:10.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.624+0000 7fc89ffff640 1 -- 172.21.15.12:0/2496784384 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8a8150240 msgr2=0x7fc8a814bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:10.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.624+0000 7fc89ffff640 1 --2- 172.21.15.12:0/2496784384 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8a8150240 0x7fc8a814bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.624+0000 7fc89ffff640 1 -- 172.21.15.12:0/2496784384 >> v1:172.21.15.31:6789/0 conn(0x7fc8a80c1130 legacy=0x7fc8a814fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:10.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.624+0000 7fc89ffff640 1 -- 172.21.15.12:0/2496784384 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a80baac0 con 0x7fc8a8071510 2023-10-16T23:28:10.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.624+0000 7fc8ad524640 1 --2- 172.21.15.12:0/2496784384 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8a8150240 0x7fc8a814bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:10.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.624+0000 7fc89ffff640 1 --2- 172.21.15.12:0/2496784384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8a8071510 0x7fc8a814b630 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc89800bb10 tx=0x7fc89801ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3533718cb8497 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:10.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.624+0000 7fc89f7fe640 1 -- 172.21.15.12:0/2496784384 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8980a7b80 con 0x7fc8a8071510 2023-10-16T23:28:10.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.624+0000 7fc89f7fe640 1 -- 172.21.15.12:0/2496784384 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8980a7ce0 con 0x7fc8a8071510 2023-10-16T23:28:10.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.624+0000 7fc89f7fe640 1 -- 172.21.15.12:0/2496784384 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8980af660 con 0x7fc8a8071510 2023-10-16T23:28:10.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.624+0000 7fc8aef87640 1 -- 172.21.15.12:0/2496784384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8a8071510 msgr2=0x7fc8a814b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:10.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.624+0000 7fc8aef87640 1 --2- 172.21.15.12:0/2496784384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8a8071510 0x7fc8a814b630 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc89800bb10 tx=0x7fc89801ebd0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.624+0000 7fc8aef87640 1 -- 172.21.15.12:0/2496784384 shutdown_connections 2023-10-16T23:28:10.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.624+0000 7fc8aef87640 1 --2- 172.21.15.12:0/2496784384 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8a8150240 0x7fc8a814bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.624+0000 7fc8aef87640 1 --2- 172.21.15.12:0/2496784384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8a8071510 0x7fc8a814b630 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.624+0000 7fc8aef87640 1 -- 172.21.15.12:0/2496784384 >> 172.21.15.12:0/2496784384 conn(0x7fc8a806ba20 msgr2=0x7fc8a80c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:10.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.624+0000 7fc8aef87640 1 -- 172.21.15.12:0/2496784384 shutdown_connections 2023-10-16T23:28:10.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.624+0000 7fc8aef87640 1 -- 172.21.15.12:0/2496784384 wait complete. 2023-10-16T23:28:10.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.628+0000 7fc8aef87640 1 Processor -- start 2023-10-16T23:28:10.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.628+0000 7fc8aef87640 1 -- start start 2023-10-16T23:28:10.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.628+0000 7fc8aef87640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8a8071510 0x7fc8a8141b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:10.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.628+0000 7fc8aef87640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8a80c1130 0x7fc8a81e3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:10.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.628+0000 7fc8aef87640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8a8150240 0x7fc8a80b6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:10.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.628+0000 7fc8aef87640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a814b2f0 con 0x7fc8a8150240 2023-10-16T23:28:10.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.628+0000 7fc8aef87640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a8149230 con 0x7fc8a80c1130 2023-10-16T23:28:10.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.628+0000 7fc8aef87640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a8148f20 con 0x7fc8a8071510 2023-10-16T23:28:10.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.628+0000 7fc8ad524640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8a8150240 0x7fc8a80b6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:10.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.628+0000 7fc8ad524640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8a8150240 0x7fc8a80b6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51544/0 (socket says 172.21.15.12:51544) 2023-10-16T23:28:10.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.628+0000 7fc8ad524640 1 -- 172.21.15.12:0/3414000213 learned_addr learned my addr 172.21.15.12:0/3414000213 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:10.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.628+0000 7fc8acd23640 1 --2- 172.21.15.12:0/3414000213 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8a8071510 0x7fc8a8141b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:10.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.628+0000 7fc89ffff640 1 --2- 172.21.15.12:0/3414000213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8a80c1130 0x7fc8a81e3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:10.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.628+0000 7fc8ad524640 1 -- 172.21.15.12:0/3414000213 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8a8071510 msgr2=0x7fc8a8141b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:10.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.628+0000 7fc8ad524640 1 --2- 172.21.15.12:0/3414000213 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8a8071510 0x7fc8a8141b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.628+0000 7fc8ad524640 1 -- 172.21.15.12:0/3414000213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8a80c1130 msgr2=0x7fc8a81e3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:10.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.628+0000 7fc8ad524640 1 --2- 172.21.15.12:0/3414000213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8a80c1130 0x7fc8a81e3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.628+0000 7fc8ad524640 1 -- 172.21.15.12:0/3414000213 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc89800b770 con 0x7fc8a8150240 2023-10-16T23:28:10.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.628+0000 7fc89ffff640 1 --2- 172.21.15.12:0/3414000213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8a80c1130 0x7fc8a81e3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:10.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.628+0000 7fc8ad524640 1 --2- 172.21.15.12:0/3414000213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8a8150240 0x7fc8a80b6a00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000cd50 tx=0x7fc8a000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:10.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.628+0000 7fc89d7fa640 1 -- 172.21.15.12:0/3414000213 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a000f680 con 0x7fc8a8150240 2023-10-16T23:28:10.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.628+0000 7fc89d7fa640 1 -- 172.21.15.12:0/3414000213 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a000f800 con 0x7fc8a8150240 2023-10-16T23:28:10.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.628+0000 7fc8aef87640 1 -- 172.21.15.12:0/3414000213 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a81e3c40 con 0x7fc8a8150240 2023-10-16T23:28:10.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.628+0000 7fc89d7fa640 1 -- 172.21.15.12:0/3414000213 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a000fbb0 con 0x7fc8a8150240 2023-10-16T23:28:10.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.628+0000 7fc8aef87640 1 -- 172.21.15.12:0/3414000213 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a814a600 con 0x7fc8a8150240 2023-10-16T23:28:10.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.628+0000 7fc8aef87640 1 -- 172.21.15.12:0/3414000213 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a814a460 con 0x7fc8a8150240 2023-10-16T23:28:10.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.632+0000 7fc89d7fa640 1 -- 172.21.15.12:0/3414000213 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fc8a000b040 con 0x7fc8a8150240 2023-10-16T23:28:10.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.632+0000 7fc89d7fa640 1 --2- 172.21.15.12:0/3414000213 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fc894065e60 0x7fc894068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:10.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.632+0000 7fc89d7fa640 1 -- 172.21.15.12:0/3414000213 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc8a0084180 con 0x7fc8a8150240 2023-10-16T23:28:10.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.632+0000 7fc8acd23640 1 --2- 172.21.15.12:0/3414000213 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fc894065e60 0x7fc894068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:10.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.632+0000 7fc8acd23640 1 --2- 172.21.15.12:0/3414000213 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fc894065e60 0x7fc894068320 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc8a80bf4b0 tx=0x7fc8a4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:10.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.636+0000 7fc89d7fa640 1 -- 172.21.15.12:0/3414000213 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fc8a814a460 con 0x7fc8a8150240 2023-10-16T23:28:10.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.796+0000 7fc8aef87640 1 -- 172.21.15.12:0/3414000213 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc8a8149370 con 0x7fc8a8150240 2023-10-16T23:28:10.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.800+0000 7fc89d7fa640 1 -- 172.21.15.12:0/3414000213 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc8a8149370 con 0x7fc8a8150240 2023-10-16T23:28:10.802 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2023-10-16T23:28:10.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.800+0000 7fc8aef87640 1 -- 172.21.15.12:0/3414000213 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fc894065e60 msgr2=0x7fc894068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:10.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.800+0000 7fc8aef87640 1 --2- 172.21.15.12:0/3414000213 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fc894065e60 0x7fc894068320 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc8a80bf4b0 tx=0x7fc8a4009040 comp rx=0 tx=0).stop 2023-10-16T23:28:10.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.800+0000 7fc8aef87640 1 -- 172.21.15.12:0/3414000213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8a8150240 msgr2=0x7fc8a80b6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:10.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.800+0000 7fc8aef87640 1 --2- 172.21.15.12:0/3414000213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8a8150240 0x7fc8a80b6a00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000cd50 tx=0x7fc8a000a650 comp rx=0 tx=0).stop 2023-10-16T23:28:10.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.800+0000 7fc8aef87640 1 -- 172.21.15.12:0/3414000213 shutdown_connections 2023-10-16T23:28:10.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.800+0000 7fc8aef87640 1 --2- 172.21.15.12:0/3414000213 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fc894065e60 0x7fc894068320 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.800+0000 7fc8aef87640 1 --2- 172.21.15.12:0/3414000213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8a8150240 0x7fc8a80b6a00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.800+0000 7fc8aef87640 1 --2- 172.21.15.12:0/3414000213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8a80c1130 0x7fc8a81e3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.800+0000 7fc8aef87640 1 --2- 172.21.15.12:0/3414000213 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc8a8071510 0x7fc8a8141b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.800+0000 7fc8aef87640 1 -- 172.21.15.12:0/3414000213 >> 172.21.15.12:0/3414000213 conn(0x7fc8a806ba20 msgr2=0x7fc8a80bfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.800+0000 7fc8aef87640 1 -- 172.21.15.12:0/3414000213 shutdown_connections 2023-10-16T23:28:10.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.800+0000 7fc8aef87640 1 -- 172.21.15.12:0/3414000213 wait complete. 2023-10-16T23:28:10.820 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-16T23:28:10.820 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T23:28:10.827 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T23:28:10.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.940+0000 7feda18b7640 1 Processor -- start 2023-10-16T23:28:10.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.940+0000 7feda18b7640 1 -- start start 2023-10-16T23:28:10.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.940+0000 7feda18b7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fed9c0c1130 0x7fed9c14fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:10.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.940+0000 7feda18b7640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed9c0ba570 0x7fed9c150070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:10.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.940+0000 7feda18b7640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed9c06f350 con 0x7fed9c071510 2023-10-16T23:28:10.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.940+0000 7feda18b7640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed9c1505b0 con 0x7fed9c0c1130 2023-10-16T23:28:10.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.940+0000 7feda18b7640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c06f630 con 0x7fed9c0ba570 2023-10-16T23:28:10.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.940+0000 7fed9affd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fed9c0c1130 0x7fed9c14fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:10.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.940+0000 7fed9affd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fed9c0c1130 0x7fed9c14fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51552/0 (socket says 172.21.15.12:51552) 2023-10-16T23:28:10.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.940+0000 7fed9affd640 1 -- 172.21.15.12:0/970627304 learned_addr learned my addr 172.21.15.12:0/970627304 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:10.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.940+0000 7fed9b7fe640 1 --2- 172.21.15.12:0/970627304 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed9c0ba570 0x7fed9c150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:10.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.940+0000 7fed9affd640 1 -- 172.21.15.12:0/970627304 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed9c0ba570 msgr2=0x7fed9c150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:10.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.940+0000 7fed9affd640 1 --2- 172.21.15.12:0/970627304 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed9c0ba570 0x7fed9c150070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.940+0000 7fed9affd640 1 -- 172.21.15.12:0/970627304 >> v1:172.21.15.31:6789/0 conn(0x7fed9c071510 legacy=0x7fed9c0bbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:10.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.940+0000 7fed9affd640 1 -- 172.21.15.12:0/970627304 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c14f610 con 0x7fed9c0c1130 2023-10-16T23:28:10.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.940+0000 7fed9affd640 1 --2- 172.21.15.12:0/970627304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed9c0c1130 0x7fed9c14fb30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009870 tx=0x7fed8c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6432b7e96ac7135f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:10.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.940+0000 7fed99ffb640 1 -- 172.21.15.12:0/970627304 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c0ab600 con 0x7fed9c0c1130 2023-10-16T23:28:10.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.940+0000 7fed99ffb640 1 -- 172.21.15.12:0/970627304 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8c0ab760 con 0x7fed9c0c1130 2023-10-16T23:28:10.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.940+0000 7fed99ffb640 1 -- 172.21.15.12:0/970627304 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c0abaf0 con 0x7fed9c0c1130 2023-10-16T23:28:10.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7feda18b7640 1 -- 172.21.15.12:0/970627304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed9c0c1130 msgr2=0x7fed9c14fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:10.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7feda18b7640 1 --2- 172.21.15.12:0/970627304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed9c0c1130 0x7fed9c14fb30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009870 tx=0x7fed8c01c500 comp rx=0 tx=0).stop 2023-10-16T23:28:10.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7feda18b7640 1 -- 172.21.15.12:0/970627304 shutdown_connections 2023-10-16T23:28:10.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7feda18b7640 1 --2- 172.21.15.12:0/970627304 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed9c0ba570 0x7fed9c150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7feda18b7640 1 --2- 172.21.15.12:0/970627304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed9c0c1130 0x7fed9c14fb30 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7feda18b7640 1 -- 172.21.15.12:0/970627304 >> 172.21.15.12:0/970627304 conn(0x7fed9c06ba20 msgr2=0x7fed9c0c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:10.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7feda18b7640 1 -- 172.21.15.12:0/970627304 shutdown_connections 2023-10-16T23:28:10.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7feda18b7640 1 -- 172.21.15.12:0/970627304 wait complete. 2023-10-16T23:28:10.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7feda18b7640 1 Processor -- start 2023-10-16T23:28:10.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7feda18b7640 1 -- start start 2023-10-16T23:28:10.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7feda18b7640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed9c071510 0x7fed9c146590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:10.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7feda18b7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed9c0ba570 0x7fed9c147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:10.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7feda18b7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed9c0c1130 0x7fed9c13e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:10.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7feda18b7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c146ad0 con 0x7fed9c0ba570 2023-10-16T23:28:10.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7feda18b7640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c147830 con 0x7fed9c0c1130 2023-10-16T23:28:10.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7feda18b7640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c147ad0 con 0x7fed9c071510 2023-10-16T23:28:10.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7fed9a7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed9c0ba570 0x7fed9c147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:10.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7fed9a7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed9c0ba570 0x7fed9c147ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51564/0 (socket says 172.21.15.12:51564) 2023-10-16T23:28:10.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7fed9a7fc640 1 -- 172.21.15.12:0/1244533542 learned_addr learned my addr 172.21.15.12:0/1244533542 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:10.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7fed9affd640 1 --2- 172.21.15.12:0/1244533542 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed9c071510 0x7fed9c146590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:10.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7fed9a7fc640 1 -- 172.21.15.12:0/1244533542 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed9c071510 msgr2=0x7fed9c146590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:10.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7fed9a7fc640 1 --2- 172.21.15.12:0/1244533542 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed9c071510 0x7fed9c146590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7fed9b7fe640 1 --2- 172.21.15.12:0/1244533542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed9c0c1130 0x7fed9c13e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:10.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7fed9a7fc640 1 -- 172.21.15.12:0/1244533542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed9c0c1130 msgr2=0x7fed9c13e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:10.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7fed9a7fc640 1 --2- 172.21.15.12:0/1244533542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed9c0c1130 0x7fed9c13e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:10.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7fed9a7fc640 1 -- 172.21.15.12:0/1244533542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c0094d0 con 0x7fed9c0ba570 2023-10-16T23:28:10.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7fed9b7fe640 1 --2- 172.21.15.12:0/1244533542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed9c0c1130 0x7fed9c13e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:10.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7fed9a7fc640 1 --2- 172.21.15.12:0/1244533542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed9c0ba570 0x7fed9c147ff0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fed9000c410 tx=0x7fed9000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:10.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7fed83fff640 1 -- 172.21.15.12:0/1244533542 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed90011790 con 0x7fed9c0ba570 2023-10-16T23:28:10.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7fed83fff640 1 -- 172.21.15.12:0/1244533542 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed900118f0 con 0x7fed9c0ba570 2023-10-16T23:28:10.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7feda18b7640 1 -- 172.21.15.12:0/1244533542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9c146060 con 0x7fed9c0ba570 2023-10-16T23:28:10.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7fed83fff640 1 -- 172.21.15.12:0/1244533542 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed90011ce0 con 0x7fed9c0ba570 2023-10-16T23:28:10.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.944+0000 7feda18b7640 1 -- 172.21.15.12:0/1244533542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9c148530 con 0x7fed9c0ba570 2023-10-16T23:28:10.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.948+0000 7feda18b7640 1 -- 172.21.15.12:0/1244533542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed9c0673a0 con 0x7fed9c0ba570 2023-10-16T23:28:10.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.948+0000 7fed83fff640 1 -- 172.21.15.12:0/1244533542 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fed9001c460 con 0x7fed9c0ba570 2023-10-16T23:28:10.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.948+0000 7fed83fff640 1 --2- 172.21.15.12:0/1244533542 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fed88065e60 0x7fed88068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:10.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.948+0000 7fed83fff640 1 -- 172.21.15.12:0/1244533542 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed900835b0 con 0x7fed9c0ba570 2023-10-16T23:28:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.948+0000 7fed9affd640 1 --2- 172.21.15.12:0/1244533542 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fed88065e60 0x7fed88068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.948+0000 7fed9affd640 1 --2- 172.21.15.12:0/1244533542 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fed88065e60 0x7fed88068320 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fed8c0af000 tx=0x7fed8c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:10.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:10.952+0000 7fed83fff640 1 -- 172.21.15.12:0/1244533542 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fed90050c00 con 0x7fed9c0ba570 2023-10-16T23:28:11.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.104+0000 7feda18b7640 1 -- 172.21.15.12:0/1244533542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed9c0b95d0 con 0x7fed9c0ba570 2023-10-16T23:28:11.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.108+0000 7fed83fff640 1 -- 172.21.15.12:0/1244533542 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17763 (secure 0 0 0) 0x7fed90054220 con 0x7fed9c0ba570 2023-10-16T23:28:11.113 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:28:11.113 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"fsid":"0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51","created":"2023-10-16T23:27:16.468087+0000","modified":"2023-10-16T23:27:41.690088+0000","last_up_change":"2023-10-16T23:27:28.136202+0000","last_in_change":"2023-10-16T23:27:18.793212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T23:27:27.354025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-16T23:27:34.786446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-16T23:27:39.130341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-16T23:27:39.674572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73e70f98-6f5e-4464-b34e-931faac41cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":38075},{"type":"v1","addr":"172.21.15.12:6814","nonce":38075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":38075},{"type":"v1","addr":"172.21.15.12:6819","nonce":38075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":38075},{"type":"v1","addr":"172.21.15.12:6827","nonce":38075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":38075},{"type":"v1","addr":"172.21.15.12:6823","nonce":38075}]},"public_addr":"172.21.15.12:6814/38075","cluster_addr":"172.21.15.12:6819/38075","heartbeat_back_addr":"172.21.15.12:6827/38075","heartbeat_front_addr":"172.21.15.12:6823/38075","state":["exists","up"]},{"osd":1,"uuid":"ff722efe-b3f9-4cc0-bbde-f4d4d8055a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":38076},{"type":"v1","addr":"172.21.15.12:6811","nonce":38076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":38076},{"type":"v1","addr":"172.21.15.12:6818","nonce":38076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":38076},{"type":"v1","addr":"172.21.15.12:6831","nonce":38076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":38076},{"type":"v1","addr":"172.21.15.12:6825","nonce":38076}]},"public_addr":"172.21.15.12:6811/38076","cluster_addr":"172.21.15.12:6818/38076","heartbeat_back_addr":"172.21.15.12:6831/38076","heartbeat_front_addr":"172.21.15.12:6825/38076","state":["exists","up"]},{"osd":2,"uuid":"9baf25db-dce0-4065-90d6-f35867286be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6809","nonce":38073},{"type":"v1","addr":"172.21.15.12:6810","nonce":38073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":38073},{"type":"v1","addr":"172.21.15.12:6817","nonce":38073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":38073},{"type":"v1","addr":"172.21.15.12:6830","nonce":38073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":38073},{"type":"v1","addr":"172.21.15.12:6826","nonce":38073}]},"public_addr":"172.21.15.12:6810/38073","cluster_addr":"172.21.15.12:6817/38073","heartbeat_back_addr":"172.21.15.12:6830/38073","heartbeat_front_addr":"172.21.15.12:6826/38073","state":["exists","up"]},{"osd":3,"uuid":"8a620ad3-2294-470d-8a8c-66f177f5fbe7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":38074},{"type":"v1","addr":"172.21.15.12:6801","nonce":38074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":38074},{"type":"v1","addr":"172.21.15.12:6803","nonce":38074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":38074},{"type":"v1","addr":"172.21.15.12:6807","nonce":38074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":38074},{"type":"v1","addr":"172.21.15.12:6805","nonce":38074}]},"public_addr":"172.21.15.12:6801/38074","cluster_addr":"172.21.15.12:6803/38074","heartbeat_back_addr":"172.21.15.12:6807/38074","heartbeat_front_addr":"172.21.15.12:6805/38074","state":["exists","up"]},{"osd":4,"uuid":"a8824d77-7405-40f5-9234-60889802b184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":38266},{"type":"v1","addr":"172.21.15.31:6817","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":38266},{"type":"v1","addr":"172.21.15.31:6819","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":38266},{"type":"v1","addr":"172.21.15.31:6823","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":38266},{"type":"v1","addr":"172.21.15.31:6821","nonce":38266}]},"public_addr":"172.21.15.31:6817/38266","cluster_addr":"172.21.15.31:6819/38266","heartbeat_back_addr":"172.21.15.31:6823/38266","heartbeat_front_addr":"172.21.15.31:6821/38266","state":["exists","up"]},{"osd":5,"uuid":"3bb01192-a47c-48e9-9662-285e3f6f4b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":38264},{"type":"v1","addr":"172.21.15.31:6807","nonce":38264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":38264},{"type":"v1","addr":"172.21.15.31:6811","nonce":38264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":38264},{"type":"v1","addr":"172.21.15.31:6815","nonce":38264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":38264},{"type":"v1","addr":"172.21.15.31:6813","nonce":38264}]},"public_addr":"172.21.15.31:6807/38264","cluster_addr":"172.21.15.31:6811/38264","heartbeat_back_addr":"172.21.15.31:6815/38264","heartbeat_front_addr":"172.21.15.31:6813/38264","state":["exists","up"]},{"osd":6,"uuid":"1e2d18e4-73e6-4a37-826c-35eca4d96935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":38263},{"type":"v1","addr":"172.21.15.31:6825","nonce":38263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":38263},{"type":"v1","addr":"172.21.15.31:6827","nonce":38263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":38263},{"type":"v1","addr":"172.21.15.31:6831","nonce":38263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":38263},{"type":"v1","addr":"172.21.15.31:6829","nonce":38263}]},"public_addr":"172.21.15.31:6825/38263","cluster_addr":"172.21.15.31:6827/38263","heartbeat_back_addr":"172.21.15.31:6831/38263","heartbeat_front_addr":"172.21.15.31:6829/38263","state":["exists","up"]},{"osd":7,"uuid":"e0f369c0-562b-4440-a5aa-12275c29412b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":38265},{"type":"v1","addr":"172.21.15.31:6801","nonce":38265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":38265},{"type":"v1","addr":"172.21.15.31:6803","nonce":38265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":38265},{"type":"v1","addr":"172.21.15.31:6810","nonce":38265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":38265},{"type":"v1","addr":"172.21.15.31:6806","nonce":38265}]},"public_addr":"172.21.15.31:6801/38265","cluster_addr":"172.21.15.31:6803/38265","heartbeat_back_addr":"172.21.15.31:6810/38265","heartbeat_front_addr":"172.21.15.31:6806/38265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.411815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.372565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.209700+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.414619+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.316843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.300348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.359800+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.219854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T23:28:11.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.112+0000 7feda18b7640 1 -- 172.21.15.12:0/1244533542 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fed88065e60 msgr2=0x7fed88068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:11.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.112+0000 7feda18b7640 1 --2- 172.21.15.12:0/1244533542 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fed88065e60 0x7fed88068320 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fed8c0af000 tx=0x7fed8c008040 comp rx=0 tx=0).stop 2023-10-16T23:28:11.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.112+0000 7feda18b7640 1 -- 172.21.15.12:0/1244533542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed9c0ba570 msgr2=0x7fed9c147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:11.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.112+0000 7feda18b7640 1 --2- 172.21.15.12:0/1244533542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed9c0ba570 0x7fed9c147ff0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fed9000c410 tx=0x7fed9000c8d0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.112+0000 7feda18b7640 1 -- 172.21.15.12:0/1244533542 shutdown_connections 2023-10-16T23:28:11.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.112+0000 7feda18b7640 1 --2- 172.21.15.12:0/1244533542 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fed88065e60 0x7fed88068320 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.112+0000 7feda18b7640 1 --2- 172.21.15.12:0/1244533542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed9c0c1130 0x7fed9c13e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.112+0000 7feda18b7640 1 --2- 172.21.15.12:0/1244533542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed9c0ba570 0x7fed9c147ff0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.112+0000 7feda18b7640 1 --2- 172.21.15.12:0/1244533542 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fed9c071510 0x7fed9c146590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.112+0000 7feda18b7640 1 -- 172.21.15.12:0/1244533542 >> 172.21.15.12:0/1244533542 conn(0x7fed9c06ba20 msgr2=0x7fed9c0c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:11.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.112+0000 7feda18b7640 1 -- 172.21.15.12:0/1244533542 shutdown_connections 2023-10-16T23:28:11.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.112+0000 7feda18b7640 1 -- 172.21.15.12:0/1244533542 wait complete. 2023-10-16T23:28:11.132 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T23:27:27.354025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-16T23:27:34.786446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T23:27:39.130341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T23:27:39.674572+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T23:28:11.133 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T23:28:11.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f236bd17640 1 Processor -- start 2023-10-16T23:28:11.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f236bd17640 1 -- start start 2023-10-16T23:28:11.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f236bd17640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23640c12a0 0x7f23640b90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:11.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f236bd17640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23641505e0 con 0x7f236414b7a0 2023-10-16T23:28:11.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f236bd17640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2364070fe0 con 0x7f23640b3bb0 2023-10-16T23:28:11.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f236bd17640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236414f7a0 con 0x7f23640c12a0 2023-10-16T23:28:11.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f236a2b4640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f236414b7a0 0x7f2364156b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46342/0 (socket says 172.21.15.12:46342) 2023-10-16T23:28:11.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f236a2b4640 1 -- 172.21.15.12:0/354893488 learned_addr learned my addr 172.21.15.12:0/354893488 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:11.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f2369ab3640 1 --2- 172.21.15.12:0/354893488 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23640c12a0 0x7f23640b90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:11.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f2368ab1640 1 -- 172.21.15.12:0/354893488 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959148596 0 0) 0x7f23641505e0 con 0x7f236414b7a0 2023-10-16T23:28:11.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f2368ab1640 1 -- 172.21.15.12:0/354893488 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2350003530 con 0x7f236414b7a0 2023-10-16T23:28:11.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f2368ab1640 1 -- 172.21.15.12:0/354893488 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1038133409 0 0) 0x7f2350003530 con 0x7f236414b7a0 2023-10-16T23:28:11.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f2368ab1640 1 -- 172.21.15.12:0/354893488 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23640c12a0 msgr2=0x7f23640b90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:11.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f2368ab1640 1 --2- 172.21.15.12:0/354893488 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23640c12a0 0x7f23640b90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f2368ab1640 1 -- 172.21.15.12:0/354893488 >> v1:172.21.15.31:6789/0 conn(0x7f23640b3bb0 legacy=0x7f236414fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:11.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f2368ab1640 1 -- 172.21.15.12:0/354893488 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23640b37e0 con 0x7f236414b7a0 2023-10-16T23:28:11.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f2368ab1640 1 -- 172.21.15.12:0/354893488 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7f235c001a00 con 0x7f236414b7a0 2023-10-16T23:28:11.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f2368ab1640 1 -- 172.21.15.12:0/354893488 >> v1:172.21.15.12:6789/0 conn(0x7f236414b7a0 legacy=0x7f2364156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:11.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f2368ab1640 1 --2- 172.21.15.12:0/354893488 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23640c12a0 0x7f23500039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:11.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f2368ab1640 1 --2- 172.21.15.12:0/354893488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2350003f30 0x7f23500047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:11.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f2368ab1640 1 --2- 172.21.15.12:0/354893488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2350004d10 0x7f2350005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:11.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f2368ab1640 1 -- 172.21.15.12:0/354893488 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236414f7a0 con 0x7f2350004d10 2023-10-16T23:28:11.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f2368ab1640 1 -- 172.21.15.12:0/354893488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235000bb20 con 0x7f2350003f30 2023-10-16T23:28:11.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f2368ab1640 1 -- 172.21.15.12:0/354893488 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235000bce0 con 0x7f23640c12a0 2023-10-16T23:28:11.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f236a2b4640 1 --2- 172.21.15.12:0/354893488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2350004d10 0x7f2350005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:11.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f2369ab3640 1 --2- 172.21.15.12:0/354893488 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23640c12a0 0x7f23500039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:11.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f23692b2640 1 --2- 172.21.15.12:0/354893488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2350003f30 0x7f23500047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:11.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f236a2b4640 1 -- 172.21.15.12:0/354893488 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23640c12a0 msgr2=0x7f23500039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:11.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f236a2b4640 1 --2- 172.21.15.12:0/354893488 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23640c12a0 0x7f23500039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f236a2b4640 1 -- 172.21.15.12:0/354893488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2350003f30 msgr2=0x7f23500047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:11.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f236a2b4640 1 --2- 172.21.15.12:0/354893488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2350003f30 0x7f23500047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.252+0000 7f236a2b4640 1 -- 172.21.15.12:0/354893488 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2350003530 con 0x7f2350004d10 2023-10-16T23:28:11.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.256+0000 7f236a2b4640 1 --2- 172.21.15.12:0/354893488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2350004d10 0x7f2350005190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f235c00a830 tx=0x7f235c01faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c7d827e362b6ac server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:11.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.256+0000 7f2368ab1640 1 -- 172.21.15.12:0/354893488 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c0aa6d0 con 0x7f2350004d10 2023-10-16T23:28:11.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.256+0000 7f2368ab1640 1 -- 172.21.15.12:0/354893488 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c0aa850 con 0x7f2350004d10 2023-10-16T23:28:11.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.256+0000 7f2368ab1640 1 -- 172.21.15.12:0/354893488 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c0aac00 con 0x7f2350004d10 2023-10-16T23:28:11.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.256+0000 7f236bd17640 1 -- 172.21.15.12:0/354893488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2350004d10 msgr2=0x7f2350005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:11.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.256+0000 7f236bd17640 1 --2- 172.21.15.12:0/354893488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2350004d10 0x7f2350005190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f235c00a830 tx=0x7f235c01faa0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.256+0000 7f236a2b4640 1 -- 172.21.15.12:0/354893488 reap_dead start 2023-10-16T23:28:11.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.256+0000 7f236bd17640 1 -- 172.21.15.12:0/354893488 shutdown_connections 2023-10-16T23:28:11.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.256+0000 7f236bd17640 1 -- 172.21.15.12:0/354893488 >> 172.21.15.12:0/354893488 conn(0x7f236406bb10 msgr2=0x7f23640c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:11.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.256+0000 7f236bd17640 1 -- 172.21.15.12:0/354893488 shutdown_connections 2023-10-16T23:28:11.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.256+0000 7f236bd17640 1 -- 172.21.15.12:0/354893488 wait complete. 2023-10-16T23:28:11.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.256+0000 7f236bd17640 1 Processor -- start 2023-10-16T23:28:11.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.256+0000 7f236bd17640 1 -- start start 2023-10-16T23:28:11.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f236bd17640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23641db660 0x7f23641ebaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:11.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f236bd17640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f236414dae0 0x7f236414ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:11.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f236bd17640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f236414f290 0x7f236414aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:11.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f236bd17640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23640b2be0 con 0x7f23641db660 2023-10-16T23:28:11.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f236bd17640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236414e020 con 0x7f236414f290 2023-10-16T23:28:11.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f236bd17640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236414e2c0 con 0x7f236414dae0 2023-10-16T23:28:11.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f2369ab3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23641db660 0x7f23641ebaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:11.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f2369ab3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23641db660 0x7f23641ebaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51584/0 (socket says 172.21.15.12:51584) 2023-10-16T23:28:11.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f2369ab3640 1 -- 172.21.15.12:0/1742741448 learned_addr learned my addr 172.21.15.12:0/1742741448 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:11.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f23692b2640 1 --2- 172.21.15.12:0/1742741448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f236414dae0 0x7f236414ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:11.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f236a2b4640 1 --2- 172.21.15.12:0/1742741448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f236414f290 0x7f236414aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:11.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f2369ab3640 1 -- 172.21.15.12:0/1742741448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f236414dae0 msgr2=0x7f236414ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:11.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f2369ab3640 1 --2- 172.21.15.12:0/1742741448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f236414dae0 0x7f236414ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f2369ab3640 1 -- 172.21.15.12:0/1742741448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f236414f290 msgr2=0x7f236414aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:11.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f2369ab3640 1 --2- 172.21.15.12:0/1742741448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f236414f290 0x7f236414aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f2369ab3640 1 -- 172.21.15.12:0/1742741448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236414e5a0 con 0x7f23641db660 2023-10-16T23:28:11.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f2369ab3640 1 --2- 172.21.15.12:0/1742741448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23641db660 0x7f23641ebaa0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f23600115e0 tx=0x7f2360011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:11.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f235a7fc640 1 -- 172.21.15.12:0/1742741448 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236000f8f0 con 0x7f23641db660 2023-10-16T23:28:11.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f235a7fc640 1 -- 172.21.15.12:0/1742741448 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236000fa50 con 0x7f23641db660 2023-10-16T23:28:11.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f236bd17640 1 -- 172.21.15.12:0/1742741448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23641ebfe0 con 0x7f23641db660 2023-10-16T23:28:11.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f235a7fc640 1 -- 172.21.15.12:0/1742741448 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236000fdc0 con 0x7f23641db660 2023-10-16T23:28:11.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f236bd17640 1 -- 172.21.15.12:0/1742741448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23641dba40 con 0x7f23641db660 2023-10-16T23:28:11.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f236bd17640 1 -- 172.21.15.12:0/1742741448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23640673a0 con 0x7f23641db660 2023-10-16T23:28:11.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f235a7fc640 1 -- 172.21.15.12:0/1742741448 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f2360015460 con 0x7f23641db660 2023-10-16T23:28:11.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f235a7fc640 1 --2- 172.21.15.12:0/1742741448 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2348065e90 0x7f2348068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:11.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f235a7fc640 1 -- 172.21.15.12:0/1742741448 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2360084060 con 0x7f23641db660 2023-10-16T23:28:11.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.260+0000 7f23692b2640 1 --2- 172.21.15.12:0/1742741448 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2348065e90 0x7f2348068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:11.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.264+0000 7f23692b2640 1 --2- 172.21.15.12:0/1742741448 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2348065e90 0x7f2348068350 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f23640b7600 tx=0x7f2354009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:11.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.264+0000 7f235a7fc640 1 -- 172.21.15.12:0/1742741448 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f2360051740 con 0x7f23641db660 2023-10-16T23:28:11.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.416+0000 7f236bd17640 1 -- 172.21.15.12:0/1742741448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f236406f300 con 0x7f23641db660 2023-10-16T23:28:11.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.416+0000 7f235a7fc640 1 -- 172.21.15.12:0/1742741448 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2360054d60 con 0x7f23641db660 2023-10-16T23:28:11.422 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-16T23:28:11.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.420+0000 7f236bd17640 1 -- 172.21.15.12:0/1742741448 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2348065e90 msgr2=0x7f2348068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:11.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.420+0000 7f236bd17640 1 --2- 172.21.15.12:0/1742741448 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2348065e90 0x7f2348068350 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f23640b7600 tx=0x7f2354009040 comp rx=0 tx=0).stop 2023-10-16T23:28:11.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.420+0000 7f236bd17640 1 -- 172.21.15.12:0/1742741448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23641db660 msgr2=0x7f23641ebaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:11.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.420+0000 7f236bd17640 1 --2- 172.21.15.12:0/1742741448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23641db660 0x7f23641ebaa0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f23600115e0 tx=0x7f2360011aa0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.420+0000 7f236bd17640 1 -- 172.21.15.12:0/1742741448 shutdown_connections 2023-10-16T23:28:11.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.420+0000 7f236bd17640 1 --2- 172.21.15.12:0/1742741448 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2348065e90 0x7f2348068350 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.420+0000 7f236bd17640 1 --2- 172.21.15.12:0/1742741448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f236414f290 0x7f236414aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.420+0000 7f236bd17640 1 --2- 172.21.15.12:0/1742741448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f236414dae0 0x7f236414ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.420+0000 7f236bd17640 1 --2- 172.21.15.12:0/1742741448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23641db660 0x7f23641ebaa0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.420+0000 7f236bd17640 1 -- 172.21.15.12:0/1742741448 >> 172.21.15.12:0/1742741448 conn(0x7f236406bb10 msgr2=0x7f2364071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:11.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.420+0000 7f236bd17640 1 -- 172.21.15.12:0/1742741448 shutdown_connections 2023-10-16T23:28:11.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.420+0000 7f236bd17640 1 -- 172.21.15.12:0/1742741448 wait complete. 2023-10-16T23:28:11.439 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-16T23:28:11.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.560+0000 7fe1826ed640 1 Processor -- start 2023-10-16T23:28:11.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.560+0000 7fe1826ed640 1 -- start start 2023-10-16T23:28:11.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.560+0000 7fe1826ed640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe17c0c12a0 0x7fe17c146c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:11.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.560+0000 7fe1826ed640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17c0bc8e0 con 0x7fe17c150880 2023-10-16T23:28:11.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.560+0000 7fe1826ed640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17c0b3f40 con 0x7fe17c0bbe00 2023-10-16T23:28:11.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.560+0000 7fe1826ed640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17c0b4220 con 0x7fe17c0c12a0 2023-10-16T23:28:11.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.560+0000 7fe17bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe17c0c12a0 0x7fe17c146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:11.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.560+0000 7fe17bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe17c0c12a0 0x7fe17c146c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51598/0 (socket says 172.21.15.12:51598) 2023-10-16T23:28:11.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.560+0000 7fe17bfff640 1 -- 172.21.15.12:0/18486580 learned_addr learned my addr 172.21.15.12:0/18486580 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:11.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.560+0000 7fe180c8a640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe17c150880 0x7fe17c150cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46358/0 (socket says 172.21.15.12:46358) 2023-10-16T23:28:11.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.560+0000 7fe17bfff640 1 -- 172.21.15.12:0/18486580 >> v1:172.21.15.31:6789/0 conn(0x7fe17c0bbe00 legacy=0x7fe17c147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:11.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.560+0000 7fe17bfff640 1 -- 172.21.15.12:0/18486580 >> v1:172.21.15.12:6789/0 conn(0x7fe17c150880 legacy=0x7fe17c150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:11.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.560+0000 7fe17affd640 1 -- 172.21.15.12:0/18486580 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40149864 0 0) 0x7fe17c0bc8e0 con 0x7fe17c150880 2023-10-16T23:28:11.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.560+0000 7fe17bfff640 1 -- 172.21.15.12:0/18486580 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c0b3b80 con 0x7fe17c0c12a0 2023-10-16T23:28:11.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe17bfff640 1 --2- 172.21.15.12:0/18486580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe17c0c12a0 0x7fe17c146c10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe16c009870 tx=0x7fe16c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334d49a0610521d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:11.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe17affd640 1 -- 172.21.15.12:0/18486580 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c0aa680 con 0x7fe17c0c12a0 2023-10-16T23:28:11.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe17affd640 1 -- 172.21.15.12:0/18486580 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16c0aa7e0 con 0x7fe17c0c12a0 2023-10-16T23:28:11.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe17affd640 1 -- 172.21.15.12:0/18486580 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c0aab70 con 0x7fe17c0c12a0 2023-10-16T23:28:11.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe1826ed640 1 -- 172.21.15.12:0/18486580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe17c0c12a0 msgr2=0x7fe17c146c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:11.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe1826ed640 1 --2- 172.21.15.12:0/18486580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe17c0c12a0 0x7fe17c146c10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe16c009870 tx=0x7fe16c01c500 comp rx=0 tx=0).stop 2023-10-16T23:28:11.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe1826ed640 1 -- 172.21.15.12:0/18486580 shutdown_connections 2023-10-16T23:28:11.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe1826ed640 1 --2- 172.21.15.12:0/18486580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe17c0c12a0 0x7fe17c146c10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe1826ed640 1 -- 172.21.15.12:0/18486580 >> 172.21.15.12:0/18486580 conn(0x7fe17c06bb10 msgr2=0x7fe17c0c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:11.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe1826ed640 1 -- 172.21.15.12:0/18486580 shutdown_connections 2023-10-16T23:28:11.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe1826ed640 1 -- 172.21.15.12:0/18486580 wait complete. 2023-10-16T23:28:11.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe1826ed640 1 Processor -- start 2023-10-16T23:28:11.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe1826ed640 1 -- start start 2023-10-16T23:28:11.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe1826ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe17c0bbe00 0x7fe17c1e83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:11.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe1826ed640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe17c0c12a0 0x7fe17c140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:11.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe1826ed640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe17c150880 0x7fe17c14ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:11.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe1826ed640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c140fc0 con 0x7fe17c0bbe00 2023-10-16T23:28:11.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe1826ed640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c14fd80 con 0x7fe17c150880 2023-10-16T23:28:11.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe1826ed640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c14f7c0 con 0x7fe17c0c12a0 2023-10-16T23:28:11.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe17bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe17c0bbe00 0x7fe17c1e83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:11.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe17bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe17c0bbe00 0x7fe17c1e83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51600/0 (socket says 172.21.15.12:51600) 2023-10-16T23:28:11.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe17bfff640 1 -- 172.21.15.12:0/1056482229 learned_addr learned my addr 172.21.15.12:0/1056482229 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:11.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe180c8a640 1 --2- 172.21.15.12:0/1056482229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe17c150880 0x7fe17c14ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:11.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe17bfff640 1 -- 172.21.15.12:0/1056482229 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe17c0c12a0 msgr2=0x7fe17c140a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:11.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe17b7fe640 1 --2- 172.21.15.12:0/1056482229 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe17c0c12a0 0x7fe17c140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:11.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe17bfff640 1 --2- 172.21.15.12:0/1056482229 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe17c0c12a0 0x7fe17c140a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe17bfff640 1 -- 172.21.15.12:0/1056482229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe17c150880 msgr2=0x7fe17c14ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:11.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe17bfff640 1 --2- 172.21.15.12:0/1056482229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe17c150880 0x7fe17c14ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe17bfff640 1 -- 172.21.15.12:0/1056482229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c0094d0 con 0x7fe17c0bbe00 2023-10-16T23:28:11.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe180c8a640 1 --2- 172.21.15.12:0/1056482229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe17c150880 0x7fe17c14ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:11.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe17bfff640 1 --2- 172.21.15.12:0/1056482229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe17c0bbe00 0x7fe17c1e83b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0ac040 tx=0x7fe16c01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:11.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe178ff9640 1 -- 172.21.15.12:0/1056482229 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c004020 con 0x7fe17c0bbe00 2023-10-16T23:28:11.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe178ff9640 1 -- 172.21.15.12:0/1056482229 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16c0b7070 con 0x7fe17c0bbe00 2023-10-16T23:28:11.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe1826ed640 1 -- 172.21.15.12:0/1056482229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17c14faa0 con 0x7fe17c0bbe00 2023-10-16T23:28:11.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe178ff9640 1 -- 172.21.15.12:0/1056482229 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c0043a0 con 0x7fe17c0bbe00 2023-10-16T23:28:11.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.564+0000 7fe1826ed640 1 -- 172.21.15.12:0/1056482229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17c1500a0 con 0x7fe17c0bbe00 2023-10-16T23:28:11.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.568+0000 7fe1826ed640 1 -- 172.21.15.12:0/1056482229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17c150380 con 0x7fe17c0bbe00 2023-10-16T23:28:11.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.568+0000 7fe178ff9640 1 -- 172.21.15.12:0/1056482229 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fe16c003620 con 0x7fe17c0bbe00 2023-10-16T23:28:11.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.568+0000 7fe178ff9640 1 --2- 172.21.15.12:0/1056482229 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe168065e60 0x7fe168068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:11.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.568+0000 7fe178ff9640 1 -- 172.21.15.12:0/1056482229 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe16c11df90 con 0x7fe17c0bbe00 2023-10-16T23:28:11.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.568+0000 7fe17b7fe640 1 --2- 172.21.15.12:0/1056482229 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe168065e60 0x7fe168068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:11.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.568+0000 7fe17b7fe640 1 --2- 172.21.15.12:0/1056482229 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe168065e60 0x7fe168068320 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe17c144680 tx=0x7fe170009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:11.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.572+0000 7fe178ff9640 1 -- 172.21.15.12:0/1056482229 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fe16c0eb550 con 0x7fe17c0bbe00 2023-10-16T23:28:11.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.728+0000 7fe1826ed640 1 -- 172.21.15.12:0/1056482229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe17c141100 con 0x7fe17c0bbe00 2023-10-16T23:28:11.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.728+0000 7fe178ff9640 1 -- 172.21.15.12:0/1056482229 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe16c0eeb70 con 0x7fe17c0bbe00 2023-10-16T23:28:11.731 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-10-16T23:28:11.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.728+0000 7fe1826ed640 1 -- 172.21.15.12:0/1056482229 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe168065e60 msgr2=0x7fe168068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:11.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.728+0000 7fe1826ed640 1 --2- 172.21.15.12:0/1056482229 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe168065e60 0x7fe168068320 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe17c144680 tx=0x7fe170009040 comp rx=0 tx=0).stop 2023-10-16T23:28:11.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.728+0000 7fe1826ed640 1 -- 172.21.15.12:0/1056482229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe17c0bbe00 msgr2=0x7fe17c1e83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:11.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.728+0000 7fe1826ed640 1 --2- 172.21.15.12:0/1056482229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe17c0bbe00 0x7fe17c1e83b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0ac040 tx=0x7fe16c01ad40 comp rx=0 tx=0).stop 2023-10-16T23:28:11.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.728+0000 7fe1826ed640 1 -- 172.21.15.12:0/1056482229 shutdown_connections 2023-10-16T23:28:11.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.728+0000 7fe1826ed640 1 --2- 172.21.15.12:0/1056482229 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe168065e60 0x7fe168068320 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.728+0000 7fe1826ed640 1 --2- 172.21.15.12:0/1056482229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe17c150880 0x7fe17c14ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.728+0000 7fe1826ed640 1 --2- 172.21.15.12:0/1056482229 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe17c0c12a0 0x7fe17c140a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.728+0000 7fe1826ed640 1 --2- 172.21.15.12:0/1056482229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe17c0bbe00 0x7fe17c1e83b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.728+0000 7fe1826ed640 1 -- 172.21.15.12:0/1056482229 >> 172.21.15.12:0/1056482229 conn(0x7fe17c06bb10 msgr2=0x7fe17c071030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:11.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.728+0000 7fe1826ed640 1 -- 172.21.15.12:0/1056482229 shutdown_connections 2023-10-16T23:28:11.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.728+0000 7fe1826ed640 1 -- 172.21.15.12:0/1056482229 wait complete. 2023-10-16T23:28:11.750 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T23:28:11.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f994059c640 1 Processor -- start 2023-10-16T23:28:11.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f994059c640 1 -- start start 2023-10-16T23:28:11.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f994059c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f99380c12a0 0x7f99380b90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:11.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f994059c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99380b3bb0 0x7f993814fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:11.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f994059c640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9938070fe0 con 0x7f9938150410 2023-10-16T23:28:11.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f994059c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f993814f7a0 con 0x7f99380c12a0 2023-10-16T23:28:11.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f994059c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99380b37e0 con 0x7f99380b3bb0 2023-10-16T23:28:11.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993eb39640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9938150410 0x7f993814b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46360/0 (socket says 172.21.15.12:46360) 2023-10-16T23:28:11.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993eb39640 1 -- 172.21.15.12:0/3119559467 learned_addr learned my addr 172.21.15.12:0/3119559467 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:11.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993db37640 1 --2- 172.21.15.12:0/3119559467 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99380b3bb0 0x7f993814fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:11.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993e338640 1 --2- 172.21.15.12:0/3119559467 >> v2:172.21.15.31:3300/0 conn(0x7f99380c12a0 0x7f99380b90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:11.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993d336640 1 -- 172.21.15.12:0/3119559467 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627943131 0 0) 0x7f9938070fe0 con 0x7f9938150410 2023-10-16T23:28:11.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993d336640 1 -- 172.21.15.12:0/3119559467 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9924003530 con 0x7f9938150410 2023-10-16T23:28:11.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993d336640 1 -- 172.21.15.12:0/3119559467 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2446499815 0 0) 0x7f9924003530 con 0x7f9938150410 2023-10-16T23:28:11.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993d336640 1 -- 172.21.15.12:0/3119559467 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99380b3bb0 msgr2=0x7f993814fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:11.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993d336640 1 --2- 172.21.15.12:0/3119559467 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99380b3bb0 0x7f993814fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993d336640 1 -- 172.21.15.12:0/3119559467 >> v2:172.21.15.31:3300/0 conn(0x7f99380c12a0 msgr2=0x7f99380b90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:11.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993d336640 1 --2- 172.21.15.12:0/3119559467 >> v2:172.21.15.31:3300/0 conn(0x7f99380c12a0 0x7f99380b90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993d336640 1 -- 172.21.15.12:0/3119559467 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993814f9b0 con 0x7f9938150410 2023-10-16T23:28:11.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993d336640 1 -- 172.21.15.12:0/3119559467 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7f9930001a00 con 0x7f9938150410 2023-10-16T23:28:11.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993d336640 1 -- 172.21.15.12:0/3119559467 >> v1:172.21.15.12:6789/0 conn(0x7f9938150410 legacy=0x7f993814b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:11.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993d336640 1 --2- 172.21.15.12:0/3119559467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9924003980 0x7f9924003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:11.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993d336640 1 --2- 172.21.15.12:0/3119559467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99240047d0 0x7f9924004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:11.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993d336640 1 --2- 172.21.15.12:0/3119559467 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99380b3bb0 0x7f9924005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:11.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993d336640 1 -- 172.21.15.12:0/3119559467 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993814f7a0 con 0x7f9924003980 2023-10-16T23:28:11.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993d336640 1 -- 172.21.15.12:0/3119559467 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99380b37e0 con 0x7f99240047d0 2023-10-16T23:28:11.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993d336640 1 -- 172.21.15.12:0/3119559467 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992400b990 con 0x7f99380b3bb0 2023-10-16T23:28:11.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993e338640 1 --2- 172.21.15.12:0/3119559467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9924003980 0x7f9924003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:11.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993db37640 1 --2- 172.21.15.12:0/3119559467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99240047d0 0x7f9924004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:11.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993eb39640 1 --2- 172.21.15.12:0/3119559467 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99380b3bb0 0x7f9924005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:11.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993e338640 1 -- 172.21.15.12:0/3119559467 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99380b3bb0 msgr2=0x7f9924005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:11.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993e338640 1 --2- 172.21.15.12:0/3119559467 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99380b3bb0 0x7f9924005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993e338640 1 -- 172.21.15.12:0/3119559467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99240047d0 msgr2=0x7f9924004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:11.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993e338640 1 --2- 172.21.15.12:0/3119559467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99240047d0 0x7f9924004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993e338640 1 -- 172.21.15.12:0/3119559467 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9924003530 con 0x7f9924003980 2023-10-16T23:28:11.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.872+0000 7f993db37640 1 --2- 172.21.15.12:0/3119559467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99240047d0 0x7f9924004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:28:11.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.876+0000 7f993e338640 1 --2- 172.21.15.12:0/3119559467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9924003980 0x7f9924003da0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9934009b10 tx=0x7f993401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdfc3beefd977027 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:11.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.876+0000 7f993d336640 1 -- 172.21.15.12:0/3119559467 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99340b0400 con 0x7f9924003980 2023-10-16T23:28:11.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.876+0000 7f993d336640 1 -- 172.21.15.12:0/3119559467 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99340b0560 con 0x7f9924003980 2023-10-16T23:28:11.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.876+0000 7f993d336640 1 -- 172.21.15.12:0/3119559467 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99340b0910 con 0x7f9924003980 2023-10-16T23:28:11.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f994059c640 1 -- 172.21.15.12:0/3119559467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9924003980 msgr2=0x7f9924003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:11.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f994059c640 1 --2- 172.21.15.12:0/3119559467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9924003980 0x7f9924003da0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9934009b10 tx=0x7f993401ca90 comp rx=0 tx=0).stop 2023-10-16T23:28:11.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f993eb39640 1 -- 172.21.15.12:0/3119559467 reap_dead start 2023-10-16T23:28:11.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f994059c640 1 -- 172.21.15.12:0/3119559467 shutdown_connections 2023-10-16T23:28:11.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f994059c640 1 -- 172.21.15.12:0/3119559467 >> 172.21.15.12:0/3119559467 conn(0x7f993806bb10 msgr2=0x7f99380c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:11.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f994059c640 1 -- 172.21.15.12:0/3119559467 shutdown_connections 2023-10-16T23:28:11.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f994059c640 1 -- 172.21.15.12:0/3119559467 wait complete. 2023-10-16T23:28:11.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f994059c640 1 Processor -- start 2023-10-16T23:28:11.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f994059c640 1 -- start start 2023-10-16T23:28:11.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f994059c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9924003980 0x7f99381492a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:11.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f994059c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99381497e0 0x7f993813f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:11.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f994059c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f993813fc20 0x7f99380bf790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:11.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f994059c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9938140ee0 con 0x7f9924003980 2023-10-16T23:28:11.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f994059c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99381e6e90 con 0x7f993813fc20 2023-10-16T23:28:11.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f994059c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9938140c80 con 0x7f99381497e0 2023-10-16T23:28:11.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f993e338640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9924003980 0x7f99381492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:11.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f993e338640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9924003980 0x7f99381492a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51620/0 (socket says 172.21.15.12:51620) 2023-10-16T23:28:11.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f993e338640 1 -- 172.21.15.12:0/314992553 learned_addr learned my addr 172.21.15.12:0/314992553 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:11.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f993e338640 1 -- 172.21.15.12:0/314992553 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99381497e0 msgr2=0x7f993813f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:11.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f993e338640 1 --2- 172.21.15.12:0/314992553 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99381497e0 0x7f993813f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f993eb39640 1 --2- 172.21.15.12:0/314992553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f993813fc20 0x7f99380bf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:11.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f993e338640 1 -- 172.21.15.12:0/314992553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f993813fc20 msgr2=0x7f99380bf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:11.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f993e338640 1 --2- 172.21.15.12:0/314992553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f993813fc20 0x7f99380bf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:11.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f993e338640 1 -- 172.21.15.12:0/314992553 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99381413b0 con 0x7f9924003980 2023-10-16T23:28:11.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f993e338640 1 --2- 172.21.15.12:0/314992553 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9924003980 0x7f99381492a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9934009b10 tx=0x7f9934019830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:11.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f992effd640 1 -- 172.21.15.12:0/314992553 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99340b06d0 con 0x7f9924003980 2023-10-16T23:28:11.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f992effd640 1 -- 172.21.15.12:0/314992553 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99340b0850 con 0x7f9924003980 2023-10-16T23:28:11.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f994059c640 1 -- 172.21.15.12:0/314992553 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99381410d0 con 0x7f9924003980 2023-10-16T23:28:11.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f992effd640 1 -- 172.21.15.12:0/314992553 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99340b0c00 con 0x7f9924003980 2023-10-16T23:28:11.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.880+0000 7f994059c640 1 -- 172.21.15.12:0/314992553 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9938140780 con 0x7f9924003980 2023-10-16T23:28:11.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.884+0000 7f994059c640 1 -- 172.21.15.12:0/314992553 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99380673a0 con 0x7f9924003980 2023-10-16T23:28:11.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.884+0000 7f992effd640 1 -- 172.21.15.12:0/314992553 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f99340a8400 con 0x7f9924003980 2023-10-16T23:28:11.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.884+0000 7f992effd640 1 --2- 172.21.15.12:0/314992553 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f991c065e90 0x7f991c068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:11.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.884+0000 7f992effd640 1 -- 172.21.15.12:0/314992553 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f993411d480 con 0x7f9924003980 2023-10-16T23:28:11.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.884+0000 7f993db37640 1 --2- 172.21.15.12:0/314992553 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f991c065e90 0x7f991c068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:11.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.884+0000 7f993db37640 1 --2- 172.21.15.12:0/314992553 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f991c065e90 0x7f991c068350 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9938147590 tx=0x7f9928008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:11.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:11.888+0000 7f992effd640 1 -- 172.21.15.12:0/314992553 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f99340eab60 con 0x7f9924003980 2023-10-16T23:28:12.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.040+0000 7f994059c640 1 -- 172.21.15.12:0/314992553 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f99380b8060 con 0x7f9924003980 2023-10-16T23:28:12.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.040+0000 7f992effd640 1 -- 172.21.15.12:0/314992553 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f99340ee180 con 0x7f9924003980 2023-10-16T23:28:12.046 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-16T23:28:12.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.044+0000 7f994059c640 1 -- 172.21.15.12:0/314992553 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f991c065e90 msgr2=0x7f991c068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:12.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.044+0000 7f994059c640 1 --2- 172.21.15.12:0/314992553 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f991c065e90 0x7f991c068350 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9938147590 tx=0x7f9928008040 comp rx=0 tx=0).stop 2023-10-16T23:28:12.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.044+0000 7f994059c640 1 -- 172.21.15.12:0/314992553 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9924003980 msgr2=0x7f99381492a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:12.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.044+0000 7f994059c640 1 --2- 172.21.15.12:0/314992553 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9924003980 0x7f99381492a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9934009b10 tx=0x7f9934019830 comp rx=0 tx=0).stop 2023-10-16T23:28:12.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.044+0000 7f994059c640 1 -- 172.21.15.12:0/314992553 shutdown_connections 2023-10-16T23:28:12.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.044+0000 7f994059c640 1 --2- 172.21.15.12:0/314992553 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f991c065e90 0x7f991c068350 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:12.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.044+0000 7f994059c640 1 --2- 172.21.15.12:0/314992553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f993813fc20 0x7f99380bf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:12.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.044+0000 7f994059c640 1 --2- 172.21.15.12:0/314992553 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f99381497e0 0x7f993813f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:12.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.044+0000 7f994059c640 1 --2- 172.21.15.12:0/314992553 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9924003980 0x7f99381492a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:12.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.044+0000 7f994059c640 1 -- 172.21.15.12:0/314992553 >> 172.21.15.12:0/314992553 conn(0x7f993806bb10 msgr2=0x7f99380c0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:12.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.044+0000 7f994059c640 1 -- 172.21.15.12:0/314992553 shutdown_connections 2023-10-16T23:28:12.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.044+0000 7f994059c640 1 -- 172.21.15.12:0/314992553 wait complete. 2023-10-16T23:28:12.065 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T23:28:12.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cc73dc640 1 Processor -- start 2023-10-16T23:28:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cc73dc640 1 -- start start 2023-10-16T23:28:12.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cc73dc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3cc00c12a0 0x7f3cc00b90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:12.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cc73dc640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cc014b7a0 0x7f3cc014bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:12.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cc73dc640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cc01505e0 con 0x7f3cc00b3bb0 2023-10-16T23:28:12.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cc73dc640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cc014f7a0 con 0x7f3cc00c12a0 2023-10-16T23:28:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cc73dc640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc0070fe0 con 0x7f3cc014b7a0 2023-10-16T23:28:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cc4977640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3cc00b3bb0 0x7f3cc014fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46374/0 (socket says 172.21.15.12:46374) 2023-10-16T23:28:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cc4977640 1 -- 172.21.15.12:0/742666252 learned_addr learned my addr 172.21.15.12:0/742666252 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cc5178640 1 --2- 172.21.15.12:0/742666252 >> v2:172.21.15.31:3300/0 conn(0x7f3cc00c12a0 0x7f3cc00b90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:12.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cc5979640 1 --2- 172.21.15.12:0/742666252 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cc014b7a0 0x7f3cc014bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:12.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cb7fff640 1 -- 172.21.15.12:0/742666252 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538717706 0 0) 0x7f3cc01505e0 con 0x7f3cc00b3bb0 2023-10-16T23:28:12.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cb7fff640 1 -- 172.21.15.12:0/742666252 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cac003530 con 0x7f3cc00b3bb0 2023-10-16T23:28:12.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cb7fff640 1 -- 172.21.15.12:0/742666252 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 297477251 0 0) 0x7f3cac003530 con 0x7f3cc00b3bb0 2023-10-16T23:28:12.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cb7fff640 1 -- 172.21.15.12:0/742666252 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cc014b7a0 msgr2=0x7f3cc014bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:12.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cb7fff640 1 --2- 172.21.15.12:0/742666252 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cc014b7a0 0x7f3cc014bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:12.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cb7fff640 1 -- 172.21.15.12:0/742666252 >> v2:172.21.15.31:3300/0 conn(0x7f3cc00c12a0 msgr2=0x7f3cc00b90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:12.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cb7fff640 1 --2- 172.21.15.12:0/742666252 >> v2:172.21.15.31:3300/0 conn(0x7f3cc00c12a0 0x7f3cc00b90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:12.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cb7fff640 1 -- 172.21.15.12:0/742666252 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc00b37e0 con 0x7f3cc00b3bb0 2023-10-16T23:28:12.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cb7fff640 1 -- 172.21.15.12:0/742666252 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7f3cb0001680 con 0x7f3cc00b3bb0 2023-10-16T23:28:12.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cc5178640 1 --2- 172.21.15.12:0/742666252 >> v2:172.21.15.31:3300/0 conn(0x7f3cc00c12a0 0x7f3cc00b90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T23:28:12.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cb7fff640 1 -- 172.21.15.12:0/742666252 >> v1:172.21.15.12:6789/0 conn(0x7f3cc00b3bb0 legacy=0x7f3cc014fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:12.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cb7fff640 1 --2- 172.21.15.12:0/742666252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cac003980 0x7f3cac003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:12.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cb7fff640 1 --2- 172.21.15.12:0/742666252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cac0047d0 0x7f3cac004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:12.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cb7fff640 1 --2- 172.21.15.12:0/742666252 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cc014b7a0 0x7f3cac005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:12.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cb7fff640 1 -- 172.21.15.12:0/742666252 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc014f7a0 con 0x7f3cac0047d0 2023-10-16T23:28:12.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cb7fff640 1 -- 172.21.15.12:0/742666252 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc0070fe0 con 0x7f3cac003980 2023-10-16T23:28:12.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cb7fff640 1 -- 172.21.15.12:0/742666252 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac00b990 con 0x7f3cc014b7a0 2023-10-16T23:28:12.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cc4977640 1 --2- 172.21.15.12:0/742666252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cac0047d0 0x7f3cac004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:12.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cc5178640 1 --2- 172.21.15.12:0/742666252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cac003980 0x7f3cac003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:12.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cc4977640 1 -- 172.21.15.12:0/742666252 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cc014b7a0 msgr2=0x7f3cac005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:12.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cc5979640 1 --2- 172.21.15.12:0/742666252 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cc014b7a0 0x7f3cac005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:12.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cc4977640 1 --2- 172.21.15.12:0/742666252 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cc014b7a0 0x7f3cac005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:12.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cc4977640 1 -- 172.21.15.12:0/742666252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cac003980 msgr2=0x7f3cac003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:12.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cc4977640 1 --2- 172.21.15.12:0/742666252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cac003980 0x7f3cac003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:12.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cc4977640 1 -- 172.21.15.12:0/742666252 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac003530 con 0x7f3cac0047d0 2023-10-16T23:28:12.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.184+0000 7f3cc5178640 1 --2- 172.21.15.12:0/742666252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cac003980 0x7f3cac003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:12.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.188+0000 7f3cc4977640 1 --2- 172.21.15.12:0/742666252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cac0047d0 0x7f3cac004c50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3cb000c270 tx=0x7f3cb001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a491a7621acb6c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:12.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.188+0000 7f3cb7fff640 1 -- 172.21.15.12:0/742666252 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb00058e0 con 0x7f3cac0047d0 2023-10-16T23:28:12.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.188+0000 7f3cb7fff640 1 -- 172.21.15.12:0/742666252 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb0005a40 con 0x7f3cac0047d0 2023-10-16T23:28:12.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.188+0000 7f3cb7fff640 1 -- 172.21.15.12:0/742666252 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0005e10 con 0x7f3cac0047d0 2023-10-16T23:28:12.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.188+0000 7f3cc73dc640 1 -- 172.21.15.12:0/742666252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cac0047d0 msgr2=0x7f3cac004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:12.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.188+0000 7f3cc73dc640 1 --2- 172.21.15.12:0/742666252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cac0047d0 0x7f3cac004c50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3cb000c270 tx=0x7f3cb001cc30 comp rx=0 tx=0).stop 2023-10-16T23:28:12.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.188+0000 7f3cc5979640 1 -- 172.21.15.12:0/742666252 reap_dead start 2023-10-16T23:28:12.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.188+0000 7f3cc73dc640 1 -- 172.21.15.12:0/742666252 shutdown_connections 2023-10-16T23:28:12.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.188+0000 7f3cc73dc640 1 -- 172.21.15.12:0/742666252 >> 172.21.15.12:0/742666252 conn(0x7f3cc006bb10 msgr2=0x7f3cc00c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:12.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.188+0000 7f3cc73dc640 1 -- 172.21.15.12:0/742666252 shutdown_connections 2023-10-16T23:28:12.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.188+0000 7f3cc73dc640 1 -- 172.21.15.12:0/742666252 wait complete. 2023-10-16T23:28:12.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.188+0000 7f3cc73dc640 1 Processor -- start 2023-10-16T23:28:12.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.188+0000 7f3cc73dc640 1 -- start start 2023-10-16T23:28:12.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.188+0000 7f3cc73dc640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cac0047d0 0x7f3cc00bfac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:12.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.188+0000 7f3cc73dc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cc00bb1e0 0x7f3cc00b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:12.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.188+0000 7f3cc73dc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cc00b3070 0x7f3cc00be730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:12.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.188+0000 7f3cc73dc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc00b7160 con 0x7f3cc00b3070 2023-10-16T23:28:12.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.188+0000 7f3cc73dc640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc00b59a0 con 0x7f3cc00bb1e0 2023-10-16T23:28:12.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.188+0000 7f3cc73dc640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc01eb320 con 0x7f3cac0047d0 2023-10-16T23:28:12.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.188+0000 7f3cc5979640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cc00b3070 0x7f3cc00be730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:12.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.188+0000 7f3cc5979640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cc00b3070 0x7f3cc00be730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51648/0 (socket says 172.21.15.12:51648) 2023-10-16T23:28:12.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.192+0000 7f3cc5979640 1 -- 172.21.15.12:0/1012142995 learned_addr learned my addr 172.21.15.12:0/1012142995 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:12.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.192+0000 7f3cc4977640 1 --2- 172.21.15.12:0/1012142995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cc00bb1e0 0x7f3cc00b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:12.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.192+0000 7f3cc5178640 1 --2- 172.21.15.12:0/1012142995 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cac0047d0 0x7f3cc00bfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:12.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.192+0000 7f3cc5979640 1 -- 172.21.15.12:0/1012142995 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cac0047d0 msgr2=0x7f3cc00bfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:12.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.192+0000 7f3cc5979640 1 --2- 172.21.15.12:0/1012142995 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cac0047d0 0x7f3cc00bfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:12.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.192+0000 7f3cc5979640 1 -- 172.21.15.12:0/1012142995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cc00bb1e0 msgr2=0x7f3cc00b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:12.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.192+0000 7f3cc5979640 1 --2- 172.21.15.12:0/1012142995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cc00bb1e0 0x7f3cc00b2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:12.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.192+0000 7f3cc5979640 1 -- 172.21.15.12:0/1012142995 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc00b6e80 con 0x7f3cc00b3070 2023-10-16T23:28:12.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.192+0000 7f3cc5979640 1 --2- 172.21.15.12:0/1012142995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cc00b3070 0x7f3cc00be730 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8009fd0 tx=0x7f3cb800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:12.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.192+0000 7f3cb5ffb640 1 -- 172.21.15.12:0/1012142995 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8017400 con 0x7f3cc00b3070 2023-10-16T23:28:12.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.192+0000 7f3cb5ffb640 1 -- 172.21.15.12:0/1012142995 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb8011040 con 0x7f3cc00b3070 2023-10-16T23:28:12.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.192+0000 7f3cc73dc640 1 -- 172.21.15.12:0/1012142995 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc00b9a40 con 0x7f3cc00b3070 2023-10-16T23:28:12.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.192+0000 7f3cb5ffb640 1 -- 172.21.15.12:0/1012142995 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb80177c0 con 0x7f3cc00b3070 2023-10-16T23:28:12.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.192+0000 7f3cc73dc640 1 -- 172.21.15.12:0/1012142995 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc014f380 con 0x7f3cc00b3070 2023-10-16T23:28:12.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.192+0000 7f3cc73dc640 1 -- 172.21.15.12:0/1012142995 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc01eb0f0 con 0x7f3cc00b3070 2023-10-16T23:28:12.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.192+0000 7f3cb5ffb640 1 -- 172.21.15.12:0/1012142995 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f3cb8021440 con 0x7f3cc00b3070 2023-10-16T23:28:12.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.192+0000 7f3cb5ffb640 1 --2- 172.21.15.12:0/1012142995 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3ca4065e90 0x7f3ca4068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:12.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.192+0000 7f3cb5ffb640 1 -- 172.21.15.12:0/1012142995 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3cb8083830 con 0x7f3cc00b3070 2023-10-16T23:28:12.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.192+0000 7f3cc5178640 1 --2- 172.21.15.12:0/1012142995 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3ca4065e90 0x7f3ca4068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:12.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.192+0000 7f3cc5178640 1 --2- 172.21.15.12:0/1012142995 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3ca4065e90 0x7f3ca4068350 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3cc01492c0 tx=0x7f3cbc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:12.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.196+0000 7f3cb5ffb640 1 -- 172.21.15.12:0/1012142995 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f3cc01eb0f0 con 0x7f3cc00b3070 2023-10-16T23:28:12.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.352+0000 7f3cc73dc640 1 -- 172.21.15.12:0/1012142995 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3cc01eb0f0 con 0x7f3cc00b3070 2023-10-16T23:28:12.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.352+0000 7f3cb5ffb640 1 -- 172.21.15.12:0/1012142995 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3cc01eb0f0 con 0x7f3cc00b3070 2023-10-16T23:28:12.357 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-16T23:28:12.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.356+0000 7f3cc73dc640 1 -- 172.21.15.12:0/1012142995 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3ca4065e90 msgr2=0x7f3ca4068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:12.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.356+0000 7f3cc73dc640 1 --2- 172.21.15.12:0/1012142995 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3ca4065e90 0x7f3ca4068350 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3cc01492c0 tx=0x7f3cbc008040 comp rx=0 tx=0).stop 2023-10-16T23:28:12.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.356+0000 7f3cc73dc640 1 -- 172.21.15.12:0/1012142995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cc00b3070 msgr2=0x7f3cc00be730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:12.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.356+0000 7f3cc73dc640 1 --2- 172.21.15.12:0/1012142995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cc00b3070 0x7f3cc00be730 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8009fd0 tx=0x7f3cb800f4a0 comp rx=0 tx=0).stop 2023-10-16T23:28:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.356+0000 7f3cc73dc640 1 -- 172.21.15.12:0/1012142995 shutdown_connections 2023-10-16T23:28:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.356+0000 7f3cc73dc640 1 --2- 172.21.15.12:0/1012142995 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3ca4065e90 0x7f3ca4068350 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.356+0000 7f3cc73dc640 1 --2- 172.21.15.12:0/1012142995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cc00b3070 0x7f3cc00be730 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:12.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.356+0000 7f3cc73dc640 1 --2- 172.21.15.12:0/1012142995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cc00bb1e0 0x7f3cc00b2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:12.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.356+0000 7f3cc73dc640 1 --2- 172.21.15.12:0/1012142995 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cac0047d0 0x7f3cc00bfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:12.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.356+0000 7f3cc73dc640 1 -- 172.21.15.12:0/1012142995 >> 172.21.15.12:0/1012142995 conn(0x7f3cc006bb10 msgr2=0x7f3cc014ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:12.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.356+0000 7f3cc73dc640 1 -- 172.21.15.12:0/1012142995 shutdown_connections 2023-10-16T23:28:12.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.356+0000 7f3cc73dc640 1 -- 172.21.15.12:0/1012142995 wait complete. 2023-10-16T23:28:12.376 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T23:28:12.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.488+0000 7f56037d7640 1 Processor -- start 2023-10-16T23:28:12.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.488+0000 7f56037d7640 1 -- start start 2023-10-16T23:28:12.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.488+0000 7f56037d7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f55fc0c1da0 0x7f55fc070c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:12.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.488+0000 7f56037d7640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f55fc0bb420 0x7f55fc138520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:12.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.488+0000 7f56037d7640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55fc0704e0 con 0x7f55fc138a60 2023-10-16T23:28:12.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.488+0000 7f56037d7640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55fc0bb180 con 0x7f55fc0c1da0 2023-10-16T23:28:12.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.488+0000 7f56037d7640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55fc14f430 con 0x7f55fc0bb420 2023-10-16T23:28:12.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.488+0000 7f5601d74640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f55fc138a60 0x7f55fc06e6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46378/0 (socket says 172.21.15.12:46378) 2023-10-16T23:28:12.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.488+0000 7f5601d74640 1 -- 172.21.15.12:0/35646541 learned_addr learned my addr 172.21.15.12:0/35646541 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:12.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.488+0000 7f5601573640 1 --2- 172.21.15.12:0/35646541 >> v2:172.21.15.12:3300/0 conn(0x7f55fc0c1da0 0x7f55fc070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:12.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.488+0000 7f5600d72640 1 --2- 172.21.15.12:0/35646541 >> v2:172.21.15.31:3300/0 conn(0x7f55fc0bb420 0x7f55fc138520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:12.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.488+0000 7f55f3fff640 1 -- 172.21.15.12:0/35646541 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2299166217 0 0) 0x7f55fc0704e0 con 0x7f55fc138a60 2023-10-16T23:28:12.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.492+0000 7f55f3fff640 1 -- 172.21.15.12:0/35646541 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55e8003530 con 0x7f55fc138a60 2023-10-16T23:28:12.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.492+0000 7f5601573640 1 -- 172.21.15.12:0/35646541 >> v2:172.21.15.31:3300/0 conn(0x7f55fc0bb420 msgr2=0x7f55fc138520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:12.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.492+0000 7f5601573640 1 --2- 172.21.15.12:0/35646541 >> v2:172.21.15.31:3300/0 conn(0x7f55fc0bb420 0x7f55fc138520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:12.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.492+0000 7f5601573640 1 -- 172.21.15.12:0/35646541 >> v1:172.21.15.12:6789/0 conn(0x7f55fc138a60 legacy=0x7f55fc06e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:12.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.492+0000 7f5601573640 1 -- 172.21.15.12:0/35646541 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55fc0bada0 con 0x7f55fc0c1da0 2023-10-16T23:28:12.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.492+0000 7f5601573640 1 --2- 172.21.15.12:0/35646541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55fc0c1da0 0x7f55fc070c80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f55fc0c26a0 tx=0x7f55f801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c86ee5c4afba1bf server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:12.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.492+0000 7f55f3fff640 1 -- 172.21.15.12:0/35646541 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f80ab600 con 0x7f55fc0c1da0 2023-10-16T23:28:12.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.492+0000 7f55f3fff640 1 -- 172.21.15.12:0/35646541 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f80a7050 con 0x7f55fc0c1da0 2023-10-16T23:28:12.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.492+0000 7f55f3fff640 1 -- 172.21.15.12:0/35646541 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f80ab980 con 0x7f55fc0c1da0 2023-10-16T23:28:12.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.492+0000 7f56037d7640 1 -- 172.21.15.12:0/35646541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55fc0c1da0 msgr2=0x7f55fc070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:12.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.492+0000 7f56037d7640 1 --2- 172.21.15.12:0/35646541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55fc0c1da0 0x7f55fc070c80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f55fc0c26a0 tx=0x7f55f801c400 comp rx=0 tx=0).stop 2023-10-16T23:28:12.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.492+0000 7f56037d7640 1 -- 172.21.15.12:0/35646541 shutdown_connections 2023-10-16T23:28:12.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.492+0000 7f56037d7640 1 --2- 172.21.15.12:0/35646541 >> v2:172.21.15.31:3300/0 conn(0x7f55fc0bb420 0x7f55fc138520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:12.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.492+0000 7f56037d7640 1 --2- 172.21.15.12:0/35646541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55fc0c1da0 0x7f55fc070c80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:12.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.492+0000 7f56037d7640 1 -- 172.21.15.12:0/35646541 >> 172.21.15.12:0/35646541 conn(0x7f55fc06b830 msgr2=0x7f55fc06bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:12.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.492+0000 7f56037d7640 1 -- 172.21.15.12:0/35646541 shutdown_connections 2023-10-16T23:28:12.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.492+0000 7f56037d7640 1 -- 172.21.15.12:0/35646541 wait complete. 2023-10-16T23:28:12.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f56037d7640 1 Processor -- start 2023-10-16T23:28:12.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f56037d7640 1 -- start start 2023-10-16T23:28:12.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f56037d7640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55fc0bb420 0x7f55fc150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:12.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f56037d7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55fc0c1da0 0x7f55fc136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:12.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f56037d7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55fc138a60 0x7f55fc14e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:12.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f56037d7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc0bffd0 con 0x7f55fc138a60 2023-10-16T23:28:12.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f56037d7640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc137000 con 0x7f55fc0c1da0 2023-10-16T23:28:12.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f56037d7640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc14e5e0 con 0x7f55fc0bb420 2023-10-16T23:28:12.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f5601d74640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55fc138a60 0x7f55fc14e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:12.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f5601d74640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55fc138a60 0x7f55fc14e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51670/0 (socket says 172.21.15.12:51670) 2023-10-16T23:28:12.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f5601d74640 1 -- 172.21.15.12:0/2833426122 learned_addr learned my addr 172.21.15.12:0/2833426122 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:12.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f5600d72640 1 --2- 172.21.15.12:0/2833426122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55fc0c1da0 0x7f55fc136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:12.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f5601573640 1 --2- 172.21.15.12:0/2833426122 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55fc0bb420 0x7f55fc150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:12.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f5601d74640 1 -- 172.21.15.12:0/2833426122 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55fc0bb420 msgr2=0x7f55fc150dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:12.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f5601d74640 1 --2- 172.21.15.12:0/2833426122 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55fc0bb420 0x7f55fc150dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:12.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f5601d74640 1 -- 172.21.15.12:0/2833426122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55fc0c1da0 msgr2=0x7f55fc136ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:12.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f5601d74640 1 --2- 172.21.15.12:0/2833426122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55fc0c1da0 0x7f55fc136ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:12.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f5601d74640 1 -- 172.21.15.12:0/2833426122 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f8009420 con 0x7f55fc138a60 2023-10-16T23:28:12.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f5601573640 1 --2- 172.21.15.12:0/2833426122 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55fc0bb420 0x7f55fc150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:12.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f5601d74640 1 --2- 172.21.15.12:0/2833426122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55fc138a60 0x7f55fc14e0a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f55f400cad0 tx=0x7f55f400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:12.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f55f1ffb640 1 -- 172.21.15.12:0/2833426122 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f400ac30 con 0x7f55fc138a60 2023-10-16T23:28:12.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f55f1ffb640 1 -- 172.21.15.12:0/2833426122 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f400ad90 con 0x7f55fc138a60 2023-10-16T23:28:12.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f56037d7640 1 -- 172.21.15.12:0/2833426122 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55fc1527a0 con 0x7f55fc138a60 2023-10-16T23:28:12.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f55f1ffb640 1 -- 172.21.15.12:0/2833426122 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f4012620 con 0x7f55fc138a60 2023-10-16T23:28:12.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f56037d7640 1 -- 172.21.15.12:0/2833426122 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55fc14ed70 con 0x7f55fc138a60 2023-10-16T23:28:12.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f56037d7640 1 -- 172.21.15.12:0/2833426122 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55fc1376d0 con 0x7f55fc138a60 2023-10-16T23:28:12.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f55f1ffb640 1 -- 172.21.15.12:0/2833426122 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f55f4007070 con 0x7f55fc138a60 2023-10-16T23:28:12.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f55f1ffb640 1 --2- 172.21.15.12:0/2833426122 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f55e0065e60 0x7f55e0068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.496+0000 7f55f1ffb640 1 -- 172.21.15.12:0/2833426122 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f55f4083720 con 0x7f55fc138a60 2023-10-16T23:28:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.500+0000 7f5601573640 1 --2- 172.21.15.12:0/2833426122 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f55e0065e60 0x7f55e0068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:12.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.500+0000 7f5601573640 1 --2- 172.21.15.12:0/2833426122 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f55e0065e60 0x7f55e0068320 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f55fc0bc830 tx=0x7f55f8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:12.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.500+0000 7f55f1ffb640 1 -- 172.21.15.12:0/2833426122 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f55f4050e00 con 0x7f55fc138a60 2023-10-16T23:28:12.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.668+0000 7f56037d7640 1 -- 172.21.15.12:0/2833426122 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f55fc0673a0 con 0x7f55fc138a60 2023-10-16T23:28:12.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.668+0000 7f55f1ffb640 1 -- 172.21.15.12:0/2833426122 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f55f4054420 con 0x7f55fc138a60 2023-10-16T23:28:12.673 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2023-10-16T23:28:12.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.672+0000 7f56037d7640 1 -- 172.21.15.12:0/2833426122 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f55e0065e60 msgr2=0x7f55e0068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:12.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.672+0000 7f56037d7640 1 --2- 172.21.15.12:0/2833426122 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f55e0065e60 0x7f55e0068320 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f55fc0bc830 tx=0x7f55f8008040 comp rx=0 tx=0).stop 2023-10-16T23:28:12.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.672+0000 7f56037d7640 1 -- 172.21.15.12:0/2833426122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55fc138a60 msgr2=0x7f55fc14e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:12.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.672+0000 7f56037d7640 1 --2- 172.21.15.12:0/2833426122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55fc138a60 0x7f55fc14e0a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f55f400cad0 tx=0x7f55f400cf90 comp rx=0 tx=0).stop 2023-10-16T23:28:12.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.672+0000 7f56037d7640 1 -- 172.21.15.12:0/2833426122 shutdown_connections 2023-10-16T23:28:12.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.672+0000 7f56037d7640 1 --2- 172.21.15.12:0/2833426122 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f55e0065e60 0x7f55e0068320 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:12.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.672+0000 7f56037d7640 1 --2- 172.21.15.12:0/2833426122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55fc138a60 0x7f55fc14e0a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:12.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.672+0000 7f56037d7640 1 --2- 172.21.15.12:0/2833426122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55fc0c1da0 0x7f55fc136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:12.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.672+0000 7f56037d7640 1 --2- 172.21.15.12:0/2833426122 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55fc0bb420 0x7f55fc150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:12.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.672+0000 7f56037d7640 1 -- 172.21.15.12:0/2833426122 >> 172.21.15.12:0/2833426122 conn(0x7f55fc06b830 msgr2=0x7f55fc0c4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:12.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.672+0000 7f56037d7640 1 -- 172.21.15.12:0/2833426122 shutdown_connections 2023-10-16T23:28:12.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:12.672+0000 7f56037d7640 1 -- 172.21.15.12:0/2833426122 wait complete. 2023-10-16T23:28:12.690 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi033.front.sepia.ceph.com... 2023-10-16T23:28:12.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:12.691 DEBUG:teuthology.orchestra.run.smithi033:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-16T23:28:12.710 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi033.stderr:ceph-fuse[33279]: fuse finished with error 0 and tester_r 0 2023-10-16T23:28:12.712 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T23:28:18.814 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2023-10-16T23:28:18.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:18.818 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-16T23:28:18.833 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-16T23:28:18.833 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T23:28:18.840 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-16T23:28:18.840 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T23:28:18.890 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T23:28:19.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.024+0000 7faf39086640 1 Processor -- start 2023-10-16T23:28:19.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.024+0000 7faf39086640 1 -- start start 2023-10-16T23:28:19.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.024+0000 7faf39086640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf340c1130 0x7faf340b8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:19.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.024+0000 7faf39086640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faf340b9f40 0x7faf340ba390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:19.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.024+0000 7faf39086640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf340b40c0 con 0x7faf3414c520 2023-10-16T23:28:19.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.024+0000 7faf39086640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf340b3ca0 con 0x7faf340b9f40 2023-10-16T23:28:19.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.024+0000 7faf39086640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf340b7ce0 con 0x7faf340c1130 2023-10-16T23:28:19.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.024+0000 7faf32d9d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf340c1130 0x7faf340b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:19.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.024+0000 7faf3359e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faf340b9f40 0x7faf340ba390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:19.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.024+0000 7faf3259c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7faf3414c520 0x7faf3414c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:36306/0 (socket says 172.21.15.12:36306) 2023-10-16T23:28:19.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.024+0000 7faf3259c640 1 -- 172.21.15.12:0/416540285 learned_addr learned my addr 172.21.15.12:0/416540285 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:19.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.024+0000 7faf3359e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faf340b9f40 0x7faf340ba390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:44240/0 (socket says 172.21.15.12:44240) 2023-10-16T23:28:19.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.024+0000 7faf32d9d640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf340c1130 0x7faf340b8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:48488/0 (socket says 172.21.15.12:48488) 2023-10-16T23:28:19.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.024+0000 7faf3359e640 1 -- 172.21.15.12:0/416540285 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf340c1130 msgr2=0x7faf340b8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:19.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.024+0000 7faf3359e640 1 --2- 172.21.15.12:0/416540285 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf340c1130 0x7faf340b8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.024+0000 7faf3359e640 1 -- 172.21.15.12:0/416540285 >> v1:172.21.15.31:6789/0 conn(0x7faf3414c520 legacy=0x7faf3414c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:19.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.024+0000 7faf3359e640 1 -- 172.21.15.12:0/416540285 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3414d090 con 0x7faf340b9f40 2023-10-16T23:28:19.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.028+0000 7faf3359e640 1 --2- 172.21.15.12:0/416540285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf340b9f40 0x7faf340ba390 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009d90 tx=0x7faf2c01c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a21abdea8aec98c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:19.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.028+0000 7faf31d9b640 1 -- 172.21.15.12:0/416540285 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c0a5910 con 0x7faf340b9f40 2023-10-16T23:28:19.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.028+0000 7faf31d9b640 1 -- 172.21.15.12:0/416540285 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c0a5a70 con 0x7faf340b9f40 2023-10-16T23:28:19.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.028+0000 7faf31d9b640 1 -- 172.21.15.12:0/416540285 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c0a5e00 con 0x7faf340b9f40 2023-10-16T23:28:19.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.028+0000 7faf39086640 1 -- 172.21.15.12:0/416540285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf340b9f40 msgr2=0x7faf340ba390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:19.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.028+0000 7faf39086640 1 --2- 172.21.15.12:0/416540285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf340b9f40 0x7faf340ba390 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009d90 tx=0x7faf2c01c830 comp rx=0 tx=0).stop 2023-10-16T23:28:19.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.028+0000 7faf39086640 1 -- 172.21.15.12:0/416540285 shutdown_connections 2023-10-16T23:28:19.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.028+0000 7faf39086640 1 --2- 172.21.15.12:0/416540285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf340b9f40 0x7faf340ba390 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.028+0000 7faf39086640 1 --2- 172.21.15.12:0/416540285 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf340c1130 0x7faf340b8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.028+0000 7faf39086640 1 -- 172.21.15.12:0/416540285 >> 172.21.15.12:0/416540285 conn(0x7faf3406ba20 msgr2=0x7faf340c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:19.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.028+0000 7faf39086640 1 -- 172.21.15.12:0/416540285 shutdown_connections 2023-10-16T23:28:19.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.028+0000 7faf39086640 1 -- 172.21.15.12:0/416540285 wait complete. 2023-10-16T23:28:19.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.032+0000 7faf39086640 1 Processor -- start 2023-10-16T23:28:19.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.032+0000 7faf39086640 1 -- start start 2023-10-16T23:28:19.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.032+0000 7faf39086640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf340b9f40 0x7faf34146a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:19.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.032+0000 7faf39086640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf340c1130 0x7faf34140690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:19.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.032+0000 7faf39086640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf3414c520 0x7faf34140bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:19.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.032+0000 7faf39086640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf340b58e0 con 0x7faf340c1130 2023-10-16T23:28:19.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.032+0000 7faf39086640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf340b6140 con 0x7faf340b9f40 2023-10-16T23:28:19.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.032+0000 7faf39086640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf34146fa0 con 0x7faf3414c520 2023-10-16T23:28:19.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.032+0000 7faf3259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf340c1130 0x7faf34140690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:19.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.032+0000 7faf3259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf340c1130 0x7faf34140690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33042/0 (socket says 172.21.15.12:33042) 2023-10-16T23:28:19.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.032+0000 7faf3259c640 1 -- 172.21.15.12:0/2958288423 learned_addr learned my addr 172.21.15.12:0/2958288423 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:19.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.032+0000 7faf32d9d640 1 --2- 172.21.15.12:0/2958288423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf340b9f40 0x7faf34146a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:19.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.032+0000 7faf3359e640 1 --2- 172.21.15.12:0/2958288423 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf3414c520 0x7faf34140bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:19.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.032+0000 7faf3259c640 1 -- 172.21.15.12:0/2958288423 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf3414c520 msgr2=0x7faf34140bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:19.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.032+0000 7faf3259c640 1 --2- 172.21.15.12:0/2958288423 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf3414c520 0x7faf34140bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.032+0000 7faf3259c640 1 -- 172.21.15.12:0/2958288423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf340b9f40 msgr2=0x7faf34146a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:19.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.032+0000 7faf3259c640 1 --2- 172.21.15.12:0/2958288423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf340b9f40 0x7faf34146a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.032+0000 7faf3259c640 1 -- 172.21.15.12:0/2958288423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c009a70 con 0x7faf340c1130 2023-10-16T23:28:19.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.032+0000 7faf3259c640 1 --2- 172.21.15.12:0/2958288423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf340c1130 0x7faf34140690 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faf2800c400 tx=0x7faf2800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:19.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.032+0000 7faf1b7fe640 1 -- 172.21.15.12:0/2958288423 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf28005cf0 con 0x7faf340c1130 2023-10-16T23:28:19.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.032+0000 7faf1b7fe640 1 -- 172.21.15.12:0/2958288423 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf28005e50 con 0x7faf340c1130 2023-10-16T23:28:19.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.032+0000 7faf39086640 1 -- 172.21.15.12:0/2958288423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf34141110 con 0x7faf340c1130 2023-10-16T23:28:19.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.032+0000 7faf1b7fe640 1 -- 172.21.15.12:0/2958288423 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf280072d0 con 0x7faf340c1130 2023-10-16T23:28:19.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.032+0000 7faf39086640 1 -- 172.21.15.12:0/2958288423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf340b5dd0 con 0x7faf340c1130 2023-10-16T23:28:19.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.032+0000 7faf39086640 1 -- 172.21.15.12:0/2958288423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf340673a0 con 0x7faf340c1130 2023-10-16T23:28:19.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.032+0000 7faf1b7fe640 1 -- 172.21.15.12:0/2958288423 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7faf28007430 con 0x7faf340c1130 2023-10-16T23:28:19.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.036+0000 7faf1b7fe640 1 --2- 172.21.15.12:0/2958288423 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7faf20065e90 0x7faf20068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:19.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.036+0000 7faf1b7fe640 1 -- 172.21.15.12:0/2958288423 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faf28082c20 con 0x7faf340c1130 2023-10-16T23:28:19.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.036+0000 7faf32d9d640 1 --2- 172.21.15.12:0/2958288423 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7faf20065e90 0x7faf20068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:19.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.036+0000 7faf32d9d640 1 --2- 172.21.15.12:0/2958288423 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7faf20065e90 0x7faf20068350 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7faf24009af0 tx=0x7faf24008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:19.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.040+0000 7faf1b7fe640 1 -- 172.21.15.12:0/2958288423 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7faf28050310 con 0x7faf340c1130 2023-10-16T23:28:19.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.196+0000 7faf39086640 1 -- 172.21.15.12:0/2958288423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf340706b0 con 0x7faf340c1130 2023-10-16T23:28:19.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.196+0000 7faf1b7fe640 1 -- 172.21.15.12:0/2958288423 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17763 (secure 0 0 0) 0x7faf28017090 con 0x7faf340c1130 2023-10-16T23:28:19.201 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:28:19.202 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"fsid":"0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51","created":"2023-10-16T23:27:16.468087+0000","modified":"2023-10-16T23:27:41.690088+0000","last_up_change":"2023-10-16T23:27:28.136202+0000","last_in_change":"2023-10-16T23:27:18.793212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T23:27:27.354025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-16T23:27:34.786446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-16T23:27:39.130341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-16T23:27:39.674572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73e70f98-6f5e-4464-b34e-931faac41cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":38075},{"type":"v1","addr":"172.21.15.12:6814","nonce":38075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":38075},{"type":"v1","addr":"172.21.15.12:6819","nonce":38075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":38075},{"type":"v1","addr":"172.21.15.12:6827","nonce":38075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":38075},{"type":"v1","addr":"172.21.15.12:6823","nonce":38075}]},"public_addr":"172.21.15.12:6814/38075","cluster_addr":"172.21.15.12:6819/38075","heartbeat_back_addr":"172.21.15.12:6827/38075","heartbeat_front_addr":"172.21.15.12:6823/38075","state":["exists","up"]},{"osd":1,"uuid":"ff722efe-b3f9-4cc0-bbde-f4d4d8055a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":38076},{"type":"v1","addr":"172.21.15.12:6811","nonce":38076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":38076},{"type":"v1","addr":"172.21.15.12:6818","nonce":38076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":38076},{"type":"v1","addr":"172.21.15.12:6831","nonce":38076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":38076},{"type":"v1","addr":"172.21.15.12:6825","nonce":38076}]},"public_addr":"172.21.15.12:6811/38076","cluster_addr":"172.21.15.12:6818/38076","heartbeat_back_addr":"172.21.15.12:6831/38076","heartbeat_front_addr":"172.21.15.12:6825/38076","state":["exists","up"]},{"osd":2,"uuid":"9baf25db-dce0-4065-90d6-f35867286be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6809","nonce":38073},{"type":"v1","addr":"172.21.15.12:6810","nonce":38073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":38073},{"type":"v1","addr":"172.21.15.12:6817","nonce":38073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":38073},{"type":"v1","addr":"172.21.15.12:6830","nonce":38073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":38073},{"type":"v1","addr":"172.21.15.12:6826","nonce":38073}]},"public_addr":"172.21.15.12:6810/38073","cluster_addr":"172.21.15.12:6817/38073","heartbeat_back_addr":"172.21.15.12:6830/38073","heartbeat_front_addr":"172.21.15.12:6826/38073","state":["exists","up"]},{"osd":3,"uuid":"8a620ad3-2294-470d-8a8c-66f177f5fbe7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":38074},{"type":"v1","addr":"172.21.15.12:6801","nonce":38074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":38074},{"type":"v1","addr":"172.21.15.12:6803","nonce":38074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":38074},{"type":"v1","addr":"172.21.15.12:6807","nonce":38074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":38074},{"type":"v1","addr":"172.21.15.12:6805","nonce":38074}]},"public_addr":"172.21.15.12:6801/38074","cluster_addr":"172.21.15.12:6803/38074","heartbeat_back_addr":"172.21.15.12:6807/38074","heartbeat_front_addr":"172.21.15.12:6805/38074","state":["exists","up"]},{"osd":4,"uuid":"a8824d77-7405-40f5-9234-60889802b184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":38266},{"type":"v1","addr":"172.21.15.31:6817","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":38266},{"type":"v1","addr":"172.21.15.31:6819","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":38266},{"type":"v1","addr":"172.21.15.31:6823","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":38266},{"type":"v1","addr":"172.21.15.31:6821","nonce":38266}]},"public_addr":"172.21.15.31:6817/38266","cluster_addr":"172.21.15.31:6819/38266","heartbeat_back_addr":"172.21.15.31:6823/38266","heartbeat_front_addr":"172.21.15.31:6821/38266","state":["exists","up"]},{"osd":5,"uuid":"3bb01192-a47c-48e9-9662-285e3f6f4b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":38264},{"type":"v1","addr":"172.21.15.31:6807","nonce":38264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":38264},{"type":"v1","addr":"172.21.15.31:6811","nonce":38264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":38264},{"type":"v1","addr":"172.21.15.31:6815","nonce":38264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":38264},{"type":"v1","addr":"172.21.15.31:6813","nonce":38264}]},"public_addr":"172.21.15.31:6807/38264","cluster_addr":"172.21.15.31:6811/38264","heartbeat_back_addr":"172.21.15.31:6815/38264","heartbeat_front_addr":"172.21.15.31:6813/38264","state":["exists","up"]},{"osd":6,"uuid":"1e2d18e4-73e6-4a37-826c-35eca4d96935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":38263},{"type":"v1","addr":"172.21.15.31:6825","nonce":38263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":38263},{"type":"v1","addr":"172.21.15.31:6827","nonce":38263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":38263},{"type":"v1","addr":"172.21.15.31:6831","nonce":38263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":38263},{"type":"v1","addr":"172.21.15.31:6829","nonce":38263}]},"public_addr":"172.21.15.31:6825/38263","cluster_addr":"172.21.15.31:6827/38263","heartbeat_back_addr":"172.21.15.31:6831/38263","heartbeat_front_addr":"172.21.15.31:6829/38263","state":["exists","up"]},{"osd":7,"uuid":"e0f369c0-562b-4440-a5aa-12275c29412b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":38265},{"type":"v1","addr":"172.21.15.31:6801","nonce":38265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":38265},{"type":"v1","addr":"172.21.15.31:6803","nonce":38265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":38265},{"type":"v1","addr":"172.21.15.31:6810","nonce":38265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":38265},{"type":"v1","addr":"172.21.15.31:6806","nonce":38265}]},"public_addr":"172.21.15.31:6801/38265","cluster_addr":"172.21.15.31:6803/38265","heartbeat_back_addr":"172.21.15.31:6810/38265","heartbeat_front_addr":"172.21.15.31:6806/38265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.411815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.372565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.209700+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.414619+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.316843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.300348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.359800+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.219854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T23:28:19.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.200+0000 7faf39086640 1 -- 172.21.15.12:0/2958288423 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7faf20065e90 msgr2=0x7faf20068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:19.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.200+0000 7faf39086640 1 --2- 172.21.15.12:0/2958288423 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7faf20065e90 0x7faf20068350 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7faf24009af0 tx=0x7faf24008040 comp rx=0 tx=0).stop 2023-10-16T23:28:19.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.200+0000 7faf39086640 1 -- 172.21.15.12:0/2958288423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf340c1130 msgr2=0x7faf34140690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:19.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.200+0000 7faf39086640 1 --2- 172.21.15.12:0/2958288423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf340c1130 0x7faf34140690 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faf2800c400 tx=0x7faf2800c8c0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.200+0000 7faf39086640 1 -- 172.21.15.12:0/2958288423 shutdown_connections 2023-10-16T23:28:19.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.200+0000 7faf39086640 1 --2- 172.21.15.12:0/2958288423 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7faf20065e90 0x7faf20068350 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.200+0000 7faf39086640 1 --2- 172.21.15.12:0/2958288423 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf3414c520 0x7faf34140bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.200+0000 7faf39086640 1 --2- 172.21.15.12:0/2958288423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf340c1130 0x7faf34140690 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.200+0000 7faf39086640 1 --2- 172.21.15.12:0/2958288423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf340b9f40 0x7faf34146a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.200+0000 7faf39086640 1 -- 172.21.15.12:0/2958288423 >> 172.21.15.12:0/2958288423 conn(0x7faf3406ba20 msgr2=0x7faf340bda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:19.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.200+0000 7faf39086640 1 -- 172.21.15.12:0/2958288423 shutdown_connections 2023-10-16T23:28:19.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.200+0000 7faf39086640 1 -- 172.21.15.12:0/2958288423 wait complete. 2023-10-16T23:28:19.220 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T23:27:27.354025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-16T23:27:34.786446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T23:27:39.130341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T23:27:39.674572+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T23:28:19.221 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T23:28:19.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.344+0000 7f37d0cb3640 1 Processor -- start 2023-10-16T23:28:19.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.344+0000 7f37d0cb3640 1 -- start start 2023-10-16T23:28:19.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.344+0000 7f37d0cb3640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f37cc0c12a0 0x7f37cc0b90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:19.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.344+0000 7f37d0cb3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37cc14b7a0 0x7f37cc14bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:19.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.344+0000 7f37d0cb3640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37cc1505e0 con 0x7f37cc0b3bb0 2023-10-16T23:28:19.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.344+0000 7f37d0cb3640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37cc14f7a0 con 0x7f37cc0c12a0 2023-10-16T23:28:19.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.344+0000 7f37d0cb3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc070fe0 con 0x7f37cc14b7a0 2023-10-16T23:28:19.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.344+0000 7f37c9d9b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f37cc0b3bb0 0x7f37cc14fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48050/0 (socket says 172.21.15.12:48050) 2023-10-16T23:28:19.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.344+0000 7f37ca59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f37cc0c12a0 0x7f37cc0b90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:19.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.344+0000 7f37c9d9b640 1 -- 172.21.15.12:0/1398713625 learned_addr learned my addr 172.21.15.12:0/1398713625 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:19.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.344+0000 7f37cad9d640 1 --2- 172.21.15.12:0/1398713625 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37cc14b7a0 0x7f37cc14bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:19.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.344+0000 7f37ca59c640 1 -- 172.21.15.12:0/1398713625 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37cc14b7a0 msgr2=0x7f37cc14bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:19.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.344+0000 7f37ca59c640 1 --2- 172.21.15.12:0/1398713625 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37cc14b7a0 0x7f37cc14bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.344+0000 7f37ca59c640 1 -- 172.21.15.12:0/1398713625 >> v1:172.21.15.12:6789/0 conn(0x7f37cc0b3bb0 legacy=0x7f37cc14fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:19.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.344+0000 7f37ca59c640 1 -- 172.21.15.12:0/1398713625 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37cc0b37e0 con 0x7f37cc0c12a0 2023-10-16T23:28:19.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.344+0000 7f37c959a640 1 -- 172.21.15.12:0/1398713625 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722430589 0 0) 0x7f37cc1505e0 con 0x7f37cc0b3bb0 2023-10-16T23:28:19.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.348+0000 7f37ca59c640 1 --2- 172.21.15.12:0/1398713625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37cc0c12a0 0x7f37cc0b90c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f37c4009d90 tx=0x7f37c401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebcc4e9f354ddaf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:19.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.348+0000 7f37c959a640 1 -- 172.21.15.12:0/1398713625 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c40a5970 con 0x7f37cc0c12a0 2023-10-16T23:28:19.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.348+0000 7f37c959a640 1 -- 172.21.15.12:0/1398713625 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c40a5ad0 con 0x7f37cc0c12a0 2023-10-16T23:28:19.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.348+0000 7f37c959a640 1 -- 172.21.15.12:0/1398713625 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c40a5e60 con 0x7f37cc0c12a0 2023-10-16T23:28:19.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.348+0000 7f37d0cb3640 1 -- 172.21.15.12:0/1398713625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37cc0c12a0 msgr2=0x7f37cc0b90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:19.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.348+0000 7f37d0cb3640 1 --2- 172.21.15.12:0/1398713625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37cc0c12a0 0x7f37cc0b90c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f37c4009d90 tx=0x7f37c401c890 comp rx=0 tx=0).stop 2023-10-16T23:28:19.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.348+0000 7f37d0cb3640 1 -- 172.21.15.12:0/1398713625 shutdown_connections 2023-10-16T23:28:19.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.348+0000 7f37d0cb3640 1 --2- 172.21.15.12:0/1398713625 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37cc14b7a0 0x7f37cc14bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.348+0000 7f37d0cb3640 1 --2- 172.21.15.12:0/1398713625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37cc0c12a0 0x7f37cc0b90c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.348+0000 7f37d0cb3640 1 -- 172.21.15.12:0/1398713625 >> 172.21.15.12:0/1398713625 conn(0x7f37cc06bb10 msgr2=0x7f37cc0c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:19.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.348+0000 7f37d0cb3640 1 -- 172.21.15.12:0/1398713625 shutdown_connections 2023-10-16T23:28:19.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.348+0000 7f37d0cb3640 1 -- 172.21.15.12:0/1398713625 wait complete. 2023-10-16T23:28:19.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.348+0000 7f37d0cb3640 1 Processor -- start 2023-10-16T23:28:19.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.348+0000 7f37d0cb3640 1 -- start start 2023-10-16T23:28:19.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37d0cb3640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37cc0b3bb0 0x7f37cc1e8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:19.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37d0cb3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37cc0c12a0 0x7f37cc1474f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:19.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37d0cb3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37cc14b7a0 0x7f37cc14d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:19.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37d0cb3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc0bb7f0 con 0x7f37cc14b7a0 2023-10-16T23:28:19.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37d0cb3640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc1e91a0 con 0x7f37cc0c12a0 2023-10-16T23:28:19.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37d0cb3640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc147a30 con 0x7f37cc0b3bb0 2023-10-16T23:28:19.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37cad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37cc14b7a0 0x7f37cc14d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:19.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37cad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37cc14b7a0 0x7f37cc14d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33060/0 (socket says 172.21.15.12:33060) 2023-10-16T23:28:19.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37cad9d640 1 -- 172.21.15.12:0/2024278332 learned_addr learned my addr 172.21.15.12:0/2024278332 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:19.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37c9d9b640 1 --2- 172.21.15.12:0/2024278332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37cc0c12a0 0x7f37cc1474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:19.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37ca59c640 1 --2- 172.21.15.12:0/2024278332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37cc0b3bb0 0x7f37cc1e8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:19.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37cad9d640 1 -- 172.21.15.12:0/2024278332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37cc0b3bb0 msgr2=0x7f37cc1e8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:19.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37cad9d640 1 --2- 172.21.15.12:0/2024278332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37cc0b3bb0 0x7f37cc1e8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37cad9d640 1 -- 172.21.15.12:0/2024278332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37cc0c12a0 msgr2=0x7f37cc1474f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:19.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37cad9d640 1 --2- 172.21.15.12:0/2024278332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37cc0c12a0 0x7f37cc1474f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37cad9d640 1 -- 172.21.15.12:0/2024278332 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c4009a70 con 0x7f37cc14b7a0 2023-10-16T23:28:19.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37cad9d640 1 --2- 172.21.15.12:0/2024278332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37cc14b7a0 0x7f37cc14d680 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f37bc00d590 tx=0x7f37bc00da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:19.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37baffd640 1 -- 172.21.15.12:0/2024278332 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc0125f0 con 0x7f37cc14b7a0 2023-10-16T23:28:19.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37baffd640 1 -- 172.21.15.12:0/2024278332 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37bc012770 con 0x7f37cc14b7a0 2023-10-16T23:28:19.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37d0cb3640 1 -- 172.21.15.12:0/2024278332 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37cc14eeb0 con 0x7f37cc14b7a0 2023-10-16T23:28:19.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37baffd640 1 -- 172.21.15.12:0/2024278332 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc012b20 con 0x7f37cc14b7a0 2023-10-16T23:28:19.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37d0cb3640 1 -- 172.21.15.12:0/2024278332 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37cc14f150 con 0x7f37cc14b7a0 2023-10-16T23:28:19.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37d0cb3640 1 -- 172.21.15.12:0/2024278332 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37cc0bb960 con 0x7f37cc14b7a0 2023-10-16T23:28:19.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37baffd640 1 -- 172.21.15.12:0/2024278332 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f37bc012c80 con 0x7f37cc14b7a0 2023-10-16T23:28:19.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37baffd640 1 --2- 172.21.15.12:0/2024278332 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f37ac065e60 0x7f37ac068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:19.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37baffd640 1 -- 172.21.15.12:0/2024278332 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f37bc083d60 con 0x7f37cc14b7a0 2023-10-16T23:28:19.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.352+0000 7f37ca59c640 1 --2- 172.21.15.12:0/2024278332 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f37ac065e60 0x7f37ac068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:19.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.356+0000 7f37ca59c640 1 --2- 172.21.15.12:0/2024278332 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f37ac065e60 0x7f37ac068320 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f37c40af000 tx=0x7f37c40a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:19.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.356+0000 7f37baffd640 1 -- 172.21.15.12:0/2024278332 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f37cc0bb960 con 0x7f37cc14b7a0 2023-10-16T23:28:19.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.512+0000 7f37d0cb3640 1 -- 172.21.15.12:0/2024278332 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f37cc0bb930 con 0x7f37cc14b7a0 2023-10-16T23:28:19.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.512+0000 7f37baffd640 1 -- 172.21.15.12:0/2024278332 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f37bc051310 con 0x7f37cc14b7a0 2023-10-16T23:28:19.517 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-16T23:28:19.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.516+0000 7f37d0cb3640 1 -- 172.21.15.12:0/2024278332 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f37ac065e60 msgr2=0x7f37ac068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:19.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.516+0000 7f37d0cb3640 1 --2- 172.21.15.12:0/2024278332 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f37ac065e60 0x7f37ac068320 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f37c40af000 tx=0x7f37c40a7070 comp rx=0 tx=0).stop 2023-10-16T23:28:19.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.516+0000 7f37d0cb3640 1 -- 172.21.15.12:0/2024278332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37cc14b7a0 msgr2=0x7f37cc14d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:19.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.516+0000 7f37d0cb3640 1 --2- 172.21.15.12:0/2024278332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37cc14b7a0 0x7f37cc14d680 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f37bc00d590 tx=0x7f37bc00da50 comp rx=0 tx=0).stop 2023-10-16T23:28:19.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.516+0000 7f37d0cb3640 1 -- 172.21.15.12:0/2024278332 shutdown_connections 2023-10-16T23:28:19.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.516+0000 7f37d0cb3640 1 --2- 172.21.15.12:0/2024278332 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f37ac065e60 0x7f37ac068320 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.516+0000 7f37d0cb3640 1 --2- 172.21.15.12:0/2024278332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37cc14b7a0 0x7f37cc14d680 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.516+0000 7f37d0cb3640 1 --2- 172.21.15.12:0/2024278332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37cc0c12a0 0x7f37cc1474f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.516+0000 7f37d0cb3640 1 --2- 172.21.15.12:0/2024278332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f37cc0b3bb0 0x7f37cc1e8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.516+0000 7f37d0cb3640 1 -- 172.21.15.12:0/2024278332 >> 172.21.15.12:0/2024278332 conn(0x7f37cc06bb10 msgr2=0x7f37cc0c0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:19.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.516+0000 7f37d0cb3640 1 -- 172.21.15.12:0/2024278332 shutdown_connections 2023-10-16T23:28:19.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.516+0000 7f37d0cb3640 1 -- 172.21.15.12:0/2024278332 wait complete. 2023-10-16T23:28:19.534 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-16T23:28:19.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.660+0000 7f338953f640 1 Processor -- start 2023-10-16T23:28:19.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.660+0000 7f338953f640 1 -- start start 2023-10-16T23:28:19.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.660+0000 7f338953f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f33840bdb80 0x7f3384152f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:19.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.660+0000 7f338953f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f33840be9f0 0x7f3384153450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:19.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.660+0000 7f338953f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33840bef40 0x7f33840bf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:19.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.660+0000 7f338953f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f338406d640 con 0x7f33840be9f0 2023-10-16T23:28:19.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.660+0000 7f338953f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f338406d890 con 0x7f33840bdb80 2023-10-16T23:28:19.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.660+0000 7f338953f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338406eea0 con 0x7f33840bef40 2023-10-16T23:28:19.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.664+0000 7f33827fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f33840be9f0 0x7f3384153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:19.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.664+0000 7f33827fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f33840be9f0 0x7f3384153450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33064/0 (socket says 172.21.15.12:33064) 2023-10-16T23:28:19.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.664+0000 7f33827fc640 1 -- 172.21.15.12:0/1237795290 learned_addr learned my addr 172.21.15.12:0/1237795290 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:19.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.664+0000 7f3382ffd640 1 --2- 172.21.15.12:0/1237795290 >> v2:172.21.15.31:3300/0 conn(0x7f33840bdb80 0x7f3384152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:19.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.664+0000 7f33837fe640 1 --2- 172.21.15.12:0/1237795290 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33840bef40 0x7f33840bf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:19.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.664+0000 7f33827fc640 1 -- 172.21.15.12:0/1237795290 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33840bef40 msgr2=0x7f33840bf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:19.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.664+0000 7f33827fc640 1 --2- 172.21.15.12:0/1237795290 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33840bef40 0x7f33840bf3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.664+0000 7f33827fc640 1 -- 172.21.15.12:0/1237795290 >> v2:172.21.15.31:3300/0 conn(0x7f33840bdb80 msgr2=0x7f3384152f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:19.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.664+0000 7f33827fc640 1 --2- 172.21.15.12:0/1237795290 >> v2:172.21.15.31:3300/0 conn(0x7f33840bdb80 0x7f3384152f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.664+0000 7f33827fc640 1 -- 172.21.15.12:0/1237795290 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33840bce10 con 0x7f33840be9f0 2023-10-16T23:28:19.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.664+0000 7f33827fc640 1 --2- 172.21.15.12:0/1237795290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33840be9f0 0x7f3384153450 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f33840bd060 tx=0x7f337801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629aa231a1b3e432 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:19.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.664+0000 7f3381ffb640 1 -- 172.21.15.12:0/1237795290 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33780ab650 con 0x7f33840be9f0 2023-10-16T23:28:19.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.664+0000 7f3381ffb640 1 -- 172.21.15.12:0/1237795290 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33780ab7b0 con 0x7f33840be9f0 2023-10-16T23:28:19.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.664+0000 7f3381ffb640 1 -- 172.21.15.12:0/1237795290 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33780abb40 con 0x7f33840be9f0 2023-10-16T23:28:19.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.664+0000 7f338953f640 1 -- 172.21.15.12:0/1237795290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33840be9f0 msgr2=0x7f3384153450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:19.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.664+0000 7f338953f640 1 --2- 172.21.15.12:0/1237795290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33840be9f0 0x7f3384153450 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f33840bd060 tx=0x7f337801c470 comp rx=0 tx=0).stop 2023-10-16T23:28:19.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.664+0000 7f338953f640 1 -- 172.21.15.12:0/1237795290 shutdown_connections 2023-10-16T23:28:19.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.664+0000 7f338953f640 1 --2- 172.21.15.12:0/1237795290 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33840bef40 0x7f33840bf3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.664+0000 7f338953f640 1 --2- 172.21.15.12:0/1237795290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33840be9f0 0x7f3384153450 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.664+0000 7f338953f640 1 --2- 172.21.15.12:0/1237795290 >> v2:172.21.15.31:3300/0 conn(0x7f33840bdb80 0x7f3384152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.664+0000 7f338953f640 1 -- 172.21.15.12:0/1237795290 >> 172.21.15.12:0/1237795290 conn(0x7f3384073020 msgr2=0x7f338406b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:19.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.664+0000 7f338953f640 1 -- 172.21.15.12:0/1237795290 shutdown_connections 2023-10-16T23:28:19.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.664+0000 7f338953f640 1 -- 172.21.15.12:0/1237795290 wait complete. 2023-10-16T23:28:19.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.668+0000 7f338953f640 1 Processor -- start 2023-10-16T23:28:19.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.668+0000 7f338953f640 1 -- start start 2023-10-16T23:28:19.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.668+0000 7f338953f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33840bdb80 0x7f3384144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:19.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.668+0000 7f338953f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33840bef40 0x7f3384146dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:19.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.668+0000 7f338953f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33841440c0 0x7f33841ea7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:19.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.668+0000 7f338953f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33841422e0 con 0x7f33840bef40 2023-10-16T23:28:19.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.668+0000 7f338953f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3384143e70 con 0x7f33841440c0 2023-10-16T23:28:19.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.668+0000 7f338953f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33841451f0 con 0x7f33840bdb80 2023-10-16T23:28:19.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.668+0000 7f33827fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33840bef40 0x7f3384146dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:19.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.668+0000 7f33827fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33840bef40 0x7f3384146dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33074/0 (socket says 172.21.15.12:33074) 2023-10-16T23:28:19.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.668+0000 7f33827fc640 1 -- 172.21.15.12:0/860569604 learned_addr learned my addr 172.21.15.12:0/860569604 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:19.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.668+0000 7f3382ffd640 1 --2- 172.21.15.12:0/860569604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33840bdb80 0x7f3384144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:19.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.668+0000 7f33837fe640 1 --2- 172.21.15.12:0/860569604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33841440c0 0x7f33841ea7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:19.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.668+0000 7f33827fc640 1 -- 172.21.15.12:0/860569604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33840bdb80 msgr2=0x7f3384144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:19.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.668+0000 7f33827fc640 1 --2- 172.21.15.12:0/860569604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33840bdb80 0x7f3384144cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.668+0000 7f33827fc640 1 -- 172.21.15.12:0/860569604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33841440c0 msgr2=0x7f33841ea7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:19.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.668+0000 7f33827fc640 1 --2- 172.21.15.12:0/860569604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33841440c0 0x7f33841ea7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.668+0000 7f33827fc640 1 -- 172.21.15.12:0/860569604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33780094d0 con 0x7f33840bef40 2023-10-16T23:28:19.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.668+0000 7f33837fe640 1 --2- 172.21.15.12:0/860569604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33841440c0 0x7f33841ea7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:28:19.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.668+0000 7f33827fc640 1 --2- 172.21.15.12:0/860569604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33840bef40 0x7f3384146dc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f337801ab20 tx=0x7f337801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:19.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.668+0000 7f336b7fe640 1 -- 172.21.15.12:0/860569604 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33780b4800 con 0x7f33840bef40 2023-10-16T23:28:19.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.668+0000 7f336b7fe640 1 -- 172.21.15.12:0/860569604 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33780b4960 con 0x7f33840bef40 2023-10-16T23:28:19.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.668+0000 7f336b7fe640 1 -- 172.21.15.12:0/860569604 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33780b4cf0 con 0x7f33840bef40 2023-10-16T23:28:19.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.668+0000 7f338953f640 1 -- 172.21.15.12:0/860569604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f338414dc40 con 0x7f33840bef40 2023-10-16T23:28:19.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.668+0000 7f338953f640 1 -- 172.21.15.12:0/860569604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33841525a0 con 0x7f33840bef40 2023-10-16T23:28:19.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.668+0000 7f338953f640 1 -- 172.21.15.12:0/860569604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3384073a30 con 0x7f33840bef40 2023-10-16T23:28:19.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.672+0000 7f336b7fe640 1 -- 172.21.15.12:0/860569604 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f33780c83a0 con 0x7f33840bef40 2023-10-16T23:28:19.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.672+0000 7f336b7fe640 1 --2- 172.21.15.12:0/860569604 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3370065e60 0x7f3370068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:19.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.672+0000 7f336b7fe640 1 -- 172.21.15.12:0/860569604 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f337811e550 con 0x7f33840bef40 2023-10-16T23:28:19.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.672+0000 7f3382ffd640 1 --2- 172.21.15.12:0/860569604 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3370065e60 0x7f3370068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:19.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.672+0000 7f3382ffd640 1 --2- 172.21.15.12:0/860569604 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3370065e60 0x7f3370068320 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3384148190 tx=0x7f3374009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:19.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.676+0000 7f336b7fe640 1 -- 172.21.15.12:0/860569604 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f33780ebcd0 con 0x7f33840bef40 2023-10-16T23:28:19.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.828+0000 7f338953f640 1 -- 172.21.15.12:0/860569604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3384143960 con 0x7f33840bef40 2023-10-16T23:28:19.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.828+0000 7f336b7fe640 1 -- 172.21.15.12:0/860569604 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3384143960 con 0x7f33840bef40 2023-10-16T23:28:19.834 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-10-16T23:28:19.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.832+0000 7f338953f640 1 -- 172.21.15.12:0/860569604 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3370065e60 msgr2=0x7f3370068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:19.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.832+0000 7f338953f640 1 --2- 172.21.15.12:0/860569604 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3370065e60 0x7f3370068320 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3384148190 tx=0x7f3374009190 comp rx=0 tx=0).stop 2023-10-16T23:28:19.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.832+0000 7f338953f640 1 -- 172.21.15.12:0/860569604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33840bef40 msgr2=0x7f3384146dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:19.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.832+0000 7f338953f640 1 --2- 172.21.15.12:0/860569604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33840bef40 0x7f3384146dc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f337801ab20 tx=0x7f337801acb0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.832+0000 7f338953f640 1 -- 172.21.15.12:0/860569604 shutdown_connections 2023-10-16T23:28:19.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.832+0000 7f338953f640 1 --2- 172.21.15.12:0/860569604 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3370065e60 0x7f3370068320 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.832+0000 7f338953f640 1 --2- 172.21.15.12:0/860569604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33841440c0 0x7f33841ea7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.832+0000 7f338953f640 1 --2- 172.21.15.12:0/860569604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33840bef40 0x7f3384146dc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.832+0000 7f338953f640 1 --2- 172.21.15.12:0/860569604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33840bdb80 0x7f3384144cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.832+0000 7f338953f640 1 -- 172.21.15.12:0/860569604 >> 172.21.15.12:0/860569604 conn(0x7f3384073020 msgr2=0x7f338414fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:19.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.832+0000 7f338953f640 1 -- 172.21.15.12:0/860569604 shutdown_connections 2023-10-16T23:28:19.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.832+0000 7f338953f640 1 -- 172.21.15.12:0/860569604 wait complete. 2023-10-16T23:28:19.854 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T23:28:19.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.972+0000 7f05efacf640 1 Processor -- start 2023-10-16T23:28:19.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.972+0000 7f05efacf640 1 -- start start 2023-10-16T23:28:19.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.972+0000 7f05efacf640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f05e814ef80 0x7f05e80705d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:19.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.972+0000 7f05efacf640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05e806f130 con 0x7f05e806e6d0 2023-10-16T23:28:19.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.972+0000 7f05efacf640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05e814f390 con 0x7f05e814eba0 2023-10-16T23:28:19.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.972+0000 7f05efacf640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e8070da0 con 0x7f05e814ef80 2023-10-16T23:28:19.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.972+0000 7f05ed06a640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f05e806e6d0 0x7f05e80c1c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48052/0 (socket says 172.21.15.12:48052) 2023-10-16T23:28:19.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.972+0000 7f05ed06a640 1 -- 172.21.15.12:0/3426349091 learned_addr learned my addr 172.21.15.12:0/3426349091 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:19.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.972+0000 7f05ec869640 1 -- 172.21.15.12:0/3426349091 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524900793 0 0) 0x7f05e806f130 con 0x7f05e806e6d0 2023-10-16T23:28:19.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.972+0000 7f05ec869640 1 -- 172.21.15.12:0/3426349091 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05d4003530 con 0x7f05e806e6d0 2023-10-16T23:28:19.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.972+0000 7f05ee06c640 1 --2- 172.21.15.12:0/3426349091 >> v2:172.21.15.31:3300/0 conn(0x7f05e814ef80 0x7f05e80705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:19.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.972+0000 7f05ec869640 1 -- 172.21.15.12:0/3426349091 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3935453008 0 0) 0x7f05d4003530 con 0x7f05e806e6d0 2023-10-16T23:28:19.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.972+0000 7f05ec869640 1 -- 172.21.15.12:0/3426349091 >> v2:172.21.15.31:3300/0 conn(0x7f05e814ef80 msgr2=0x7f05e80705d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:19.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.972+0000 7f05ec869640 1 --2- 172.21.15.12:0/3426349091 >> v2:172.21.15.31:3300/0 conn(0x7f05e814ef80 0x7f05e80705d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.972+0000 7f05ec869640 1 -- 172.21.15.12:0/3426349091 >> v1:172.21.15.31:6789/0 conn(0x7f05e814eba0 legacy=0x7f05e8152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:19.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.972+0000 7f05ec869640 1 -- 172.21.15.12:0/3426349091 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e80c1020 con 0x7f05e806e6d0 2023-10-16T23:28:19.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.972+0000 7f05ec869640 1 -- 172.21.15.12:0/3426349091 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7f05d8001680 con 0x7f05e806e6d0 2023-10-16T23:28:19.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05ec869640 1 -- 172.21.15.12:0/3426349091 >> v1:172.21.15.12:6789/0 conn(0x7f05e806e6d0 legacy=0x7f05e80c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:19.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05ec869640 1 --2- 172.21.15.12:0/3426349091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05d4003980 0x7f05d4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:19.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05ec869640 1 --2- 172.21.15.12:0/3426349091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05d40047d0 0x7f05d4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:19.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05ec869640 1 --2- 172.21.15.12:0/3426349091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d4005390 0x7f05d400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:19.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05ec869640 1 -- 172.21.15.12:0/3426349091 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d400c1f0 con 0x7f05d4005390 2023-10-16T23:28:19.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05ec869640 1 -- 172.21.15.12:0/3426349091 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d400c360 con 0x7f05d4003980 2023-10-16T23:28:19.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05ec869640 1 -- 172.21.15.12:0/3426349091 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d400c520 con 0x7f05d40047d0 2023-10-16T23:28:19.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05ee06c640 1 --2- 172.21.15.12:0/3426349091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d4005390 0x7f05d400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:19.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05ed86b640 1 --2- 172.21.15.12:0/3426349091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05d4003980 0x7f05d4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:19.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05ed06a640 1 --2- 172.21.15.12:0/3426349091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05d40047d0 0x7f05d4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:19.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05ee06c640 1 -- 172.21.15.12:0/3426349091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05d40047d0 msgr2=0x7f05d4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:19.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05ee06c640 1 --2- 172.21.15.12:0/3426349091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05d40047d0 0x7f05d4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05ee06c640 1 -- 172.21.15.12:0/3426349091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05d4003980 msgr2=0x7f05d4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:19.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05ee06c640 1 --2- 172.21.15.12:0/3426349091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05d4003980 0x7f05d4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:19.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05ee06c640 1 -- 172.21.15.12:0/3426349091 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d4003530 con 0x7f05d4005390 2023-10-16T23:28:19.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05ed06a640 1 --2- 172.21.15.12:0/3426349091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05d40047d0 0x7f05d4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:19.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05ee06c640 1 -- 172.21.15.12:0/3426349091 reap_dead start 2023-10-16T23:28:19.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05ee06c640 1 --2- 172.21.15.12:0/3426349091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d4005390 0x7f05d400b990 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f05e400ba30 tx=0x7f05e401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b2fff69ebae1ba server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:19.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05ec869640 1 -- 172.21.15.12:0/3426349091 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e40a4ea0 con 0x7f05d4005390 2023-10-16T23:28:19.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05ec869640 1 -- 172.21.15.12:0/3426349091 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e40a7030 con 0x7f05d4005390 2023-10-16T23:28:19.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05ec869640 1 -- 172.21.15.12:0/3426349091 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e4004260 con 0x7f05d4005390 2023-10-16T23:28:19.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05efacf640 1 -- 172.21.15.12:0/3426349091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d4005390 msgr2=0x7f05d400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:19.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05efacf640 1 --2- 172.21.15.12:0/3426349091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d4005390 0x7f05d400b990 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f05e400ba30 tx=0x7f05e401c400 comp rx=0 tx=0).stop 2023-10-16T23:28:19.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05efacf640 1 -- 172.21.15.12:0/3426349091 shutdown_connections 2023-10-16T23:28:19.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05efacf640 1 --2- 172.21.15.12:0/3426349091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d4005390 0x7f05d400b990 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05efacf640 1 -- 172.21.15.12:0/3426349091 >> 172.21.15.12:0/3426349091 conn(0x7f05e806b800 msgr2=0x7f05e806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:20.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05efacf640 1 -- 172.21.15.12:0/3426349091 shutdown_connections 2023-10-16T23:28:20.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.976+0000 7f05efacf640 1 -- 172.21.15.12:0/3426349091 wait complete. 2023-10-16T23:28:20.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05efacf640 1 Processor -- start 2023-10-16T23:28:20.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05efacf640 1 -- start start 2023-10-16T23:28:20.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05efacf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05d4005390 0x7f05e80c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:20.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05efacf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05e814cd60 0x7f05e814afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:20.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05efacf640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05e81e7620 0x7f05e81e7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:20.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05efacf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e814d3b0 con 0x7f05e814cd60 2023-10-16T23:28:20.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05efacf640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e81e6e80 con 0x7f05d4005390 2023-10-16T23:28:20.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05efacf640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e814b510 con 0x7f05e81e7620 2023-10-16T23:28:20.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05ed06a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05e814cd60 0x7f05e814afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:20.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05ed06a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05e814cd60 0x7f05e814afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33092/0 (socket says 172.21.15.12:33092) 2023-10-16T23:28:20.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05ed06a640 1 -- 172.21.15.12:0/1745628579 learned_addr learned my addr 172.21.15.12:0/1745628579 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:20.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05ee06c640 1 --2- 172.21.15.12:0/1745628579 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05e81e7620 0x7f05e81e7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:20.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05ed86b640 1 --2- 172.21.15.12:0/1745628579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05d4005390 0x7f05e80c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:20.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05ed06a640 1 -- 172.21.15.12:0/1745628579 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05e81e7620 msgr2=0x7f05e81e7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:20.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05ed06a640 1 --2- 172.21.15.12:0/1745628579 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05e81e7620 0x7f05e81e7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05ed06a640 1 -- 172.21.15.12:0/1745628579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05d4005390 msgr2=0x7f05e80c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:20.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05ed06a640 1 --2- 172.21.15.12:0/1745628579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05d4005390 0x7f05e80c3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05ed06a640 1 -- 172.21.15.12:0/1745628579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e81e7ff0 con 0x7f05e814cd60 2023-10-16T23:28:20.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05ed86b640 1 --2- 172.21.15.12:0/1745628579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05d4005390 0x7f05e80c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:20.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05ed06a640 1 --2- 172.21.15.12:0/1745628579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05e814cd60 0x7f05e814afd0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f05d800d7e0 tx=0x7f05d800dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:20.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05de7fc640 1 -- 172.21.15.12:0/1745628579 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d80074e0 con 0x7f05e814cd60 2023-10-16T23:28:20.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05de7fc640 1 -- 172.21.15.12:0/1745628579 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d8007640 con 0x7f05e814cd60 2023-10-16T23:28:20.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05efacf640 1 -- 172.21.15.12:0/1745628579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e81eb150 con 0x7f05e814cd60 2023-10-16T23:28:20.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05de7fc640 1 -- 172.21.15.12:0/1745628579 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d8004a30 con 0x7f05e814cd60 2023-10-16T23:28:20.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05efacf640 1 -- 172.21.15.12:0/1745628579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e81eae00 con 0x7f05e814cd60 2023-10-16T23:28:20.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05efacf640 1 -- 172.21.15.12:0/1745628579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e80673a0 con 0x7f05e814cd60 2023-10-16T23:28:20.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.980+0000 7f05de7fc640 1 -- 172.21.15.12:0/1745628579 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f05d8004b90 con 0x7f05e814cd60 2023-10-16T23:28:20.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.984+0000 7f05de7fc640 1 --2- 172.21.15.12:0/1745628579 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f05cc065e90 0x7f05cc068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:20.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.984+0000 7f05de7fc640 1 -- 172.21.15.12:0/1745628579 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f05d80833f0 con 0x7f05e814cd60 2023-10-16T23:28:20.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.984+0000 7f05ed86b640 1 --2- 172.21.15.12:0/1745628579 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f05cc065e90 0x7f05cc068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:20.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.984+0000 7f05ed86b640 1 --2- 172.21.15.12:0/1745628579 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f05cc065e90 0x7f05cc068350 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f05e0000f90 tx=0x7f05e0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:20.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:19.988+0000 7f05de7fc640 1 -- 172.21.15.12:0/1745628579 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f05d8050ab0 con 0x7f05e814cd60 2023-10-16T23:28:20.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.132+0000 7f05efacf640 1 -- 172.21.15.12:0/1745628579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f05e8152330 con 0x7f05e814cd60 2023-10-16T23:28:20.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.132+0000 7f05de7fc640 1 -- 172.21.15.12:0/1745628579 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f05d80540d0 con 0x7f05e814cd60 2023-10-16T23:28:20.138 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-16T23:28:20.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.136+0000 7f05efacf640 1 -- 172.21.15.12:0/1745628579 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f05cc065e90 msgr2=0x7f05cc068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:20.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.136+0000 7f05efacf640 1 --2- 172.21.15.12:0/1745628579 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f05cc065e90 0x7f05cc068350 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f05e0000f90 tx=0x7f05e0009040 comp rx=0 tx=0).stop 2023-10-16T23:28:20.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.136+0000 7f05efacf640 1 -- 172.21.15.12:0/1745628579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05e814cd60 msgr2=0x7f05e814afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:20.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.136+0000 7f05efacf640 1 --2- 172.21.15.12:0/1745628579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05e814cd60 0x7f05e814afd0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f05d800d7e0 tx=0x7f05d800dca0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.136+0000 7f05efacf640 1 -- 172.21.15.12:0/1745628579 shutdown_connections 2023-10-16T23:28:20.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.136+0000 7f05efacf640 1 --2- 172.21.15.12:0/1745628579 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f05cc065e90 0x7f05cc068350 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.136+0000 7f05efacf640 1 --2- 172.21.15.12:0/1745628579 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05e81e7620 0x7f05e81e7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.136+0000 7f05efacf640 1 --2- 172.21.15.12:0/1745628579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05e814cd60 0x7f05e814afd0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.136+0000 7f05efacf640 1 --2- 172.21.15.12:0/1745628579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05d4005390 0x7f05e80c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.136+0000 7f05efacf640 1 -- 172.21.15.12:0/1745628579 >> 172.21.15.12:0/1745628579 conn(0x7f05e806b800 msgr2=0x7f05e806bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:20.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.136+0000 7f05efacf640 1 -- 172.21.15.12:0/1745628579 shutdown_connections 2023-10-16T23:28:20.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.136+0000 7f05efacf640 1 -- 172.21.15.12:0/1745628579 wait complete. 2023-10-16T23:28:20.154 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T23:28:20.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe76f531640 1 Processor -- start 2023-10-16T23:28:20.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe76f531640 1 -- start start 2023-10-16T23:28:20.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe76f531640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe7680bbe00 0x7fe768147320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:20.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe76f531640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7680bc8e0 con 0x7fe7680c12a0 2023-10-16T23:28:20.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe76f531640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7680b3f40 con 0x7fe768150880 2023-10-16T23:28:20.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe76f531640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7680b4220 con 0x7fe7680bbe00 2023-10-16T23:28:20.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe76d2cd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe7680c12a0 0x7fe768146c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48062/0 (socket says 172.21.15.12:48062) 2023-10-16T23:28:20.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe76d2cd640 1 -- 172.21.15.12:0/183861172 learned_addr learned my addr 172.21.15.12:0/183861172 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:20.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe76cacc640 1 --2- 172.21.15.12:0/183861172 >> v2:172.21.15.31:3300/0 conn(0x7fe7680bbe00 0x7fe768147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:20.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe75bfff640 1 -- 172.21.15.12:0/183861172 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128449201 0 0) 0x7fe7680bc8e0 con 0x7fe7680c12a0 2023-10-16T23:28:20.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe75bfff640 1 -- 172.21.15.12:0/183861172 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe754003530 con 0x7fe7680c12a0 2023-10-16T23:28:20.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe75bfff640 1 -- 172.21.15.12:0/183861172 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 380826758 0 0) 0x7fe754003530 con 0x7fe7680c12a0 2023-10-16T23:28:20.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe75bfff640 1 -- 172.21.15.12:0/183861172 >> v2:172.21.15.31:3300/0 conn(0x7fe7680bbe00 msgr2=0x7fe768147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:20.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe75bfff640 1 --2- 172.21.15.12:0/183861172 >> v2:172.21.15.31:3300/0 conn(0x7fe7680bbe00 0x7fe768147320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe75bfff640 1 -- 172.21.15.12:0/183861172 >> v1:172.21.15.31:6789/0 conn(0x7fe768150880 legacy=0x7fe768150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:20.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe75bfff640 1 -- 172.21.15.12:0/183861172 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7680b3b80 con 0x7fe7680c12a0 2023-10-16T23:28:20.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe75bfff640 1 -- 172.21.15.12:0/183861172 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7fe75c001680 con 0x7fe7680c12a0 2023-10-16T23:28:20.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe75bfff640 1 -- 172.21.15.12:0/183861172 >> v1:172.21.15.12:6789/0 conn(0x7fe7680c12a0 legacy=0x7fe768146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:20.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe75bfff640 1 --2- 172.21.15.12:0/183861172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe754003980 0x7fe754003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:20.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe75bfff640 1 --2- 172.21.15.12:0/183861172 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7540047d0 0x7fe754004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:20.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe75bfff640 1 --2- 172.21.15.12:0/183861172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe754005190 0x7fe75400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:20.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe75bfff640 1 -- 172.21.15.12:0/183861172 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7680b4220 con 0x7fe754003980 2023-10-16T23:28:20.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe75bfff640 1 -- 172.21.15.12:0/183861172 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75400c030 con 0x7fe754005190 2023-10-16T23:28:20.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe75bfff640 1 -- 172.21.15.12:0/183861172 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75400c1f0 con 0x7fe7540047d0 2023-10-16T23:28:20.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe76d2cd640 1 --2- 172.21.15.12:0/183861172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe754003980 0x7fe754003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:20.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe76cacc640 1 --2- 172.21.15.12:0/183861172 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7540047d0 0x7fe754004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:20.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe76dace640 1 --2- 172.21.15.12:0/183861172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe754005190 0x7fe75400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:20.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe76d2cd640 1 -- 172.21.15.12:0/183861172 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7540047d0 msgr2=0x7fe754004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:20.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe76d2cd640 1 --2- 172.21.15.12:0/183861172 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7540047d0 0x7fe754004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe76d2cd640 1 -- 172.21.15.12:0/183861172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe754005190 msgr2=0x7fe75400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:20.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe76d2cd640 1 --2- 172.21.15.12:0/183861172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe754005190 0x7fe75400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe76d2cd640 1 -- 172.21.15.12:0/183861172 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe754003530 con 0x7fe754003980 2023-10-16T23:28:20.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe76cacc640 1 --2- 172.21.15.12:0/183861172 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe7540047d0 0x7fe754004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:20.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe76dace640 1 --2- 172.21.15.12:0/183861172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe754005190 0x7fe75400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:20.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.280+0000 7fe76dace640 1 -- 172.21.15.12:0/183861172 reap_dead start 2023-10-16T23:28:20.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe76d2cd640 1 --2- 172.21.15.12:0/183861172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe754003980 0x7fe754003da0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00c240 tx=0x7fe75c01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8837c191ec3c54 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:20.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe75bfff640 1 -- 172.21.15.12:0/183861172 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c005ae0 con 0x7fe754003980 2023-10-16T23:28:20.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe75bfff640 1 -- 172.21.15.12:0/183861172 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c005c60 con 0x7fe754003980 2023-10-16T23:28:20.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe75bfff640 1 -- 172.21.15.12:0/183861172 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c0a5830 con 0x7fe754003980 2023-10-16T23:28:20.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe76f531640 1 -- 172.21.15.12:0/183861172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe754003980 msgr2=0x7fe754003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:20.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe76f531640 1 --2- 172.21.15.12:0/183861172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe754003980 0x7fe754003da0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00c240 tx=0x7fe75c01cc40 comp rx=0 tx=0).stop 2023-10-16T23:28:20.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe76f531640 1 -- 172.21.15.12:0/183861172 shutdown_connections 2023-10-16T23:28:20.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe76f531640 1 --2- 172.21.15.12:0/183861172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe754003980 0x7fe754003da0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe76f531640 1 -- 172.21.15.12:0/183861172 >> 172.21.15.12:0/183861172 conn(0x7fe76806bb10 msgr2=0x7fe7680c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:20.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe76f531640 1 -- 172.21.15.12:0/183861172 shutdown_connections 2023-10-16T23:28:20.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe76f531640 1 -- 172.21.15.12:0/183861172 wait complete. 2023-10-16T23:28:20.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe76f531640 1 Processor -- start 2023-10-16T23:28:20.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe76f531640 1 -- start start 2023-10-16T23:28:20.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe76f531640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe754003980 0x7fe7681501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:20.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe76f531640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe768143ee0 0x7fe7681da7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:20.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe76f531640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe76806f680 0x7fe76806fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:20.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe76f531640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe768070040 con 0x7fe768143ee0 2023-10-16T23:28:20.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe76f531640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7681445a0 con 0x7fe76806f680 2023-10-16T23:28:20.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe76f531640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe768150700 con 0x7fe754003980 2023-10-16T23:28:20.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe76cacc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe768143ee0 0x7fe7681da7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:20.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe76cacc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe768143ee0 0x7fe7681da7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33108/0 (socket says 172.21.15.12:33108) 2023-10-16T23:28:20.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe76cacc640 1 -- 172.21.15.12:0/1233910807 learned_addr learned my addr 172.21.15.12:0/1233910807 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:20.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe76d2cd640 1 --2- 172.21.15.12:0/1233910807 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe754003980 0x7fe7681501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:20.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe76dace640 1 --2- 172.21.15.12:0/1233910807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe76806f680 0x7fe76806fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:20.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe76cacc640 1 -- 172.21.15.12:0/1233910807 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe754003980 msgr2=0x7fe7681501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:20.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe76cacc640 1 --2- 172.21.15.12:0/1233910807 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe754003980 0x7fe7681501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe76cacc640 1 -- 172.21.15.12:0/1233910807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe76806f680 msgr2=0x7fe76806fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:20.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe76cacc640 1 --2- 172.21.15.12:0/1233910807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe76806f680 0x7fe76806fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.284+0000 7fe76cacc640 1 -- 172.21.15.12:0/1233910807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe768143d00 con 0x7fe768143ee0 2023-10-16T23:28:20.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.288+0000 7fe76cacc640 1 --2- 172.21.15.12:0/1233910807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe768143ee0 0x7fe7681da7d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe76400f3b0 tx=0x7fe76400f870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:20.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.288+0000 7fe759ffb640 1 -- 172.21.15.12:0/1233910807 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76401a070 con 0x7fe768143ee0 2023-10-16T23:28:20.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.288+0000 7fe759ffb640 1 -- 172.21.15.12:0/1233910807 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7640039a0 con 0x7fe768143ee0 2023-10-16T23:28:20.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.288+0000 7fe759ffb640 1 -- 172.21.15.12:0/1233910807 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe764003d30 con 0x7fe768143ee0 2023-10-16T23:28:20.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.288+0000 7fe76f531640 1 -- 172.21.15.12:0/1233910807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7681dad10 con 0x7fe768143ee0 2023-10-16T23:28:20.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.288+0000 7fe76f531640 1 -- 172.21.15.12:0/1233910807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76814f5a0 con 0x7fe768143ee0 2023-10-16T23:28:20.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.288+0000 7fe76f531640 1 -- 172.21.15.12:0/1233910807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7680673a0 con 0x7fe768143ee0 2023-10-16T23:28:20.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.288+0000 7fe759ffb640 1 -- 172.21.15.12:0/1233910807 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fe764004020 con 0x7fe768143ee0 2023-10-16T23:28:20.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.288+0000 7fe759ffb640 1 --2- 172.21.15.12:0/1233910807 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe74c065e90 0x7fe74c068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:20.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.288+0000 7fe759ffb640 1 -- 172.21.15.12:0/1233910807 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe764084220 con 0x7fe768143ee0 2023-10-16T23:28:20.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.288+0000 7fe76d2cd640 1 --2- 172.21.15.12:0/1233910807 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe74c065e90 0x7fe74c068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:20.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.288+0000 7fe76d2cd640 1 --2- 172.21.15.12:0/1233910807 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe74c065e90 0x7fe74c068350 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe75c0ab000 tx=0x7fe75c0b1040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:20.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.292+0000 7fe759ffb640 1 -- 172.21.15.12:0/1233910807 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fe764051860 con 0x7fe768143ee0 2023-10-16T23:28:20.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.444+0000 7fe76f531640 1 -- 172.21.15.12:0/1233910807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe768144bb0 con 0x7fe768143ee0 2023-10-16T23:28:20.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.448+0000 7fe759ffb640 1 -- 172.21.15.12:0/1233910807 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe764054e80 con 0x7fe768143ee0 2023-10-16T23:28:20.450 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-16T23:28:20.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.448+0000 7fe76f531640 1 -- 172.21.15.12:0/1233910807 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe74c065e90 msgr2=0x7fe74c068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:20.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.448+0000 7fe76f531640 1 --2- 172.21.15.12:0/1233910807 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe74c065e90 0x7fe74c068350 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe75c0ab000 tx=0x7fe75c0b1040 comp rx=0 tx=0).stop 2023-10-16T23:28:20.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.448+0000 7fe76f531640 1 -- 172.21.15.12:0/1233910807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe768143ee0 msgr2=0x7fe7681da7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:20.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.448+0000 7fe76f531640 1 --2- 172.21.15.12:0/1233910807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe768143ee0 0x7fe7681da7d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe76400f3b0 tx=0x7fe76400f870 comp rx=0 tx=0).stop 2023-10-16T23:28:20.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.448+0000 7fe76f531640 1 -- 172.21.15.12:0/1233910807 shutdown_connections 2023-10-16T23:28:20.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.448+0000 7fe76f531640 1 --2- 172.21.15.12:0/1233910807 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe74c065e90 0x7fe74c068350 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.448+0000 7fe76f531640 1 --2- 172.21.15.12:0/1233910807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe76806f680 0x7fe76806fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.448+0000 7fe76f531640 1 --2- 172.21.15.12:0/1233910807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe768143ee0 0x7fe7681da7d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.448+0000 7fe76f531640 1 --2- 172.21.15.12:0/1233910807 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe754003980 0x7fe7681501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.448+0000 7fe76f531640 1 -- 172.21.15.12:0/1233910807 >> 172.21.15.12:0/1233910807 conn(0x7fe76806bb10 msgr2=0x7fe7680bdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:20.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.448+0000 7fe76f531640 1 -- 172.21.15.12:0/1233910807 shutdown_connections 2023-10-16T23:28:20.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.448+0000 7fe76f531640 1 -- 172.21.15.12:0/1233910807 wait complete. 2023-10-16T23:28:20.468 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T23:28:20.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.576+0000 7efd0db61640 1 Processor -- start 2023-10-16T23:28:20.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.576+0000 7efd0db61640 1 -- start start 2023-10-16T23:28:20.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.576+0000 7efd0db61640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd080b8630 0x7efd0814cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:20.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.576+0000 7efd0db61640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efd080b9f40 0x7efd080ba390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:20.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.576+0000 7efd0db61640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd080b40c0 con 0x7efd080c1130 2023-10-16T23:28:20.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.576+0000 7efd0db61640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd080b3ca0 con 0x7efd080b9f40 2023-10-16T23:28:20.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.576+0000 7efd0db61640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd080b8a90 con 0x7efd080b8630 2023-10-16T23:28:20.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.576+0000 7efd06ffd640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd080b8630 0x7efd0814cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:20.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.576+0000 7efd07fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efd080b9f40 0x7efd080ba390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:20.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.576+0000 7efd07fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efd080b9f40 0x7efd080ba390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:44310/0 (socket says 172.21.15.12:44310) 2023-10-16T23:28:20.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.576+0000 7efd077fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7efd080c1130 0x7efd0814c520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:36338/0 (socket says 172.21.15.12:36338) 2023-10-16T23:28:20.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.576+0000 7efd07fff640 1 -- 172.21.15.12:0/4045441222 learned_addr learned my addr 172.21.15.12:0/4045441222 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:20.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.576+0000 7efd06ffd640 1 -- 172.21.15.12:0/4045441222 >> v2:172.21.15.31:3300/0 conn(0x7efd080b9f40 msgr2=0x7efd080ba390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:20.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.576+0000 7efd06ffd640 1 --2- 172.21.15.12:0/4045441222 >> v2:172.21.15.31:3300/0 conn(0x7efd080b9f40 0x7efd080ba390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.576+0000 7efd06ffd640 1 -- 172.21.15.12:0/4045441222 >> v1:172.21.15.31:6789/0 conn(0x7efd080c1130 legacy=0x7efd0814c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:20.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.576+0000 7efd06ffd640 1 -- 172.21.15.12:0/4045441222 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd080b7ce0 con 0x7efd080b8630 2023-10-16T23:28:20.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.580+0000 7efd06ffd640 1 --2- 172.21.15.12:0/4045441222 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd080b8630 0x7efd0814cc30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efcfc0097c0 tx=0x7efcfc01c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17ad34ebfa266a28 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:20.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.580+0000 7efd067fc640 1 -- 172.21.15.12:0/4045441222 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc0ab600 con 0x7efd080b8630 2023-10-16T23:28:20.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.580+0000 7efd067fc640 1 -- 172.21.15.12:0/4045441222 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcfc0a7050 con 0x7efd080b8630 2023-10-16T23:28:20.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.580+0000 7efd067fc640 1 -- 172.21.15.12:0/4045441222 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc0ab980 con 0x7efd080b8630 2023-10-16T23:28:20.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.580+0000 7efd0db61640 1 -- 172.21.15.12:0/4045441222 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd080b8630 msgr2=0x7efd0814cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:20.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.580+0000 7efd0db61640 1 --2- 172.21.15.12:0/4045441222 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd080b8630 0x7efd0814cc30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efcfc0097c0 tx=0x7efcfc01c360 comp rx=0 tx=0).stop 2023-10-16T23:28:20.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.580+0000 7efd0db61640 1 -- 172.21.15.12:0/4045441222 shutdown_connections 2023-10-16T23:28:20.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.580+0000 7efd0db61640 1 --2- 172.21.15.12:0/4045441222 >> v2:172.21.15.31:3300/0 conn(0x7efd080b9f40 0x7efd080ba390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.580+0000 7efd0db61640 1 --2- 172.21.15.12:0/4045441222 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd080b8630 0x7efd0814cc30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.580+0000 7efd0db61640 1 -- 172.21.15.12:0/4045441222 >> 172.21.15.12:0/4045441222 conn(0x7efd0806ba20 msgr2=0x7efd080c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:20.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.580+0000 7efd0db61640 1 -- 172.21.15.12:0/4045441222 shutdown_connections 2023-10-16T23:28:20.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.580+0000 7efd0db61640 1 -- 172.21.15.12:0/4045441222 wait complete. 2023-10-16T23:28:20.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.580+0000 7efd0db61640 1 Processor -- start 2023-10-16T23:28:20.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.580+0000 7efd0db61640 1 -- start start 2023-10-16T23:28:20.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efd0db61640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd080b8630 0x7efd080b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:20.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efd0db61640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd080b9f40 0x7efd080bb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:20.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efd0db61640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd080c1130 0x7efd08146800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:20.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efd0db61640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd081eb600 con 0x7efd080c1130 2023-10-16T23:28:20.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efd0db61640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd080b25f0 con 0x7efd080b9f40 2023-10-16T23:28:20.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efd0db61640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd080bb5a0 con 0x7efd080b8630 2023-10-16T23:28:20.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efd07fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd080c1130 0x7efd08146800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:20.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efd07fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd080c1130 0x7efd08146800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33116/0 (socket says 172.21.15.12:33116) 2023-10-16T23:28:20.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efd07fff640 1 -- 172.21.15.12:0/2035723562 learned_addr learned my addr 172.21.15.12:0/2035723562 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:20.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efd077fe640 1 --2- 172.21.15.12:0/2035723562 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd080b8630 0x7efd080b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:20.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efd06ffd640 1 --2- 172.21.15.12:0/2035723562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd080b9f40 0x7efd080bb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:20.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efd07fff640 1 -- 172.21.15.12:0/2035723562 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd080b8630 msgr2=0x7efd080b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:20.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efd07fff640 1 --2- 172.21.15.12:0/2035723562 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd080b8630 0x7efd080b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efd07fff640 1 -- 172.21.15.12:0/2035723562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd080b9f40 msgr2=0x7efd080bb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:20.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efd07fff640 1 --2- 172.21.15.12:0/2035723562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd080b9f40 0x7efd080bb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efd07fff640 1 -- 172.21.15.12:0/2035723562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcfc009420 con 0x7efd080c1130 2023-10-16T23:28:20.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efd07fff640 1 --2- 172.21.15.12:0/2035723562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd080c1130 0x7efd08146800 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efd0000efc0 tx=0x7efd0000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:20.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efceffff640 1 -- 172.21.15.12:0/2035723562 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0000cd20 con 0x7efd080c1130 2023-10-16T23:28:20.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efceffff640 1 -- 172.21.15.12:0/2035723562 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0000f040 con 0x7efd080c1130 2023-10-16T23:28:20.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efd0db61640 1 -- 172.21.15.12:0/2035723562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd080b8480 con 0x7efd080c1130 2023-10-16T23:28:20.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efceffff640 1 -- 172.21.15.12:0/2035723562 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd00003be0 con 0x7efd080c1130 2023-10-16T23:28:20.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efd0db61640 1 -- 172.21.15.12:0/2035723562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd081ef6b0 con 0x7efd080c1130 2023-10-16T23:28:20.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efd0db61640 1 -- 172.21.15.12:0/2035723562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd081ef8a0 con 0x7efd080c1130 2023-10-16T23:28:20.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efceffff640 1 -- 172.21.15.12:0/2035723562 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7efd00003d40 con 0x7efd080c1130 2023-10-16T23:28:20.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efceffff640 1 --2- 172.21.15.12:0/2035723562 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efcf4065e60 0x7efcf4068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:20.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efceffff640 1 -- 172.21.15.12:0/2035723562 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efd00083d50 con 0x7efd080c1130 2023-10-16T23:28:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.584+0000 7efd077fe640 1 --2- 172.21.15.12:0/2035723562 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efcf4065e60 0x7efcf4068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.588+0000 7efd077fe640 1 --2- 172.21.15.12:0/2035723562 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efcf4065e60 0x7efcf4068320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efcf8000f70 tx=0x7efcf8007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:20.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.588+0000 7efceffff640 1 -- 172.21.15.12:0/2035723562 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7efd00087030 con 0x7efd080c1130 2023-10-16T23:28:20.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.752+0000 7efd0db61640 1 -- 172.21.15.12:0/2035723562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7efd080673a0 con 0x7efd080c1130 2023-10-16T23:28:20.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.756+0000 7efceffff640 1 -- 172.21.15.12:0/2035723562 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7efd00051430 con 0x7efd080c1130 2023-10-16T23:28:20.759 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2023-10-16T23:28:20.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.756+0000 7efd0db61640 1 -- 172.21.15.12:0/2035723562 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efcf4065e60 msgr2=0x7efcf4068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:20.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.756+0000 7efd0db61640 1 --2- 172.21.15.12:0/2035723562 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efcf4065e60 0x7efcf4068320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efcf8000f70 tx=0x7efcf8007e90 comp rx=0 tx=0).stop 2023-10-16T23:28:20.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.756+0000 7efd0db61640 1 -- 172.21.15.12:0/2035723562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd080c1130 msgr2=0x7efd08146800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:20.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.756+0000 7efd0db61640 1 --2- 172.21.15.12:0/2035723562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd080c1130 0x7efd08146800 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efd0000efc0 tx=0x7efd0000c490 comp rx=0 tx=0).stop 2023-10-16T23:28:20.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.756+0000 7efd0db61640 1 -- 172.21.15.12:0/2035723562 shutdown_connections 2023-10-16T23:28:20.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.756+0000 7efd0db61640 1 --2- 172.21.15.12:0/2035723562 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efcf4065e60 0x7efcf4068320 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.756+0000 7efd0db61640 1 --2- 172.21.15.12:0/2035723562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd080c1130 0x7efd08146800 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.756+0000 7efd0db61640 1 --2- 172.21.15.12:0/2035723562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd080b9f40 0x7efd080bb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.756+0000 7efd0db61640 1 --2- 172.21.15.12:0/2035723562 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efd080b8630 0x7efd080b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.756+0000 7efd0db61640 1 -- 172.21.15.12:0/2035723562 >> 172.21.15.12:0/2035723562 conn(0x7efd0806ba20 msgr2=0x7efd080bda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:20.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.756+0000 7efd0db61640 1 -- 172.21.15.12:0/2035723562 shutdown_connections 2023-10-16T23:28:20.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.756+0000 7efd0db61640 1 -- 172.21.15.12:0/2035723562 wait complete. 2023-10-16T23:28:20.776 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-16T23:28:20.776 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T23:28:20.784 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T23:28:20.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b6666a640 1 Processor -- start 2023-10-16T23:28:20.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b6666a640 1 -- start start 2023-10-16T23:28:20.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b6666a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1b600b8630 0x7f1b6014cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:20.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b6666a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b600b40c0 con 0x7f1b600c1130 2023-10-16T23:28:20.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b6666a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b600b7ce0 con 0x7f1b600b9f40 2023-10-16T23:28:20.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b6666a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b600b3ca0 con 0x7f1b600b8630 2023-10-16T23:28:20.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b5ffff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1b600c1130 0x7f1b6014c520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48074/0 (socket says 172.21.15.12:48074) 2023-10-16T23:28:20.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b5ffff640 1 -- 172.21.15.12:0/1984895167 learned_addr learned my addr 172.21.15.12:0/1984895167 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:20.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b577fe640 1 --2- 172.21.15.12:0/1984895167 >> v2:172.21.15.31:3300/0 conn(0x7f1b600b8630 0x7f1b6014cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:20.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b5f7fe640 1 -- 172.21.15.12:0/1984895167 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935610766 0 0) 0x7f1b600b40c0 con 0x7f1b600c1130 2023-10-16T23:28:20.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b5f7fe640 1 -- 172.21.15.12:0/1984895167 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b4c003530 con 0x7f1b600c1130 2023-10-16T23:28:20.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b5f7fe640 1 -- 172.21.15.12:0/1984895167 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3281963869 0 0) 0x7f1b4c003530 con 0x7f1b600c1130 2023-10-16T23:28:20.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b5f7fe640 1 -- 172.21.15.12:0/1984895167 >> v2:172.21.15.31:3300/0 conn(0x7f1b600b8630 msgr2=0x7f1b6014cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:20.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b5f7fe640 1 --2- 172.21.15.12:0/1984895167 >> v2:172.21.15.31:3300/0 conn(0x7f1b600b8630 0x7f1b6014cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b5f7fe640 1 -- 172.21.15.12:0/1984895167 >> v1:172.21.15.31:6789/0 conn(0x7f1b600b9f40 legacy=0x7f1b600ba370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:20.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b5f7fe640 1 -- 172.21.15.12:0/1984895167 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b600c1510 con 0x7f1b600c1130 2023-10-16T23:28:20.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b5f7fe640 1 -- 172.21.15.12:0/1984895167 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7f1b50001680 con 0x7f1b600c1130 2023-10-16T23:28:20.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b5f7fe640 1 -- 172.21.15.12:0/1984895167 >> v1:172.21.15.12:6789/0 conn(0x7f1b600c1130 legacy=0x7f1b6014c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:20.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b5f7fe640 1 --2- 172.21.15.12:0/1984895167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b4c003980 0x7f1b4c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:20.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b5f7fe640 1 --2- 172.21.15.12:0/1984895167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b4c0047d0 0x7f1b4c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:20.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b5f7fe640 1 --2- 172.21.15.12:0/1984895167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b4c0052b0 0x7f1b4c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:20.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b5f7fe640 1 -- 172.21.15.12:0/1984895167 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b600b3ca0 con 0x7f1b4c0047d0 2023-10-16T23:28:20.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b5f7fe640 1 -- 172.21.15.12:0/1984895167 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c00c180 con 0x7f1b4c0052b0 2023-10-16T23:28:20.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b5f7fe640 1 -- 172.21.15.12:0/1984895167 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c00c340 con 0x7f1b4c003980 2023-10-16T23:28:20.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b577fe640 1 --2- 172.21.15.12:0/1984895167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b4c0047d0 0x7f1b4c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:20.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b5ffff640 1 --2- 172.21.15.12:0/1984895167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b4c003980 0x7f1b4c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:20.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b577fe640 1 -- 172.21.15.12:0/1984895167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b4c003980 msgr2=0x7f1b4c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:20.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b577fe640 1 --2- 172.21.15.12:0/1984895167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b4c003980 0x7f1b4c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b577fe640 1 -- 172.21.15.12:0/1984895167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b4c0052b0 msgr2=0x7f1b4c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:20.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b577fe640 1 --2- 172.21.15.12:0/1984895167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b4c0052b0 0x7f1b4c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b577fe640 1 -- 172.21.15.12:0/1984895167 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4c003530 con 0x7f1b4c0047d0 2023-10-16T23:28:20.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b5ffff640 1 --2- 172.21.15.12:0/1984895167 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b4c003980 0x7f1b4c003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:20.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.904+0000 7f1b64c07640 1 -- 172.21.15.12:0/1984895167 reap_dead start 2023-10-16T23:28:20.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.908+0000 7f1b577fe640 1 --2- 172.21.15.12:0/1984895167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b4c0047d0 0x7f1b4c004c50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009ab0 tx=0x7f1b4801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929e949987e56cc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:20.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.908+0000 7f1b5f7fe640 1 -- 172.21.15.12:0/1984895167 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b480a5530 con 0x7f1b4c0047d0 2023-10-16T23:28:20.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.908+0000 7f1b5f7fe640 1 -- 172.21.15.12:0/1984895167 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b480a5690 con 0x7f1b4c0047d0 2023-10-16T23:28:20.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.908+0000 7f1b5f7fe640 1 -- 172.21.15.12:0/1984895167 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b480a5a40 con 0x7f1b4c0047d0 2023-10-16T23:28:20.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.908+0000 7f1b6666a640 1 -- 172.21.15.12:0/1984895167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b4c0047d0 msgr2=0x7f1b4c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:20.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.908+0000 7f1b6666a640 1 --2- 172.21.15.12:0/1984895167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b4c0047d0 0x7f1b4c004c50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009ab0 tx=0x7f1b4801ca50 comp rx=0 tx=0).stop 2023-10-16T23:28:20.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.908+0000 7f1b6666a640 1 -- 172.21.15.12:0/1984895167 shutdown_connections 2023-10-16T23:28:20.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.908+0000 7f1b6666a640 1 --2- 172.21.15.12:0/1984895167 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b4c0047d0 0x7f1b4c004c50 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.908+0000 7f1b6666a640 1 -- 172.21.15.12:0/1984895167 >> 172.21.15.12:0/1984895167 conn(0x7f1b6006ba20 msgr2=0x7f1b600c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:20.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.908+0000 7f1b6666a640 1 -- 172.21.15.12:0/1984895167 shutdown_connections 2023-10-16T23:28:20.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.908+0000 7f1b6666a640 1 -- 172.21.15.12:0/1984895167 wait complete. 2023-10-16T23:28:20.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.908+0000 7f1b6666a640 1 Processor -- start 2023-10-16T23:28:20.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.908+0000 7f1b6666a640 1 -- start start 2023-10-16T23:28:20.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.908+0000 7f1b6666a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b4c0047d0 0x7f1b601e4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:20.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.908+0000 7f1b6666a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b60149940 0x7f1b600b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:20.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.908+0000 7f1b6666a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b600b58e0 0x7f1b600b3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:20.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.908+0000 7f1b6666a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b600b34a0 con 0x7f1b60149940 2023-10-16T23:28:20.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.908+0000 7f1b6666a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b60148ea0 con 0x7f1b600b58e0 2023-10-16T23:28:20.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.908+0000 7f1b6666a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b60145220 con 0x7f1b4c0047d0 2023-10-16T23:28:20.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.908+0000 7f1b577fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b60149940 0x7f1b600b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:20.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.908+0000 7f1b577fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b60149940 0x7f1b600b53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33126/0 (socket says 172.21.15.12:33126) 2023-10-16T23:28:20.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.908+0000 7f1b577fe640 1 -- 172.21.15.12:0/1349362899 learned_addr learned my addr 172.21.15.12:0/1349362899 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:20.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.908+0000 7f1b64c07640 1 --2- 172.21.15.12:0/1349362899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b600b58e0 0x7f1b600b3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:20.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.908+0000 7f1b5ffff640 1 --2- 172.21.15.12:0/1349362899 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b4c0047d0 0x7f1b601e4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:20.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.912+0000 7f1b577fe640 1 -- 172.21.15.12:0/1349362899 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b4c0047d0 msgr2=0x7f1b601e4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:20.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.912+0000 7f1b577fe640 1 --2- 172.21.15.12:0/1349362899 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b4c0047d0 0x7f1b601e4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.912+0000 7f1b577fe640 1 -- 172.21.15.12:0/1349362899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b600b58e0 msgr2=0x7f1b600b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:20.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.912+0000 7f1b577fe640 1 --2- 172.21.15.12:0/1349362899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b600b58e0 0x7f1b600b3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:20.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.912+0000 7f1b577fe640 1 -- 172.21.15.12:0/1349362899 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b600b4ba0 con 0x7f1b60149940 2023-10-16T23:28:20.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.912+0000 7f1b5ffff640 1 --2- 172.21.15.12:0/1349362899 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b4c0047d0 0x7f1b601e4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:20.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.912+0000 7f1b577fe640 1 --2- 172.21.15.12:0/1349362899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b60149940 0x7f1b600b53a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009ab0 tx=0x7f1b4c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:20.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.912+0000 7f1b5d7fa640 1 -- 172.21.15.12:0/1349362899 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b480be070 con 0x7f1b60149940 2023-10-16T23:28:20.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.912+0000 7f1b5d7fa640 1 -- 172.21.15.12:0/1349362899 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4800f000 con 0x7f1b60149940 2023-10-16T23:28:20.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.912+0000 7f1b6666a640 1 -- 172.21.15.12:0/1349362899 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b600b4e80 con 0x7f1b60149940 2023-10-16T23:28:20.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.912+0000 7f1b5d7fa640 1 -- 172.21.15.12:0/1349362899 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b480a5ea0 con 0x7f1b60149940 2023-10-16T23:28:20.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.912+0000 7f1b6666a640 1 -- 172.21.15.12:0/1349362899 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b601e56b0 con 0x7f1b60149940 2023-10-16T23:28:20.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.912+0000 7f1b6666a640 1 -- 172.21.15.12:0/1349362899 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b600673a0 con 0x7f1b60149940 2023-10-16T23:28:20.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.912+0000 7f1b5d7fa640 1 -- 172.21.15.12:0/1349362899 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f1b480b4040 con 0x7f1b60149940 2023-10-16T23:28:20.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.912+0000 7f1b5d7fa640 1 --2- 172.21.15.12:0/1349362899 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1b40065e60 0x7f1b40068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:20.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.912+0000 7f1b5d7fa640 1 -- 172.21.15.12:0/1349362899 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1b4811cfb0 con 0x7f1b60149940 2023-10-16T23:28:20.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.912+0000 7f1b5ffff640 1 --2- 172.21.15.12:0/1349362899 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1b40065e60 0x7f1b40068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:20.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.912+0000 7f1b5ffff640 1 --2- 172.21.15.12:0/1349362899 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1b40065e60 0x7f1b40068320 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1b50001210 tx=0x7f1b50009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:20.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:20.916+0000 7f1b5d7fa640 1 -- 172.21.15.12:0/1349362899 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f1b480ea690 con 0x7f1b60149940 2023-10-16T23:28:21.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.072+0000 7f1b6666a640 1 -- 172.21.15.12:0/1349362899 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b600bfaa0 con 0x7f1b60149940 2023-10-16T23:28:21.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.076+0000 7f1b5d7fa640 1 -- 172.21.15.12:0/1349362899 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17763 (secure 0 0 0) 0x7f1b480edcb0 con 0x7f1b60149940 2023-10-16T23:28:21.079 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:28:21.080 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"fsid":"0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51","created":"2023-10-16T23:27:16.468087+0000","modified":"2023-10-16T23:27:41.690088+0000","last_up_change":"2023-10-16T23:27:28.136202+0000","last_in_change":"2023-10-16T23:27:18.793212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T23:27:27.354025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-16T23:27:34.786446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-16T23:27:39.130341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-16T23:27:39.674572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73e70f98-6f5e-4464-b34e-931faac41cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":38075},{"type":"v1","addr":"172.21.15.12:6814","nonce":38075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":38075},{"type":"v1","addr":"172.21.15.12:6819","nonce":38075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":38075},{"type":"v1","addr":"172.21.15.12:6827","nonce":38075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":38075},{"type":"v1","addr":"172.21.15.12:6823","nonce":38075}]},"public_addr":"172.21.15.12:6814/38075","cluster_addr":"172.21.15.12:6819/38075","heartbeat_back_addr":"172.21.15.12:6827/38075","heartbeat_front_addr":"172.21.15.12:6823/38075","state":["exists","up"]},{"osd":1,"uuid":"ff722efe-b3f9-4cc0-bbde-f4d4d8055a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":38076},{"type":"v1","addr":"172.21.15.12:6811","nonce":38076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":38076},{"type":"v1","addr":"172.21.15.12:6818","nonce":38076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":38076},{"type":"v1","addr":"172.21.15.12:6831","nonce":38076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":38076},{"type":"v1","addr":"172.21.15.12:6825","nonce":38076}]},"public_addr":"172.21.15.12:6811/38076","cluster_addr":"172.21.15.12:6818/38076","heartbeat_back_addr":"172.21.15.12:6831/38076","heartbeat_front_addr":"172.21.15.12:6825/38076","state":["exists","up"]},{"osd":2,"uuid":"9baf25db-dce0-4065-90d6-f35867286be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6809","nonce":38073},{"type":"v1","addr":"172.21.15.12:6810","nonce":38073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":38073},{"type":"v1","addr":"172.21.15.12:6817","nonce":38073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":38073},{"type":"v1","addr":"172.21.15.12:6830","nonce":38073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":38073},{"type":"v1","addr":"172.21.15.12:6826","nonce":38073}]},"public_addr":"172.21.15.12:6810/38073","cluster_addr":"172.21.15.12:6817/38073","heartbeat_back_addr":"172.21.15.12:6830/38073","heartbeat_front_addr":"172.21.15.12:6826/38073","state":["exists","up"]},{"osd":3,"uuid":"8a620ad3-2294-470d-8a8c-66f177f5fbe7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":38074},{"type":"v1","addr":"172.21.15.12:6801","nonce":38074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":38074},{"type":"v1","addr":"172.21.15.12:6803","nonce":38074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":38074},{"type":"v1","addr":"172.21.15.12:6807","nonce":38074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":38074},{"type":"v1","addr":"172.21.15.12:6805","nonce":38074}]},"public_addr":"172.21.15.12:6801/38074","cluster_addr":"172.21.15.12:6803/38074","heartbeat_back_addr":"172.21.15.12:6807/38074","heartbeat_front_addr":"172.21.15.12:6805/38074","state":["exists","up"]},{"osd":4,"uuid":"a8824d77-7405-40f5-9234-60889802b184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":38266},{"type":"v1","addr":"172.21.15.31:6817","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":38266},{"type":"v1","addr":"172.21.15.31:6819","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":38266},{"type":"v1","addr":"172.21.15.31:6823","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":38266},{"type":"v1","addr":"172.21.15.31:6821","nonce":38266}]},"public_addr":"172.21.15.31:6817/38266","cluster_addr":"172.21.15.31:6819/38266","heartbeat_back_addr":"172.21.15.31:6823/38266","heartbeat_front_addr":"172.21.15.31:6821/38266","state":["exists","up"]},{"osd":5,"uuid":"3bb01192-a47c-48e9-9662-285e3f6f4b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":38264},{"type":"v1","addr":"172.21.15.31:6807","nonce":38264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":38264},{"type":"v1","addr":"172.21.15.31:6811","nonce":38264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":38264},{"type":"v1","addr":"172.21.15.31:6815","nonce":38264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":38264},{"type":"v1","addr":"172.21.15.31:6813","nonce":38264}]},"public_addr":"172.21.15.31:6807/38264","cluster_addr":"172.21.15.31:6811/38264","heartbeat_back_addr":"172.21.15.31:6815/38264","heartbeat_front_addr":"172.21.15.31:6813/38264","state":["exists","up"]},{"osd":6,"uuid":"1e2d18e4-73e6-4a37-826c-35eca4d96935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":38263},{"type":"v1","addr":"172.21.15.31:6825","nonce":38263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":38263},{"type":"v1","addr":"172.21.15.31:6827","nonce":38263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":38263},{"type":"v1","addr":"172.21.15.31:6831","nonce":38263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":38263},{"type":"v1","addr":"172.21.15.31:6829","nonce":38263}]},"public_addr":"172.21.15.31:6825/38263","cluster_addr":"172.21.15.31:6827/38263","heartbeat_back_addr":"172.21.15.31:6831/38263","heartbeat_front_addr":"172.21.15.31:6829/38263","state":["exists","up"]},{"osd":7,"uuid":"e0f369c0-562b-4440-a5aa-12275c29412b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":38265},{"type":"v1","addr":"172.21.15.31:6801","nonce":38265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":38265},{"type":"v1","addr":"172.21.15.31:6803","nonce":38265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":38265},{"type":"v1","addr":"172.21.15.31:6810","nonce":38265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":38265},{"type":"v1","addr":"172.21.15.31:6806","nonce":38265}]},"public_addr":"172.21.15.31:6801/38265","cluster_addr":"172.21.15.31:6803/38265","heartbeat_back_addr":"172.21.15.31:6810/38265","heartbeat_front_addr":"172.21.15.31:6806/38265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.411815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.372565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.209700+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.414619+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.316843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.300348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.359800+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.219854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T23:28:21.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.076+0000 7f1b6666a640 1 -- 172.21.15.12:0/1349362899 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1b40065e60 msgr2=0x7f1b40068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:21.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.076+0000 7f1b6666a640 1 --2- 172.21.15.12:0/1349362899 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1b40065e60 0x7f1b40068320 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1b50001210 tx=0x7f1b50009040 comp rx=0 tx=0).stop 2023-10-16T23:28:21.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.076+0000 7f1b6666a640 1 -- 172.21.15.12:0/1349362899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b60149940 msgr2=0x7f1b600b53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:21.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.076+0000 7f1b6666a640 1 --2- 172.21.15.12:0/1349362899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b60149940 0x7f1b600b53a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009ab0 tx=0x7f1b4c005800 comp rx=0 tx=0).stop 2023-10-16T23:28:21.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.076+0000 7f1b6666a640 1 -- 172.21.15.12:0/1349362899 shutdown_connections 2023-10-16T23:28:21.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.076+0000 7f1b6666a640 1 --2- 172.21.15.12:0/1349362899 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1b40065e60 0x7f1b40068320 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.076+0000 7f1b6666a640 1 --2- 172.21.15.12:0/1349362899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b600b58e0 0x7f1b600b3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.076+0000 7f1b6666a640 1 --2- 172.21.15.12:0/1349362899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b60149940 0x7f1b600b53a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.076+0000 7f1b6666a640 1 --2- 172.21.15.12:0/1349362899 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1b4c0047d0 0x7f1b601e4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.076+0000 7f1b6666a640 1 -- 172.21.15.12:0/1349362899 >> 172.21.15.12:0/1349362899 conn(0x7f1b6006ba20 msgr2=0x7f1b600bca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:21.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.076+0000 7f1b6666a640 1 -- 172.21.15.12:0/1349362899 shutdown_connections 2023-10-16T23:28:21.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.076+0000 7f1b6666a640 1 -- 172.21.15.12:0/1349362899 wait complete. 2023-10-16T23:28:21.098 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T23:27:27.354025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-16T23:27:34.786446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T23:27:39.130341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T23:27:39.674572+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T23:28:21.099 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T23:28:21.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efed6790640 1 Processor -- start 2023-10-16T23:28:21.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efed6790640 1 -- start start 2023-10-16T23:28:21.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efed6790640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efed00c12a0 0x7efed00bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:21.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efed6790640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efed00b3f70 0x7efed014f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:21.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efed6790640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed0153580 con 0x7efed0070800 2023-10-16T23:28:21.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efed6790640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed0153860 con 0x7efed00c12a0 2023-10-16T23:28:21.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efed6790640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed00c1680 con 0x7efed00b3f70 2023-10-16T23:28:21.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efecf7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efed0070800 0x7efed014e950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48090/0 (socket says 172.21.15.12:48090) 2023-10-16T23:28:21.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efecf7fe640 1 -- 172.21.15.12:0/3522645125 learned_addr learned my addr 172.21.15.12:0/3522645125 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:21.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efecffff640 1 --2- 172.21.15.12:0/3522645125 >> v2:172.21.15.31:3300/0 conn(0x7efed00c12a0 0x7efed00bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:21.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efed4d2d640 1 --2- 172.21.15.12:0/3522645125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efed00b3f70 0x7efed014f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:21.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efeceffd640 1 -- 172.21.15.12:0/3522645125 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2114627526 0 0) 0x7efed0153580 con 0x7efed0070800 2023-10-16T23:28:21.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efeceffd640 1 -- 172.21.15.12:0/3522645125 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efeb8003530 con 0x7efed0070800 2023-10-16T23:28:21.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efeceffd640 1 -- 172.21.15.12:0/3522645125 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3341429399 0 0) 0x7efeb8003530 con 0x7efed0070800 2023-10-16T23:28:21.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efeceffd640 1 -- 172.21.15.12:0/3522645125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efed00b3f70 msgr2=0x7efed014f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:21.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efeceffd640 1 --2- 172.21.15.12:0/3522645125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efed00b3f70 0x7efed014f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efeceffd640 1 -- 172.21.15.12:0/3522645125 >> v2:172.21.15.31:3300/0 conn(0x7efed00c12a0 msgr2=0x7efed00bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:21.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efeceffd640 1 --2- 172.21.15.12:0/3522645125 >> v2:172.21.15.31:3300/0 conn(0x7efed00c12a0 0x7efed00bcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efeceffd640 1 -- 172.21.15.12:0/3522645125 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed00c17f0 con 0x7efed0070800 2023-10-16T23:28:21.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efeceffd640 1 -- 172.21.15.12:0/3522645125 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7efec0001680 con 0x7efed0070800 2023-10-16T23:28:21.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efeceffd640 1 -- 172.21.15.12:0/3522645125 >> v1:172.21.15.12:6789/0 conn(0x7efed0070800 legacy=0x7efed014e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:21.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efeceffd640 1 --2- 172.21.15.12:0/3522645125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efeb8003980 0x7efeb8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:21.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efeceffd640 1 --2- 172.21.15.12:0/3522645125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efed00b3f70 0x7efeb80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:21.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efeceffd640 1 --2- 172.21.15.12:0/3522645125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efeb8004d10 0x7efeb8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:21.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efeceffd640 1 -- 172.21.15.12:0/3522645125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed0153860 con 0x7efeb8003980 2023-10-16T23:28:21.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efeceffd640 1 -- 172.21.15.12:0/3522645125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed00c1680 con 0x7efeb8004d10 2023-10-16T23:28:21.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efeceffd640 1 -- 172.21.15.12:0/3522645125 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb800b990 con 0x7efed00b3f70 2023-10-16T23:28:21.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efecffff640 1 --2- 172.21.15.12:0/3522645125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efeb8003980 0x7efeb8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:21.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efed4d2d640 1 --2- 172.21.15.12:0/3522645125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efeb8004d10 0x7efeb8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:21.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efecf7fe640 1 --2- 172.21.15.12:0/3522645125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efed00b3f70 0x7efeb80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:21.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efecffff640 1 -- 172.21.15.12:0/3522645125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efed00b3f70 msgr2=0x7efeb80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:21.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efecffff640 1 --2- 172.21.15.12:0/3522645125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efed00b3f70 0x7efeb80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efecffff640 1 -- 172.21.15.12:0/3522645125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efeb8004d10 msgr2=0x7efeb8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:21.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efecffff640 1 --2- 172.21.15.12:0/3522645125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efeb8004d10 0x7efeb8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.224+0000 7efecffff640 1 -- 172.21.15.12:0/3522645125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed00c17f0 con 0x7efeb8003980 2023-10-16T23:28:21.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.228+0000 7efecffff640 1 --2- 172.21.15.12:0/3522645125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efeb8003980 0x7efeb8003da0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7efec4009ae0 tx=0x7efec401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3f3432cdfc40da server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:21.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.228+0000 7efeceffd640 1 -- 172.21.15.12:0/3522645125 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec40a5570 con 0x7efeb8003980 2023-10-16T23:28:21.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.228+0000 7efeceffd640 1 -- 172.21.15.12:0/3522645125 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec40a56d0 con 0x7efeb8003980 2023-10-16T23:28:21.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.228+0000 7efeceffd640 1 -- 172.21.15.12:0/3522645125 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec40a5a80 con 0x7efeb8003980 2023-10-16T23:28:21.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.228+0000 7efed6790640 1 -- 172.21.15.12:0/3522645125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efeb8003980 msgr2=0x7efeb8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:21.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.228+0000 7efed6790640 1 --2- 172.21.15.12:0/3522645125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efeb8003980 0x7efeb8003da0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7efec4009ae0 tx=0x7efec401ca90 comp rx=0 tx=0).stop 2023-10-16T23:28:21.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.228+0000 7efed4d2d640 1 -- 172.21.15.12:0/3522645125 reap_dead start 2023-10-16T23:28:21.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.228+0000 7efed6790640 1 -- 172.21.15.12:0/3522645125 shutdown_connections 2023-10-16T23:28:21.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.228+0000 7efed6790640 1 -- 172.21.15.12:0/3522645125 >> 172.21.15.12:0/3522645125 conn(0x7efed006bb10 msgr2=0x7efed00c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:21.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.228+0000 7efed6790640 1 -- 172.21.15.12:0/3522645125 shutdown_connections 2023-10-16T23:28:21.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.228+0000 7efed6790640 1 -- 172.21.15.12:0/3522645125 wait complete. 2023-10-16T23:28:21.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.228+0000 7efed6790640 1 Processor -- start 2023-10-16T23:28:21.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.228+0000 7efed6790640 1 -- start start 2023-10-16T23:28:21.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efed6790640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efeb8003980 0x7efed0142250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:21.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efed6790640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efed0142b40 0x7efed01400a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:21.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efed6790640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efed014a7f0 0x7efed013eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:21.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efed6790640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed01405e0 con 0x7efed0142b40 2023-10-16T23:28:21.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efed6790640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed0141d50 con 0x7efed014a7f0 2023-10-16T23:28:21.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efed6790640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed0140f80 con 0x7efeb8003980 2023-10-16T23:28:21.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efecf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efed0142b40 0x7efed01400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:21.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efecf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efed0142b40 0x7efed01400a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33142/0 (socket says 172.21.15.12:33142) 2023-10-16T23:28:21.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efecf7fe640 1 -- 172.21.15.12:0/1212690347 learned_addr learned my addr 172.21.15.12:0/1212690347 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:21.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efecffff640 1 --2- 172.21.15.12:0/1212690347 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efeb8003980 0x7efed0142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:21.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efed4d2d640 1 --2- 172.21.15.12:0/1212690347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efed014a7f0 0x7efed013eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:21.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efecf7fe640 1 -- 172.21.15.12:0/1212690347 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efeb8003980 msgr2=0x7efed0142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:21.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efecf7fe640 1 --2- 172.21.15.12:0/1212690347 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efeb8003980 0x7efed0142250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efecf7fe640 1 -- 172.21.15.12:0/1212690347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efed014a7f0 msgr2=0x7efed013eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:21.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efecf7fe640 1 --2- 172.21.15.12:0/1212690347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efed014a7f0 0x7efed013eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efecf7fe640 1 -- 172.21.15.12:0/1212690347 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed01460f0 con 0x7efed0142b40 2023-10-16T23:28:21.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efed4d2d640 1 --2- 172.21.15.12:0/1212690347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efed014a7f0 0x7efed013eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:21.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efecf7fe640 1 --2- 172.21.15.12:0/1212690347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efed0142b40 0x7efed01400a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7efec000e800 tx=0x7efec000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:21.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efeccff9640 1 -- 172.21.15.12:0/1212690347 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec000c8d0 con 0x7efed0142b40 2023-10-16T23:28:21.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efeccff9640 1 -- 172.21.15.12:0/1212690347 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec000ca30 con 0x7efed0142b40 2023-10-16T23:28:21.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efed6790640 1 -- 172.21.15.12:0/1212690347 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed013f420 con 0x7efed0142b40 2023-10-16T23:28:21.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efeccff9640 1 -- 172.21.15.12:0/1212690347 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec000cde0 con 0x7efed0142b40 2023-10-16T23:28:21.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efed6790640 1 -- 172.21.15.12:0/1212690347 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed01e7410 con 0x7efed0142b40 2023-10-16T23:28:21.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efed6790640 1 -- 172.21.15.12:0/1212690347 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed0141f70 con 0x7efed0142b40 2023-10-16T23:28:21.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efeccff9640 1 -- 172.21.15.12:0/1212690347 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7efec001d460 con 0x7efed0142b40 2023-10-16T23:28:21.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efeccff9640 1 --2- 172.21.15.12:0/1212690347 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efebc065e60 0x7efebc068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:21.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efeccff9640 1 -- 172.21.15.12:0/1212690347 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efec00838a0 con 0x7efed0142b40 2023-10-16T23:28:21.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.232+0000 7efecffff640 1 --2- 172.21.15.12:0/1212690347 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efebc065e60 0x7efebc068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:21.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.236+0000 7efecffff640 1 --2- 172.21.15.12:0/1212690347 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efebc065e60 0x7efebc068320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efec40af000 tx=0x7efec40046d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:21.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.236+0000 7efeccff9640 1 -- 172.21.15.12:0/1212690347 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7efed0141f70 con 0x7efed0142b40 2023-10-16T23:28:21.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.388+0000 7efed6790640 1 -- 172.21.15.12:0/1212690347 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efed0141f70 con 0x7efed0142b40 2023-10-16T23:28:21.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.388+0000 7efeccff9640 1 -- 172.21.15.12:0/1212690347 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7efed0141f70 con 0x7efed0142b40 2023-10-16T23:28:21.393 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-16T23:28:21.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.392+0000 7efed6790640 1 -- 172.21.15.12:0/1212690347 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efebc065e60 msgr2=0x7efebc068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:21.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.392+0000 7efed6790640 1 --2- 172.21.15.12:0/1212690347 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efebc065e60 0x7efebc068320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efec40af000 tx=0x7efec40046d0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.392+0000 7efed6790640 1 -- 172.21.15.12:0/1212690347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efed0142b40 msgr2=0x7efed01400a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:21.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.392+0000 7efed6790640 1 --2- 172.21.15.12:0/1212690347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efed0142b40 0x7efed01400a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7efec000e800 tx=0x7efec000ecc0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.392+0000 7efed6790640 1 -- 172.21.15.12:0/1212690347 shutdown_connections 2023-10-16T23:28:21.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.392+0000 7efed6790640 1 --2- 172.21.15.12:0/1212690347 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efebc065e60 0x7efebc068320 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.392+0000 7efed6790640 1 --2- 172.21.15.12:0/1212690347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efed014a7f0 0x7efed013eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.392+0000 7efed6790640 1 --2- 172.21.15.12:0/1212690347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efed0142b40 0x7efed01400a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.392+0000 7efed6790640 1 --2- 172.21.15.12:0/1212690347 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efeb8003980 0x7efed0142250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.392+0000 7efed6790640 1 -- 172.21.15.12:0/1212690347 >> 172.21.15.12:0/1212690347 conn(0x7efed006bb10 msgr2=0x7efed01481e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:21.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.392+0000 7efed6790640 1 -- 172.21.15.12:0/1212690347 shutdown_connections 2023-10-16T23:28:21.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.392+0000 7efed6790640 1 -- 172.21.15.12:0/1212690347 wait complete. 2023-10-16T23:28:21.410 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-16T23:28:21.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.520+0000 7f3e9d97c640 1 Processor -- start 2023-10-16T23:28:21.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e9d97c640 1 -- start start 2023-10-16T23:28:21.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e9d97c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3e980c12a0 0x7f3e98146c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:21.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e9d97c640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e980bc8e0 con 0x7f3e98150880 2023-10-16T23:28:21.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e9d97c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e980b3f40 con 0x7f3e980bbe00 2023-10-16T23:28:21.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e9d97c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e980b4220 con 0x7f3e980c12a0 2023-10-16T23:28:21.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e977fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3e98150880 0x7f3e98150cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48102/0 (socket says 172.21.15.12:48102) 2023-10-16T23:28:21.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e977fe640 1 -- 172.21.15.12:0/3414809189 learned_addr learned my addr 172.21.15.12:0/3414809189 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:21.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e96ffd640 1 --2- 172.21.15.12:0/3414809189 >> v2:172.21.15.31:3300/0 conn(0x7f3e980c12a0 0x7f3e98146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:21.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e95ffb640 1 -- 172.21.15.12:0/3414809189 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461345195 0 0) 0x7f3e980bc8e0 con 0x7f3e98150880 2023-10-16T23:28:21.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e95ffb640 1 -- 172.21.15.12:0/3414809189 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e84003530 con 0x7f3e98150880 2023-10-16T23:28:21.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e95ffb640 1 -- 172.21.15.12:0/3414809189 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3344895795 0 0) 0x7f3e84003530 con 0x7f3e98150880 2023-10-16T23:28:21.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e95ffb640 1 -- 172.21.15.12:0/3414809189 >> v2:172.21.15.31:3300/0 conn(0x7f3e980c12a0 msgr2=0x7f3e98146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:21.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e95ffb640 1 --2- 172.21.15.12:0/3414809189 >> v2:172.21.15.31:3300/0 conn(0x7f3e980c12a0 0x7f3e98146c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e95ffb640 1 -- 172.21.15.12:0/3414809189 >> v1:172.21.15.31:6789/0 conn(0x7f3e980bbe00 legacy=0x7f3e98147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:21.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e95ffb640 1 -- 172.21.15.12:0/3414809189 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e980b3b80 con 0x7f3e98150880 2023-10-16T23:28:21.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e95ffb640 1 -- 172.21.15.12:0/3414809189 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7f3e90001a00 con 0x7f3e98150880 2023-10-16T23:28:21.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e95ffb640 1 -- 172.21.15.12:0/3414809189 >> v1:172.21.15.12:6789/0 conn(0x7f3e98150880 legacy=0x7f3e98150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:21.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e95ffb640 1 --2- 172.21.15.12:0/3414809189 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e84003980 0x7f3e84003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:21.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e95ffb640 1 --2- 172.21.15.12:0/3414809189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e840047d0 0x7f3e84004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:21.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e95ffb640 1 --2- 172.21.15.12:0/3414809189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e84005190 0x7f3e8400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:21.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e95ffb640 1 -- 172.21.15.12:0/3414809189 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e980b4220 con 0x7f3e84005190 2023-10-16T23:28:21.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e95ffb640 1 -- 172.21.15.12:0/3414809189 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8400c030 con 0x7f3e840047d0 2023-10-16T23:28:21.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e95ffb640 1 -- 172.21.15.12:0/3414809189 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8400c1f0 con 0x7f3e84003980 2023-10-16T23:28:21.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e977fe640 1 --2- 172.21.15.12:0/3414809189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e84005190 0x7f3e8400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:21.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e967fc640 1 --2- 172.21.15.12:0/3414809189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e840047d0 0x7f3e84004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:21.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e96ffd640 1 --2- 172.21.15.12:0/3414809189 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e84003980 0x7f3e84003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:21.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e977fe640 1 -- 172.21.15.12:0/3414809189 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e84003980 msgr2=0x7f3e84003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:21.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e977fe640 1 --2- 172.21.15.12:0/3414809189 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e84003980 0x7f3e84003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e977fe640 1 -- 172.21.15.12:0/3414809189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e840047d0 msgr2=0x7f3e84004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:21.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e977fe640 1 --2- 172.21.15.12:0/3414809189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e840047d0 0x7f3e84004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.524+0000 7f3e977fe640 1 -- 172.21.15.12:0/3414809189 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e84003530 con 0x7f3e84005190 2023-10-16T23:28:21.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e977fe640 1 -- 172.21.15.12:0/3414809189 reap_dead start 2023-10-16T23:28:21.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e977fe640 1 --2- 172.21.15.12:0/3414809189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e84005190 0x7f3e8400b990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3e9000a830 tx=0x7f3e9001d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c609d50246e0988 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:21.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e95ffb640 1 -- 172.21.15.12:0/3414809189 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e900072d0 con 0x7f3e84005190 2023-10-16T23:28:21.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e95ffb640 1 -- 172.21.15.12:0/3414809189 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e900a8070 con 0x7f3e84005190 2023-10-16T23:28:21.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e95ffb640 1 -- 172.21.15.12:0/3414809189 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e900076b0 con 0x7f3e84005190 2023-10-16T23:28:21.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e9d97c640 1 -- 172.21.15.12:0/3414809189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e84005190 msgr2=0x7f3e8400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:21.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e9d97c640 1 --2- 172.21.15.12:0/3414809189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e84005190 0x7f3e8400b990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3e9000a830 tx=0x7f3e9001d340 comp rx=0 tx=0).stop 2023-10-16T23:28:21.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e9d97c640 1 -- 172.21.15.12:0/3414809189 shutdown_connections 2023-10-16T23:28:21.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e9d97c640 1 --2- 172.21.15.12:0/3414809189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e84005190 0x7f3e8400b990 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e9d97c640 1 -- 172.21.15.12:0/3414809189 >> 172.21.15.12:0/3414809189 conn(0x7f3e9806bb10 msgr2=0x7f3e980c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:21.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e9d97c640 1 -- 172.21.15.12:0/3414809189 shutdown_connections 2023-10-16T23:28:21.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e9d97c640 1 -- 172.21.15.12:0/3414809189 wait complete. 2023-10-16T23:28:21.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e9d97c640 1 Processor -- start 2023-10-16T23:28:21.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e9d97c640 1 -- start start 2023-10-16T23:28:21.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e9d97c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e84005190 0x7f3e9814fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:21.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e9d97c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e981d8540 0x7f3e980b6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:21.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e9d97c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e981d6cc0 0x7f3e980b68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:21.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e9d97c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e980b7330 con 0x7f3e84005190 2023-10-16T23:28:21.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e9d97c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9814ff70 con 0x7f3e981d6cc0 2023-10-16T23:28:21.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e9d97c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e981e39f0 con 0x7f3e981d8540 2023-10-16T23:28:21.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e96ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e84005190 0x7f3e9814fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:21.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e96ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e84005190 0x7f3e9814fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33162/0 (socket says 172.21.15.12:33162) 2023-10-16T23:28:21.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e96ffd640 1 -- 172.21.15.12:0/2528117766 learned_addr learned my addr 172.21.15.12:0/2528117766 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:21.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e977fe640 1 --2- 172.21.15.12:0/2528117766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e981d6cc0 0x7f3e980b68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:21.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e967fc640 1 --2- 172.21.15.12:0/2528117766 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e981d8540 0x7f3e980b6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:21.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e96ffd640 1 -- 172.21.15.12:0/2528117766 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e981d8540 msgr2=0x7f3e980b6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:21.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e96ffd640 1 --2- 172.21.15.12:0/2528117766 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e981d8540 0x7f3e980b6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e96ffd640 1 -- 172.21.15.12:0/2528117766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e981d6cc0 msgr2=0x7f3e980b68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:21.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e96ffd640 1 --2- 172.21.15.12:0/2528117766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e981d6cc0 0x7f3e980b68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e96ffd640 1 -- 172.21.15.12:0/2528117766 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e980b7510 con 0x7f3e84005190 2023-10-16T23:28:21.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e967fc640 1 --2- 172.21.15.12:0/2528117766 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e981d8540 0x7f3e980b6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:21.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e977fe640 1 --2- 172.21.15.12:0/2528117766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e981d6cc0 0x7f3e980b68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:21.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e96ffd640 1 --2- 172.21.15.12:0/2528117766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e84005190 0x7f3e9814fa30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3e80011560 tx=0x7f3e80011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:21.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e8ffff640 1 -- 172.21.15.12:0/2528117766 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e80015930 con 0x7f3e84005190 2023-10-16T23:28:21.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e8ffff640 1 -- 172.21.15.12:0/2528117766 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e80015a90 con 0x7f3e84005190 2023-10-16T23:28:21.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e9d97c640 1 -- 172.21.15.12:0/2528117766 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e981e4610 con 0x7f3e84005190 2023-10-16T23:28:21.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e8ffff640 1 -- 172.21.15.12:0/2528117766 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e80015e60 con 0x7f3e84005190 2023-10-16T23:28:21.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.528+0000 7f3e9d97c640 1 -- 172.21.15.12:0/2528117766 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e980703c0 con 0x7f3e84005190 2023-10-16T23:28:21.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.532+0000 7f3e9d97c640 1 -- 172.21.15.12:0/2528117766 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e980673a0 con 0x7f3e84005190 2023-10-16T23:28:21.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.532+0000 7f3e8ffff640 1 -- 172.21.15.12:0/2528117766 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f3e8000f460 con 0x7f3e84005190 2023-10-16T23:28:21.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.532+0000 7f3e8ffff640 1 --2- 172.21.15.12:0/2528117766 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3e78065e60 0x7f3e78068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:21.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.532+0000 7f3e8ffff640 1 -- 172.21.15.12:0/2528117766 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3e80084010 con 0x7f3e84005190 2023-10-16T23:28:21.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.532+0000 7f3e967fc640 1 --2- 172.21.15.12:0/2528117766 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3e78065e60 0x7f3e78068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:21.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.532+0000 7f3e967fc640 1 --2- 172.21.15.12:0/2528117766 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3e78065e60 0x7f3e78068320 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3e88007fd0 tx=0x7f3e88009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:21.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.536+0000 7f3e8ffff640 1 -- 172.21.15.12:0/2528117766 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f3e800516f0 con 0x7f3e84005190 2023-10-16T23:28:21.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.688+0000 7f3e9d97c640 1 -- 172.21.15.12:0/2528117766 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3e980706a0 con 0x7f3e84005190 2023-10-16T23:28:21.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.688+0000 7f3e8ffff640 1 -- 172.21.15.12:0/2528117766 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3e80054d10 con 0x7f3e84005190 2023-10-16T23:28:21.694 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-10-16T23:28:21.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.688+0000 7f3e9d97c640 1 -- 172.21.15.12:0/2528117766 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3e78065e60 msgr2=0x7f3e78068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:21.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.688+0000 7f3e9d97c640 1 --2- 172.21.15.12:0/2528117766 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3e78065e60 0x7f3e78068320 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3e88007fd0 tx=0x7f3e88009040 comp rx=0 tx=0).stop 2023-10-16T23:28:21.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.688+0000 7f3e9d97c640 1 -- 172.21.15.12:0/2528117766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e84005190 msgr2=0x7f3e9814fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:21.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.688+0000 7f3e9d97c640 1 --2- 172.21.15.12:0/2528117766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e84005190 0x7f3e9814fa30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3e80011560 tx=0x7f3e80011a20 comp rx=0 tx=0).stop 2023-10-16T23:28:21.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.688+0000 7f3e9d97c640 1 -- 172.21.15.12:0/2528117766 shutdown_connections 2023-10-16T23:28:21.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.688+0000 7f3e9d97c640 1 --2- 172.21.15.12:0/2528117766 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3e78065e60 0x7f3e78068320 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.688+0000 7f3e9d97c640 1 --2- 172.21.15.12:0/2528117766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e981d6cc0 0x7f3e980b68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.688+0000 7f3e9d97c640 1 --2- 172.21.15.12:0/2528117766 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e981d8540 0x7f3e980b6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.688+0000 7f3e9d97c640 1 --2- 172.21.15.12:0/2528117766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e84005190 0x7f3e9814fa30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.688+0000 7f3e9d97c640 1 -- 172.21.15.12:0/2528117766 >> 172.21.15.12:0/2528117766 conn(0x7f3e9806bb10 msgr2=0x7f3e9814cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:21.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.688+0000 7f3e9d97c640 1 -- 172.21.15.12:0/2528117766 shutdown_connections 2023-10-16T23:28:21.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.688+0000 7f3e9d97c640 1 -- 172.21.15.12:0/2528117766 wait complete. 2023-10-16T23:28:21.708 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T23:28:21.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.828+0000 7f45bbafe640 1 Processor -- start 2023-10-16T23:28:21.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.828+0000 7f45bbafe640 1 -- start start 2023-10-16T23:28:21.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.828+0000 7f45bbafe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45b40bdec0 0x7f45b40b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:21.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.828+0000 7f45bbafe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f45b414bfe0 0x7f45b414c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:21.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.828+0000 7f45bbafe640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b414b850 con 0x7f45b4070ae0 2023-10-16T23:28:21.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.828+0000 7f45bbafe640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b4071250 con 0x7f45b414bfe0 2023-10-16T23:28:21.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.828+0000 7f45bbafe640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b4071640 con 0x7f45b40bdec0 2023-10-16T23:28:21.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.828+0000 7f45ba09b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f45b414bfe0 0x7f45b414c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:21.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.828+0000 7f45b9099640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f45b4070ae0 0x7f45b406fab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48112/0 (socket says 172.21.15.12:48112) 2023-10-16T23:28:21.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.828+0000 7f45b9099640 1 -- 172.21.15.12:0/852524282 learned_addr learned my addr 172.21.15.12:0/852524282 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:21.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.828+0000 7f45b989a640 1 --2- 172.21.15.12:0/852524282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45b40bdec0 0x7f45b40b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:21.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.828+0000 7f45b8898640 1 -- 172.21.15.12:0/852524282 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3889793508 0 0) 0x7f45b414b850 con 0x7f45b4070ae0 2023-10-16T23:28:21.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.828+0000 7f45b8898640 1 -- 172.21.15.12:0/852524282 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45a0003450 con 0x7f45b4070ae0 2023-10-16T23:28:21.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.828+0000 7f45ba09b640 1 -- 172.21.15.12:0/852524282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45b40bdec0 msgr2=0x7f45b40b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:21.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.828+0000 7f45ba09b640 1 --2- 172.21.15.12:0/852524282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45b40bdec0 0x7f45b40b60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.828+0000 7f45ba09b640 1 -- 172.21.15.12:0/852524282 >> v1:172.21.15.12:6789/0 conn(0x7f45b4070ae0 legacy=0x7f45b406fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:21.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.828+0000 7f45ba09b640 1 -- 172.21.15.12:0/852524282 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b4070f70 con 0x7f45b414bfe0 2023-10-16T23:28:21.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45ba09b640 1 --2- 172.21.15.12:0/852524282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45b414bfe0 0x7f45b414c450 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f45b00097f0 tx=0x7f45b001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b3a2989e2125ff1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:21.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45b8898640 1 -- 172.21.15.12:0/852524282 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b00ab600 con 0x7f45b414bfe0 2023-10-16T23:28:21.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45b8898640 1 -- 172.21.15.12:0/852524282 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b00a7050 con 0x7f45b414bfe0 2023-10-16T23:28:21.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45b8898640 1 -- 172.21.15.12:0/852524282 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b00ab980 con 0x7f45b414bfe0 2023-10-16T23:28:21.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45bbafe640 1 -- 172.21.15.12:0/852524282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45b414bfe0 msgr2=0x7f45b414c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:21.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45bbafe640 1 --2- 172.21.15.12:0/852524282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45b414bfe0 0x7f45b414c450 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f45b00097f0 tx=0x7f45b001c450 comp rx=0 tx=0).stop 2023-10-16T23:28:21.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45bbafe640 1 -- 172.21.15.12:0/852524282 shutdown_connections 2023-10-16T23:28:21.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45bbafe640 1 --2- 172.21.15.12:0/852524282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45b414bfe0 0x7f45b414c450 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45bbafe640 1 --2- 172.21.15.12:0/852524282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45b40bdec0 0x7f45b40b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45bbafe640 1 -- 172.21.15.12:0/852524282 >> 172.21.15.12:0/852524282 conn(0x7f45b4069d30 msgr2=0x7f45b406a140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:21.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45bbafe640 1 -- 172.21.15.12:0/852524282 shutdown_connections 2023-10-16T23:28:21.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45bbafe640 1 -- 172.21.15.12:0/852524282 wait complete. 2023-10-16T23:28:21.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45bbafe640 1 Processor -- start 2023-10-16T23:28:21.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45bbafe640 1 -- start start 2023-10-16T23:28:21.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45bbafe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45b40bdec0 0x7f45b40c05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:21.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45bbafe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45b414bfe0 0x7f45b41e31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45bbafe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45b41e36f0 0x7f45b41e5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45bbafe640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b406a4e0 con 0x7f45b41e36f0 2023-10-16T23:28:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45bbafe640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b413dec0 con 0x7f45b414bfe0 2023-10-16T23:28:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45bbafe640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b4144390 con 0x7f45b40bdec0 2023-10-16T23:28:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45ba09b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45b41e36f0 0x7f45b41e5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45ba09b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45b41e36f0 0x7f45b41e5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33188/0 (socket says 172.21.15.12:33188) 2023-10-16T23:28:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45ba09b640 1 -- 172.21.15.12:0/2102926512 learned_addr learned my addr 172.21.15.12:0/2102926512 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:21.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45b989a640 1 --2- 172.21.15.12:0/2102926512 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45b40bdec0 0x7f45b40c05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:21.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45ba09b640 1 -- 172.21.15.12:0/2102926512 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45b40bdec0 msgr2=0x7f45b40c05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:21.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45ba09b640 1 --2- 172.21.15.12:0/2102926512 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45b40bdec0 0x7f45b40c05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45ba09b640 1 -- 172.21.15.12:0/2102926512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45b414bfe0 msgr2=0x7f45b41e31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:21.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45ba09b640 1 --2- 172.21.15.12:0/2102926512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45b414bfe0 0x7f45b41e31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:21.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45ba09b640 1 -- 172.21.15.12:0/2102926512 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b0009420 con 0x7f45b41e36f0 2023-10-16T23:28:21.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.832+0000 7f45ba09b640 1 --2- 172.21.15.12:0/2102926512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45b41e36f0 0x7f45b41e5d60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f45b00097f0 tx=0x7f45b00191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:21.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.836+0000 7f45aa7fc640 1 -- 172.21.15.12:0/2102926512 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b00b4430 con 0x7f45b41e36f0 2023-10-16T23:28:21.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.836+0000 7f45aa7fc640 1 -- 172.21.15.12:0/2102926512 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b00b4590 con 0x7f45b41e36f0 2023-10-16T23:28:21.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.836+0000 7f45bbafe640 1 -- 172.21.15.12:0/2102926512 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b41448c0 con 0x7f45b41e36f0 2023-10-16T23:28:21.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.836+0000 7f45aa7fc640 1 -- 172.21.15.12:0/2102926512 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b00b4940 con 0x7f45b41e36f0 2023-10-16T23:28:21.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.836+0000 7f45bbafe640 1 -- 172.21.15.12:0/2102926512 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b40c0b00 con 0x7f45b41e36f0 2023-10-16T23:28:21.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.836+0000 7f45bbafe640 1 -- 172.21.15.12:0/2102926512 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b40673a0 con 0x7f45b41e36f0 2023-10-16T23:28:21.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.836+0000 7f45aa7fc640 1 -- 172.21.15.12:0/2102926512 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f45b00b2040 con 0x7f45b41e36f0 2023-10-16T23:28:21.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.836+0000 7f45aa7fc640 1 --2- 172.21.15.12:0/2102926512 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4598065e60 0x7f4598068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:21.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.836+0000 7f45aa7fc640 1 -- 172.21.15.12:0/2102926512 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f45b011d6a0 con 0x7f45b41e36f0 2023-10-16T23:28:21.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.836+0000 7f45b989a640 1 --2- 172.21.15.12:0/2102926512 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4598065e60 0x7f4598068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:21.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.836+0000 7f45b989a640 1 --2- 172.21.15.12:0/2102926512 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4598065e60 0x7f4598068320 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f45ac009f30 tx=0x7f45ac00b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:21.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.840+0000 7f45aa7fc640 1 -- 172.21.15.12:0/2102926512 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f45b00eac90 con 0x7f45b41e36f0 2023-10-16T23:28:21.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.996+0000 7f45bbafe640 1 -- 172.21.15.12:0/2102926512 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45b4149fd0 con 0x7f45b41e36f0 2023-10-16T23:28:21.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.996+0000 7f45aa7fc640 1 -- 172.21.15.12:0/2102926512 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45b00ee2b0 con 0x7f45b41e36f0 2023-10-16T23:28:21.999 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-16T23:28:22.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.996+0000 7f45bbafe640 1 -- 172.21.15.12:0/2102926512 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4598065e60 msgr2=0x7f4598068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:22.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.996+0000 7f45bbafe640 1 --2- 172.21.15.12:0/2102926512 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4598065e60 0x7f4598068320 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f45ac009f30 tx=0x7f45ac00b040 comp rx=0 tx=0).stop 2023-10-16T23:28:22.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.996+0000 7f45bbafe640 1 -- 172.21.15.12:0/2102926512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45b41e36f0 msgr2=0x7f45b41e5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:22.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.996+0000 7f45bbafe640 1 --2- 172.21.15.12:0/2102926512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45b41e36f0 0x7f45b41e5d60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f45b00097f0 tx=0x7f45b00191f0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.996+0000 7f45bbafe640 1 -- 172.21.15.12:0/2102926512 shutdown_connections 2023-10-16T23:28:22.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.996+0000 7f45bbafe640 1 --2- 172.21.15.12:0/2102926512 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4598065e60 0x7f4598068320 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.996+0000 7f45bbafe640 1 --2- 172.21.15.12:0/2102926512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45b41e36f0 0x7f45b41e5d60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.996+0000 7f45bbafe640 1 --2- 172.21.15.12:0/2102926512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45b414bfe0 0x7f45b41e31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.996+0000 7f45bbafe640 1 --2- 172.21.15.12:0/2102926512 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f45b40bdec0 0x7f45b40c05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.996+0000 7f45bbafe640 1 -- 172.21.15.12:0/2102926512 >> 172.21.15.12:0/2102926512 conn(0x7f45b4069d30 msgr2=0x7f45b414abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:22.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.996+0000 7f45bbafe640 1 -- 172.21.15.12:0/2102926512 shutdown_connections 2023-10-16T23:28:22.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:21.996+0000 7f45bbafe640 1 -- 172.21.15.12:0/2102926512 wait complete. 2023-10-16T23:28:22.017 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T23:28:22.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1aa07e9640 1 Processor -- start 2023-10-16T23:28:22.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1aa07e9640 1 -- start start 2023-10-16T23:28:22.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1aa07e9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1a980c12a0 0x7f1a98146c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:22.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1aa07e9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a980bc8e0 con 0x7f1a980bbe00 2023-10-16T23:28:22.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1aa07e9640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a980b3f40 con 0x7f1a98150880 2023-10-16T23:28:22.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1aa07e9640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a980b4220 con 0x7f1a980c12a0 2023-10-16T23:28:22.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9dd84640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1a980bbe00 0x7f1a98147150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48122/0 (socket says 172.21.15.12:48122) 2023-10-16T23:28:22.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9dd84640 1 -- 172.21.15.12:0/887456309 learned_addr learned my addr 172.21.15.12:0/887456309 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:22.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9e585640 1 --2- 172.21.15.12:0/887456309 >> v2:172.21.15.31:3300/0 conn(0x7f1a980c12a0 0x7f1a98146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:22.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9d583640 1 -- 172.21.15.12:0/887456309 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2482704919 0 0) 0x7f1a980bc8e0 con 0x7f1a980bbe00 2023-10-16T23:28:22.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9d583640 1 -- 172.21.15.12:0/887456309 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a84003530 con 0x7f1a980bbe00 2023-10-16T23:28:22.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9d583640 1 -- 172.21.15.12:0/887456309 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1653826403 0 0) 0x7f1a84003530 con 0x7f1a980bbe00 2023-10-16T23:28:22.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9d583640 1 -- 172.21.15.12:0/887456309 >> v2:172.21.15.31:3300/0 conn(0x7f1a980c12a0 msgr2=0x7f1a98146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:22.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9d583640 1 --2- 172.21.15.12:0/887456309 >> v2:172.21.15.31:3300/0 conn(0x7f1a980c12a0 0x7f1a98146c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9d583640 1 -- 172.21.15.12:0/887456309 >> v1:172.21.15.31:6789/0 conn(0x7f1a98150880 legacy=0x7f1a98150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:22.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9d583640 1 -- 172.21.15.12:0/887456309 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a980b3b80 con 0x7f1a980bbe00 2023-10-16T23:28:22.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9d583640 1 -- 172.21.15.12:0/887456309 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7f1a88001680 con 0x7f1a980bbe00 2023-10-16T23:28:22.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9d583640 1 -- 172.21.15.12:0/887456309 >> v1:172.21.15.12:6789/0 conn(0x7f1a980bbe00 legacy=0x7f1a98147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:22.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9d583640 1 --2- 172.21.15.12:0/887456309 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a84003980 0x7f1a84003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:22.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9d583640 1 --2- 172.21.15.12:0/887456309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a840047d0 0x7f1a84004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:22.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9d583640 1 --2- 172.21.15.12:0/887456309 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a84005190 0x7f1a8400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:22.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9d583640 1 -- 172.21.15.12:0/887456309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a980b4220 con 0x7f1a840047d0 2023-10-16T23:28:22.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9d583640 1 -- 172.21.15.12:0/887456309 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8400c030 con 0x7f1a84005190 2023-10-16T23:28:22.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9d583640 1 -- 172.21.15.12:0/887456309 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8400c1f0 con 0x7f1a84003980 2023-10-16T23:28:22.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9dd84640 1 --2- 172.21.15.12:0/887456309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a840047d0 0x7f1a84004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:22.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9ed86640 1 --2- 172.21.15.12:0/887456309 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a84005190 0x7f1a8400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:22.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9e585640 1 --2- 172.21.15.12:0/887456309 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a84003980 0x7f1a84003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:22.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9dd84640 1 -- 172.21.15.12:0/887456309 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a84003980 msgr2=0x7f1a84003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:22.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9dd84640 1 --2- 172.21.15.12:0/887456309 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a84003980 0x7f1a84003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9dd84640 1 -- 172.21.15.12:0/887456309 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a84005190 msgr2=0x7f1a8400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:22.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9dd84640 1 --2- 172.21.15.12:0/887456309 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a84005190 0x7f1a8400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9dd84640 1 -- 172.21.15.12:0/887456309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a84003530 con 0x7f1a840047d0 2023-10-16T23:28:22.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9e585640 1 --2- 172.21.15.12:0/887456309 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a84003980 0x7f1a84003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:22.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9ed86640 1 --2- 172.21.15.12:0/887456309 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a84005190 0x7f1a8400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:22.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.144+0000 7f1a9ed86640 1 -- 172.21.15.12:0/887456309 reap_dead start 2023-10-16T23:28:22.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.148+0000 7f1a9dd84640 1 --2- 172.21.15.12:0/887456309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a840047d0 0x7f1a84004c50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800c240 tx=0x7f1a8801f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89aa5b75f80e2add server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:22.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.148+0000 7f1a9d583640 1 -- 172.21.15.12:0/887456309 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88005ae0 con 0x7f1a840047d0 2023-10-16T23:28:22.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.148+0000 7f1a9d583640 1 -- 172.21.15.12:0/887456309 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a880ab070 con 0x7f1a840047d0 2023-10-16T23:28:22.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.148+0000 7f1a9d583640 1 -- 172.21.15.12:0/887456309 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88007070 con 0x7f1a840047d0 2023-10-16T23:28:22.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.148+0000 7f1aa07e9640 1 -- 172.21.15.12:0/887456309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a840047d0 msgr2=0x7f1a84004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:22.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.148+0000 7f1aa07e9640 1 --2- 172.21.15.12:0/887456309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a840047d0 0x7f1a84004c50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800c240 tx=0x7f1a8801f3b0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.148+0000 7f1aa07e9640 1 -- 172.21.15.12:0/887456309 shutdown_connections 2023-10-16T23:28:22.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.148+0000 7f1aa07e9640 1 --2- 172.21.15.12:0/887456309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a840047d0 0x7f1a84004c50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.148+0000 7f1aa07e9640 1 -- 172.21.15.12:0/887456309 >> 172.21.15.12:0/887456309 conn(0x7f1a9806bb10 msgr2=0x7f1a980c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:22.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.148+0000 7f1aa07e9640 1 -- 172.21.15.12:0/887456309 shutdown_connections 2023-10-16T23:28:22.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.148+0000 7f1aa07e9640 1 -- 172.21.15.12:0/887456309 wait complete. 2023-10-16T23:28:22.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.148+0000 7f1aa07e9640 1 Processor -- start 2023-10-16T23:28:22.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.148+0000 7f1aa07e9640 1 -- start start 2023-10-16T23:28:22.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.148+0000 7f1aa07e9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a840047d0 0x7f1a9814fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:22.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.148+0000 7f1aa07e9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a9814c440 0x7f1a980b7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:22.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.148+0000 7f1aa07e9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a981e1fe0 0x7f1a981e2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:22.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.148+0000 7f1aa07e9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a980b6bf0 con 0x7f1a840047d0 2023-10-16T23:28:22.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.148+0000 7f1aa07e9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a98150490 con 0x7f1a9814c440 2023-10-16T23:28:22.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.148+0000 7f1aa07e9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9814ff70 con 0x7f1a981e1fe0 2023-10-16T23:28:22.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.148+0000 7f1a9e585640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a840047d0 0x7f1a9814fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:22.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.148+0000 7f1a9e585640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a840047d0 0x7f1a9814fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33206/0 (socket says 172.21.15.12:33206) 2023-10-16T23:28:22.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.148+0000 7f1a9e585640 1 -- 172.21.15.12:0/3784570639 learned_addr learned my addr 172.21.15.12:0/3784570639 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:22.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.152+0000 7f1a9ed86640 1 --2- 172.21.15.12:0/3784570639 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a981e1fe0 0x7f1a981e2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:22.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.152+0000 7f1a9dd84640 1 --2- 172.21.15.12:0/3784570639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a9814c440 0x7f1a980b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:22.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.152+0000 7f1a9e585640 1 -- 172.21.15.12:0/3784570639 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a981e1fe0 msgr2=0x7f1a981e2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:22.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.152+0000 7f1a9e585640 1 --2- 172.21.15.12:0/3784570639 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a981e1fe0 0x7f1a981e2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.152+0000 7f1a9e585640 1 -- 172.21.15.12:0/3784570639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a9814c440 msgr2=0x7f1a980b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:22.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.152+0000 7f1a9e585640 1 --2- 172.21.15.12:0/3784570639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a9814c440 0x7f1a980b7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.152+0000 7f1a9e585640 1 -- 172.21.15.12:0/3784570639 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a980b53f0 con 0x7f1a840047d0 2023-10-16T23:28:22.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.152+0000 7f1a9ed86640 1 --2- 172.21.15.12:0/3784570639 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a981e1fe0 0x7f1a981e2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:22.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.152+0000 7f1a9e585640 1 --2- 172.21.15.12:0/3784570639 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a840047d0 0x7f1a9814fa30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1a94010790 tx=0x7f1a94010c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:22.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.152+0000 7f1a8effd640 1 -- 172.21.15.12:0/3784570639 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a94004220 con 0x7f1a840047d0 2023-10-16T23:28:22.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.152+0000 7f1a8effd640 1 -- 172.21.15.12:0/3784570639 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a94004380 con 0x7f1a840047d0 2023-10-16T23:28:22.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.152+0000 7f1a8effd640 1 -- 172.21.15.12:0/3784570639 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9400eb80 con 0x7f1a840047d0 2023-10-16T23:28:22.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.152+0000 7f1aa07e9640 1 -- 172.21.15.12:0/3784570639 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a980b5110 con 0x7f1a840047d0 2023-10-16T23:28:22.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.152+0000 7f1aa07e9640 1 -- 172.21.15.12:0/3784570639 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a980b4d70 con 0x7f1a840047d0 2023-10-16T23:28:22.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.152+0000 7f1aa07e9640 1 -- 172.21.15.12:0/3784570639 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a980b6e60 con 0x7f1a840047d0 2023-10-16T23:28:22.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.152+0000 7f1a8effd640 1 -- 172.21.15.12:0/3784570639 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f1a9400ece0 con 0x7f1a840047d0 2023-10-16T23:28:22.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.152+0000 7f1a8effd640 1 --2- 172.21.15.12:0/3784570639 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1a7c065e60 0x7f1a7c068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:22.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.152+0000 7f1a8effd640 1 -- 172.21.15.12:0/3784570639 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1a940836e0 con 0x7f1a840047d0 2023-10-16T23:28:22.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.152+0000 7f1a9dd84640 1 --2- 172.21.15.12:0/3784570639 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1a7c065e60 0x7f1a7c068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:22.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.152+0000 7f1a9dd84640 1 --2- 172.21.15.12:0/3784570639 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1a7c065e60 0x7f1a7c068320 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1a880af000 tx=0x7f1a880aa000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:22.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.156+0000 7f1a8effd640 1 -- 172.21.15.12:0/3784570639 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f1a94050d20 con 0x7f1a840047d0 2023-10-16T23:28:22.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.308+0000 7f1aa07e9640 1 -- 172.21.15.12:0/3784570639 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1a980b6950 con 0x7f1a840047d0 2023-10-16T23:28:22.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.308+0000 7f1a8effd640 1 -- 172.21.15.12:0/3784570639 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1a980b6950 con 0x7f1a840047d0 2023-10-16T23:28:22.312 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-16T23:28:22.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.312+0000 7f1aa07e9640 1 -- 172.21.15.12:0/3784570639 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1a7c065e60 msgr2=0x7f1a7c068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:22.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.312+0000 7f1aa07e9640 1 --2- 172.21.15.12:0/3784570639 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1a7c065e60 0x7f1a7c068320 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1a880af000 tx=0x7f1a880aa000 comp rx=0 tx=0).stop 2023-10-16T23:28:22.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.312+0000 7f1aa07e9640 1 -- 172.21.15.12:0/3784570639 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a840047d0 msgr2=0x7f1a9814fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:22.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.312+0000 7f1aa07e9640 1 --2- 172.21.15.12:0/3784570639 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a840047d0 0x7f1a9814fa30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1a94010790 tx=0x7f1a94010c50 comp rx=0 tx=0).stop 2023-10-16T23:28:22.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.312+0000 7f1aa07e9640 1 -- 172.21.15.12:0/3784570639 shutdown_connections 2023-10-16T23:28:22.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.312+0000 7f1aa07e9640 1 --2- 172.21.15.12:0/3784570639 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1a7c065e60 0x7f1a7c068320 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.312+0000 7f1aa07e9640 1 --2- 172.21.15.12:0/3784570639 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a981e1fe0 0x7f1a981e2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.312+0000 7f1aa07e9640 1 --2- 172.21.15.12:0/3784570639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a9814c440 0x7f1a980b7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.312+0000 7f1aa07e9640 1 --2- 172.21.15.12:0/3784570639 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a840047d0 0x7f1a9814fa30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.312+0000 7f1aa07e9640 1 -- 172.21.15.12:0/3784570639 >> 172.21.15.12:0/3784570639 conn(0x7f1a9806bb10 msgr2=0x7f1a98143cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:22.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.312+0000 7f1aa07e9640 1 -- 172.21.15.12:0/3784570639 shutdown_connections 2023-10-16T23:28:22.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.312+0000 7f1aa07e9640 1 -- 172.21.15.12:0/3784570639 wait complete. 2023-10-16T23:28:22.329 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T23:28:22.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.452+0000 7f71a8c07640 1 Processor -- start 2023-10-16T23:28:22.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.452+0000 7f71a8c07640 1 -- start start 2023-10-16T23:28:22.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.452+0000 7f71a8c07640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f71a414c220 0x7f71a414ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:22.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.452+0000 7f71a8c07640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a40bae10 con 0x7f71a4070b30 2023-10-16T23:28:22.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.452+0000 7f71a8c07640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a414fb20 con 0x7f71a406ebc0 2023-10-16T23:28:22.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.452+0000 7f71a8c07640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a40b7710 con 0x7f71a414c220 2023-10-16T23:28:22.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.452+0000 7f71a1d9b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f71a4070b30 0x7f71a40c0ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48132/0 (socket says 172.21.15.12:48132) 2023-10-16T23:28:22.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.452+0000 7f71a1d9b640 1 -- 172.21.15.12:0/1412889667 learned_addr learned my addr 172.21.15.12:0/1412889667 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:22.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.452+0000 7f71a2d9d640 1 --2- 172.21.15.12:0/1412889667 >> v2:172.21.15.12:3300/0 conn(0x7f71a414c220 0x7f71a414ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:22.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.452+0000 7f71a159a640 1 -- 172.21.15.12:0/1412889667 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962295142 0 0) 0x7f71a40bae10 con 0x7f71a4070b30 2023-10-16T23:28:22.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.452+0000 7f71a159a640 1 -- 172.21.15.12:0/1412889667 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7190003530 con 0x7f71a4070b30 2023-10-16T23:28:22.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.452+0000 7f71a2d9d640 1 -- 172.21.15.12:0/1412889667 >> v1:172.21.15.31:6789/0 conn(0x7f71a406ebc0 legacy=0x7f71a414eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:22.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.452+0000 7f71a2d9d640 1 -- 172.21.15.12:0/1412889667 >> v1:172.21.15.12:6789/0 conn(0x7f71a4070b30 legacy=0x7f71a40c0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:22.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.452+0000 7f71a2d9d640 1 -- 172.21.15.12:0/1412889667 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a40b4000 con 0x7f71a414c220 2023-10-16T23:28:22.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.456+0000 7f71a2d9d640 1 --2- 172.21.15.12:0/1412889667 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71a414c220 0x7f71a414ab70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f719c009d90 tx=0x7f719c01c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d836a09cf3fe32a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:22.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.456+0000 7f71a159a640 1 -- 172.21.15.12:0/1412889667 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c0a57a0 con 0x7f71a414c220 2023-10-16T23:28:22.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.456+0000 7f71a159a640 1 -- 172.21.15.12:0/1412889667 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719c0a5900 con 0x7f71a414c220 2023-10-16T23:28:22.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.456+0000 7f71a159a640 1 -- 172.21.15.12:0/1412889667 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c0a5c90 con 0x7f71a414c220 2023-10-16T23:28:22.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.456+0000 7f71a8c07640 1 -- 172.21.15.12:0/1412889667 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71a414c220 msgr2=0x7f71a414ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:22.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.456+0000 7f71a8c07640 1 --2- 172.21.15.12:0/1412889667 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71a414c220 0x7f71a414ab70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f719c009d90 tx=0x7f719c01c7f0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.456+0000 7f71a8c07640 1 -- 172.21.15.12:0/1412889667 shutdown_connections 2023-10-16T23:28:22.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.456+0000 7f71a8c07640 1 --2- 172.21.15.12:0/1412889667 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71a414c220 0x7f71a414ab70 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.456+0000 7f71a8c07640 1 -- 172.21.15.12:0/1412889667 >> 172.21.15.12:0/1412889667 conn(0x7f71a406ba20 msgr2=0x7f71a40c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:22.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.456+0000 7f71a8c07640 1 -- 172.21.15.12:0/1412889667 shutdown_connections 2023-10-16T23:28:22.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.456+0000 7f71a8c07640 1 -- 172.21.15.12:0/1412889667 wait complete. 2023-10-16T23:28:22.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.456+0000 7f71a8c07640 1 Processor -- start 2023-10-16T23:28:22.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.456+0000 7f71a8c07640 1 -- start start 2023-10-16T23:28:22.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.456+0000 7f71a8c07640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71a406ebc0 0x7f71a4147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:22.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.456+0000 7f71a8c07640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71a4070b30 0x7f71a4140700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:22.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.456+0000 7f71a8c07640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71a414c220 0x7f71a4140c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:22.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.456+0000 7f71a8c07640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a40befd0 con 0x7f71a406ebc0 2023-10-16T23:28:22.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.456+0000 7f71a8c07640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a40bf2b0 con 0x7f71a414c220 2023-10-16T23:28:22.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.456+0000 7f71a8c07640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a40bf740 con 0x7f71a4070b30 2023-10-16T23:28:22.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.456+0000 7f71a259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71a406ebc0 0x7f71a4147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:22.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.456+0000 7f71a259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71a406ebc0 0x7f71a4147bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33232/0 (socket says 172.21.15.12:33232) 2023-10-16T23:28:22.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.456+0000 7f71a259c640 1 -- 172.21.15.12:0/1702422476 learned_addr learned my addr 172.21.15.12:0/1702422476 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:22.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.456+0000 7f71a2d9d640 1 --2- 172.21.15.12:0/1702422476 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71a414c220 0x7f71a4140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:22.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.460+0000 7f71a1d9b640 1 --2- 172.21.15.12:0/1702422476 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71a4070b30 0x7f71a4140700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:22.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.460+0000 7f71a259c640 1 -- 172.21.15.12:0/1702422476 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71a4070b30 msgr2=0x7f71a4140700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:22.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.460+0000 7f71a259c640 1 --2- 172.21.15.12:0/1702422476 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71a4070b30 0x7f71a4140700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.460+0000 7f71a259c640 1 -- 172.21.15.12:0/1702422476 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71a414c220 msgr2=0x7f71a4140c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:22.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.460+0000 7f71a259c640 1 --2- 172.21.15.12:0/1702422476 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71a414c220 0x7f71a4140c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.460+0000 7f71a259c640 1 -- 172.21.15.12:0/1702422476 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c009a70 con 0x7f71a406ebc0 2023-10-16T23:28:22.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.460+0000 7f71a2d9d640 1 --2- 172.21.15.12:0/1702422476 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71a414c220 0x7f71a4140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:22.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.460+0000 7f71a1d9b640 1 --2- 172.21.15.12:0/1702422476 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71a4070b30 0x7f71a4140700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:22.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.460+0000 7f71a259c640 1 --2- 172.21.15.12:0/1702422476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71a406ebc0 0x7f71a4147bd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f718c00c450 tx=0x7f718c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:22.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.460+0000 7f719affd640 1 -- 172.21.15.12:0/1702422476 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c012830 con 0x7f71a406ebc0 2023-10-16T23:28:22.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.460+0000 7f719affd640 1 -- 172.21.15.12:0/1702422476 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c0129b0 con 0x7f71a406ebc0 2023-10-16T23:28:22.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.460+0000 7f71a8c07640 1 -- 172.21.15.12:0/1702422476 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a40bfea0 con 0x7f71a406ebc0 2023-10-16T23:28:22.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.460+0000 7f719affd640 1 -- 172.21.15.12:0/1702422476 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c012d60 con 0x7f71a406ebc0 2023-10-16T23:28:22.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.460+0000 7f71a8c07640 1 -- 172.21.15.12:0/1702422476 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a40bfb50 con 0x7f71a406ebc0 2023-10-16T23:28:22.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.460+0000 7f71a8c07640 1 -- 172.21.15.12:0/1702422476 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a40c0060 con 0x7f71a406ebc0 2023-10-16T23:28:22.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.460+0000 7f719affd640 1 -- 172.21.15.12:0/1702422476 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f718c01c460 con 0x7f71a406ebc0 2023-10-16T23:28:22.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.460+0000 7f719affd640 1 --2- 172.21.15.12:0/1702422476 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7184065e60 0x7f7184068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:22.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.460+0000 7f719affd640 1 -- 172.21.15.12:0/1702422476 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f718c0841f0 con 0x7f71a406ebc0 2023-10-16T23:28:22.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.460+0000 7f71a1d9b640 1 --2- 172.21.15.12:0/1702422476 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7184065e60 0x7f7184068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:22.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.464+0000 7f71a1d9b640 1 --2- 172.21.15.12:0/1702422476 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7184065e60 0x7f7184068320 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f71a4140180 tx=0x7f7194009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:22.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.464+0000 7f719affd640 1 -- 172.21.15.12:0/1702422476 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f718c051870 con 0x7f71a406ebc0 2023-10-16T23:28:22.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.632+0000 7f71a8c07640 1 -- 172.21.15.12:0/1702422476 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f71a40673a0 con 0x7f71a406ebc0 2023-10-16T23:28:22.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.632+0000 7f719affd640 1 -- 172.21.15.12:0/1702422476 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f718c054e90 con 0x7f71a406ebc0 2023-10-16T23:28:22.637 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2023-10-16T23:28:22.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.636+0000 7f71a8c07640 1 -- 172.21.15.12:0/1702422476 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7184065e60 msgr2=0x7f7184068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:22.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.636+0000 7f71a8c07640 1 --2- 172.21.15.12:0/1702422476 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7184065e60 0x7f7184068320 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f71a4140180 tx=0x7f7194009040 comp rx=0 tx=0).stop 2023-10-16T23:28:22.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.636+0000 7f71a8c07640 1 -- 172.21.15.12:0/1702422476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71a406ebc0 msgr2=0x7f71a4147bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:22.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.636+0000 7f71a8c07640 1 --2- 172.21.15.12:0/1702422476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71a406ebc0 0x7f71a4147bd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f718c00c450 tx=0x7f718c00c910 comp rx=0 tx=0).stop 2023-10-16T23:28:22.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.636+0000 7f71a8c07640 1 -- 172.21.15.12:0/1702422476 shutdown_connections 2023-10-16T23:28:22.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.636+0000 7f71a8c07640 1 --2- 172.21.15.12:0/1702422476 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f7184065e60 0x7f7184068320 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.636+0000 7f71a8c07640 1 --2- 172.21.15.12:0/1702422476 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71a414c220 0x7f71a4140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.636+0000 7f71a8c07640 1 --2- 172.21.15.12:0/1702422476 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f71a4070b30 0x7f71a4140700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.636+0000 7f71a8c07640 1 --2- 172.21.15.12:0/1702422476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71a406ebc0 0x7f71a4147bd0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.636+0000 7f71a8c07640 1 -- 172.21.15.12:0/1702422476 >> 172.21.15.12:0/1702422476 conn(0x7f71a406ba20 msgr2=0x7f71a414eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:22.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.636+0000 7f71a8c07640 1 -- 172.21.15.12:0/1702422476 shutdown_connections 2023-10-16T23:28:22.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.636+0000 7f71a8c07640 1 -- 172.21.15.12:0/1702422476 wait complete. 2023-10-16T23:28:22.655 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi072.front.sepia.ceph.com... 2023-10-16T23:28:22.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:22.656 DEBUG:teuthology.orchestra.run.smithi072:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-16T23:28:22.676 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi072.stderr:ceph-fuse[33388]: fuse finished with error 0 and tester_r 0 2023-10-16T23:28:22.678 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T23:28:22.701 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-10-16T23:28:22.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:22.702 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-16T23:28:22.768 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-10-16T23:28:22.769 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T23:28:22.776 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-10-16T23:28:22.776 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T23:28:22.825 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T23:28:22.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.952+0000 7fb43c2cf640 1 Processor -- start 2023-10-16T23:28:22.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.952+0000 7fb43c2cf640 1 -- start start 2023-10-16T23:28:22.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.956+0000 7fb43c2cf640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb4340c1950 0x7fb4340c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:22.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.956+0000 7fb43c2cf640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb4340bfc30 0x7fb434153150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:22.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.956+0000 7fb43c2cf640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4340c01e0 con 0x7fb43406e770 2023-10-16T23:28:22.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.956+0000 7fb43c2cf640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4340b85b0 con 0x7fb4340bfc30 2023-10-16T23:28:22.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.956+0000 7fb43c2cf640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4340b8120 con 0x7fb4340c1950 2023-10-16T23:28:22.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.956+0000 7fb43a86c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb4340bfc30 0x7fb434153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:22.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.956+0000 7fb43a86c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb4340bfc30 0x7fb434153150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33248/0 (socket says 172.21.15.12:33248) 2023-10-16T23:28:22.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.956+0000 7fb43a86c640 1 -- 172.21.15.12:0/3234909270 learned_addr learned my addr 172.21.15.12:0/3234909270 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:22.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.956+0000 7fb43a06b640 1 --2- 172.21.15.12:0/3234909270 >> v2:172.21.15.31:3300/0 conn(0x7fb4340c1950 0x7fb4340c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:22.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.956+0000 7fb43a86c640 1 -- 172.21.15.12:0/3234909270 >> v2:172.21.15.31:3300/0 conn(0x7fb4340c1950 msgr2=0x7fb4340c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:22.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.956+0000 7fb43a86c640 1 --2- 172.21.15.12:0/3234909270 >> v2:172.21.15.31:3300/0 conn(0x7fb4340c1950 0x7fb4340c1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.956+0000 7fb43a86c640 1 -- 172.21.15.12:0/3234909270 >> v1:172.21.15.31:6789/0 conn(0x7fb43406e770 legacy=0x7fb434152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:22.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.956+0000 7fb43a86c640 1 -- 172.21.15.12:0/3234909270 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4340b7db0 con 0x7fb4340bfc30 2023-10-16T23:28:22.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.956+0000 7fb43a86c640 1 --2- 172.21.15.12:0/3234909270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4340bfc30 0x7fb434153150 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb4340c0800 tx=0x7fb42c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cac99b3fc8cdf47 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:22.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.956+0000 7fb439069640 1 -- 172.21.15.12:0/3234909270 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c0a57e0 con 0x7fb4340bfc30 2023-10-16T23:28:22.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb439069640 1 -- 172.21.15.12:0/3234909270 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42c0a5940 con 0x7fb4340bfc30 2023-10-16T23:28:22.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb439069640 1 -- 172.21.15.12:0/3234909270 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c0a5cd0 con 0x7fb4340bfc30 2023-10-16T23:28:22.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43c2cf640 1 -- 172.21.15.12:0/3234909270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4340bfc30 msgr2=0x7fb434153150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:22.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43c2cf640 1 --2- 172.21.15.12:0/3234909270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4340bfc30 0x7fb434153150 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb4340c0800 tx=0x7fb42c01c900 comp rx=0 tx=0).stop 2023-10-16T23:28:22.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43c2cf640 1 -- 172.21.15.12:0/3234909270 shutdown_connections 2023-10-16T23:28:22.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43c2cf640 1 --2- 172.21.15.12:0/3234909270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4340bfc30 0x7fb434153150 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43c2cf640 1 --2- 172.21.15.12:0/3234909270 >> v2:172.21.15.31:3300/0 conn(0x7fb4340c1950 0x7fb4340c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43c2cf640 1 -- 172.21.15.12:0/3234909270 >> 172.21.15.12:0/3234909270 conn(0x7fb43406b5d0 msgr2=0x7fb43406b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:22.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43c2cf640 1 -- 172.21.15.12:0/3234909270 shutdown_connections 2023-10-16T23:28:22.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43c2cf640 1 -- 172.21.15.12:0/3234909270 wait complete. 2023-10-16T23:28:22.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43c2cf640 1 Processor -- start 2023-10-16T23:28:22.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43c2cf640 1 -- start start 2023-10-16T23:28:22.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43c2cf640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb43406e770 0x7fb434146eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:22.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43c2cf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4340bfc30 0x7fb4340bae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:22.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43c2cf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4340c1950 0x7fb434142d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:22.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43c2cf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4340ba020 con 0x7fb4340c1950 2023-10-16T23:28:22.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43c2cf640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb434146150 con 0x7fb4340bfc30 2023-10-16T23:28:22.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43c2cf640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4341473f0 con 0x7fb43406e770 2023-10-16T23:28:22.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43a86c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4340c1950 0x7fb434142d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:22.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43a86c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4340c1950 0x7fb434142d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33254/0 (socket says 172.21.15.12:33254) 2023-10-16T23:28:22.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43a86c640 1 -- 172.21.15.12:0/301430645 learned_addr learned my addr 172.21.15.12:0/301430645 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:22.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43a06b640 1 --2- 172.21.15.12:0/301430645 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb43406e770 0x7fb434146eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:22.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43986a640 1 --2- 172.21.15.12:0/301430645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4340bfc30 0x7fb4340bae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:22.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43a86c640 1 -- 172.21.15.12:0/301430645 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb43406e770 msgr2=0x7fb434146eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:22.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43a86c640 1 --2- 172.21.15.12:0/301430645 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb43406e770 0x7fb434146eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43a86c640 1 -- 172.21.15.12:0/301430645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4340bfc30 msgr2=0x7fb4340bae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:22.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43a86c640 1 --2- 172.21.15.12:0/301430645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4340bfc30 0x7fb4340bae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:22.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43a86c640 1 -- 172.21.15.12:0/301430645 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42c009b30 con 0x7fb4340c1950 2023-10-16T23:28:22.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43986a640 1 --2- 172.21.15.12:0/301430645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4340bfc30 0x7fb4340bae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:28:22.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43a86c640 1 --2- 172.21.15.12:0/301430645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4340c1950 0x7fb434142d50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb42c01d1a0 tx=0x7fb4340bf190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:22.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb42affd640 1 -- 172.21.15.12:0/301430645 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c009250 con 0x7fb4340c1950 2023-10-16T23:28:22.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb42affd640 1 -- 172.21.15.12:0/301430645 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42c0b8680 con 0x7fb4340c1950 2023-10-16T23:28:22.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43c2cf640 1 -- 172.21.15.12:0/301430645 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4341eacc0 con 0x7fb4340c1950 2023-10-16T23:28:22.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb42affd640 1 -- 172.21.15.12:0/301430645 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c0b8a30 con 0x7fb4340c1950 2023-10-16T23:28:22.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.960+0000 7fb43c2cf640 1 -- 172.21.15.12:0/301430645 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4341eb280 con 0x7fb4340c1950 2023-10-16T23:28:22.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.964+0000 7fb43c2cf640 1 -- 172.21.15.12:0/301430645 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4340673a0 con 0x7fb4340c1950 2023-10-16T23:28:22.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.964+0000 7fb42affd640 1 -- 172.21.15.12:0/301430645 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fb42c0b8b90 con 0x7fb4340c1950 2023-10-16T23:28:22.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.964+0000 7fb42affd640 1 --2- 172.21.15.12:0/301430645 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb418065e60 0x7fb418068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:22.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.964+0000 7fb42affd640 1 -- 172.21.15.12:0/301430645 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb42c11ef70 con 0x7fb4340c1950 2023-10-16T23:28:22.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.964+0000 7fb43a06b640 1 --2- 172.21.15.12:0/301430645 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb418065e60 0x7fb418068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:22.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.964+0000 7fb43a06b640 1 --2- 172.21.15.12:0/301430645 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb418065e60 0x7fb418068320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb43000a970 tx=0x7fb430008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:22.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:22.968+0000 7fb42affd640 1 -- 172.21.15.12:0/301430645 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fb42c0ec690 con 0x7fb4340c1950 2023-10-16T23:28:23.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.124+0000 7fb43c2cf640 1 -- 172.21.15.12:0/301430645 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb43414c740 con 0x7fb4340c1950 2023-10-16T23:28:23.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.128+0000 7fb42affd640 1 -- 172.21.15.12:0/301430645 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17857 (secure 0 0 0) 0x7fb42c0efcb0 con 0x7fb4340c1950 2023-10-16T23:28:23.131 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:28:23.131 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":25,"fsid":"0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51","created":"2023-10-16T23:27:16.468087+0000","modified":"2023-10-16T23:28:22.229319+0000","last_up_change":"2023-10-16T23:27:28.136202+0000","last_in_change":"2023-10-16T23:27:18.793212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T23:27:27.354025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-16T23:27:34.786446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-16T23:27:39.130341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-16T23:27:39.674572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73e70f98-6f5e-4464-b34e-931faac41cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":38075},{"type":"v1","addr":"172.21.15.12:6814","nonce":38075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":38075},{"type":"v1","addr":"172.21.15.12:6819","nonce":38075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":38075},{"type":"v1","addr":"172.21.15.12:6827","nonce":38075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":38075},{"type":"v1","addr":"172.21.15.12:6823","nonce":38075}]},"public_addr":"172.21.15.12:6814/38075","cluster_addr":"172.21.15.12:6819/38075","heartbeat_back_addr":"172.21.15.12:6827/38075","heartbeat_front_addr":"172.21.15.12:6823/38075","state":["exists","up"]},{"osd":1,"uuid":"ff722efe-b3f9-4cc0-bbde-f4d4d8055a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":38076},{"type":"v1","addr":"172.21.15.12:6811","nonce":38076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":38076},{"type":"v1","addr":"172.21.15.12:6818","nonce":38076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":38076},{"type":"v1","addr":"172.21.15.12:6831","nonce":38076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":38076},{"type":"v1","addr":"172.21.15.12:6825","nonce":38076}]},"public_addr":"172.21.15.12:6811/38076","cluster_addr":"172.21.15.12:6818/38076","heartbeat_back_addr":"172.21.15.12:6831/38076","heartbeat_front_addr":"172.21.15.12:6825/38076","state":["exists","up"]},{"osd":2,"uuid":"9baf25db-dce0-4065-90d6-f35867286be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6809","nonce":38073},{"type":"v1","addr":"172.21.15.12:6810","nonce":38073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":38073},{"type":"v1","addr":"172.21.15.12:6817","nonce":38073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":38073},{"type":"v1","addr":"172.21.15.12:6830","nonce":38073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":38073},{"type":"v1","addr":"172.21.15.12:6826","nonce":38073}]},"public_addr":"172.21.15.12:6810/38073","cluster_addr":"172.21.15.12:6817/38073","heartbeat_back_addr":"172.21.15.12:6830/38073","heartbeat_front_addr":"172.21.15.12:6826/38073","state":["exists","up"]},{"osd":3,"uuid":"8a620ad3-2294-470d-8a8c-66f177f5fbe7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":38074},{"type":"v1","addr":"172.21.15.12:6801","nonce":38074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":38074},{"type":"v1","addr":"172.21.15.12:6803","nonce":38074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":38074},{"type":"v1","addr":"172.21.15.12:6807","nonce":38074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":38074},{"type":"v1","addr":"172.21.15.12:6805","nonce":38074}]},"public_addr":"172.21.15.12:6801/38074","cluster_addr":"172.21.15.12:6803/38074","heartbeat_back_addr":"172.21.15.12:6807/38074","heartbeat_front_addr":"172.21.15.12:6805/38074","state":["exists","up"]},{"osd":4,"uuid":"a8824d77-7405-40f5-9234-60889802b184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":38266},{"type":"v1","addr":"172.21.15.31:6817","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":38266},{"type":"v1","addr":"172.21.15.31:6819","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":38266},{"type":"v1","addr":"172.21.15.31:6823","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":38266},{"type":"v1","addr":"172.21.15.31:6821","nonce":38266}]},"public_addr":"172.21.15.31:6817/38266","cluster_addr":"172.21.15.31:6819/38266","heartbeat_back_addr":"172.21.15.31:6823/38266","heartbeat_front_addr":"172.21.15.31:6821/38266","state":["exists","up"]},{"osd":5,"uuid":"3bb01192-a47c-48e9-9662-285e3f6f4b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":38264},{"type":"v1","addr":"172.21.15.31:6807","nonce":38264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":38264},{"type":"v1","addr":"172.21.15.31:6811","nonce":38264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":38264},{"type":"v1","addr":"172.21.15.31:6815","nonce":38264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":38264},{"type":"v1","addr":"172.21.15.31:6813","nonce":38264}]},"public_addr":"172.21.15.31:6807/38264","cluster_addr":"172.21.15.31:6811/38264","heartbeat_back_addr":"172.21.15.31:6815/38264","heartbeat_front_addr":"172.21.15.31:6813/38264","state":["exists","up"]},{"osd":6,"uuid":"1e2d18e4-73e6-4a37-826c-35eca4d96935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":38263},{"type":"v1","addr":"172.21.15.31:6825","nonce":38263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":38263},{"type":"v1","addr":"172.21.15.31:6827","nonce":38263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":38263},{"type":"v1","addr":"172.21.15.31:6831","nonce":38263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":38263},{"type":"v1","addr":"172.21.15.31:6829","nonce":38263}]},"public_addr":"172.21.15.31:6825/38263","cluster_addr":"172.21.15.31:6827/38263","heartbeat_back_addr":"172.21.15.31:6831/38263","heartbeat_front_addr":"172.21.15.31:6829/38263","state":["exists","up"]},{"osd":7,"uuid":"e0f369c0-562b-4440-a5aa-12275c29412b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":38265},{"type":"v1","addr":"172.21.15.31:6801","nonce":38265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":38265},{"type":"v1","addr":"172.21.15.31:6803","nonce":38265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":38265},{"type":"v1","addr":"172.21.15.31:6810","nonce":38265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":38265},{"type":"v1","addr":"172.21.15.31:6806","nonce":38265}]},"public_addr":"172.21.15.31:6801/38265","cluster_addr":"172.21.15.31:6803/38265","heartbeat_back_addr":"172.21.15.31:6810/38265","heartbeat_front_addr":"172.21.15.31:6806/38265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.411815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.372565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.209700+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.414619+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.316843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.300348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.359800+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.219854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T23:28:23.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.128+0000 7fb43c2cf640 1 -- 172.21.15.12:0/301430645 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb418065e60 msgr2=0x7fb418068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:23.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.128+0000 7fb43c2cf640 1 --2- 172.21.15.12:0/301430645 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb418065e60 0x7fb418068320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb43000a970 tx=0x7fb430008040 comp rx=0 tx=0).stop 2023-10-16T23:28:23.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.128+0000 7fb43c2cf640 1 -- 172.21.15.12:0/301430645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4340c1950 msgr2=0x7fb434142d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:23.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.128+0000 7fb43c2cf640 1 --2- 172.21.15.12:0/301430645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4340c1950 0x7fb434142d50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb42c01d1a0 tx=0x7fb4340bf190 comp rx=0 tx=0).stop 2023-10-16T23:28:23.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.128+0000 7fb43c2cf640 1 -- 172.21.15.12:0/301430645 shutdown_connections 2023-10-16T23:28:23.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.128+0000 7fb43c2cf640 1 --2- 172.21.15.12:0/301430645 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb418065e60 0x7fb418068320 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.128+0000 7fb43c2cf640 1 --2- 172.21.15.12:0/301430645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4340c1950 0x7fb434142d50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.128+0000 7fb43c2cf640 1 --2- 172.21.15.12:0/301430645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4340bfc30 0x7fb4340bae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.128+0000 7fb43c2cf640 1 --2- 172.21.15.12:0/301430645 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb43406e770 0x7fb434146eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.128+0000 7fb43c2cf640 1 -- 172.21.15.12:0/301430645 >> 172.21.15.12:0/301430645 conn(0x7fb43406b5d0 msgr2=0x7fb43406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:23.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.128+0000 7fb43c2cf640 1 -- 172.21.15.12:0/301430645 shutdown_connections 2023-10-16T23:28:23.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.128+0000 7fb43c2cf640 1 -- 172.21.15.12:0/301430645 wait complete. 2023-10-16T23:28:23.149 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T23:27:27.354025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-16T23:27:34.786446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T23:27:39.130341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T23:27:39.674572+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T23:28:23.150 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T23:28:23.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.268+0000 7f3eb23d6640 1 Processor -- start 2023-10-16T23:28:23.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.268+0000 7f3eb23d6640 1 -- start start 2023-10-16T23:28:23.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.268+0000 7f3eb23d6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3eac0bcc90 0x7f3eac14c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:23.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.268+0000 7f3eb23d6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3eac0b9b40 0x7f3eac14cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:23.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.268+0000 7f3eb23d6640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eac06de10 con 0x7f3eac0bea50 2023-10-16T23:28:23.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.268+0000 7f3eb23d6640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eac0bc150 con 0x7f3eac0b9b40 2023-10-16T23:28:23.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.268+0000 7f3eb23d6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac0ba660 con 0x7f3eac0bcc90 2023-10-16T23:28:23.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.268+0000 7f3eb0973640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3eac0b9b40 0x7f3eac14cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:23.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.268+0000 7f3eb0973640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3eac0b9b40 0x7f3eac14cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33268/0 (socket says 172.21.15.12:33268) 2023-10-16T23:28:23.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.268+0000 7f3eb0973640 1 -- 172.21.15.12:0/420532303 learned_addr learned my addr 172.21.15.12:0/420532303 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:23.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.268+0000 7f3eab7fe640 1 --2- 172.21.15.12:0/420532303 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3eac0bcc90 0x7f3eac14c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:23.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.268+0000 7f3eb0973640 1 -- 172.21.15.12:0/420532303 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3eac0bcc90 msgr2=0x7f3eac14c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:23.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.268+0000 7f3eb0973640 1 --2- 172.21.15.12:0/420532303 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3eac0bcc90 0x7f3eac14c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.268+0000 7f3eb0973640 1 -- 172.21.15.12:0/420532303 >> v1:172.21.15.31:6789/0 conn(0x7f3eac0bea50 legacy=0x7f3eac0bc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:23.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.268+0000 7f3eb0973640 1 -- 172.21.15.12:0/420532303 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac0ba940 con 0x7f3eac0b9b40 2023-10-16T23:28:23.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb0973640 1 --2- 172.21.15.12:0/420532303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3eac0b9b40 0x7f3eac14cb10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009e50 tx=0x7f3ea401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368d41ed0d9210c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:23.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eaaffd640 1 -- 172.21.15.12:0/420532303 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea40a57d0 con 0x7f3eac0b9b40 2023-10-16T23:28:23.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eaaffd640 1 -- 172.21.15.12:0/420532303 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea40a5930 con 0x7f3eac0b9b40 2023-10-16T23:28:23.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eaaffd640 1 -- 172.21.15.12:0/420532303 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea40a5cc0 con 0x7f3eac0b9b40 2023-10-16T23:28:23.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb23d6640 1 -- 172.21.15.12:0/420532303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3eac0b9b40 msgr2=0x7f3eac14cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:23.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb23d6640 1 --2- 172.21.15.12:0/420532303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3eac0b9b40 0x7f3eac14cb10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009e50 tx=0x7f3ea401c980 comp rx=0 tx=0).stop 2023-10-16T23:28:23.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb23d6640 1 -- 172.21.15.12:0/420532303 shutdown_connections 2023-10-16T23:28:23.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb23d6640 1 --2- 172.21.15.12:0/420532303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3eac0b9b40 0x7f3eac14cb10 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb23d6640 1 --2- 172.21.15.12:0/420532303 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3eac0bcc90 0x7f3eac14c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb23d6640 1 -- 172.21.15.12:0/420532303 >> 172.21.15.12:0/420532303 conn(0x7f3eac0c2a70 msgr2=0x7f3eac0c2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:23.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb23d6640 1 -- 172.21.15.12:0/420532303 shutdown_connections 2023-10-16T23:28:23.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb23d6640 1 -- 172.21.15.12:0/420532303 wait complete. 2023-10-16T23:28:23.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb23d6640 1 Processor -- start 2023-10-16T23:28:23.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb23d6640 1 -- start start 2023-10-16T23:28:23.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb23d6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3eac0b9b40 0x7f3eac0b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:23.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb23d6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3eac0bcc90 0x7f3eac13e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:23.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb23d6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3eac0bea50 0x7f3eac1e8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:23.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb23d6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac14b8f0 con 0x7f3eac0bea50 2023-10-16T23:28:23.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb23d6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac1e6090 con 0x7f3eac0b9b40 2023-10-16T23:28:23.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb23d6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac14b400 con 0x7f3eac0bcc90 2023-10-16T23:28:23.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb0973640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3eac0bea50 0x7f3eac1e8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:23.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb0973640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3eac0bea50 0x7f3eac1e8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33278/0 (socket says 172.21.15.12:33278) 2023-10-16T23:28:23.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb0973640 1 -- 172.21.15.12:0/1553188661 learned_addr learned my addr 172.21.15.12:0/1553188661 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:23.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eab7fe640 1 --2- 172.21.15.12:0/1553188661 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3eac0bcc90 0x7f3eac13e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:23.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eabfff640 1 --2- 172.21.15.12:0/1553188661 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3eac0b9b40 0x7f3eac0b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:23.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb0973640 1 -- 172.21.15.12:0/1553188661 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3eac0bcc90 msgr2=0x7f3eac13e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:23.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb0973640 1 --2- 172.21.15.12:0/1553188661 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3eac0bcc90 0x7f3eac13e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb0973640 1 -- 172.21.15.12:0/1553188661 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3eac0b9b40 msgr2=0x7f3eac0b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:23.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb0973640 1 --2- 172.21.15.12:0/1553188661 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3eac0b9b40 0x7f3eac0b8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb0973640 1 -- 172.21.15.12:0/1553188661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea4009b30 con 0x7f3eac0bea50 2023-10-16T23:28:23.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eab7fe640 1 --2- 172.21.15.12:0/1553188661 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3eac0bcc90 0x7f3eac13e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:23.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eabfff640 1 --2- 172.21.15.12:0/1553188661 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3eac0b9b40 0x7f3eac0b8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:23.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb0973640 1 --2- 172.21.15.12:0/1553188661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3eac0bea50 0x7f3eac1e8810 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3ea40af040 tx=0x7f3ea4019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:23.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3ea8ff9640 1 -- 172.21.15.12:0/1553188661 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea40b8880 con 0x7f3eac0bea50 2023-10-16T23:28:23.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3ea8ff9640 1 -- 172.21.15.12:0/1553188661 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea40b89e0 con 0x7f3eac0bea50 2023-10-16T23:28:23.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb23d6640 1 -- 172.21.15.12:0/1553188661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eac0b9010 con 0x7f3eac0bea50 2023-10-16T23:28:23.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3ea8ff9640 1 -- 172.21.15.12:0/1553188661 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea40b8d90 con 0x7f3eac0bea50 2023-10-16T23:28:23.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.272+0000 7f3eb23d6640 1 -- 172.21.15.12:0/1553188661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eac14b040 con 0x7f3eac0bea50 2023-10-16T23:28:23.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.276+0000 7f3eb23d6640 1 -- 172.21.15.12:0/1553188661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eac14b5c0 con 0x7f3eac0bea50 2023-10-16T23:28:23.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.276+0000 7f3ea8ff9640 1 -- 172.21.15.12:0/1553188661 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f3ea40b6440 con 0x7f3eac0bea50 2023-10-16T23:28:23.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.276+0000 7f3ea8ff9640 1 --2- 172.21.15.12:0/1553188661 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3e98065e60 0x7f3e98068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:23.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.276+0000 7f3ea8ff9640 1 -- 172.21.15.12:0/1553188661 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3ea411efa0 con 0x7f3eac0bea50 2023-10-16T23:28:23.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.276+0000 7f3eabfff640 1 --2- 172.21.15.12:0/1553188661 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3e98065e60 0x7f3e98068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:23.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.276+0000 7f3eabfff640 1 --2- 172.21.15.12:0/1553188661 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3e98065e60 0x7f3e98068320 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3eac0be4a0 tx=0x7f3ea0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:23.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.280+0000 7f3ea8ff9640 1 -- 172.21.15.12:0/1553188661 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f3ea40ec5c0 con 0x7f3eac0bea50 2023-10-16T23:28:23.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.428+0000 7f3eb23d6640 1 -- 172.21.15.12:0/1553188661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3eac0673a0 con 0x7f3eac0bea50 2023-10-16T23:28:23.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.432+0000 7f3ea8ff9640 1 -- 172.21.15.12:0/1553188661 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3ea40efbe0 con 0x7f3eac0bea50 2023-10-16T23:28:23.436 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-16T23:28:23.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.436+0000 7f3eb23d6640 1 -- 172.21.15.12:0/1553188661 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3e98065e60 msgr2=0x7f3e98068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:23.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.436+0000 7f3eb23d6640 1 --2- 172.21.15.12:0/1553188661 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3e98065e60 0x7f3e98068320 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3eac0be4a0 tx=0x7f3ea0009040 comp rx=0 tx=0).stop 2023-10-16T23:28:23.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.436+0000 7f3eb23d6640 1 -- 172.21.15.12:0/1553188661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3eac0bea50 msgr2=0x7f3eac1e8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:23.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.436+0000 7f3eb23d6640 1 --2- 172.21.15.12:0/1553188661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3eac0bea50 0x7f3eac1e8810 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3ea40af040 tx=0x7f3ea4019720 comp rx=0 tx=0).stop 2023-10-16T23:28:23.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.436+0000 7f3eb23d6640 1 -- 172.21.15.12:0/1553188661 shutdown_connections 2023-10-16T23:28:23.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.436+0000 7f3eb23d6640 1 --2- 172.21.15.12:0/1553188661 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f3e98065e60 0x7f3e98068320 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.436+0000 7f3eb23d6640 1 --2- 172.21.15.12:0/1553188661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3eac0bea50 0x7f3eac1e8810 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.436+0000 7f3eb23d6640 1 --2- 172.21.15.12:0/1553188661 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3eac0bcc90 0x7f3eac13e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.436+0000 7f3eb23d6640 1 --2- 172.21.15.12:0/1553188661 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3eac0b9b40 0x7f3eac0b8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.436+0000 7f3eb23d6640 1 -- 172.21.15.12:0/1553188661 >> 172.21.15.12:0/1553188661 conn(0x7f3eac0c2a70 msgr2=0x7f3eac147e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:23.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.436+0000 7f3eb23d6640 1 -- 172.21.15.12:0/1553188661 shutdown_connections 2023-10-16T23:28:23.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.436+0000 7f3eb23d6640 1 -- 172.21.15.12:0/1553188661 wait complete. 2023-10-16T23:28:23.453 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-16T23:28:23.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.576+0000 7f2a1c169640 1 Processor -- start 2023-10-16T23:28:23.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.576+0000 7f2a1c169640 1 -- start start 2023-10-16T23:28:23.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.576+0000 7f2a1c169640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2a14070e20 0x7f2a1414f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:23.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.576+0000 7f2a1c169640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a140c1040 0x7f2a140baf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:23.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.576+0000 7f2a1c169640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a1414feb0 con 0x7f2a1406ed20 2023-10-16T23:28:23.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.576+0000 7f2a1c169640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a1414bb00 con 0x7f2a14070e20 2023-10-16T23:28:23.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.576+0000 7f2a1c169640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1414bda0 con 0x7f2a140c1040 2023-10-16T23:28:23.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.576+0000 7f2a19f05640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2a14070e20 0x7f2a1414f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:23.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.576+0000 7f2a19f05640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2a14070e20 0x7f2a1414f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33292/0 (socket says 172.21.15.12:33292) 2023-10-16T23:28:23.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.576+0000 7f2a19f05640 1 -- 172.21.15.12:0/2808699237 learned_addr learned my addr 172.21.15.12:0/2808699237 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:23.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.576+0000 7f2a1a706640 1 --2- 172.21.15.12:0/2808699237 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a140c1040 0x7f2a140baf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:23.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.576+0000 7f2a19f05640 1 -- 172.21.15.12:0/2808699237 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a140c1040 msgr2=0x7f2a140baf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:23.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.576+0000 7f2a19f05640 1 --2- 172.21.15.12:0/2808699237 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a140c1040 0x7f2a140baf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.576+0000 7f2a19f05640 1 -- 172.21.15.12:0/2808699237 >> v1:172.21.15.31:6789/0 conn(0x7f2a1406ed20 legacy=0x7f2a1414c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:23.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.576+0000 7f2a19f05640 1 -- 172.21.15.12:0/2808699237 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1414c080 con 0x7f2a14070e20 2023-10-16T23:28:23.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.576+0000 7f2a19f05640 1 --2- 172.21.15.12:0/2808699237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a14070e20 0x7f2a1414f970 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2a10009870 tx=0x7f2a1001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a87651353ef78a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:23.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a18f03640 1 -- 172.21.15.12:0/2808699237 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a100ab600 con 0x7f2a14070e20 2023-10-16T23:28:23.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a18f03640 1 -- 172.21.15.12:0/2808699237 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a100a7050 con 0x7f2a14070e20 2023-10-16T23:28:23.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a18f03640 1 -- 172.21.15.12:0/2808699237 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a100ab980 con 0x7f2a14070e20 2023-10-16T23:28:23.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a1c169640 1 -- 172.21.15.12:0/2808699237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a14070e20 msgr2=0x7f2a1414f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:23.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a1c169640 1 --2- 172.21.15.12:0/2808699237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a14070e20 0x7f2a1414f970 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2a10009870 tx=0x7f2a1001c4b0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a1c169640 1 -- 172.21.15.12:0/2808699237 shutdown_connections 2023-10-16T23:28:23.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a1c169640 1 --2- 172.21.15.12:0/2808699237 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a140c1040 0x7f2a140baf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a1c169640 1 --2- 172.21.15.12:0/2808699237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a14070e20 0x7f2a1414f970 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a1c169640 1 -- 172.21.15.12:0/2808699237 >> 172.21.15.12:0/2808699237 conn(0x7f2a1406bb10 msgr2=0x7f2a140c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:23.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a1c169640 1 -- 172.21.15.12:0/2808699237 shutdown_connections 2023-10-16T23:28:23.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a1c169640 1 -- 172.21.15.12:0/2808699237 wait complete. 2023-10-16T23:28:23.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a1c169640 1 Processor -- start 2023-10-16T23:28:23.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a1c169640 1 -- start start 2023-10-16T23:28:23.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a1c169640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a1406ed20 0x7f2a14143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:23.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a1c169640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a14070e20 0x7f2a141e8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:23.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a1c169640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a140c1040 0x7f2a141e90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:23.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a1c169640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a140b4d60 con 0x7f2a1406ed20 2023-10-16T23:28:23.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a1c169640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a140b46f0 con 0x7f2a140c1040 2023-10-16T23:28:23.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a1c169640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a14144520 con 0x7f2a14070e20 2023-10-16T23:28:23.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a19f05640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a1406ed20 0x7f2a14143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:23.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a19f05640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a1406ed20 0x7f2a14143fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33308/0 (socket says 172.21.15.12:33308) 2023-10-16T23:28:23.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a19f05640 1 -- 172.21.15.12:0/1884387729 learned_addr learned my addr 172.21.15.12:0/1884387729 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:23.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a19704640 1 --2- 172.21.15.12:0/1884387729 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a14070e20 0x7f2a141e8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:23.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a1a706640 1 --2- 172.21.15.12:0/1884387729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a140c1040 0x7f2a141e90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:23.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a19f05640 1 -- 172.21.15.12:0/1884387729 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a14070e20 msgr2=0x7f2a141e8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:23.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a19f05640 1 --2- 172.21.15.12:0/1884387729 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a14070e20 0x7f2a141e8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a19f05640 1 -- 172.21.15.12:0/1884387729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a140c1040 msgr2=0x7f2a141e90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:23.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a19f05640 1 --2- 172.21.15.12:0/1884387729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a140c1040 0x7f2a141e90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a19f05640 1 -- 172.21.15.12:0/1884387729 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a100094d0 con 0x7f2a1406ed20 2023-10-16T23:28:23.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a19704640 1 --2- 172.21.15.12:0/1884387729 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a14070e20 0x7f2a141e8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:23.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a1a706640 1 --2- 172.21.15.12:0/1884387729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a140c1040 0x7f2a141e90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:23.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a19f05640 1 --2- 172.21.15.12:0/1884387729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a1406ed20 0x7f2a14143fe0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2a100ae040 tx=0x7f2a1001acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:23.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a0a7fc640 1 -- 172.21.15.12:0/1884387729 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a100b6620 con 0x7f2a1406ed20 2023-10-16T23:28:23.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a0a7fc640 1 -- 172.21.15.12:0/1884387729 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a100abe90 con 0x7f2a1406ed20 2023-10-16T23:28:23.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a1c169640 1 -- 172.21.15.12:0/1884387729 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a140b40a0 con 0x7f2a1406ed20 2023-10-16T23:28:23.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a0a7fc640 1 -- 172.21.15.12:0/1884387729 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a100b69e0 con 0x7f2a1406ed20 2023-10-16T23:28:23.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.580+0000 7f2a1c169640 1 -- 172.21.15.12:0/1884387729 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a14143a30 con 0x7f2a1406ed20 2023-10-16T23:28:23.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.584+0000 7f2a1c169640 1 -- 172.21.15.12:0/1884387729 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a141e55a0 con 0x7f2a1406ed20 2023-10-16T23:28:23.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.584+0000 7f2a0a7fc640 1 -- 172.21.15.12:0/1884387729 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f2a100b2040 con 0x7f2a1406ed20 2023-10-16T23:28:23.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.584+0000 7f2a0a7fc640 1 --2- 172.21.15.12:0/1884387729 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f29f8065e60 0x7f29f8068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:23.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.584+0000 7f2a0a7fc640 1 -- 172.21.15.12:0/1884387729 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2a1011dcf0 con 0x7f2a1406ed20 2023-10-16T23:28:23.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.584+0000 7f2a19704640 1 --2- 172.21.15.12:0/1884387729 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f29f8065e60 0x7f29f8068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.584+0000 7f2a19704640 1 --2- 172.21.15.12:0/1884387729 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f29f8065e60 0x7f29f8068320 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2a1414b7e0 tx=0x7f2a04009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:23.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.588+0000 7f2a0a7fc640 1 -- 172.21.15.12:0/1884387729 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f2a10122070 con 0x7f2a1406ed20 2023-10-16T23:28:23.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.748+0000 7f2a1c169640 1 -- 172.21.15.12:0/1884387729 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2a140673a0 con 0x7f2a1406ed20 2023-10-16T23:28:23.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.752+0000 7f2a0a7fc640 1 -- 172.21.15.12:0/1884387729 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2a100eb300 con 0x7f2a1406ed20 2023-10-16T23:28:23.754 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-10-16T23:28:23.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.752+0000 7f2a1c169640 1 -- 172.21.15.12:0/1884387729 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f29f8065e60 msgr2=0x7f29f8068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:23.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.752+0000 7f2a1c169640 1 --2- 172.21.15.12:0/1884387729 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f29f8065e60 0x7f29f8068320 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2a1414b7e0 tx=0x7f2a04009040 comp rx=0 tx=0).stop 2023-10-16T23:28:23.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.752+0000 7f2a1c169640 1 -- 172.21.15.12:0/1884387729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a1406ed20 msgr2=0x7f2a14143fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:23.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.752+0000 7f2a1c169640 1 --2- 172.21.15.12:0/1884387729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a1406ed20 0x7f2a14143fe0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2a100ae040 tx=0x7f2a1001acf0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.752+0000 7f2a1c169640 1 -- 172.21.15.12:0/1884387729 shutdown_connections 2023-10-16T23:28:23.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.752+0000 7f2a1c169640 1 --2- 172.21.15.12:0/1884387729 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f29f8065e60 0x7f29f8068320 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.752+0000 7f2a1c169640 1 --2- 172.21.15.12:0/1884387729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a140c1040 0x7f2a141e90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.752+0000 7f2a1c169640 1 --2- 172.21.15.12:0/1884387729 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a14070e20 0x7f2a141e8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.752+0000 7f2a1c169640 1 --2- 172.21.15.12:0/1884387729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a1406ed20 0x7f2a14143fe0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.752+0000 7f2a1c169640 1 -- 172.21.15.12:0/1884387729 >> 172.21.15.12:0/1884387729 conn(0x7f2a1406bb10 msgr2=0x7f2a140ba0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:23.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.752+0000 7f2a1c169640 1 -- 172.21.15.12:0/1884387729 shutdown_connections 2023-10-16T23:28:23.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.752+0000 7f2a1c169640 1 -- 172.21.15.12:0/1884387729 wait complete. 2023-10-16T23:28:23.773 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T23:28:23.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.892+0000 7fb631897640 1 Processor -- start 2023-10-16T23:28:23.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.892+0000 7fb631897640 1 -- start start 2023-10-16T23:28:23.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.892+0000 7fb631897640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb62c14cad0 0x7fb62c0b9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:23.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.892+0000 7fb631897640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb62c14fd80 0x7fb62c0bd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:23.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.892+0000 7fb631897640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb62c1502d0 con 0x7fb62c06d080 2023-10-16T23:28:23.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.892+0000 7fb631897640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb62c0700d0 con 0x7fb62c14fd80 2023-10-16T23:28:23.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.892+0000 7fb631897640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb62c06fcf0 con 0x7fb62c14cad0 2023-10-16T23:28:23.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.892+0000 7fb62b7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb62c14fd80 0x7fb62c0bd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:23.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.892+0000 7fb62affd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb62c06d080 0x7fb62c14c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48148/0 (socket says 172.21.15.12:48148) 2023-10-16T23:28:23.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.892+0000 7fb62affd640 1 -- 172.21.15.12:0/2842265973 learned_addr learned my addr 172.21.15.12:0/2842265973 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:23.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.892+0000 7fb623fff640 1 --2- 172.21.15.12:0/2842265973 >> v2:172.21.15.31:3300/0 conn(0x7fb62c14cad0 0x7fb62c0b9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:23.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.892+0000 7fb62a7fc640 1 -- 172.21.15.12:0/2842265973 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425813739 0 0) 0x7fb62c1502d0 con 0x7fb62c06d080 2023-10-16T23:28:23.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.892+0000 7fb62a7fc640 1 -- 172.21.15.12:0/2842265973 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb618003530 con 0x7fb62c06d080 2023-10-16T23:28:23.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.892+0000 7fb62b7fe640 1 -- 172.21.15.12:0/2842265973 >> v2:172.21.15.31:3300/0 conn(0x7fb62c14cad0 msgr2=0x7fb62c0b9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:23.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.892+0000 7fb62b7fe640 1 --2- 172.21.15.12:0/2842265973 >> v2:172.21.15.31:3300/0 conn(0x7fb62c14cad0 0x7fb62c0b9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.892+0000 7fb62b7fe640 1 -- 172.21.15.12:0/2842265973 >> v1:172.21.15.12:6789/0 conn(0x7fb62c06d080 legacy=0x7fb62c14c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:23.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.892+0000 7fb62b7fe640 1 -- 172.21.15.12:0/2842265973 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c06dda0 con 0x7fb62c14fd80 2023-10-16T23:28:23.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.896+0000 7fb62b7fe640 1 --2- 172.21.15.12:0/2842265973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb62c14fd80 0x7fb62c0bd1a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0b9330 tx=0x7fb62401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761004bc530f9556 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:23.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.896+0000 7fb62a7fc640 1 -- 172.21.15.12:0/2842265973 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6240a5960 con 0x7fb62c14fd80 2023-10-16T23:28:23.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.896+0000 7fb62a7fc640 1 -- 172.21.15.12:0/2842265973 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6240a5ac0 con 0x7fb62c14fd80 2023-10-16T23:28:23.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.896+0000 7fb62a7fc640 1 -- 172.21.15.12:0/2842265973 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6240a5e50 con 0x7fb62c14fd80 2023-10-16T23:28:23.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.896+0000 7fb631897640 1 -- 172.21.15.12:0/2842265973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb62c14fd80 msgr2=0x7fb62c0bd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:23.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.896+0000 7fb631897640 1 --2- 172.21.15.12:0/2842265973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb62c14fd80 0x7fb62c0bd1a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0b9330 tx=0x7fb62401c880 comp rx=0 tx=0).stop 2023-10-16T23:28:23.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.896+0000 7fb631897640 1 -- 172.21.15.12:0/2842265973 shutdown_connections 2023-10-16T23:28:23.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.896+0000 7fb631897640 1 --2- 172.21.15.12:0/2842265973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb62c14fd80 0x7fb62c0bd1a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.896+0000 7fb631897640 1 --2- 172.21.15.12:0/2842265973 >> v2:172.21.15.31:3300/0 conn(0x7fb62c14cad0 0x7fb62c0b9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.896+0000 7fb631897640 1 -- 172.21.15.12:0/2842265973 >> 172.21.15.12:0/2842265973 conn(0x7fb62c0c2a70 msgr2=0x7fb62c0c2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:23.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.896+0000 7fb631897640 1 -- 172.21.15.12:0/2842265973 shutdown_connections 2023-10-16T23:28:23.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.896+0000 7fb631897640 1 -- 172.21.15.12:0/2842265973 wait complete. 2023-10-16T23:28:23.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.896+0000 7fb631897640 1 Processor -- start 2023-10-16T23:28:23.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.896+0000 7fb631897640 1 -- start start 2023-10-16T23:28:23.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb631897640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb62c06d080 0x7fb62c146c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:23.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb631897640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb62c14cad0 0x7fb62c140640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:23.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb631897640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb62c14fd80 0x7fb62c140b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:23.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb631897640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c152cd0 con 0x7fb62c14cad0 2023-10-16T23:28:23.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb631897640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c14d2d0 con 0x7fb62c06d080 2023-10-16T23:28:23.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb631897640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c1471a0 con 0x7fb62c14fd80 2023-10-16T23:28:23.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb623fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb62c14cad0 0x7fb62c140640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:23.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb623fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb62c14cad0 0x7fb62c140640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33322/0 (socket says 172.21.15.12:33322) 2023-10-16T23:28:23.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb623fff640 1 -- 172.21.15.12:0/4083537561 learned_addr learned my addr 172.21.15.12:0/4083537561 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:23.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb62b7fe640 1 --2- 172.21.15.12:0/4083537561 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb62c14fd80 0x7fb62c140b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:23.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb62affd640 1 --2- 172.21.15.12:0/4083537561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb62c06d080 0x7fb62c146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:23.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb623fff640 1 -- 172.21.15.12:0/4083537561 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb62c14fd80 msgr2=0x7fb62c140b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:23.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb623fff640 1 --2- 172.21.15.12:0/4083537561 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb62c14fd80 0x7fb62c140b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb623fff640 1 -- 172.21.15.12:0/4083537561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb62c06d080 msgr2=0x7fb62c146c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:23.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb623fff640 1 --2- 172.21.15.12:0/4083537561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb62c06d080 0x7fb62c146c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:23.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb623fff640 1 -- 172.21.15.12:0/4083537561 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb624009a70 con 0x7fb62c14cad0 2023-10-16T23:28:23.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb62affd640 1 --2- 172.21.15.12:0/4083537561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb62c06d080 0x7fb62c146c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:23.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb623fff640 1 --2- 172.21.15.12:0/4083537561 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb62c14cad0 0x7fb62c140640 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb61400e990 tx=0x7fb61400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:23.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb628ff9640 1 -- 172.21.15.12:0/4083537561 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb614009690 con 0x7fb62c14cad0 2023-10-16T23:28:23.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb628ff9640 1 -- 172.21.15.12:0/4083537561 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61400c980 con 0x7fb62c14cad0 2023-10-16T23:28:23.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb628ff9640 1 -- 172.21.15.12:0/4083537561 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61400ccf0 con 0x7fb62c14cad0 2023-10-16T23:28:23.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb631897640 1 -- 172.21.15.12:0/4083537561 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb62c152f20 con 0x7fb62c14cad0 2023-10-16T23:28:23.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb631897640 1 -- 172.21.15.12:0/4083537561 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62c1508b0 con 0x7fb62c14cad0 2023-10-16T23:28:23.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb631897640 1 -- 172.21.15.12:0/4083537561 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62c0673a0 con 0x7fb62c14cad0 2023-10-16T23:28:23.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb628ff9640 1 -- 172.21.15.12:0/4083537561 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fb614013470 con 0x7fb62c14cad0 2023-10-16T23:28:23.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb628ff9640 1 --2- 172.21.15.12:0/4083537561 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb60c065e90 0x7fb60c068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:23.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.900+0000 7fb628ff9640 1 -- 172.21.15.12:0/4083537561 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb614083980 con 0x7fb62c14cad0 2023-10-16T23:28:23.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.904+0000 7fb62affd640 1 --2- 172.21.15.12:0/4083537561 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb60c065e90 0x7fb60c068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:23.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.904+0000 7fb62affd640 1 --2- 172.21.15.12:0/4083537561 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb60c065e90 0x7fb60c068350 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb61c005890 tx=0x7fb61c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:23.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:23.908+0000 7fb628ff9640 1 -- 172.21.15.12:0/4083537561 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fb614051020 con 0x7fb62c14cad0 2023-10-16T23:28:24.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.060+0000 7fb631897640 1 -- 172.21.15.12:0/4083537561 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb62c14d410 con 0x7fb62c14cad0 2023-10-16T23:28:24.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.060+0000 7fb628ff9640 1 -- 172.21.15.12:0/4083537561 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb614017020 con 0x7fb62c14cad0 2023-10-16T23:28:24.064 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-16T23:28:24.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.064+0000 7fb631897640 1 -- 172.21.15.12:0/4083537561 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb60c065e90 msgr2=0x7fb60c068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:24.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.064+0000 7fb631897640 1 --2- 172.21.15.12:0/4083537561 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb60c065e90 0x7fb60c068350 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb61c005890 tx=0x7fb61c009040 comp rx=0 tx=0).stop 2023-10-16T23:28:24.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.064+0000 7fb631897640 1 -- 172.21.15.12:0/4083537561 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb62c14cad0 msgr2=0x7fb62c140640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:24.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.064+0000 7fb631897640 1 --2- 172.21.15.12:0/4083537561 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb62c14cad0 0x7fb62c140640 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb61400e990 tx=0x7fb61400ee50 comp rx=0 tx=0).stop 2023-10-16T23:28:24.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.064+0000 7fb631897640 1 -- 172.21.15.12:0/4083537561 shutdown_connections 2023-10-16T23:28:24.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.064+0000 7fb631897640 1 --2- 172.21.15.12:0/4083537561 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb60c065e90 0x7fb60c068350 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.064+0000 7fb631897640 1 --2- 172.21.15.12:0/4083537561 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb62c14fd80 0x7fb62c140b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.064+0000 7fb631897640 1 --2- 172.21.15.12:0/4083537561 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb62c14cad0 0x7fb62c140640 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.064+0000 7fb631897640 1 --2- 172.21.15.12:0/4083537561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb62c06d080 0x7fb62c146c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.064+0000 7fb631897640 1 -- 172.21.15.12:0/4083537561 >> 172.21.15.12:0/4083537561 conn(0x7fb62c0c2a70 msgr2=0x7fb62c06e430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:24.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.064+0000 7fb631897640 1 -- 172.21.15.12:0/4083537561 shutdown_connections 2023-10-16T23:28:24.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.064+0000 7fb631897640 1 -- 172.21.15.12:0/4083537561 wait complete. 2023-10-16T23:28:24.084 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T23:28:24.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.204+0000 7fd27f5ca640 1 Processor -- start 2023-10-16T23:28:24.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.204+0000 7fd27f5ca640 1 -- start start 2023-10-16T23:28:24.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.208+0000 7fd27f5ca640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd278070800 0x7fd2780bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:24.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.208+0000 7fd27f5ca640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd278153580 con 0x7fd2780c12a0 2023-10-16T23:28:24.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.208+0000 7fd27f5ca640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd278153860 con 0x7fd2780b3f70 2023-10-16T23:28:24.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.208+0000 7fd27f5ca640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2780c1680 con 0x7fd278070800 2023-10-16T23:28:24.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.208+0000 7fd27d366640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd2780c12a0 0x7fd27814e950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48150/0 (socket says 172.21.15.12:48150) 2023-10-16T23:28:24.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.208+0000 7fd27d366640 1 -- 172.21.15.12:0/1549818245 learned_addr learned my addr 172.21.15.12:0/1549818245 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:24.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.208+0000 7fd27cb65640 1 --2- 172.21.15.12:0/1549818245 >> v2:172.21.15.12:3300/0 conn(0x7fd278070800 0x7fd2780bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.208+0000 7fd277fff640 1 -- 172.21.15.12:0/1549818245 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 599395670 0 0) 0x7fd278153580 con 0x7fd2780c12a0 2023-10-16T23:28:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.208+0000 7fd27cb65640 1 -- 172.21.15.12:0/1549818245 >> v1:172.21.15.31:6789/0 conn(0x7fd2780b3f70 legacy=0x7fd27806efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.208+0000 7fd27cb65640 1 -- 172.21.15.12:0/1549818245 >> v1:172.21.15.12:6789/0 conn(0x7fd2780c12a0 legacy=0x7fd27814e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.208+0000 7fd27cb65640 1 -- 172.21.15.12:0/1549818245 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2780c17c0 con 0x7fd278070800 2023-10-16T23:28:24.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.208+0000 7fd27cb65640 1 --2- 172.21.15.12:0/1549818245 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd278070800 0x7fd2780bcc80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd26c009d90 tx=0x7fd26c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec9ef449bd08eb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:24.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.208+0000 7fd277fff640 1 -- 172.21.15.12:0/1549818245 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c0a5920 con 0x7fd278070800 2023-10-16T23:28:24.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.208+0000 7fd277fff640 1 -- 172.21.15.12:0/1549818245 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26c0a5a80 con 0x7fd278070800 2023-10-16T23:28:24.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.208+0000 7fd277fff640 1 -- 172.21.15.12:0/1549818245 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c0a5e10 con 0x7fd278070800 2023-10-16T23:28:24.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27f5ca640 1 -- 172.21.15.12:0/1549818245 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd278070800 msgr2=0x7fd2780bcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:24.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27f5ca640 1 --2- 172.21.15.12:0/1549818245 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd278070800 0x7fd2780bcc80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd26c009d90 tx=0x7fd26c01c950 comp rx=0 tx=0).stop 2023-10-16T23:28:24.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27f5ca640 1 -- 172.21.15.12:0/1549818245 shutdown_connections 2023-10-16T23:28:24.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27f5ca640 1 --2- 172.21.15.12:0/1549818245 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd278070800 0x7fd2780bcc80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27f5ca640 1 -- 172.21.15.12:0/1549818245 >> 172.21.15.12:0/1549818245 conn(0x7fd27806bb10 msgr2=0x7fd2780c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:24.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27f5ca640 1 -- 172.21.15.12:0/1549818245 shutdown_connections 2023-10-16T23:28:24.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27f5ca640 1 -- 172.21.15.12:0/1549818245 wait complete. 2023-10-16T23:28:24.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27f5ca640 1 Processor -- start 2023-10-16T23:28:24.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27f5ca640 1 -- start start 2023-10-16T23:28:24.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27f5ca640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd278070800 0x7fd278140e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:24.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27f5ca640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2780b3f70 0x7fd27813bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:24.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27f5ca640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2780c12a0 0x7fd2781496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:24.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27f5ca640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27814a2e0 con 0x7fd2780b3f70 2023-10-16T23:28:24.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27f5ca640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd278148e00 con 0x7fd2780c12a0 2023-10-16T23:28:24.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27f5ca640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd278141360 con 0x7fd278070800 2023-10-16T23:28:24.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27cb65640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2780b3f70 0x7fd27813bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:24.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27cb65640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2780b3f70 0x7fd27813bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33344/0 (socket says 172.21.15.12:33344) 2023-10-16T23:28:24.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27cb65640 1 -- 172.21.15.12:0/3819281272 learned_addr learned my addr 172.21.15.12:0/3819281272 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:24.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27d366640 1 --2- 172.21.15.12:0/3819281272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd278070800 0x7fd278140e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:24.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27db67640 1 --2- 172.21.15.12:0/3819281272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2780c12a0 0x7fd2781496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:24.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27cb65640 1 -- 172.21.15.12:0/3819281272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd278070800 msgr2=0x7fd278140e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:24.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27cb65640 1 --2- 172.21.15.12:0/3819281272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd278070800 0x7fd278140e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27cb65640 1 -- 172.21.15.12:0/3819281272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2780c12a0 msgr2=0x7fd2781496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:24.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27cb65640 1 --2- 172.21.15.12:0/3819281272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2780c12a0 0x7fd2781496a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27cb65640 1 -- 172.21.15.12:0/3819281272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26c009a70 con 0x7fd2780b3f70 2023-10-16T23:28:24.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27d366640 1 --2- 172.21.15.12:0/3819281272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd278070800 0x7fd278140e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:24.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27db67640 1 --2- 172.21.15.12:0/3819281272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2780c12a0 0x7fd2781496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:24.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27cb65640 1 --2- 172.21.15.12:0/3819281272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2780b3f70 0x7fd27813bdb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd26c0b0040 tx=0x7fd26c0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:24.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd275ffb640 1 -- 172.21.15.12:0/3819281272 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c0b7600 con 0x7fd2780b3f70 2023-10-16T23:28:24.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd275ffb640 1 -- 172.21.15.12:0/3819281272 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26c0b7760 con 0x7fd2780b3f70 2023-10-16T23:28:24.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27f5ca640 1 -- 172.21.15.12:0/3819281272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27814a530 con 0x7fd2780b3f70 2023-10-16T23:28:24.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd275ffb640 1 -- 172.21.15.12:0/3819281272 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c0b7b10 con 0x7fd2780b3f70 2023-10-16T23:28:24.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.212+0000 7fd27f5ca640 1 -- 172.21.15.12:0/3819281272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd278140410 con 0x7fd2780b3f70 2023-10-16T23:28:24.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.216+0000 7fd27f5ca640 1 -- 172.21.15.12:0/3819281272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd278148f90 con 0x7fd2780b3f70 2023-10-16T23:28:24.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.216+0000 7fd275ffb640 1 -- 172.21.15.12:0/3819281272 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fd26c0b7c70 con 0x7fd2780b3f70 2023-10-16T23:28:24.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.216+0000 7fd275ffb640 1 --2- 172.21.15.12:0/3819281272 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd264065e90 0x7fd264068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:24.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.216+0000 7fd275ffb640 1 -- 172.21.15.12:0/3819281272 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd26c11f650 con 0x7fd2780b3f70 2023-10-16T23:28:24.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.216+0000 7fd27d366640 1 --2- 172.21.15.12:0/3819281272 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd264065e90 0x7fd264068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:24.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.216+0000 7fd27d366640 1 --2- 172.21.15.12:0/3819281272 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd264065e90 0x7fd264068350 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd268000f70 tx=0x7fd268009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:24.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.220+0000 7fd275ffb640 1 -- 172.21.15.12:0/3819281272 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fd26c0ecd90 con 0x7fd2780b3f70 2023-10-16T23:28:24.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.376+0000 7fd27f5ca640 1 -- 172.21.15.12:0/3819281272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd2780673a0 con 0x7fd2780b3f70 2023-10-16T23:28:24.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.376+0000 7fd275ffb640 1 -- 172.21.15.12:0/3819281272 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd26c0f03b0 con 0x7fd2780b3f70 2023-10-16T23:28:24.380 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-16T23:28:24.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.380+0000 7fd27f5ca640 1 -- 172.21.15.12:0/3819281272 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd264065e90 msgr2=0x7fd264068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:24.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.380+0000 7fd27f5ca640 1 --2- 172.21.15.12:0/3819281272 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd264065e90 0x7fd264068350 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd268000f70 tx=0x7fd268009040 comp rx=0 tx=0).stop 2023-10-16T23:28:24.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.380+0000 7fd27f5ca640 1 -- 172.21.15.12:0/3819281272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2780b3f70 msgr2=0x7fd27813bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:24.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.380+0000 7fd27f5ca640 1 --2- 172.21.15.12:0/3819281272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2780b3f70 0x7fd27813bdb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd26c0b0040 tx=0x7fd26c0196f0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.380+0000 7fd27f5ca640 1 -- 172.21.15.12:0/3819281272 shutdown_connections 2023-10-16T23:28:24.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.380+0000 7fd27f5ca640 1 --2- 172.21.15.12:0/3819281272 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd264065e90 0x7fd264068350 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.380+0000 7fd27f5ca640 1 --2- 172.21.15.12:0/3819281272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2780c12a0 0x7fd2781496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.380+0000 7fd27f5ca640 1 --2- 172.21.15.12:0/3819281272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2780b3f70 0x7fd27813bdb0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.380+0000 7fd27f5ca640 1 --2- 172.21.15.12:0/3819281272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd278070800 0x7fd278140e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.380+0000 7fd27f5ca640 1 -- 172.21.15.12:0/3819281272 >> 172.21.15.12:0/3819281272 conn(0x7fd27806bb10 msgr2=0x7fd278071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:24.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.380+0000 7fd27f5ca640 1 -- 172.21.15.12:0/3819281272 shutdown_connections 2023-10-16T23:28:24.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.380+0000 7fd27f5ca640 1 -- 172.21.15.12:0/3819281272 wait complete. 2023-10-16T23:28:24.400 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T23:28:24.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.516+0000 7f9a40907640 1 Processor -- start 2023-10-16T23:28:24.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.516+0000 7f9a40907640 1 -- start start 2023-10-16T23:28:24.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.516+0000 7f9a40907640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9a3c0c1950 0x7f9a3c0c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:24.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.516+0000 7f9a40907640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a3c06e770 0x7f9a3c152a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:24.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.516+0000 7f9a40907640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9a3c0bfc30 0x7f9a3c152f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:24.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.516+0000 7f9a40907640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a3c0b85b0 con 0x7f9a3c0bfc30 2023-10-16T23:28:24.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.516+0000 7f9a40907640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a3c0c01e0 con 0x7f9a3c0c1950 2023-10-16T23:28:24.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.516+0000 7f9a40907640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c0b8120 con 0x7f9a3c06e770 2023-10-16T23:28:24.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.516+0000 7f9a3ad9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9a3c0bfc30 0x7f9a3c152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:24.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.516+0000 7f9a3ad9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9a3c0bfc30 0x7f9a3c152f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33348/0 (socket says 172.21.15.12:33348) 2023-10-16T23:28:24.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.516+0000 7f9a3ad9d640 1 -- 172.21.15.12:0/3468045493 learned_addr learned my addr 172.21.15.12:0/3468045493 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:24.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.516+0000 7f9a33fff640 1 --2- 172.21.15.12:0/3468045493 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a3c06e770 0x7f9a3c152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:24.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.516+0000 7f9a3a59c640 1 --2- 172.21.15.12:0/3468045493 >> v2:172.21.15.31:3300/0 conn(0x7f9a3c0c1950 0x7f9a3c0c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:24.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.520+0000 7f9a3ad9d640 1 -- 172.21.15.12:0/3468045493 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a3c06e770 msgr2=0x7f9a3c152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:24.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.520+0000 7f9a3ad9d640 1 --2- 172.21.15.12:0/3468045493 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a3c06e770 0x7f9a3c152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.520+0000 7f9a3ad9d640 1 -- 172.21.15.12:0/3468045493 >> v2:172.21.15.31:3300/0 conn(0x7f9a3c0c1950 msgr2=0x7f9a3c0c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:24.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.520+0000 7f9a3ad9d640 1 --2- 172.21.15.12:0/3468045493 >> v2:172.21.15.31:3300/0 conn(0x7f9a3c0c1950 0x7f9a3c0c1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.520+0000 7f9a3ad9d640 1 -- 172.21.15.12:0/3468045493 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3c0b7db0 con 0x7f9a3c0bfc30 2023-10-16T23:28:24.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.520+0000 7f9a3a59c640 1 --2- 172.21.15.12:0/3468045493 >> v2:172.21.15.31:3300/0 conn(0x7f9a3c0c1950 0x7f9a3c0c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:24.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.520+0000 7f9a3ad9d640 1 --2- 172.21.15.12:0/3468045493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a3c0bfc30 0x7f9a3c152f80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0c0800 tx=0x7f9a3401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19fb4b3b9a23cfa6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:24.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.520+0000 7f9a39d9b640 1 -- 172.21.15.12:0/3468045493 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a340a56d0 con 0x7f9a3c0bfc30 2023-10-16T23:28:24.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.520+0000 7f9a39d9b640 1 -- 172.21.15.12:0/3468045493 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a340a5830 con 0x7f9a3c0bfc30 2023-10-16T23:28:24.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.520+0000 7f9a39d9b640 1 -- 172.21.15.12:0/3468045493 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a340a5bc0 con 0x7f9a3c0bfc30 2023-10-16T23:28:24.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.520+0000 7f9a40907640 1 -- 172.21.15.12:0/3468045493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a3c0bfc30 msgr2=0x7f9a3c152f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:24.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.520+0000 7f9a40907640 1 --2- 172.21.15.12:0/3468045493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a3c0bfc30 0x7f9a3c152f80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0c0800 tx=0x7f9a3401c940 comp rx=0 tx=0).stop 2023-10-16T23:28:24.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.520+0000 7f9a40907640 1 -- 172.21.15.12:0/3468045493 shutdown_connections 2023-10-16T23:28:24.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.520+0000 7f9a40907640 1 --2- 172.21.15.12:0/3468045493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a3c0bfc30 0x7f9a3c152f80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.520+0000 7f9a40907640 1 --2- 172.21.15.12:0/3468045493 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a3c06e770 0x7f9a3c152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.520+0000 7f9a40907640 1 --2- 172.21.15.12:0/3468045493 >> v2:172.21.15.31:3300/0 conn(0x7f9a3c0c1950 0x7f9a3c0c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.520+0000 7f9a40907640 1 -- 172.21.15.12:0/3468045493 >> 172.21.15.12:0/3468045493 conn(0x7f9a3c06b5d0 msgr2=0x7f9a3c06b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:24.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.520+0000 7f9a40907640 1 -- 172.21.15.12:0/3468045493 shutdown_connections 2023-10-16T23:28:24.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.520+0000 7f9a40907640 1 -- 172.21.15.12:0/3468045493 wait complete. 2023-10-16T23:28:24.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a40907640 1 Processor -- start 2023-10-16T23:28:24.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a40907640 1 -- start start 2023-10-16T23:28:24.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a40907640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a3c06e770 0x7f9a3c0b9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:24.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a40907640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a3c0bfc30 0x7f9a3c14d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:24.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a40907640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a3c0c1950 0x7f9a3c1e7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:24.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a40907640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c0b8d10 con 0x7f9a3c0bfc30 2023-10-16T23:28:24.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a40907640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c1ea530 con 0x7f9a3c0c1950 2023-10-16T23:28:24.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a40907640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c14dd60 con 0x7f9a3c06e770 2023-10-16T23:28:24.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a33fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a3c0bfc30 0x7f9a3c14d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:24.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a33fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a3c0bfc30 0x7f9a3c14d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33352/0 (socket says 172.21.15.12:33352) 2023-10-16T23:28:24.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a33fff640 1 -- 172.21.15.12:0/3846611404 learned_addr learned my addr 172.21.15.12:0/3846611404 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:24.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a3ad9d640 1 --2- 172.21.15.12:0/3846611404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a3c0c1950 0x7f9a3c1e7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:24.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a3a59c640 1 --2- 172.21.15.12:0/3846611404 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a3c06e770 0x7f9a3c0b9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:24.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a33fff640 1 -- 172.21.15.12:0/3846611404 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a3c06e770 msgr2=0x7f9a3c0b9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:24.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a33fff640 1 --2- 172.21.15.12:0/3846611404 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a3c06e770 0x7f9a3c0b9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a33fff640 1 -- 172.21.15.12:0/3846611404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a3c0c1950 msgr2=0x7f9a3c1e7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:24.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a33fff640 1 --2- 172.21.15.12:0/3846611404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a3c0c1950 0x7f9a3c1e7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a33fff640 1 -- 172.21.15.12:0/3846611404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a34009b30 con 0x7f9a3c0bfc30 2023-10-16T23:28:24.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a33fff640 1 --2- 172.21.15.12:0/3846611404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a3c0bfc30 0x7f9a3c14d820 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9a2400d5f0 tx=0x7f9a2400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:24.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a32ffd640 1 -- 172.21.15.12:0/3846611404 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24018070 con 0x7f9a3c0bfc30 2023-10-16T23:28:24.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a32ffd640 1 -- 172.21.15.12:0/3846611404 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a24004240 con 0x7f9a3c0bfc30 2023-10-16T23:28:24.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a40907640 1 -- 172.21.15.12:0/3846611404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3c1ea740 con 0x7f9a3c0bfc30 2023-10-16T23:28:24.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a32ffd640 1 -- 172.21.15.12:0/3846611404 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a240043f0 con 0x7f9a3c0bfc30 2023-10-16T23:28:24.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a40907640 1 -- 172.21.15.12:0/3846611404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3c1e73a0 con 0x7f9a3c0bfc30 2023-10-16T23:28:24.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a40907640 1 -- 172.21.15.12:0/3846611404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a3c0673a0 con 0x7f9a3c0bfc30 2023-10-16T23:28:24.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a32ffd640 1 -- 172.21.15.12:0/3846611404 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f9a24003620 con 0x7f9a3c0bfc30 2023-10-16T23:28:24.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a32ffd640 1 --2- 172.21.15.12:0/3846611404 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9a1c065e90 0x7f9a1c068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:24.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.524+0000 7f9a32ffd640 1 -- 172.21.15.12:0/3846611404 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9a24083580 con 0x7f9a3c0bfc30 2023-10-16T23:28:24.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.528+0000 7f9a3a59c640 1 --2- 172.21.15.12:0/3846611404 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9a1c065e90 0x7f9a1c068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:24.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.528+0000 7f9a3a59c640 1 --2- 172.21.15.12:0/3846611404 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9a1c065e90 0x7f9a1c068350 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00a9a0 tx=0x7f9a2c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:24.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.528+0000 7f9a32ffd640 1 -- 172.21.15.12:0/3846611404 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f9a24050c20 con 0x7f9a3c0bfc30 2023-10-16T23:28:24.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.696+0000 7f9a40907640 1 -- 172.21.15.12:0/3846611404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9a3c06bed0 con 0x7f9a3c0bfc30 2023-10-16T23:28:24.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.696+0000 7f9a32ffd640 1 -- 172.21.15.12:0/3846611404 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9a24054240 con 0x7f9a3c0bfc30 2023-10-16T23:28:24.701 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2023-10-16T23:28:24.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.700+0000 7f9a40907640 1 -- 172.21.15.12:0/3846611404 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9a1c065e90 msgr2=0x7f9a1c068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:24.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.700+0000 7f9a40907640 1 --2- 172.21.15.12:0/3846611404 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9a1c065e90 0x7f9a1c068350 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00a9a0 tx=0x7f9a2c008040 comp rx=0 tx=0).stop 2023-10-16T23:28:24.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.700+0000 7f9a40907640 1 -- 172.21.15.12:0/3846611404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a3c0bfc30 msgr2=0x7f9a3c14d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:24.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.700+0000 7f9a40907640 1 --2- 172.21.15.12:0/3846611404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a3c0bfc30 0x7f9a3c14d820 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9a2400d5f0 tx=0x7f9a2400dab0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.700+0000 7f9a40907640 1 -- 172.21.15.12:0/3846611404 shutdown_connections 2023-10-16T23:28:24.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.700+0000 7f9a40907640 1 --2- 172.21.15.12:0/3846611404 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f9a1c065e90 0x7f9a1c068350 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.700+0000 7f9a40907640 1 --2- 172.21.15.12:0/3846611404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a3c0c1950 0x7f9a3c1e7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.700+0000 7f9a40907640 1 --2- 172.21.15.12:0/3846611404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a3c0bfc30 0x7f9a3c14d820 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.700+0000 7f9a40907640 1 --2- 172.21.15.12:0/3846611404 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9a3c06e770 0x7f9a3c0b9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.700+0000 7f9a40907640 1 -- 172.21.15.12:0/3846611404 >> 172.21.15.12:0/3846611404 conn(0x7f9a3c06b5d0 msgr2=0x7f9a3c0bca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:24.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.700+0000 7f9a40907640 1 -- 172.21.15.12:0/3846611404 shutdown_connections 2023-10-16T23:28:24.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.700+0000 7f9a40907640 1 -- 172.21.15.12:0/3846611404 wait complete. 2023-10-16T23:28:24.719 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-10-16T23:28:24.720 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T23:28:24.726 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T23:28:24.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.848+0000 7f5c8fb3a640 1 Processor -- start 2023-10-16T23:28:24.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.848+0000 7f5c8fb3a640 1 -- start start 2023-10-16T23:28:24.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.852+0000 7f5c8fb3a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5c880b8630 0x7f5c8814cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:24.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.852+0000 7f5c8fb3a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c880b9f40 0x7f5c880ba390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:24.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.852+0000 7f5c8fb3a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c880b40c0 con 0x7f5c880c1130 2023-10-16T23:28:24.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.852+0000 7f5c8fb3a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c880b3ca0 con 0x7f5c880b8630 2023-10-16T23:28:24.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.852+0000 7f5c8fb3a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8814d170 con 0x7f5c880b9f40 2023-10-16T23:28:24.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.852+0000 7f5c8d0d5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5c880b8630 0x7f5c8814cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:24.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.852+0000 7f5c8e0d7640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c880b9f40 0x7f5c880ba390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:24.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.852+0000 7f5c8d8d6640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5c880c1130 0x7f5c8814c520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:36406/0 (socket says 172.21.15.12:36406) 2023-10-16T23:28:24.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.852+0000 7f5c8d8d6640 1 -- 172.21.15.12:0/2970267032 learned_addr learned my addr 172.21.15.12:0/2970267032 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:24.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.852+0000 7f5c8c8d4640 1 -- 172.21.15.12:0/2970267032 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2573056668 0 0) 0x7f5c880b40c0 con 0x7f5c880c1130 2023-10-16T23:28:24.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.852+0000 7f5c8c8d4640 1 -- 172.21.15.12:0/2970267032 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c74003530 con 0x7f5c880c1130 2023-10-16T23:28:24.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.852+0000 7f5c8d0d5640 1 -- 172.21.15.12:0/2970267032 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c880b9f40 msgr2=0x7f5c880ba390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:24.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.852+0000 7f5c8d0d5640 1 --2- 172.21.15.12:0/2970267032 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c880b9f40 0x7f5c880ba390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.852+0000 7f5c8d0d5640 1 -- 172.21.15.12:0/2970267032 >> v1:172.21.15.31:6789/0 conn(0x7f5c880c1130 legacy=0x7f5c8814c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:24.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.852+0000 7f5c8d0d5640 1 -- 172.21.15.12:0/2970267032 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c880b7ce0 con 0x7f5c880b8630 2023-10-16T23:28:24.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.852+0000 7f5c8e0d7640 1 --2- 172.21.15.12:0/2970267032 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c880b9f40 0x7f5c880ba390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T23:28:24.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.856+0000 7f5c8d0d5640 1 --2- 172.21.15.12:0/2970267032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c880b8630 0x7f5c8814cc30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5c780097c0 tx=0x7f5c7801c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa4bae1813fa6dd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:24.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.856+0000 7f5c8c8d4640 1 -- 172.21.15.12:0/2970267032 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c780ab600 con 0x7f5c880b8630 2023-10-16T23:28:24.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.856+0000 7f5c8c8d4640 1 -- 172.21.15.12:0/2970267032 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c780a7050 con 0x7f5c880b8630 2023-10-16T23:28:24.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.856+0000 7f5c8c8d4640 1 -- 172.21.15.12:0/2970267032 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c780ab980 con 0x7f5c880b8630 2023-10-16T23:28:24.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.856+0000 7f5c8fb3a640 1 -- 172.21.15.12:0/2970267032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c880b8630 msgr2=0x7f5c8814cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:24.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.856+0000 7f5c8fb3a640 1 --2- 172.21.15.12:0/2970267032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c880b8630 0x7f5c8814cc30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5c780097c0 tx=0x7f5c7801c360 comp rx=0 tx=0).stop 2023-10-16T23:28:24.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.856+0000 7f5c8fb3a640 1 -- 172.21.15.12:0/2970267032 shutdown_connections 2023-10-16T23:28:24.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.856+0000 7f5c8fb3a640 1 --2- 172.21.15.12:0/2970267032 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c880b9f40 0x7f5c880ba390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.856+0000 7f5c8fb3a640 1 --2- 172.21.15.12:0/2970267032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c880b8630 0x7f5c8814cc30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.856+0000 7f5c8fb3a640 1 -- 172.21.15.12:0/2970267032 >> 172.21.15.12:0/2970267032 conn(0x7f5c8806ba20 msgr2=0x7f5c880c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:24.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.856+0000 7f5c8fb3a640 1 -- 172.21.15.12:0/2970267032 shutdown_connections 2023-10-16T23:28:24.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.856+0000 7f5c8fb3a640 1 -- 172.21.15.12:0/2970267032 wait complete. 2023-10-16T23:28:24.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.856+0000 7f5c8fb3a640 1 Processor -- start 2023-10-16T23:28:24.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.856+0000 7f5c8fb3a640 1 -- start start 2023-10-16T23:28:24.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.856+0000 7f5c8fb3a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c880b8630 0x7f5c881449e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:24.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.856+0000 7f5c8fb3a640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c880b9f40 0x7f5c881e64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:24.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.860+0000 7f5c8fb3a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c880c1130 0x7f5c881e6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:24.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.860+0000 7f5c8fb3a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c881e6f50 con 0x7f5c880b8630 2023-10-16T23:28:24.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.860+0000 7f5c8fb3a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c881e8670 con 0x7f5c880c1130 2023-10-16T23:28:24.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.860+0000 7f5c8fb3a640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c881e8950 con 0x7f5c880b9f40 2023-10-16T23:28:24.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.860+0000 7f5c8d8d6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c880b8630 0x7f5c881449e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:24.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.860+0000 7f5c8d8d6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c880b8630 0x7f5c881449e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33360/0 (socket says 172.21.15.12:33360) 2023-10-16T23:28:24.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.860+0000 7f5c8d8d6640 1 -- 172.21.15.12:0/2975478700 learned_addr learned my addr 172.21.15.12:0/2975478700 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:24.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.860+0000 7f5c8d0d5640 1 --2- 172.21.15.12:0/2975478700 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c880b9f40 0x7f5c881e64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:24.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.860+0000 7f5c8e0d7640 1 --2- 172.21.15.12:0/2975478700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c880c1130 0x7f5c881e6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:24.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.860+0000 7f5c8d8d6640 1 -- 172.21.15.12:0/2975478700 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c880b9f40 msgr2=0x7f5c881e64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:24.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.860+0000 7f5c8d8d6640 1 --2- 172.21.15.12:0/2975478700 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c880b9f40 0x7f5c881e64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.860+0000 7f5c8d8d6640 1 -- 172.21.15.12:0/2975478700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c880c1130 msgr2=0x7f5c881e6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:24.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.860+0000 7f5c8d8d6640 1 --2- 172.21.15.12:0/2975478700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c880c1130 0x7f5c881e6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:24.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.860+0000 7f5c8d8d6640 1 -- 172.21.15.12:0/2975478700 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c84009420 con 0x7f5c880b8630 2023-10-16T23:28:24.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.860+0000 7f5c8d8d6640 1 --2- 172.21.15.12:0/2975478700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c880b8630 0x7f5c881449e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5c8000cbc0 tx=0x7f5c8000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:24.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.860+0000 7f5c7e7fc640 1 -- 172.21.15.12:0/2975478700 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8000ad40 con 0x7f5c880b8630 2023-10-16T23:28:24.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.860+0000 7f5c7e7fc640 1 -- 172.21.15.12:0/2975478700 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c80012400 con 0x7f5c880b8630 2023-10-16T23:28:24.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.860+0000 7f5c8fb3a640 1 -- 172.21.15.12:0/2975478700 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c78009420 con 0x7f5c880b8630 2023-10-16T23:28:24.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.860+0000 7f5c7e7fc640 1 -- 172.21.15.12:0/2975478700 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8000aea0 con 0x7f5c880b8630 2023-10-16T23:28:24.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.860+0000 7f5c8fb3a640 1 -- 172.21.15.12:0/2975478700 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c880b8480 con 0x7f5c880b8630 2023-10-16T23:28:24.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.860+0000 7f5c8fb3a640 1 -- 172.21.15.12:0/2975478700 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c881e8e70 con 0x7f5c880b8630 2023-10-16T23:28:24.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.860+0000 7f5c7e7fc640 1 -- 172.21.15.12:0/2975478700 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f5c80007070 con 0x7f5c880b8630 2023-10-16T23:28:24.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.860+0000 7f5c7e7fc640 1 --2- 172.21.15.12:0/2975478700 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5c6c065e60 0x7f5c6c068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:24.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.860+0000 7f5c7e7fc640 1 -- 172.21.15.12:0/2975478700 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5c80083900 con 0x7f5c880b8630 2023-10-16T23:28:24.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.860+0000 7f5c8d0d5640 1 --2- 172.21.15.12:0/2975478700 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5c6c065e60 0x7f5c6c068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:24.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.864+0000 7f5c8d0d5640 1 --2- 172.21.15.12:0/2975478700 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5c6c065e60 0x7f5c6c068320 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5c780ad000 tx=0x7f5c78008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:24.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:24.864+0000 7f5c7e7fc640 1 -- 172.21.15.12:0/2975478700 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f5c881e8e70 con 0x7f5c880b8630 2023-10-16T23:28:25.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.020+0000 7f5c8fb3a640 1 -- 172.21.15.12:0/2975478700 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c881e8e70 con 0x7f5c880b8630 2023-10-16T23:28:25.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.024+0000 7f5c7e7fc640 1 -- 172.21.15.12:0/2975478700 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17857 (secure 0 0 0) 0x7f5c881e8e70 con 0x7f5c880b8630 2023-10-16T23:28:25.026 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:28:25.027 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":26,"fsid":"0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51","created":"2023-10-16T23:27:16.468087+0000","modified":"2023-10-16T23:28:23.417777+0000","last_up_change":"2023-10-16T23:27:28.136202+0000","last_in_change":"2023-10-16T23:27:18.793212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T23:27:27.354025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-16T23:27:34.786446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-16T23:27:39.130341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-16T23:27:39.674572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73e70f98-6f5e-4464-b34e-931faac41cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":38075},{"type":"v1","addr":"172.21.15.12:6814","nonce":38075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":38075},{"type":"v1","addr":"172.21.15.12:6819","nonce":38075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":38075},{"type":"v1","addr":"172.21.15.12:6827","nonce":38075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":38075},{"type":"v1","addr":"172.21.15.12:6823","nonce":38075}]},"public_addr":"172.21.15.12:6814/38075","cluster_addr":"172.21.15.12:6819/38075","heartbeat_back_addr":"172.21.15.12:6827/38075","heartbeat_front_addr":"172.21.15.12:6823/38075","state":["exists","up"]},{"osd":1,"uuid":"ff722efe-b3f9-4cc0-bbde-f4d4d8055a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":38076},{"type":"v1","addr":"172.21.15.12:6811","nonce":38076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":38076},{"type":"v1","addr":"172.21.15.12:6818","nonce":38076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":38076},{"type":"v1","addr":"172.21.15.12:6831","nonce":38076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":38076},{"type":"v1","addr":"172.21.15.12:6825","nonce":38076}]},"public_addr":"172.21.15.12:6811/38076","cluster_addr":"172.21.15.12:6818/38076","heartbeat_back_addr":"172.21.15.12:6831/38076","heartbeat_front_addr":"172.21.15.12:6825/38076","state":["exists","up"]},{"osd":2,"uuid":"9baf25db-dce0-4065-90d6-f35867286be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6809","nonce":38073},{"type":"v1","addr":"172.21.15.12:6810","nonce":38073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":38073},{"type":"v1","addr":"172.21.15.12:6817","nonce":38073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":38073},{"type":"v1","addr":"172.21.15.12:6830","nonce":38073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":38073},{"type":"v1","addr":"172.21.15.12:6826","nonce":38073}]},"public_addr":"172.21.15.12:6810/38073","cluster_addr":"172.21.15.12:6817/38073","heartbeat_back_addr":"172.21.15.12:6830/38073","heartbeat_front_addr":"172.21.15.12:6826/38073","state":["exists","up"]},{"osd":3,"uuid":"8a620ad3-2294-470d-8a8c-66f177f5fbe7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":38074},{"type":"v1","addr":"172.21.15.12:6801","nonce":38074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":38074},{"type":"v1","addr":"172.21.15.12:6803","nonce":38074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":38074},{"type":"v1","addr":"172.21.15.12:6807","nonce":38074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":38074},{"type":"v1","addr":"172.21.15.12:6805","nonce":38074}]},"public_addr":"172.21.15.12:6801/38074","cluster_addr":"172.21.15.12:6803/38074","heartbeat_back_addr":"172.21.15.12:6807/38074","heartbeat_front_addr":"172.21.15.12:6805/38074","state":["exists","up"]},{"osd":4,"uuid":"a8824d77-7405-40f5-9234-60889802b184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":38266},{"type":"v1","addr":"172.21.15.31:6817","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":38266},{"type":"v1","addr":"172.21.15.31:6819","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":38266},{"type":"v1","addr":"172.21.15.31:6823","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":38266},{"type":"v1","addr":"172.21.15.31:6821","nonce":38266}]},"public_addr":"172.21.15.31:6817/38266","cluster_addr":"172.21.15.31:6819/38266","heartbeat_back_addr":"172.21.15.31:6823/38266","heartbeat_front_addr":"172.21.15.31:6821/38266","state":["exists","up"]},{"osd":5,"uuid":"3bb01192-a47c-48e9-9662-285e3f6f4b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":38264},{"type":"v1","addr":"172.21.15.31:6807","nonce":38264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":38264},{"type":"v1","addr":"172.21.15.31:6811","nonce":38264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":38264},{"type":"v1","addr":"172.21.15.31:6815","nonce":38264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":38264},{"type":"v1","addr":"172.21.15.31:6813","nonce":38264}]},"public_addr":"172.21.15.31:6807/38264","cluster_addr":"172.21.15.31:6811/38264","heartbeat_back_addr":"172.21.15.31:6815/38264","heartbeat_front_addr":"172.21.15.31:6813/38264","state":["exists","up"]},{"osd":6,"uuid":"1e2d18e4-73e6-4a37-826c-35eca4d96935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":38263},{"type":"v1","addr":"172.21.15.31:6825","nonce":38263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":38263},{"type":"v1","addr":"172.21.15.31:6827","nonce":38263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":38263},{"type":"v1","addr":"172.21.15.31:6831","nonce":38263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":38263},{"type":"v1","addr":"172.21.15.31:6829","nonce":38263}]},"public_addr":"172.21.15.31:6825/38263","cluster_addr":"172.21.15.31:6827/38263","heartbeat_back_addr":"172.21.15.31:6831/38263","heartbeat_front_addr":"172.21.15.31:6829/38263","state":["exists","up"]},{"osd":7,"uuid":"e0f369c0-562b-4440-a5aa-12275c29412b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":38265},{"type":"v1","addr":"172.21.15.31:6801","nonce":38265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":38265},{"type":"v1","addr":"172.21.15.31:6803","nonce":38265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":38265},{"type":"v1","addr":"172.21.15.31:6810","nonce":38265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":38265},{"type":"v1","addr":"172.21.15.31:6806","nonce":38265}]},"public_addr":"172.21.15.31:6801/38265","cluster_addr":"172.21.15.31:6803/38265","heartbeat_back_addr":"172.21.15.31:6810/38265","heartbeat_front_addr":"172.21.15.31:6806/38265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.411815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.372565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.209700+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.414619+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.316843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.300348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.359800+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.219854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T23:28:25.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.024+0000 7f5c8fb3a640 1 -- 172.21.15.12:0/2975478700 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5c6c065e60 msgr2=0x7f5c6c068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:25.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.024+0000 7f5c8fb3a640 1 --2- 172.21.15.12:0/2975478700 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5c6c065e60 0x7f5c6c068320 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5c780ad000 tx=0x7f5c78008040 comp rx=0 tx=0).stop 2023-10-16T23:28:25.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.024+0000 7f5c8fb3a640 1 -- 172.21.15.12:0/2975478700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c880b8630 msgr2=0x7f5c881449e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:25.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.024+0000 7f5c8fb3a640 1 --2- 172.21.15.12:0/2975478700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c880b8630 0x7f5c881449e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5c8000cbc0 tx=0x7f5c8000a430 comp rx=0 tx=0).stop 2023-10-16T23:28:25.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.024+0000 7f5c8fb3a640 1 -- 172.21.15.12:0/2975478700 shutdown_connections 2023-10-16T23:28:25.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.024+0000 7f5c8fb3a640 1 --2- 172.21.15.12:0/2975478700 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5c6c065e60 0x7f5c6c068320 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.024+0000 7f5c8fb3a640 1 --2- 172.21.15.12:0/2975478700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c880c1130 0x7f5c881e6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.024+0000 7f5c8fb3a640 1 --2- 172.21.15.12:0/2975478700 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5c880b9f40 0x7f5c881e64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.024+0000 7f5c8fb3a640 1 --2- 172.21.15.12:0/2975478700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c880b8630 0x7f5c881449e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.024+0000 7f5c8fb3a640 1 -- 172.21.15.12:0/2975478700 >> 172.21.15.12:0/2975478700 conn(0x7f5c8806ba20 msgr2=0x7f5c880bb660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:25.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.024+0000 7f5c8fb3a640 1 -- 172.21.15.12:0/2975478700 shutdown_connections 2023-10-16T23:28:25.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.024+0000 7f5c8fb3a640 1 -- 172.21.15.12:0/2975478700 wait complete. 2023-10-16T23:28:25.044 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T23:27:27.354025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-16T23:27:34.786446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T23:27:39.130341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T23:27:39.674572+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T23:28:25.045 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T23:28:25.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.168+0000 7fb8e02b9640 1 Processor -- start 2023-10-16T23:28:25.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.168+0000 7fb8e02b9640 1 -- start start 2023-10-16T23:28:25.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.168+0000 7fb8e02b9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb8d814eba0 0x7fb8d814ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:25.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.168+0000 7fb8e02b9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb8d806e6d0 0x7fb8d80705d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:25.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.168+0000 7fb8e02b9640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d806f130 con 0x7fb8d8152a60 2023-10-16T23:28:25.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.168+0000 7fb8e02b9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8d8070da0 con 0x7fb8d814eba0 2023-10-16T23:28:25.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.168+0000 7fb8e02b9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d80b86f0 con 0x7fb8d806e6d0 2023-10-16T23:28:25.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.168+0000 7fb8de055640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb8d814eba0 0x7fb8d814ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:25.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.168+0000 7fb8de055640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb8d814eba0 0x7fb8d814ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33376/0 (socket says 172.21.15.12:33376) 2023-10-16T23:28:25.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.168+0000 7fb8de055640 1 -- 172.21.15.12:0/3958108542 learned_addr learned my addr 172.21.15.12:0/3958108542 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:25.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.168+0000 7fb8de055640 1 -- 172.21.15.12:0/3958108542 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb8d806e6d0 msgr2=0x7fb8d80705d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:25.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.168+0000 7fb8de055640 1 --2- 172.21.15.12:0/3958108542 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb8d806e6d0 0x7fb8d80705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.168+0000 7fb8de055640 1 -- 172.21.15.12:0/3958108542 >> v1:172.21.15.31:6789/0 conn(0x7fb8d8152a60 legacy=0x7fb8d80c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:25.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.168+0000 7fb8de055640 1 -- 172.21.15.12:0/3958108542 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d80c1020 con 0x7fb8d814eba0 2023-10-16T23:28:25.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.168+0000 7fb8de055640 1 --2- 172.21.15.12:0/3958108542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d814eba0 0x7fb8d814ef80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40098a0 tx=0x7fb8d401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b514e0280ac4f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:25.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8dd053640 1 -- 172.21.15.12:0/3958108542 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d40ad680 con 0x7fb8d814eba0 2023-10-16T23:28:25.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8dd053640 1 -- 172.21.15.12:0/3958108542 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d40ad7e0 con 0x7fb8d814eba0 2023-10-16T23:28:25.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8dd053640 1 -- 172.21.15.12:0/3958108542 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d40adb70 con 0x7fb8d814eba0 2023-10-16T23:28:25.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8e02b9640 1 -- 172.21.15.12:0/3958108542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d814eba0 msgr2=0x7fb8d814ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:25.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8e02b9640 1 --2- 172.21.15.12:0/3958108542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d814eba0 0x7fb8d814ef80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40098a0 tx=0x7fb8d401c3c0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8e02b9640 1 -- 172.21.15.12:0/3958108542 shutdown_connections 2023-10-16T23:28:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8e02b9640 1 --2- 172.21.15.12:0/3958108542 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb8d806e6d0 0x7fb8d80705d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8e02b9640 1 --2- 172.21.15.12:0/3958108542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d814eba0 0x7fb8d814ef80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8e02b9640 1 -- 172.21.15.12:0/3958108542 >> 172.21.15.12:0/3958108542 conn(0x7fb8d806b800 msgr2=0x7fb8d806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8e02b9640 1 -- 172.21.15.12:0/3958108542 shutdown_connections 2023-10-16T23:28:25.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8e02b9640 1 -- 172.21.15.12:0/3958108542 wait complete. 2023-10-16T23:28:25.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8e02b9640 1 Processor -- start 2023-10-16T23:28:25.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8e02b9640 1 -- start start 2023-10-16T23:28:25.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8e02b9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb8d806e6d0 0x7fb8d81eaf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:25.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8e02b9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8d814eba0 0x7fb8d81e79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:25.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8e02b9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d8152a60 0x7fb8d81ea4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:25.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8e02b9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d80c5020 con 0x7fb8d8152a60 2023-10-16T23:28:25.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8e02b9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d80c49f0 con 0x7fb8d814eba0 2023-10-16T23:28:25.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8e02b9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d80c2e90 con 0x7fb8d806e6d0 2023-10-16T23:28:25.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8de856640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d8152a60 0x7fb8d81ea4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:25.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8de856640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d8152a60 0x7fb8d81ea4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33392/0 (socket says 172.21.15.12:33392) 2023-10-16T23:28:25.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8de856640 1 -- 172.21.15.12:0/2396550153 learned_addr learned my addr 172.21.15.12:0/2396550153 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:25.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8dd854640 1 --2- 172.21.15.12:0/2396550153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8d814eba0 0x7fb8d81e79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:25.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8de856640 1 -- 172.21.15.12:0/2396550153 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb8d806e6d0 msgr2=0x7fb8d81eaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:25.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8de856640 1 --2- 172.21.15.12:0/2396550153 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb8d806e6d0 0x7fb8d81eaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8de856640 1 -- 172.21.15.12:0/2396550153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8d814eba0 msgr2=0x7fb8d81e79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8de856640 1 --2- 172.21.15.12:0/2396550153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8d814eba0 0x7fb8d81e79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8de856640 1 -- 172.21.15.12:0/2396550153 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d40094d0 con 0x7fb8d8152a60 2023-10-16T23:28:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8de856640 1 --2- 172.21.15.12:0/2396550153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d8152a60 0x7fb8d81ea4b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000b9c0 tx=0x7fb8d000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:25.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8ceffd640 1 -- 172.21.15.12:0/2396550153 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d000cba0 con 0x7fb8d8152a60 2023-10-16T23:28:25.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8ceffd640 1 -- 172.21.15.12:0/2396550153 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d000cd00 con 0x7fb8d8152a60 2023-10-16T23:28:25.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8e02b9640 1 -- 172.21.15.12:0/2396550153 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d80c4c40 con 0x7fb8d8152a60 2023-10-16T23:28:25.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8ceffd640 1 -- 172.21.15.12:0/2396550153 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0014680 con 0x7fb8d8152a60 2023-10-16T23:28:25.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.172+0000 7fb8e02b9640 1 -- 172.21.15.12:0/2396550153 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d814bd80 con 0x7fb8d8152a60 2023-10-16T23:28:25.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.176+0000 7fb8e02b9640 1 -- 172.21.15.12:0/2396550153 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d80c4e80 con 0x7fb8d8152a60 2023-10-16T23:28:25.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.176+0000 7fb8ceffd640 1 -- 172.21.15.12:0/2396550153 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fb8d0007370 con 0x7fb8d8152a60 2023-10-16T23:28:25.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.176+0000 7fb8ceffd640 1 --2- 172.21.15.12:0/2396550153 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb8bc065e90 0x7fb8bc068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:25.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.176+0000 7fb8ceffd640 1 -- 172.21.15.12:0/2396550153 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb8d00832c0 con 0x7fb8d8152a60 2023-10-16T23:28:25.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.176+0000 7fb8de055640 1 --2- 172.21.15.12:0/2396550153 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb8bc065e90 0x7fb8bc068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:25.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.176+0000 7fb8de055640 1 --2- 172.21.15.12:0/2396550153 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb8bc065e90 0x7fb8bc068350 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40af000 tx=0x7fb8d4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:25.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.180+0000 7fb8ceffd640 1 -- 172.21.15.12:0/2396550153 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fb8d80c4e80 con 0x7fb8d8152a60 2023-10-16T23:28:25.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.336+0000 7fb8e02b9640 1 -- 172.21.15.12:0/2396550153 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb8d80c4e30 con 0x7fb8d8152a60 2023-10-16T23:28:25.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.336+0000 7fb8ceffd640 1 -- 172.21.15.12:0/2396550153 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb8d0050960 con 0x7fb8d8152a60 2023-10-16T23:28:25.340 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-16T23:28:25.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.336+0000 7fb8e02b9640 1 -- 172.21.15.12:0/2396550153 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb8bc065e90 msgr2=0x7fb8bc068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:25.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.336+0000 7fb8e02b9640 1 --2- 172.21.15.12:0/2396550153 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb8bc065e90 0x7fb8bc068350 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40af000 tx=0x7fb8d4008040 comp rx=0 tx=0).stop 2023-10-16T23:28:25.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.336+0000 7fb8e02b9640 1 -- 172.21.15.12:0/2396550153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d8152a60 msgr2=0x7fb8d81ea4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:25.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.336+0000 7fb8e02b9640 1 --2- 172.21.15.12:0/2396550153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d8152a60 0x7fb8d81ea4b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000b9c0 tx=0x7fb8d000be80 comp rx=0 tx=0).stop 2023-10-16T23:28:25.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.340+0000 7fb8e02b9640 1 -- 172.21.15.12:0/2396550153 shutdown_connections 2023-10-16T23:28:25.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.340+0000 7fb8e02b9640 1 --2- 172.21.15.12:0/2396550153 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb8bc065e90 0x7fb8bc068350 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.340+0000 7fb8e02b9640 1 --2- 172.21.15.12:0/2396550153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8d8152a60 0x7fb8d81ea4b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.340+0000 7fb8e02b9640 1 --2- 172.21.15.12:0/2396550153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8d814eba0 0x7fb8d81e79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.340+0000 7fb8e02b9640 1 --2- 172.21.15.12:0/2396550153 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb8d806e6d0 0x7fb8d81eaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.340+0000 7fb8e02b9640 1 -- 172.21.15.12:0/2396550153 >> 172.21.15.12:0/2396550153 conn(0x7fb8d806b800 msgr2=0x7fb8d806bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:25.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.340+0000 7fb8e02b9640 1 -- 172.21.15.12:0/2396550153 shutdown_connections 2023-10-16T23:28:25.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.340+0000 7fb8e02b9640 1 -- 172.21.15.12:0/2396550153 wait complete. 2023-10-16T23:28:25.358 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-16T23:28:25.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.476+0000 7f4d89df0640 1 Processor -- start 2023-10-16T23:28:25.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.476+0000 7f4d89df0640 1 -- start start 2023-10-16T23:28:25.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d89df0640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d8406ed20 0x7f4d8414f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:25.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d89df0640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4d84070e20 0x7f4d8414c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:25.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d89df0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4d840baf80 0x7f4d840bb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:25.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d89df0640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8414feb0 con 0x7f4d84070e20 2023-10-16T23:28:25.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d89df0640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8414bb00 con 0x7f4d840baf80 2023-10-16T23:28:25.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d89df0640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8414bda0 con 0x7f4d8406ed20 2023-10-16T23:28:25.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d82ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4d84070e20 0x7f4d8414c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:25.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d82ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4d84070e20 0x7f4d8414c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33408/0 (socket says 172.21.15.12:33408) 2023-10-16T23:28:25.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d82ffd640 1 -- 172.21.15.12:0/3293443032 learned_addr learned my addr 172.21.15.12:0/3293443032 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:25.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d82ffd640 1 -- 172.21.15.12:0/3293443032 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d8406ed20 msgr2=0x7f4d8414f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:25.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d837fe640 1 --2- 172.21.15.12:0/3293443032 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d8406ed20 0x7f4d8414f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:25.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d82ffd640 1 --2- 172.21.15.12:0/3293443032 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d8406ed20 0x7f4d8414f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d82ffd640 1 -- 172.21.15.12:0/3293443032 >> v2:172.21.15.31:3300/0 conn(0x7f4d840baf80 msgr2=0x7f4d840bb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:25.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d82ffd640 1 --2- 172.21.15.12:0/3293443032 >> v2:172.21.15.31:3300/0 conn(0x7f4d840baf80 0x7f4d840bb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d82ffd640 1 -- 172.21.15.12:0/3293443032 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8414c080 con 0x7f4d84070e20 2023-10-16T23:28:25.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d82ffd640 1 --2- 172.21.15.12:0/3293443032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d84070e20 0x7f4d8414c5a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4d84071910 tx=0x7f4d7801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69957a9902f36fc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:25.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d827fc640 1 -- 172.21.15.12:0/3293443032 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d780ab600 con 0x7f4d84070e20 2023-10-16T23:28:25.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d827fc640 1 -- 172.21.15.12:0/3293443032 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d780a7050 con 0x7f4d84070e20 2023-10-16T23:28:25.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d827fc640 1 -- 172.21.15.12:0/3293443032 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d780ab980 con 0x7f4d84070e20 2023-10-16T23:28:25.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d89df0640 1 -- 172.21.15.12:0/3293443032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d84070e20 msgr2=0x7f4d8414c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:25.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d89df0640 1 --2- 172.21.15.12:0/3293443032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d84070e20 0x7f4d8414c5a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4d84071910 tx=0x7f4d7801c470 comp rx=0 tx=0).stop 2023-10-16T23:28:25.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d89df0640 1 -- 172.21.15.12:0/3293443032 shutdown_connections 2023-10-16T23:28:25.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d89df0640 1 --2- 172.21.15.12:0/3293443032 >> v2:172.21.15.31:3300/0 conn(0x7f4d840baf80 0x7f4d840bb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d89df0640 1 --2- 172.21.15.12:0/3293443032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d84070e20 0x7f4d8414c5a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d89df0640 1 --2- 172.21.15.12:0/3293443032 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d8406ed20 0x7f4d8414f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d89df0640 1 -- 172.21.15.12:0/3293443032 >> 172.21.15.12:0/3293443032 conn(0x7f4d8406bb10 msgr2=0x7f4d840c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:25.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d89df0640 1 -- 172.21.15.12:0/3293443032 shutdown_connections 2023-10-16T23:28:25.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.480+0000 7f4d89df0640 1 -- 172.21.15.12:0/3293443032 wait complete. 2023-10-16T23:28:25.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.484+0000 7f4d89df0640 1 Processor -- start 2023-10-16T23:28:25.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.484+0000 7f4d89df0640 1 -- start start 2023-10-16T23:28:25.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.484+0000 7f4d89df0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d8406ed20 0x7f4d84143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:25.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.484+0000 7f4d89df0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d84070e20 0x7f4d841406f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:25.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.484+0000 7f4d89df0640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d840baf80 0x7f4d84140c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:25.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.484+0000 7f4d89df0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d84146930 con 0x7f4d8406ed20 2023-10-16T23:28:25.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.484+0000 7f4d89df0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d84156980 con 0x7f4d84070e20 2023-10-16T23:28:25.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.484+0000 7f4d89df0640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d84144000 con 0x7f4d840baf80 2023-10-16T23:28:25.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.484+0000 7f4d837fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d8406ed20 0x7f4d84143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:25.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.484+0000 7f4d837fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d8406ed20 0x7f4d84143ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33422/0 (socket says 172.21.15.12:33422) 2023-10-16T23:28:25.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.484+0000 7f4d837fe640 1 -- 172.21.15.12:0/125694715 learned_addr learned my addr 172.21.15.12:0/125694715 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:25.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.484+0000 7f4d82ffd640 1 --2- 172.21.15.12:0/125694715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d84070e20 0x7f4d841406f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.484+0000 7f4d837fe640 1 -- 172.21.15.12:0/125694715 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d840baf80 msgr2=0x7f4d84140c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.484+0000 7f4d83fff640 1 --2- 172.21.15.12:0/125694715 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d840baf80 0x7f4d84140c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.484+0000 7f4d837fe640 1 --2- 172.21.15.12:0/125694715 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d840baf80 0x7f4d84140c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.484+0000 7f4d837fe640 1 -- 172.21.15.12:0/125694715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d84070e20 msgr2=0x7f4d841406f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:25.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.484+0000 7f4d837fe640 1 --2- 172.21.15.12:0/125694715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d84070e20 0x7f4d841406f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.484+0000 7f4d837fe640 1 -- 172.21.15.12:0/125694715 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d780094d0 con 0x7f4d8406ed20 2023-10-16T23:28:25.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.484+0000 7f4d82ffd640 1 --2- 172.21.15.12:0/125694715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d84070e20 0x7f4d841406f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:25.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.484+0000 7f4d837fe640 1 --2- 172.21.15.12:0/125694715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d8406ed20 0x7f4d84143ac0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400c820 tx=0x7f4d7400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:25.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.484+0000 7f4d6bfff640 1 -- 172.21.15.12:0/125694715 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d74004220 con 0x7f4d8406ed20 2023-10-16T23:28:25.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.484+0000 7f4d6bfff640 1 -- 172.21.15.12:0/125694715 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d740043a0 con 0x7f4d8406ed20 2023-10-16T23:28:25.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.484+0000 7f4d89df0640 1 -- 172.21.15.12:0/125694715 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d840ba2f0 con 0x7f4d8406ed20 2023-10-16T23:28:25.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.484+0000 7f4d6bfff640 1 -- 172.21.15.12:0/125694715 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d74004510 con 0x7f4d8406ed20 2023-10-16T23:28:25.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.484+0000 7f4d89df0640 1 -- 172.21.15.12:0/125694715 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d84146550 con 0x7f4d8406ed20 2023-10-16T23:28:25.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.484+0000 7f4d89df0640 1 -- 172.21.15.12:0/125694715 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d840673a0 con 0x7f4d8406ed20 2023-10-16T23:28:25.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.488+0000 7f4d6bfff640 1 -- 172.21.15.12:0/125694715 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f4d74007a70 con 0x7f4d8406ed20 2023-10-16T23:28:25.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.488+0000 7f4d6bfff640 1 --2- 172.21.15.12:0/125694715 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4d70065e60 0x7f4d70068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:25.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.488+0000 7f4d6bfff640 1 -- 172.21.15.12:0/125694715 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4d740839e0 con 0x7f4d8406ed20 2023-10-16T23:28:25.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.488+0000 7f4d82ffd640 1 --2- 172.21.15.12:0/125694715 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4d70065e60 0x7f4d70068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:25.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.488+0000 7f4d82ffd640 1 --2- 172.21.15.12:0/125694715 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4d70065e60 0x7f4d70068320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4d780ad000 tx=0x7f4d78008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:25.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.492+0000 7f4d6bfff640 1 -- 172.21.15.12:0/125694715 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f4d74051060 con 0x7f4d8406ed20 2023-10-16T23:28:25.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.644+0000 7f4d89df0640 1 -- 172.21.15.12:0/125694715 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4d84146a70 con 0x7f4d8406ed20 2023-10-16T23:28:25.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.644+0000 7f4d6bfff640 1 -- 172.21.15.12:0/125694715 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4d7401e020 con 0x7f4d8406ed20 2023-10-16T23:28:25.650 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-10-16T23:28:25.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.648+0000 7f4d89df0640 1 -- 172.21.15.12:0/125694715 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4d70065e60 msgr2=0x7f4d70068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:25.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.648+0000 7f4d89df0640 1 --2- 172.21.15.12:0/125694715 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4d70065e60 0x7f4d70068320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4d780ad000 tx=0x7f4d78008040 comp rx=0 tx=0).stop 2023-10-16T23:28:25.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.648+0000 7f4d89df0640 1 -- 172.21.15.12:0/125694715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d8406ed20 msgr2=0x7f4d84143ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:25.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.648+0000 7f4d89df0640 1 --2- 172.21.15.12:0/125694715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d8406ed20 0x7f4d84143ac0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400c820 tx=0x7f4d7400cce0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.648+0000 7f4d89df0640 1 -- 172.21.15.12:0/125694715 shutdown_connections 2023-10-16T23:28:25.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.648+0000 7f4d89df0640 1 --2- 172.21.15.12:0/125694715 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4d70065e60 0x7f4d70068320 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.648+0000 7f4d89df0640 1 --2- 172.21.15.12:0/125694715 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d840baf80 0x7f4d84140c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.648+0000 7f4d89df0640 1 --2- 172.21.15.12:0/125694715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d84070e20 0x7f4d841406f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.648+0000 7f4d89df0640 1 --2- 172.21.15.12:0/125694715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d8406ed20 0x7f4d84143ac0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.648+0000 7f4d89df0640 1 -- 172.21.15.12:0/125694715 >> 172.21.15.12:0/125694715 conn(0x7f4d8406bb10 msgr2=0x7f4d841de100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:25.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.648+0000 7f4d89df0640 1 -- 172.21.15.12:0/125694715 shutdown_connections 2023-10-16T23:28:25.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.648+0000 7f4d89df0640 1 -- 172.21.15.12:0/125694715 wait complete. 2023-10-16T23:28:25.668 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T23:28:25.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.780+0000 7f5aab926640 1 Processor -- start 2023-10-16T23:28:25.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.780+0000 7f5aab926640 1 -- start start 2023-10-16T23:28:25.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.784+0000 7f5aab926640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5aa40c12a0 0x7f5aa4146c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:25.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.784+0000 7f5aab926640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5aa4150880 0x7f5aa4150c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:25.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.784+0000 7f5aab926640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aa40bc8e0 con 0x7f5aa40bbe00 2023-10-16T23:28:25.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.784+0000 7f5aab926640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa40b3f40 con 0x7f5aa4150880 2023-10-16T23:28:25.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.784+0000 7f5aab926640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa40b4220 con 0x7f5aa40c12a0 2023-10-16T23:28:25.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.784+0000 7f5aa9ec3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5aa4150880 0x7f5aa4150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:25.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.784+0000 7f5aa96c2640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5aa40c12a0 0x7f5aa4146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:25.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.784+0000 7f5aa8ec1640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5aa40bbe00 0x7f5aa4147150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:36424/0 (socket says 172.21.15.12:36424) 2023-10-16T23:28:25.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.784+0000 7f5aa8ec1640 1 -- 172.21.15.12:0/97096463 learned_addr learned my addr 172.21.15.12:0/97096463 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:25.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.784+0000 7f5aa9ec3640 1 -- 172.21.15.12:0/97096463 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5aa40c12a0 msgr2=0x7f5aa4146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:25.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.784+0000 7f5aa9ec3640 1 --2- 172.21.15.12:0/97096463 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5aa40c12a0 0x7f5aa4146c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.784+0000 7f5aa9ec3640 1 -- 172.21.15.12:0/97096463 >> v1:172.21.15.31:6789/0 conn(0x7f5aa40bbe00 legacy=0x7f5aa4147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:25.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.784+0000 7f5aa9ec3640 1 -- 172.21.15.12:0/97096463 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa40b3b80 con 0x7f5aa4150880 2023-10-16T23:28:25.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.784+0000 7f5aa9ec3640 1 --2- 172.21.15.12:0/97096463 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5aa4150880 0x7f5aa4150c90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5a94009d90 tx=0x7f5a9401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2a56d8aaae23d8f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:25.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.784+0000 7f5aa3fff640 1 -- 172.21.15.12:0/97096463 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a940a5920 con 0x7f5aa4150880 2023-10-16T23:28:25.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.784+0000 7f5aa3fff640 1 -- 172.21.15.12:0/97096463 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a940a5a80 con 0x7f5aa4150880 2023-10-16T23:28:25.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.784+0000 7f5aa3fff640 1 -- 172.21.15.12:0/97096463 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a940a5e10 con 0x7f5aa4150880 2023-10-16T23:28:25.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aab926640 1 -- 172.21.15.12:0/97096463 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5aa4150880 msgr2=0x7f5aa4150c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:25.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aab926640 1 --2- 172.21.15.12:0/97096463 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5aa4150880 0x7f5aa4150c90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5a94009d90 tx=0x7f5a9401c950 comp rx=0 tx=0).stop 2023-10-16T23:28:25.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aab926640 1 -- 172.21.15.12:0/97096463 shutdown_connections 2023-10-16T23:28:25.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aab926640 1 --2- 172.21.15.12:0/97096463 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5aa4150880 0x7f5aa4150c90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aab926640 1 --2- 172.21.15.12:0/97096463 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5aa40c12a0 0x7f5aa4146c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aab926640 1 -- 172.21.15.12:0/97096463 >> 172.21.15.12:0/97096463 conn(0x7f5aa406bb10 msgr2=0x7f5aa40c0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:25.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aab926640 1 -- 172.21.15.12:0/97096463 shutdown_connections 2023-10-16T23:28:25.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aab926640 1 -- 172.21.15.12:0/97096463 wait complete. 2023-10-16T23:28:25.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aab926640 1 Processor -- start 2023-10-16T23:28:25.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aab926640 1 -- start start 2023-10-16T23:28:25.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aab926640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5aa40bbe00 0x7f5aa414fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:25.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aab926640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5aa40c12a0 0x7f5aa40b7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:25.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aab926640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aa4150880 0x7f5aa413f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:25.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aab926640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa4070380 con 0x7f5aa4150880 2023-10-16T23:28:25.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aab926640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa41503e0 con 0x7f5aa40bbe00 2023-10-16T23:28:25.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aab926640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa41eaef0 con 0x7f5aa40c12a0 2023-10-16T23:28:25.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aa9ec3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aa4150880 0x7f5aa413f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:25.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aa9ec3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aa4150880 0x7f5aa413f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33424/0 (socket says 172.21.15.12:33424) 2023-10-16T23:28:25.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aa9ec3640 1 -- 172.21.15.12:0/3025085541 learned_addr learned my addr 172.21.15.12:0/3025085541 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:25.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aa8ec1640 1 --2- 172.21.15.12:0/3025085541 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5aa40c12a0 0x7f5aa40b7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:25.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aa96c2640 1 --2- 172.21.15.12:0/3025085541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5aa40bbe00 0x7f5aa414fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:25.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aa9ec3640 1 -- 172.21.15.12:0/3025085541 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5aa40c12a0 msgr2=0x7f5aa40b7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:25.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aa9ec3640 1 --2- 172.21.15.12:0/3025085541 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5aa40c12a0 0x7f5aa40b7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aa9ec3640 1 -- 172.21.15.12:0/3025085541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5aa40bbe00 msgr2=0x7f5aa414fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:25.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aa9ec3640 1 --2- 172.21.15.12:0/3025085541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5aa40bbe00 0x7f5aa414fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aa9ec3640 1 -- 172.21.15.12:0/3025085541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a94009a70 con 0x7f5aa4150880 2023-10-16T23:28:25.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aa96c2640 1 --2- 172.21.15.12:0/3025085541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5aa40bbe00 0x7f5aa414fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:25.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aa9ec3640 1 --2- 172.21.15.12:0/3025085541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aa4150880 0x7f5aa413f270 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5a9401b000 tx=0x7f5a940196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:25.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aa1ffb640 1 -- 172.21.15.12:0/3025085541 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a94007000 con 0x7f5aa4150880 2023-10-16T23:28:25.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aa1ffb640 1 -- 172.21.15.12:0/3025085541 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a940aede0 con 0x7f5aa4150880 2023-10-16T23:28:25.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aa1ffb640 1 -- 172.21.15.12:0/3025085541 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a940b7650 con 0x7f5aa4150880 2023-10-16T23:28:25.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aab926640 1 -- 172.21.15.12:0/3025085541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa40b81a0 con 0x7f5aa4150880 2023-10-16T23:28:25.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.788+0000 7f5aab926640 1 -- 172.21.15.12:0/3025085541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa4070590 con 0x7f5aa4150880 2023-10-16T23:28:25.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.792+0000 7f5aab926640 1 -- 172.21.15.12:0/3025085541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa41eb060 con 0x7f5aa4150880 2023-10-16T23:28:25.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.792+0000 7f5aa1ffb640 1 -- 172.21.15.12:0/3025085541 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f5a940b4050 con 0x7f5aa4150880 2023-10-16T23:28:25.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.792+0000 7f5aa1ffb640 1 --2- 172.21.15.12:0/3025085541 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5a90065e60 0x7f5a90068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:25.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.792+0000 7f5aa1ffb640 1 -- 172.21.15.12:0/3025085541 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5a9411ea40 con 0x7f5aa4150880 2023-10-16T23:28:25.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.792+0000 7f5aa96c2640 1 --2- 172.21.15.12:0/3025085541 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5a90065e60 0x7f5a90068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:25.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.792+0000 7f5aa96c2640 1 --2- 172.21.15.12:0/3025085541 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5a90065e60 0x7f5a90068320 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c009ae0 tx=0x7f5a9c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:25.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.796+0000 7f5aa1ffb640 1 -- 172.21.15.12:0/3025085541 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f5a940ebfb0 con 0x7f5aa4150880 2023-10-16T23:28:25.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.944+0000 7f5aab926640 1 -- 172.21.15.12:0/3025085541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5aa40673a0 con 0x7f5aa4150880 2023-10-16T23:28:25.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.944+0000 7f5aa1ffb640 1 -- 172.21.15.12:0/3025085541 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5a940b20a0 con 0x7f5aa4150880 2023-10-16T23:28:25.947 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-16T23:28:25.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.944+0000 7f5aab926640 1 -- 172.21.15.12:0/3025085541 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5a90065e60 msgr2=0x7f5a90068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:25.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.944+0000 7f5aab926640 1 --2- 172.21.15.12:0/3025085541 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5a90065e60 0x7f5a90068320 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c009ae0 tx=0x7f5a9c008040 comp rx=0 tx=0).stop 2023-10-16T23:28:25.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.944+0000 7f5aab926640 1 -- 172.21.15.12:0/3025085541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aa4150880 msgr2=0x7f5aa413f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:25.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.944+0000 7f5aab926640 1 --2- 172.21.15.12:0/3025085541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aa4150880 0x7f5aa413f270 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5a9401b000 tx=0x7f5a940196f0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.944+0000 7f5aab926640 1 -- 172.21.15.12:0/3025085541 shutdown_connections 2023-10-16T23:28:25.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.944+0000 7f5aab926640 1 --2- 172.21.15.12:0/3025085541 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5a90065e60 0x7f5a90068320 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.944+0000 7f5aab926640 1 --2- 172.21.15.12:0/3025085541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5aa4150880 0x7f5aa413f270 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.944+0000 7f5aab926640 1 --2- 172.21.15.12:0/3025085541 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5aa40c12a0 0x7f5aa40b7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.944+0000 7f5aab926640 1 --2- 172.21.15.12:0/3025085541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5aa40bbe00 0x7f5aa414fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:25.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.944+0000 7f5aab926640 1 -- 172.21.15.12:0/3025085541 >> 172.21.15.12:0/3025085541 conn(0x7f5aa406bb10 msgr2=0x7f5aa40c0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:25.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.944+0000 7f5aab926640 1 -- 172.21.15.12:0/3025085541 shutdown_connections 2023-10-16T23:28:25.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:25.944+0000 7f5aab926640 1 -- 172.21.15.12:0/3025085541 wait complete. 2023-10-16T23:28:25.964 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T23:28:26.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.076+0000 7f90f0cc2640 1 Processor -- start 2023-10-16T23:28:26.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.076+0000 7f90f0cc2640 1 -- start start 2023-10-16T23:28:26.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.076+0000 7f90f0cc2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f90ec14cad0 0x7f90ec0b9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:26.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.076+0000 7f90f0cc2640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f90ec14fd80 0x7f90ec0bd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:26.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.076+0000 7f90f0cc2640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90ec1502d0 con 0x7f90ec06d080 2023-10-16T23:28:26.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.076+0000 7f90f0cc2640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90ec0700d0 con 0x7f90ec14cad0 2023-10-16T23:28:26.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.076+0000 7f90f0cc2640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec06fcf0 con 0x7f90ec14fd80 2023-10-16T23:28:26.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.076+0000 7f90e9d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f90ec14cad0 0x7f90ec0b9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:26.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.076+0000 7f90e9d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f90ec14cad0 0x7f90ec0b9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33426/0 (socket says 172.21.15.12:33426) 2023-10-16T23:28:26.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.076+0000 7f90e9d9b640 1 -- 172.21.15.12:0/458010640 learned_addr learned my addr 172.21.15.12:0/458010640 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:26.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.076+0000 7f90ead9d640 1 --2- 172.21.15.12:0/458010640 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f90ec14fd80 0x7f90ec0bd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:26.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.076+0000 7f90e9d9b640 1 -- 172.21.15.12:0/458010640 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f90ec14fd80 msgr2=0x7f90ec0bd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:26.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.076+0000 7f90e9d9b640 1 --2- 172.21.15.12:0/458010640 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f90ec14fd80 0x7f90ec0bd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:26.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.076+0000 7f90e9d9b640 1 -- 172.21.15.12:0/458010640 >> v1:172.21.15.31:6789/0 conn(0x7f90ec06d080 legacy=0x7f90ec14c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:26.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.076+0000 7f90e9d9b640 1 -- 172.21.15.12:0/458010640 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec06dda0 con 0x7f90ec14cad0 2023-10-16T23:28:26.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90e9d9b640 1 --2- 172.21.15.12:0/458010640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90ec14cad0 0x7f90ec0b9570 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f90e0009870 tx=0x7f90e001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db6ac4cd8f957d75 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:26.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90e959a640 1 -- 172.21.15.12:0/458010640 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e00ab650 con 0x7f90ec14cad0 2023-10-16T23:28:26.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90e959a640 1 -- 172.21.15.12:0/458010640 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e00ab7b0 con 0x7f90ec14cad0 2023-10-16T23:28:26.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90e959a640 1 -- 172.21.15.12:0/458010640 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e00abb40 con 0x7f90ec14cad0 2023-10-16T23:28:26.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90f0cc2640 1 -- 172.21.15.12:0/458010640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90ec14cad0 msgr2=0x7f90ec0b9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:26.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90f0cc2640 1 --2- 172.21.15.12:0/458010640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90ec14cad0 0x7f90ec0b9570 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f90e0009870 tx=0x7f90e001c470 comp rx=0 tx=0).stop 2023-10-16T23:28:26.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90f0cc2640 1 -- 172.21.15.12:0/458010640 shutdown_connections 2023-10-16T23:28:26.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90f0cc2640 1 --2- 172.21.15.12:0/458010640 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f90ec14fd80 0x7f90ec0bd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:26.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90f0cc2640 1 --2- 172.21.15.12:0/458010640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90ec14cad0 0x7f90ec0b9570 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:26.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90f0cc2640 1 -- 172.21.15.12:0/458010640 >> 172.21.15.12:0/458010640 conn(0x7f90ec0c2a70 msgr2=0x7f90ec0c2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:26.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90f0cc2640 1 -- 172.21.15.12:0/458010640 shutdown_connections 2023-10-16T23:28:26.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90f0cc2640 1 -- 172.21.15.12:0/458010640 wait complete. 2023-10-16T23:28:26.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90f0cc2640 1 Processor -- start 2023-10-16T23:28:26.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90f0cc2640 1 -- start start 2023-10-16T23:28:26.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90f0cc2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90ec06d080 0x7f90ec14da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:26.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90f0cc2640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f90ec14cad0 0x7f90ec141060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:26.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90f0cc2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90ec14fd80 0x7f90ec1e6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:26.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90f0cc2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec14df90 con 0x7f90ec14fd80 2023-10-16T23:28:26.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90f0cc2640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec14cf70 con 0x7f90ec06d080 2023-10-16T23:28:26.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90f0cc2640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec14d250 con 0x7f90ec14cad0 2023-10-16T23:28:26.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90ead9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90ec14fd80 0x7f90ec1e6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:26.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90ead9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90ec14fd80 0x7f90ec1e6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33442/0 (socket says 172.21.15.12:33442) 2023-10-16T23:28:26.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90ead9d640 1 -- 172.21.15.12:0/3066449378 learned_addr learned my addr 172.21.15.12:0/3066449378 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:26.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90e9d9b640 1 --2- 172.21.15.12:0/3066449378 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f90ec14cad0 0x7f90ec141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:26.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90ea59c640 1 --2- 172.21.15.12:0/3066449378 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90ec06d080 0x7f90ec14da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:26.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90ead9d640 1 -- 172.21.15.12:0/3066449378 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f90ec14cad0 msgr2=0x7f90ec141060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:26.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90ead9d640 1 --2- 172.21.15.12:0/3066449378 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f90ec14cad0 0x7f90ec141060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:26.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90ead9d640 1 -- 172.21.15.12:0/3066449378 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90ec06d080 msgr2=0x7f90ec14da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:26.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90ead9d640 1 --2- 172.21.15.12:0/3066449378 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90ec06d080 0x7f90ec14da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:26.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90ead9d640 1 -- 172.21.15.12:0/3066449378 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e00094d0 con 0x7f90ec14fd80 2023-10-16T23:28:26.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90ea59c640 1 --2- 172.21.15.12:0/3066449378 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90ec06d080 0x7f90ec14da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:26.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90ead9d640 1 --2- 172.21.15.12:0/3066449378 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90ec14fd80 0x7f90ec1e6bb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f90e4007e60 tx=0x7f90e400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:26.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90daffd640 1 -- 172.21.15.12:0/3066449378 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4014420 con 0x7f90ec14fd80 2023-10-16T23:28:26.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90daffd640 1 -- 172.21.15.12:0/3066449378 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e40145a0 con 0x7f90ec14fd80 2023-10-16T23:28:26.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90f0cc2640 1 -- 172.21.15.12:0/3066449378 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ec14d530 con 0x7f90ec14fd80 2023-10-16T23:28:26.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90daffd640 1 -- 172.21.15.12:0/3066449378 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4014950 con 0x7f90ec14fd80 2023-10-16T23:28:26.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.080+0000 7f90f0cc2640 1 -- 172.21.15.12:0/3066449378 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ec1390d0 con 0x7f90ec14fd80 2023-10-16T23:28:26.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.084+0000 7f90f0cc2640 1 -- 172.21.15.12:0/3066449378 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90ec14d770 con 0x7f90ec14fd80 2023-10-16T23:28:26.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.084+0000 7f90daffd640 1 -- 172.21.15.12:0/3066449378 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f90e4014ab0 con 0x7f90ec14fd80 2023-10-16T23:28:26.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.084+0000 7f90daffd640 1 --2- 172.21.15.12:0/3066449378 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f90cc065e60 0x7f90cc068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:26.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.084+0000 7f90daffd640 1 -- 172.21.15.12:0/3066449378 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f90e4084ba0 con 0x7f90ec14fd80 2023-10-16T23:28:26.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.084+0000 7f90ea59c640 1 --2- 172.21.15.12:0/3066449378 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f90cc065e60 0x7f90cc068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:26.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.084+0000 7f90ea59c640 1 --2- 172.21.15.12:0/3066449378 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f90cc065e60 0x7f90cc068320 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f90ec1365c0 tx=0x7f90dc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:26.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.088+0000 7f90daffd640 1 -- 172.21.15.12:0/3066449378 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f90e4052190 con 0x7f90ec14fd80 2023-10-16T23:28:26.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.240+0000 7f90f0cc2640 1 -- 172.21.15.12:0/3066449378 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f90ec14d770 con 0x7f90ec14fd80 2023-10-16T23:28:26.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.240+0000 7f90daffd640 1 -- 172.21.15.12:0/3066449378 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f90ec14d770 con 0x7f90ec14fd80 2023-10-16T23:28:26.244 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-16T23:28:26.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.240+0000 7f90f0cc2640 1 -- 172.21.15.12:0/3066449378 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f90cc065e60 msgr2=0x7f90cc068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:26.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.240+0000 7f90f0cc2640 1 --2- 172.21.15.12:0/3066449378 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f90cc065e60 0x7f90cc068320 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f90ec1365c0 tx=0x7f90dc009040 comp rx=0 tx=0).stop 2023-10-16T23:28:26.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.240+0000 7f90f0cc2640 1 -- 172.21.15.12:0/3066449378 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90ec14fd80 msgr2=0x7f90ec1e6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:26.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.240+0000 7f90f0cc2640 1 --2- 172.21.15.12:0/3066449378 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90ec14fd80 0x7f90ec1e6bb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f90e4007e60 tx=0x7f90e400e4b0 comp rx=0 tx=0).stop 2023-10-16T23:28:26.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.240+0000 7f90f0cc2640 1 -- 172.21.15.12:0/3066449378 shutdown_connections 2023-10-16T23:28:26.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.240+0000 7f90f0cc2640 1 --2- 172.21.15.12:0/3066449378 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f90cc065e60 0x7f90cc068320 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:26.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.240+0000 7f90f0cc2640 1 --2- 172.21.15.12:0/3066449378 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90ec14fd80 0x7f90ec1e6bb0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:26.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.240+0000 7f90f0cc2640 1 --2- 172.21.15.12:0/3066449378 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f90ec14cad0 0x7f90ec141060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:26.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.240+0000 7f90f0cc2640 1 --2- 172.21.15.12:0/3066449378 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90ec06d080 0x7f90ec14da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:26.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.240+0000 7f90f0cc2640 1 -- 172.21.15.12:0/3066449378 >> 172.21.15.12:0/3066449378 conn(0x7f90ec0c2a70 msgr2=0x7f90ec14b520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:26.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.240+0000 7f90f0cc2640 1 -- 172.21.15.12:0/3066449378 shutdown_connections 2023-10-16T23:28:26.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.240+0000 7f90f0cc2640 1 -- 172.21.15.12:0/3066449378 wait complete. 2023-10-16T23:28:26.262 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T23:28:26.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f8577bfe640 1 Processor -- start 2023-10-16T23:28:26.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f8577bfe640 1 -- start start 2023-10-16T23:28:26.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f8577bfe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f85700c1130 0x7f85700b8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:26.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f8577bfe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f857014c520 0x7f857014c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:26.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f8577bfe640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85700b40c0 con 0x7f857014cec0 2023-10-16T23:28:26.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f8577bfe640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85700b3ca0 con 0x7f85700c1130 2023-10-16T23:28:26.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f8577bfe640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85700b7ce0 con 0x7f857014c520 2023-10-16T23:28:26.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f857619b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f857014cec0 0x7f85700b9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48158/0 (socket says 172.21.15.12:48158) 2023-10-16T23:28:26.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f857619b640 1 -- 172.21.15.12:0/188432607 learned_addr learned my addr 172.21.15.12:0/188432607 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:26.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f8575199640 1 --2- 172.21.15.12:0/188432607 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f857014c520 0x7f857014c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:26.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f8574998640 1 -- 172.21.15.12:0/188432607 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360487127 0 0) 0x7f85700b40c0 con 0x7f857014cec0 2023-10-16T23:28:26.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f857599a640 1 --2- 172.21.15.12:0/188432607 >> v2:172.21.15.31:3300/0 conn(0x7f85700c1130 0x7f85700b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:26.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f8574998640 1 -- 172.21.15.12:0/188432607 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8558003530 con 0x7f857014cec0 2023-10-16T23:28:26.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f8574998640 1 -- 172.21.15.12:0/188432607 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1469851712 0 0) 0x7f8558003530 con 0x7f857014cec0 2023-10-16T23:28:26.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f8574998640 1 -- 172.21.15.12:0/188432607 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f857014c520 msgr2=0x7f857014c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:26.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f8574998640 1 --2- 172.21.15.12:0/188432607 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f857014c520 0x7f857014c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:26.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f8574998640 1 -- 172.21.15.12:0/188432607 >> v2:172.21.15.31:3300/0 conn(0x7f85700c1130 msgr2=0x7f85700b8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:26.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f8574998640 1 --2- 172.21.15.12:0/188432607 >> v2:172.21.15.31:3300/0 conn(0x7f85700c1130 0x7f85700b8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:26.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f8574998640 1 -- 172.21.15.12:0/188432607 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85700c1510 con 0x7f857014cec0 2023-10-16T23:28:26.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f8574998640 1 -- 172.21.15.12:0/188432607 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7f8560001680 con 0x7f857014cec0 2023-10-16T23:28:26.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f8574998640 1 -- 172.21.15.12:0/188432607 >> v1:172.21.15.12:6789/0 conn(0x7f857014cec0 legacy=0x7f85700b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:26.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f8574998640 1 --2- 172.21.15.12:0/188432607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8558003980 0x7f8558003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:26.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f8574998640 1 --2- 172.21.15.12:0/188432607 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f857014c520 0x7f85580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:26.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f8574998640 1 --2- 172.21.15.12:0/188432607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8558004d10 0x7f8558005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:26.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f8574998640 1 -- 172.21.15.12:0/188432607 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85700b3ca0 con 0x7f8558004d10 2023-10-16T23:28:26.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f8574998640 1 -- 172.21.15.12:0/188432607 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85700b7ce0 con 0x7f8558003980 2023-10-16T23:28:26.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f8574998640 1 -- 172.21.15.12:0/188432607 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855800fe20 con 0x7f857014c520 2023-10-16T23:28:26.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f857619b640 1 --2- 172.21.15.12:0/188432607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8558004d10 0x7f8558005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:26.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f857599a640 1 --2- 172.21.15.12:0/188432607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8558003980 0x7f8558003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:26.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f857619b640 1 -- 172.21.15.12:0/188432607 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f857014c520 msgr2=0x7f85580047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:26.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f8575199640 1 --2- 172.21.15.12:0/188432607 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f857014c520 0x7f85580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:26.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f857619b640 1 --2- 172.21.15.12:0/188432607 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f857014c520 0x7f85580047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:26.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f857619b640 1 -- 172.21.15.12:0/188432607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8558003980 msgr2=0x7f8558003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:26.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f857619b640 1 --2- 172.21.15.12:0/188432607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8558003980 0x7f8558003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:26.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f857619b640 1 -- 172.21.15.12:0/188432607 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8558003530 con 0x7f8558004d10 2023-10-16T23:28:26.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.384+0000 7f857599a640 1 --2- 172.21.15.12:0/188432607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8558003980 0x7f8558003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:26.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.388+0000 7f857619b640 1 --2- 172.21.15.12:0/188432607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8558004d10 0x7f8558005190 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f856000c210 tx=0x7f856001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ea55add79791fc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:26.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.388+0000 7f8574998640 1 -- 172.21.15.12:0/188432607 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85600058e0 con 0x7f8558004d10 2023-10-16T23:28:26.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.388+0000 7f8574998640 1 -- 172.21.15.12:0/188432607 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8560005a40 con 0x7f8558004d10 2023-10-16T23:28:26.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.388+0000 7f8574998640 1 -- 172.21.15.12:0/188432607 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8560005e30 con 0x7f8558004d10 2023-10-16T23:28:26.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.388+0000 7f8577bfe640 1 -- 172.21.15.12:0/188432607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8558004d10 msgr2=0x7f8558005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:26.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.388+0000 7f8577bfe640 1 --2- 172.21.15.12:0/188432607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8558004d10 0x7f8558005190 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f856000c210 tx=0x7f856001cc40 comp rx=0 tx=0).stop 2023-10-16T23:28:26.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.388+0000 7f857619b640 1 -- 172.21.15.12:0/188432607 reap_dead start 2023-10-16T23:28:26.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.388+0000 7f8577bfe640 1 -- 172.21.15.12:0/188432607 shutdown_connections 2023-10-16T23:28:26.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.388+0000 7f8577bfe640 1 -- 172.21.15.12:0/188432607 >> 172.21.15.12:0/188432607 conn(0x7f857006ba20 msgr2=0x7f85700c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:26.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.388+0000 7f8577bfe640 1 -- 172.21.15.12:0/188432607 shutdown_connections 2023-10-16T23:28:26.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.388+0000 7f8577bfe640 1 -- 172.21.15.12:0/188432607 wait complete. 2023-10-16T23:28:26.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.388+0000 7f8577bfe640 1 Processor -- start 2023-10-16T23:28:26.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.388+0000 7f8577bfe640 1 -- start start 2023-10-16T23:28:26.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.388+0000 7f8577bfe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85700bf8e0 0x7f857014eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:26.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.388+0000 7f8577bfe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85701458d0 0x7f85701e3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:26.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.388+0000 7f8577bfe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85700bfcc0 0x7f8570144cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:26.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.388+0000 7f8577bfe640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85700b6870 con 0x7f85701458d0 2023-10-16T23:28:26.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.388+0000 7f8577bfe640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85700b6320 con 0x7f85700bf8e0 2023-10-16T23:28:26.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.388+0000 7f8577bfe640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85700b5fb0 con 0x7f85700bfcc0 2023-10-16T23:28:26.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.388+0000 7f8575199640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85701458d0 0x7f85701e3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:26.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.388+0000 7f8575199640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85701458d0 0x7f85701e3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33448/0 (socket says 172.21.15.12:33448) 2023-10-16T23:28:26.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.388+0000 7f8575199640 1 -- 172.21.15.12:0/2460609456 learned_addr learned my addr 172.21.15.12:0/2460609456 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:26.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.392+0000 7f857619b640 1 --2- 172.21.15.12:0/2460609456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85700bfcc0 0x7f8570144cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:26.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.392+0000 7f857599a640 1 --2- 172.21.15.12:0/2460609456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85700bf8e0 0x7f857014eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:26.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.392+0000 7f8575199640 1 -- 172.21.15.12:0/2460609456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85700bfcc0 msgr2=0x7f8570144cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:26.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.392+0000 7f8575199640 1 --2- 172.21.15.12:0/2460609456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85700bfcc0 0x7f8570144cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:26.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.392+0000 7f8575199640 1 -- 172.21.15.12:0/2460609456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85700bf8e0 msgr2=0x7f857014eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:26.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.392+0000 7f8575199640 1 --2- 172.21.15.12:0/2460609456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85700bf8e0 0x7f857014eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:26.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.392+0000 7f8575199640 1 -- 172.21.15.12:0/2460609456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85700b6500 con 0x7f85701458d0 2023-10-16T23:28:26.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.392+0000 7f857599a640 1 --2- 172.21.15.12:0/2460609456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85700bf8e0 0x7f857014eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:26.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.392+0000 7f8575199640 1 --2- 172.21.15.12:0/2460609456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85701458d0 0x7f85701e3bd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f856c00f350 tx=0x7f856c00f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:26.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.392+0000 7f85667fc640 1 -- 172.21.15.12:0/2460609456 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c017600 con 0x7f85701458d0 2023-10-16T23:28:26.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.392+0000 7f85667fc640 1 -- 172.21.15.12:0/2460609456 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856c011040 con 0x7f85701458d0 2023-10-16T23:28:26.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.392+0000 7f8577bfe640 1 -- 172.21.15.12:0/2460609456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85700b42f0 con 0x7f85701458d0 2023-10-16T23:28:26.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.392+0000 7f85667fc640 1 -- 172.21.15.12:0/2460609456 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c0179c0 con 0x7f85701458d0 2023-10-16T23:28:26.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.392+0000 7f8577bfe640 1 -- 172.21.15.12:0/2460609456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85701e42e0 con 0x7f85701458d0 2023-10-16T23:28:26.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.392+0000 7f8577bfe640 1 -- 172.21.15.12:0/2460609456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85700b5e10 con 0x7f85701458d0 2023-10-16T23:28:26.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.392+0000 7f85667fc640 1 -- 172.21.15.12:0/2460609456 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f856c017b20 con 0x7f85701458d0 2023-10-16T23:28:26.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.392+0000 7f85667fc640 1 --2- 172.21.15.12:0/2460609456 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f855c065e60 0x7f855c068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:26.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.392+0000 7f85667fc640 1 -- 172.21.15.12:0/2460609456 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f856c083ee0 con 0x7f85701458d0 2023-10-16T23:28:26.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.392+0000 7f857599a640 1 --2- 172.21.15.12:0/2460609456 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f855c065e60 0x7f855c068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:26.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.392+0000 7f857599a640 1 --2- 172.21.15.12:0/2460609456 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f855c065e60 0x7f855c068320 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8568009b40 tx=0x7f8568008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:26.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.396+0000 7f85667fc640 1 -- 172.21.15.12:0/2460609456 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f85700b5e10 con 0x7f85701458d0 2023-10-16T23:28:26.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.560+0000 7f8577bfe640 1 -- 172.21.15.12:0/2460609456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f857014e8b0 con 0x7f85701458d0 2023-10-16T23:28:26.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.560+0000 7f85667fc640 1 -- 172.21.15.12:0/2460609456 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f857014e8b0 con 0x7f85701458d0 2023-10-16T23:28:26.565 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2023-10-16T23:28:26.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.564+0000 7f8577bfe640 1 -- 172.21.15.12:0/2460609456 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f855c065e60 msgr2=0x7f855c068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:26.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.564+0000 7f8577bfe640 1 --2- 172.21.15.12:0/2460609456 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f855c065e60 0x7f855c068320 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8568009b40 tx=0x7f8568008040 comp rx=0 tx=0).stop 2023-10-16T23:28:26.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.564+0000 7f8577bfe640 1 -- 172.21.15.12:0/2460609456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85701458d0 msgr2=0x7f85701e3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:26.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.564+0000 7f8577bfe640 1 --2- 172.21.15.12:0/2460609456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85701458d0 0x7f85701e3bd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f856c00f350 tx=0x7f856c00f810 comp rx=0 tx=0).stop 2023-10-16T23:28:26.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.564+0000 7f8577bfe640 1 -- 172.21.15.12:0/2460609456 shutdown_connections 2023-10-16T23:28:26.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.564+0000 7f8577bfe640 1 --2- 172.21.15.12:0/2460609456 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f855c065e60 0x7f855c068320 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:26.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.564+0000 7f8577bfe640 1 --2- 172.21.15.12:0/2460609456 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85700bfcc0 0x7f8570144cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:26.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.564+0000 7f8577bfe640 1 --2- 172.21.15.12:0/2460609456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85701458d0 0x7f85701e3bd0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:26.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.564+0000 7f8577bfe640 1 --2- 172.21.15.12:0/2460609456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85700bf8e0 0x7f857014eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:26.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.564+0000 7f8577bfe640 1 -- 172.21.15.12:0/2460609456 >> 172.21.15.12:0/2460609456 conn(0x7f857006ba20 msgr2=0x7f85700bb6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:26.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.564+0000 7f8577bfe640 1 -- 172.21.15.12:0/2460609456 shutdown_connections 2023-10-16T23:28:26.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:26.564+0000 7f8577bfe640 1 -- 172.21.15.12:0/2460609456 wait complete. 2023-10-16T23:28:26.581 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi138.front.sepia.ceph.com... 2023-10-16T23:28:26.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:26.582 DEBUG:teuthology.orchestra.run.smithi138:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-10-16T23:28:26.606 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi138.stderr:ceph-fuse[33334]: fuse finished with error 0 and tester_r 0 2023-10-16T23:28:26.607 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T23:28:32.710 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi138.front.sepia.ceph.com 2023-10-16T23:28:32.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:32.711 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-16T23:28:32.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:32.733 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-10-16T23:28:32.739 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-16T23:28:32.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:32.740 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T23:28:32.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:32.796 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2023-10-16T23:28:32.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:32.947 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2023-10-16T23:28:32.953 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 0) 2023-10-16T23:28:32.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:32.954 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T23:28:33.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:33.010 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link delete ceph-brx 2023-10-16T23:28:33.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:33.199 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2023-10-16T23:28:33.205 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T23:28:33.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:33.206 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T23:28:33.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T23:28:33.264 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2023-10-16T23:28:33.488 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-16T23:28:33.497 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-16T23:28:33.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T23:28:33.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.628+0000 7fbf0b874640 1 Processor -- start 2023-10-16T23:28:33.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.628+0000 7fbf0b874640 1 -- start start 2023-10-16T23:28:33.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.632+0000 7fbf0b874640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf0406e770 0x7fbf040c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:33.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.632+0000 7fbf0b874640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbf040bfc30 0x7fbf04153150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:33.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.632+0000 7fbf0b874640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf040c01e0 con 0x7fbf040c1950 2023-10-16T23:28:33.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.632+0000 7fbf0b874640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf040b85b0 con 0x7fbf040bfc30 2023-10-16T23:28:33.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.632+0000 7fbf0b874640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf040b8120 con 0x7fbf0406e770 2023-10-16T23:28:33.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.632+0000 7fbf09e11640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbf040bfc30 0x7fbf04153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:33.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.632+0000 7fbf09e11640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbf040bfc30 0x7fbf04153150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36376/0 (socket says 172.21.15.12:36376) 2023-10-16T23:28:33.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.632+0000 7fbf09e11640 1 -- 172.21.15.12:0/1332915402 learned_addr learned my addr 172.21.15.12:0/1332915402 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:33.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.632+0000 7fbf08e0f640 1 --2- 172.21.15.12:0/1332915402 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf0406e770 0x7fbf040c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:33.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.632+0000 7fbf09e11640 1 -- 172.21.15.12:0/1332915402 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf0406e770 msgr2=0x7fbf040c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:33.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.632+0000 7fbf09e11640 1 --2- 172.21.15.12:0/1332915402 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf0406e770 0x7fbf040c1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:33.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.632+0000 7fbf09e11640 1 -- 172.21.15.12:0/1332915402 >> v1:172.21.15.31:6789/0 conn(0x7fbf040c1950 legacy=0x7fbf04152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:33.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.632+0000 7fbf09e11640 1 -- 172.21.15.12:0/1332915402 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf040b7db0 con 0x7fbf040bfc30 2023-10-16T23:28:33.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.632+0000 7fbf09e11640 1 --2- 172.21.15.12:0/1332915402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf040bfc30 0x7fbf04153150 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbefc009870 tx=0x7fbefc01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd74832be2d07ff server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:33.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.632+0000 7fbf03fff640 1 -- 172.21.15.12:0/1332915402 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc0aa430 con 0x7fbf040bfc30 2023-10-16T23:28:33.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.632+0000 7fbf03fff640 1 -- 172.21.15.12:0/1332915402 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbefc0aa590 con 0x7fbf040bfc30 2023-10-16T23:28:33.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.632+0000 7fbf03fff640 1 -- 172.21.15.12:0/1332915402 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc0aa920 con 0x7fbf040bfc30 2023-10-16T23:28:33.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf0b874640 1 -- 172.21.15.12:0/1332915402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf040bfc30 msgr2=0x7fbf04153150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:33.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf0b874640 1 --2- 172.21.15.12:0/1332915402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf040bfc30 0x7fbf04153150 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbefc009870 tx=0x7fbefc01c4b0 comp rx=0 tx=0).stop 2023-10-16T23:28:33.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf0b874640 1 -- 172.21.15.12:0/1332915402 shutdown_connections 2023-10-16T23:28:33.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf0b874640 1 --2- 172.21.15.12:0/1332915402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf040bfc30 0x7fbf04153150 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:33.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf0b874640 1 --2- 172.21.15.12:0/1332915402 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf0406e770 0x7fbf040c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:33.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf0b874640 1 -- 172.21.15.12:0/1332915402 >> 172.21.15.12:0/1332915402 conn(0x7fbf0406b5d0 msgr2=0x7fbf0406b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:33.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf0b874640 1 -- 172.21.15.12:0/1332915402 shutdown_connections 2023-10-16T23:28:33.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf0b874640 1 -- 172.21.15.12:0/1332915402 wait complete. 2023-10-16T23:28:33.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf0b874640 1 Processor -- start 2023-10-16T23:28:33.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf0b874640 1 -- start start 2023-10-16T23:28:33.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf0b874640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf0406e770 0x7fbf041468a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:33.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf0b874640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf040bfc30 0x7fbf040bc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:33.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf0b874640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf040c1950 0x7fbf041ea980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:33.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf0b874640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf040b8700 con 0x7fbf040c1950 2023-10-16T23:28:33.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf0b874640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf040bcee0 con 0x7fbf0406e770 2023-10-16T23:28:33.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf0b874640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf04146ea0 con 0x7fbf040bfc30 2023-10-16T23:28:33.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf09e11640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf040c1950 0x7fbf041ea980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:33.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf09e11640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf040c1950 0x7fbf041ea980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36384/0 (socket says 172.21.15.12:36384) 2023-10-16T23:28:33.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf09e11640 1 -- 172.21.15.12:0/2643292570 learned_addr learned my addr 172.21.15.12:0/2643292570 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:33.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf08e0f640 1 --2- 172.21.15.12:0/2643292570 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf040bfc30 0x7fbf040bc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:33.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf09610640 1 --2- 172.21.15.12:0/2643292570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf0406e770 0x7fbf041468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:33.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf09e11640 1 -- 172.21.15.12:0/2643292570 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf040bfc30 msgr2=0x7fbf040bc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:33.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf09e11640 1 --2- 172.21.15.12:0/2643292570 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf040bfc30 0x7fbf040bc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:33.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf09e11640 1 -- 172.21.15.12:0/2643292570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf0406e770 msgr2=0x7fbf041468a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:33.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf09e11640 1 --2- 172.21.15.12:0/2643292570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf0406e770 0x7fbf041468a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:33.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf09e11640 1 -- 172.21.15.12:0/2643292570 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbefc0094d0 con 0x7fbf040c1950 2023-10-16T23:28:33.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf08e0f640 1 --2- 172.21.15.12:0/2643292570 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf040bfc30 0x7fbf040bc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:33.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf09e11640 1 --2- 172.21.15.12:0/2643292570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf040c1950 0x7fbf041ea980 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbefc0ac040 tx=0x7fbefc019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:33.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf01ffb640 1 -- 172.21.15.12:0/2643292570 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc0aa430 con 0x7fbf040c1950 2023-10-16T23:28:33.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf01ffb640 1 -- 172.21.15.12:0/2643292570 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbefc0b3820 con 0x7fbf040c1950 2023-10-16T23:28:33.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf0b874640 1 -- 172.21.15.12:0/2643292570 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf04147180 con 0x7fbf040c1950 2023-10-16T23:28:33.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf01ffb640 1 -- 172.21.15.12:0/2643292570 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc0b3bd0 con 0x7fbf040c1950 2023-10-16T23:28:33.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf0b874640 1 -- 172.21.15.12:0/2643292570 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf041eaec0 con 0x7fbf040c1950 2023-10-16T23:28:33.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.636+0000 7fbf0b874640 1 -- 172.21.15.12:0/2643292570 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf040b8870 con 0x7fbf040c1950 2023-10-16T23:28:33.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.640+0000 7fbf01ffb640 1 -- 172.21.15.12:0/2643292570 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fbefc0b3d30 con 0x7fbf040c1950 2023-10-16T23:28:33.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.640+0000 7fbf01ffb640 1 --2- 172.21.15.12:0/2643292570 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fbef0065e90 0x7fbef0068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:33.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.640+0000 7fbf01ffb640 1 -- 172.21.15.12:0/2643292570 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fbefc11dd10 con 0x7fbf040c1950 2023-10-16T23:28:33.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.640+0000 7fbf09610640 1 --2- 172.21.15.12:0/2643292570 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fbef0065e90 0x7fbef0068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:33.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.640+0000 7fbf09610640 1 --2- 172.21.15.12:0/2643292570 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fbef0065e90 0x7fbef0068350 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbef4000f70 tx=0x7fbef4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:33.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.644+0000 7fbf01ffb640 1 -- 172.21.15.12:0/2643292570 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fbf040b8870 con 0x7fbf040c1950 2023-10-16T23:28:33.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.796+0000 7fbf0b874640 1 -- 172.21.15.12:0/2643292570 --> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf040b8840 con 0x7fbef0065e90 2023-10-16T23:28:33.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.820+0000 7fbf01ffb640 1 -- 172.21.15.12:0/2643292570 <== mgr.4108 v2:172.21.15.31:6832/37949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+295503 (secure 0 0 0) 0x7fbf040b8840 con 0x7fbef0065e90 2023-10-16T23:28:33.827 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:28:33.829 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-16T23:28:33.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.824+0000 7fbf0b874640 1 -- 172.21.15.12:0/2643292570 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fbef0065e90 msgr2=0x7fbef0068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:33.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.824+0000 7fbf0b874640 1 --2- 172.21.15.12:0/2643292570 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fbef0065e90 0x7fbef0068350 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbef4000f70 tx=0x7fbef4009040 comp rx=0 tx=0).stop 2023-10-16T23:28:33.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.824+0000 7fbf0b874640 1 -- 172.21.15.12:0/2643292570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf040c1950 msgr2=0x7fbf041ea980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:33.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.824+0000 7fbf0b874640 1 --2- 172.21.15.12:0/2643292570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf040c1950 0x7fbf041ea980 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbefc0ac040 tx=0x7fbefc019250 comp rx=0 tx=0).stop 2023-10-16T23:28:33.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.824+0000 7fbf0b874640 1 -- 172.21.15.12:0/2643292570 shutdown_connections 2023-10-16T23:28:33.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.824+0000 7fbf0b874640 1 --2- 172.21.15.12:0/2643292570 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fbef0065e90 0x7fbef0068350 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:33.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.824+0000 7fbf0b874640 1 --2- 172.21.15.12:0/2643292570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf040c1950 0x7fbf041ea980 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:33.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.824+0000 7fbf0b874640 1 --2- 172.21.15.12:0/2643292570 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbf040bfc30 0x7fbf040bc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:33.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.824+0000 7fbf0b874640 1 --2- 172.21.15.12:0/2643292570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf0406e770 0x7fbf041468a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:33.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.824+0000 7fbf0b874640 1 -- 172.21.15.12:0/2643292570 >> 172.21.15.12:0/2643292570 conn(0x7fbf0406b5d0 msgr2=0x7fbf0406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:33.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.824+0000 7fbf0b874640 1 -- 172.21.15.12:0/2643292570 shutdown_connections 2023-10-16T23:28:33.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:33.824+0000 7fbf0b874640 1 -- 172.21.15.12:0/2643292570 wait complete. 2023-10-16T23:28:33.845 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2023-10-16T23:28:33.303359+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595638,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":215,"num_write_kb":2441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223048,"kb_used_data":3336,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751672,"statfs":{"total":773094113280,"available":772865712128,"internally_reserved":0,"allocated":3416064,"data_stored":2020140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":282,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003584"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.243979+0000","last_change":"2023-10-16T23:27:40.706600+0000","last_active":"2023-10-16T23:28:22.243979+0000","last_peered":"2023-10-16T23:28:22.243979+0000","last_clean":"2023-10-16T23:28:22.243979+0000","last_became_active":"2023-10-16T23:27:40.706320+0000","last_became_peered":"2023-10-16T23:27:40.706320+0000","last_unstale":"2023-10-16T23:28:22.243979+0000","last_undegraded":"2023-10-16T23:28:22.243979+0000","last_fullsized":"2023-10-16T23:28:22.243979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:48:20.356964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962517+0000","last_change":"2023-10-16T23:27:40.756555+0000","last_active":"2023-10-16T23:28:22.962517+0000","last_peered":"2023-10-16T23:28:22.962517+0000","last_clean":"2023-10-16T23:28:22.962517+0000","last_became_active":"2023-10-16T23:27:40.754736+0000","last_became_peered":"2023-10-16T23:27:40.754736+0000","last_unstale":"2023-10-16T23:28:22.962517+0000","last_undegraded":"2023-10-16T23:28:22.962517+0000","last_fullsized":"2023-10-16T23:28:22.962517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:45.642622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248499+0000","last_change":"2023-10-16T23:27:40.726586+0000","last_active":"2023-10-16T23:28:22.248499+0000","last_peered":"2023-10-16T23:28:22.248499+0000","last_clean":"2023-10-16T23:28:22.248499+0000","last_became_active":"2023-10-16T23:27:40.725731+0000","last_became_peered":"2023-10-16T23:27:40.725731+0000","last_unstale":"2023-10-16T23:28:22.248499+0000","last_undegraded":"2023-10-16T23:28:22.248499+0000","last_fullsized":"2023-10-16T23:28:22.248499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:04:22.434372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247656+0000","last_change":"2023-10-16T23:27:40.715543+0000","last_active":"2023-10-16T23:28:22.247656+0000","last_peered":"2023-10-16T23:28:22.247656+0000","last_clean":"2023-10-16T23:28:22.247656+0000","last_became_active":"2023-10-16T23:27:40.714592+0000","last_became_peered":"2023-10-16T23:27:40.714592+0000","last_unstale":"2023-10-16T23:28:22.247656+0000","last_undegraded":"2023-10-16T23:28:22.247656+0000","last_fullsized":"2023-10-16T23:28:22.247656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:42:37.696897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.311992+0000","last_change":"2023-10-16T23:27:40.722734+0000","last_active":"2023-10-16T23:27:43.311992+0000","last_peered":"2023-10-16T23:27:43.311992+0000","last_clean":"2023-10-16T23:27:43.311992+0000","last_became_active":"2023-10-16T23:27:40.722399+0000","last_became_peered":"2023-10-16T23:27:40.722399+0000","last_unstale":"2023-10-16T23:27:43.311992+0000","last_undegraded":"2023-10-16T23:27:43.311992+0000","last_fullsized":"2023-10-16T23:27:43.311992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:19:17.463284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246458+0000","last_change":"2023-10-16T23:27:40.716139+0000","last_active":"2023-10-16T23:28:22.246458+0000","last_peered":"2023-10-16T23:28:22.246458+0000","last_clean":"2023-10-16T23:28:22.246458+0000","last_became_active":"2023-10-16T23:27:40.715294+0000","last_became_peered":"2023-10-16T23:27:40.715294+0000","last_unstale":"2023-10-16T23:28:22.246458+0000","last_undegraded":"2023-10-16T23:28:22.246458+0000","last_fullsized":"2023-10-16T23:28:22.246458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:19:17.463284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683398+0000","last_change":"2023-10-16T23:27:40.762253+0000","last_active":"2023-10-16T23:28:22.683398+0000","last_peered":"2023-10-16T23:28:22.683398+0000","last_clean":"2023-10-16T23:28:22.683398+0000","last_became_active":"2023-10-16T23:27:40.760726+0000","last_became_peered":"2023-10-16T23:27:40.760726+0000","last_unstale":"2023-10-16T23:28:22.683398+0000","last_undegraded":"2023-10-16T23:28:22.683398+0000","last_fullsized":"2023-10-16T23:28:22.683398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:50:08.569961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962326+0000","last_change":"2023-10-16T23:27:40.756184+0000","last_active":"2023-10-16T23:28:22.962326+0000","last_peered":"2023-10-16T23:28:22.962326+0000","last_clean":"2023-10-16T23:28:22.962326+0000","last_became_active":"2023-10-16T23:27:40.755276+0000","last_became_peered":"2023-10-16T23:27:40.755276+0000","last_unstale":"2023-10-16T23:28:22.962326+0000","last_undegraded":"2023-10-16T23:28:22.962326+0000","last_fullsized":"2023-10-16T23:28:22.962326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.312307+0000","last_change":"2023-10-16T23:27:40.724060+0000","last_active":"2023-10-16T23:27:43.312307+0000","last_peered":"2023-10-16T23:27:43.312307+0000","last_clean":"2023-10-16T23:27:43.312307+0000","last_became_active":"2023-10-16T23:27:40.723701+0000","last_became_peered":"2023-10-16T23:27:40.723701+0000","last_unstale":"2023-10-16T23:27:43.312307+0000","last_undegraded":"2023-10-16T23:27:43.312307+0000","last_fullsized":"2023-10-16T23:27:43.312307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:04.722168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962762+0000","last_change":"2023-10-16T23:27:40.756783+0000","last_active":"2023-10-16T23:28:22.962762+0000","last_peered":"2023-10-16T23:28:22.962762+0000","last_clean":"2023-10-16T23:28:22.962762+0000","last_became_active":"2023-10-16T23:27:40.755772+0000","last_became_peered":"2023-10-16T23:27:40.755772+0000","last_unstale":"2023-10-16T23:28:22.962762+0000","last_undegraded":"2023-10-16T23:28:22.962762+0000","last_fullsized":"2023-10-16T23:28:22.962762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248718+0000","last_change":"2023-10-16T23:27:40.724754+0000","last_active":"2023-10-16T23:28:22.248718+0000","last_peered":"2023-10-16T23:28:22.248718+0000","last_clean":"2023-10-16T23:28:22.248718+0000","last_became_active":"2023-10-16T23:27:40.724031+0000","last_became_peered":"2023-10-16T23:27:40.724031+0000","last_unstale":"2023-10-16T23:28:22.248718+0000","last_undegraded":"2023-10-16T23:28:22.248718+0000","last_fullsized":"2023-10-16T23:28:22.248718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:04.722168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.243519+0000","last_change":"2023-10-16T23:27:40.724453+0000","last_active":"2023-10-16T23:28:22.243519+0000","last_peered":"2023-10-16T23:28:22.243519+0000","last_clean":"2023-10-16T23:28:22.243519+0000","last_became_active":"2023-10-16T23:27:40.724099+0000","last_became_peered":"2023-10-16T23:27:40.724099+0000","last_unstale":"2023-10-16T23:28:22.243519+0000","last_undegraded":"2023-10-16T23:28:22.243519+0000","last_fullsized":"2023-10-16T23:28:22.243519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:01:05.350517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.243081+0000","last_change":"2023-10-16T23:27:40.704484+0000","last_active":"2023-10-16T23:28:22.243081+0000","last_peered":"2023-10-16T23:28:22.243081+0000","last_clean":"2023-10-16T23:28:22.243081+0000","last_became_active":"2023-10-16T23:27:40.704162+0000","last_became_peered":"2023-10-16T23:27:40.704162+0000","last_unstale":"2023-10-16T23:28:22.243081+0000","last_undegraded":"2023-10-16T23:28:22.243081+0000","last_fullsized":"2023-10-16T23:28:22.243081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:15:16.646850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962528+0000","last_change":"2023-10-16T23:27:40.738913+0000","last_active":"2023-10-16T23:28:22.962528+0000","last_peered":"2023-10-16T23:28:22.962528+0000","last_clean":"2023-10-16T23:28:22.962528+0000","last_became_active":"2023-10-16T23:27:40.738070+0000","last_became_peered":"2023-10-16T23:27:40.738070+0000","last_unstale":"2023-10-16T23:28:22.962528+0000","last_undegraded":"2023-10-16T23:28:22.962528+0000","last_fullsized":"2023-10-16T23:28:22.962528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:56:41.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683534+0000","last_change":"2023-10-16T23:27:40.762529+0000","last_active":"2023-10-16T23:28:22.683534+0000","last_peered":"2023-10-16T23:28:22.683534+0000","last_clean":"2023-10-16T23:28:22.683534+0000","last_became_active":"2023-10-16T23:27:40.761570+0000","last_became_peered":"2023-10-16T23:27:40.761570+0000","last_unstale":"2023-10-16T23:28:22.683534+0000","last_undegraded":"2023-10-16T23:28:22.683534+0000","last_fullsized":"2023-10-16T23:28:22.683534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:46.449264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246388+0000","last_change":"2023-10-16T23:27:40.719227+0000","last_active":"2023-10-16T23:28:22.246388+0000","last_peered":"2023-10-16T23:28:22.246388+0000","last_clean":"2023-10-16T23:28:22.246388+0000","last_became_active":"2023-10-16T23:27:40.718276+0000","last_became_peered":"2023-10-16T23:27:40.718276+0000","last_unstale":"2023-10-16T23:28:22.246388+0000","last_undegraded":"2023-10-16T23:28:22.246388+0000","last_fullsized":"2023-10-16T23:28:22.246388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.312350+0000","last_change":"2023-10-16T23:27:40.719723+0000","last_active":"2023-10-16T23:27:43.312350+0000","last_peered":"2023-10-16T23:27:43.312350+0000","last_clean":"2023-10-16T23:27:43.312350+0000","last_became_active":"2023-10-16T23:27:40.719402+0000","last_became_peered":"2023-10-16T23:27:40.719402+0000","last_unstale":"2023-10-16T23:27:43.312350+0000","last_undegraded":"2023-10-16T23:27:43.312350+0000","last_fullsized":"2023-10-16T23:27:43.312350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:04:22.434372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248141+0000","last_change":"2023-10-16T23:27:40.732931+0000","last_active":"2023-10-16T23:28:22.248141+0000","last_peered":"2023-10-16T23:28:22.248141+0000","last_clean":"2023-10-16T23:28:22.248141+0000","last_became_active":"2023-10-16T23:27:40.732102+0000","last_became_peered":"2023-10-16T23:27:40.732102+0000","last_unstale":"2023-10-16T23:28:22.248141+0000","last_undegraded":"2023-10-16T23:28:22.248141+0000","last_fullsized":"2023-10-16T23:28:22.248141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:14.359461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.244017+0000","last_change":"2023-10-16T23:27:40.728920+0000","last_active":"2023-10-16T23:28:22.244017+0000","last_peered":"2023-10-16T23:28:22.244017+0000","last_clean":"2023-10-16T23:28:22.244017+0000","last_became_active":"2023-10-16T23:27:40.728298+0000","last_became_peered":"2023-10-16T23:27:40.728298+0000","last_unstale":"2023-10-16T23:28:22.244017+0000","last_undegraded":"2023-10-16T23:28:22.244017+0000","last_fullsized":"2023-10-16T23:28:22.244017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:28:33.509782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248025+0000","last_change":"2023-10-16T23:27:40.745270+0000","last_active":"2023-10-16T23:28:22.248025+0000","last_peered":"2023-10-16T23:28:22.248025+0000","last_clean":"2023-10-16T23:28:22.248025+0000","last_became_active":"2023-10-16T23:27:40.744483+0000","last_became_peered":"2023-10-16T23:27:40.744483+0000","last_unstale":"2023-10-16T23:28:22.248025+0000","last_undegraded":"2023-10-16T23:28:22.248025+0000","last_fullsized":"2023-10-16T23:28:22.248025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:24:33.998070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683429+0000","last_change":"2023-10-16T23:27:40.761480+0000","last_active":"2023-10-16T23:28:22.683429+0000","last_peered":"2023-10-16T23:28:22.683429+0000","last_clean":"2023-10-16T23:28:22.683429+0000","last_became_active":"2023-10-16T23:27:40.760882+0000","last_became_peered":"2023-10-16T23:27:40.760882+0000","last_unstale":"2023-10-16T23:28:22.683429+0000","last_undegraded":"2023-10-16T23:28:22.683429+0000","last_fullsized":"2023-10-16T23:28:22.683429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:37:38.843931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.311797+0000","last_change":"2023-10-16T23:27:40.722620+0000","last_active":"2023-10-16T23:27:43.311797+0000","last_peered":"2023-10-16T23:27:43.311797+0000","last_clean":"2023-10-16T23:27:43.311797+0000","last_became_active":"2023-10-16T23:27:40.722302+0000","last_became_peered":"2023-10-16T23:27:40.722302+0000","last_unstale":"2023-10-16T23:27:43.311797+0000","last_undegraded":"2023-10-16T23:27:43.311797+0000","last_fullsized":"2023-10-16T23:27:43.311797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689201+0000","last_change":"2023-10-16T23:27:40.716578+0000","last_active":"2023-10-16T23:28:22.689201+0000","last_peered":"2023-10-16T23:28:22.689201+0000","last_clean":"2023-10-16T23:28:22.689201+0000","last_became_active":"2023-10-16T23:27:40.716228+0000","last_became_peered":"2023-10-16T23:27:40.716228+0000","last_unstale":"2023-10-16T23:28:22.689201+0000","last_undegraded":"2023-10-16T23:28:22.689201+0000","last_fullsized":"2023-10-16T23:28:22.689201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:27:29.534374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683349+0000","last_change":"2023-10-16T23:27:40.761323+0000","last_active":"2023-10-16T23:28:22.683349+0000","last_peered":"2023-10-16T23:28:22.683349+0000","last_clean":"2023-10-16T23:28:22.683349+0000","last_became_active":"2023-10-16T23:27:40.760659+0000","last_became_peered":"2023-10-16T23:27:40.760659+0000","last_unstale":"2023-10-16T23:28:22.683349+0000","last_undegraded":"2023-10-16T23:28:22.683349+0000","last_fullsized":"2023-10-16T23:28:22.683349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:09:55.835429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967422+0000","last_change":"2023-10-16T23:27:40.727629+0000","last_active":"2023-10-16T23:28:22.967422+0000","last_peered":"2023-10-16T23:28:22.967422+0000","last_clean":"2023-10-16T23:28:22.967422+0000","last_became_active":"2023-10-16T23:27:40.727334+0000","last_became_peered":"2023-10-16T23:27:40.727334+0000","last_unstale":"2023-10-16T23:28:22.967422+0000","last_undegraded":"2023-10-16T23:28:22.967422+0000","last_fullsized":"2023-10-16T23:28:22.967422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:38:33.383867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967294+0000","last_change":"2023-10-16T23:27:40.704775+0000","last_active":"2023-10-16T23:28:22.967294+0000","last_peered":"2023-10-16T23:28:22.967294+0000","last_clean":"2023-10-16T23:28:22.967294+0000","last_became_active":"2023-10-16T23:27:40.704536+0000","last_became_peered":"2023-10-16T23:27:40.704536+0000","last_unstale":"2023-10-16T23:28:22.967294+0000","last_undegraded":"2023-10-16T23:28:22.967294+0000","last_fullsized":"2023-10-16T23:28:22.967294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962992+0000","last_change":"2023-10-16T23:27:40.764351+0000","last_active":"2023-10-16T23:28:22.962992+0000","last_peered":"2023-10-16T23:28:22.962992+0000","last_clean":"2023-10-16T23:28:22.962992+0000","last_became_active":"2023-10-16T23:27:40.763592+0000","last_became_peered":"2023-10-16T23:27:40.763592+0000","last_unstale":"2023-10-16T23:28:22.962992+0000","last_undegraded":"2023-10-16T23:28:22.962992+0000","last_fullsized":"2023-10-16T23:28:22.962992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967127+0000","last_change":"2023-10-16T23:27:40.760989+0000","last_active":"2023-10-16T23:28:22.967127+0000","last_peered":"2023-10-16T23:28:22.967127+0000","last_clean":"2023-10-16T23:28:22.967127+0000","last_became_active":"2023-10-16T23:27:40.760615+0000","last_became_peered":"2023-10-16T23:27:40.760615+0000","last_unstale":"2023-10-16T23:28:22.967127+0000","last_undegraded":"2023-10-16T23:28:22.967127+0000","last_fullsized":"2023-10-16T23:28:22.967127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689374+0000","last_change":"2023-10-16T23:27:40.760762+0000","last_active":"2023-10-16T23:28:22.689374+0000","last_peered":"2023-10-16T23:28:22.689374+0000","last_clean":"2023-10-16T23:28:22.689374+0000","last_became_active":"2023-10-16T23:27:40.760437+0000","last_became_peered":"2023-10-16T23:27:40.760437+0000","last_unstale":"2023-10-16T23:28:22.689374+0000","last_undegraded":"2023-10-16T23:28:22.689374+0000","last_fullsized":"2023-10-16T23:28:22.689374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:55:29.771781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247695+0000","last_change":"2023-10-16T23:27:40.745197+0000","last_active":"2023-10-16T23:28:22.247695+0000","last_peered":"2023-10-16T23:28:22.247695+0000","last_clean":"2023-10-16T23:28:22.247695+0000","last_became_active":"2023-10-16T23:27:40.744458+0000","last_became_peered":"2023-10-16T23:27:40.744458+0000","last_unstale":"2023-10-16T23:28:22.247695+0000","last_undegraded":"2023-10-16T23:28:22.247695+0000","last_fullsized":"2023-10-16T23:28:22.247695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689184+0000","last_change":"2023-10-16T23:27:40.711795+0000","last_active":"2023-10-16T23:28:22.689184+0000","last_peered":"2023-10-16T23:28:22.689184+0000","last_clean":"2023-10-16T23:28:22.689184+0000","last_became_active":"2023-10-16T23:27:40.711492+0000","last_became_peered":"2023-10-16T23:27:40.711492+0000","last_unstale":"2023-10-16T23:28:22.689184+0000","last_undegraded":"2023-10-16T23:28:22.689184+0000","last_fullsized":"2023-10-16T23:28:22.689184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:04:22.434372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.245860+0000","last_change":"2023-10-16T23:27:40.710149+0000","last_active":"2023-10-16T23:28:22.245860+0000","last_peered":"2023-10-16T23:28:22.245860+0000","last_clean":"2023-10-16T23:28:22.245860+0000","last_became_active":"2023-10-16T23:27:40.709286+0000","last_became_peered":"2023-10-16T23:27:40.709286+0000","last_unstale":"2023-10-16T23:28:22.245860+0000","last_undegraded":"2023-10-16T23:28:22.245860+0000","last_fullsized":"2023-10-16T23:28:22.245860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:22:41.708468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689705+0000","last_change":"2023-10-16T23:27:40.707271+0000","last_active":"2023-10-16T23:28:22.689705+0000","last_peered":"2023-10-16T23:28:22.689705+0000","last_clean":"2023-10-16T23:28:22.689705+0000","last_became_active":"2023-10-16T23:27:40.706864+0000","last_became_peered":"2023-10-16T23:27:40.706864+0000","last_unstale":"2023-10-16T23:28:22.689705+0000","last_undegraded":"2023-10-16T23:28:22.689705+0000","last_fullsized":"2023-10-16T23:28:22.689705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683702+0000","last_change":"2023-10-16T23:27:40.353567+0000","last_active":"2023-10-16T23:28:22.683702+0000","last_peered":"2023-10-16T23:28:22.683702+0000","last_clean":"2023-10-16T23:28:22.683702+0000","last_became_active":"2023-10-16T23:27:40.352775+0000","last_became_peered":"2023-10-16T23:27:40.352775+0000","last_unstale":"2023-10-16T23:28:22.683702+0000","last_undegraded":"2023-10-16T23:28:22.683702+0000","last_fullsized":"2023-10-16T23:28:22.683702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:52:58.351406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.963098+0000","last_change":"2023-10-16T23:27:40.765398+0000","last_active":"2023-10-16T23:28:22.963098+0000","last_peered":"2023-10-16T23:28:22.963098+0000","last_clean":"2023-10-16T23:28:22.963098+0000","last_became_active":"2023-10-16T23:27:40.764517+0000","last_became_peered":"2023-10-16T23:27:40.764517+0000","last_unstale":"2023-10-16T23:28:22.963098+0000","last_undegraded":"2023-10-16T23:28:22.963098+0000","last_fullsized":"2023-10-16T23:28:22.963098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:31.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.311846+0000","last_change":"2023-10-16T23:27:40.335221+0000","last_active":"2023-10-16T23:27:43.311846+0000","last_peered":"2023-10-16T23:27:43.311846+0000","last_clean":"2023-10-16T23:27:43.311846+0000","last_became_active":"2023-10-16T23:27:40.334885+0000","last_became_peered":"2023-10-16T23:27:40.334885+0000","last_unstale":"2023-10-16T23:27:43.311846+0000","last_undegraded":"2023-10-16T23:27:43.311846+0000","last_fullsized":"2023-10-16T23:27:43.311846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.312206+0000","last_change":"2023-10-16T23:27:40.719997+0000","last_active":"2023-10-16T23:27:43.312206+0000","last_peered":"2023-10-16T23:27:43.312206+0000","last_clean":"2023-10-16T23:27:43.312206+0000","last_became_active":"2023-10-16T23:27:40.719811+0000","last_became_peered":"2023-10-16T23:27:40.719811+0000","last_unstale":"2023-10-16T23:27:43.312206+0000","last_undegraded":"2023-10-16T23:27:43.312206+0000","last_fullsized":"2023-10-16T23:27:43.312206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:13.934735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683767+0000","last_change":"2023-10-16T23:27:40.357620+0000","last_active":"2023-10-16T23:28:22.683767+0000","last_peered":"2023-10-16T23:28:22.683767+0000","last_clean":"2023-10-16T23:28:22.683767+0000","last_became_active":"2023-10-16T23:27:40.357009+0000","last_became_peered":"2023-10-16T23:27:40.357009+0000","last_unstale":"2023-10-16T23:28:22.683767+0000","last_undegraded":"2023-10-16T23:28:22.683767+0000","last_fullsized":"2023-10-16T23:28:22.683767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:07:50.847519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.690065+0000","last_change":"2023-10-16T23:27:40.760925+0000","last_active":"2023-10-16T23:28:22.690065+0000","last_peered":"2023-10-16T23:28:22.690065+0000","last_clean":"2023-10-16T23:28:22.690065+0000","last_became_active":"2023-10-16T23:27:40.760365+0000","last_became_peered":"2023-10-16T23:27:40.760365+0000","last_unstale":"2023-10-16T23:28:22.690065+0000","last_undegraded":"2023-10-16T23:28:22.690065+0000","last_fullsized":"2023-10-16T23:28:22.690065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:13.934735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246026+0000","last_change":"2023-10-16T23:27:40.331826+0000","last_active":"2023-10-16T23:28:22.246026+0000","last_peered":"2023-10-16T23:28:22.246026+0000","last_clean":"2023-10-16T23:28:22.246026+0000","last_became_active":"2023-10-16T23:27:40.330857+0000","last_became_peered":"2023-10-16T23:27:40.330857+0000","last_unstale":"2023-10-16T23:28:22.246026+0000","last_undegraded":"2023-10-16T23:28:22.246026+0000","last_fullsized":"2023-10-16T23:28:22.246026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:42:46.614672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.684412+0000","last_change":"2023-10-16T23:27:40.357691+0000","last_active":"2023-10-16T23:28:22.684412+0000","last_peered":"2023-10-16T23:28:22.684412+0000","last_clean":"2023-10-16T23:28:22.684412+0000","last_became_active":"2023-10-16T23:27:40.357047+0000","last_became_peered":"2023-10-16T23:27:40.357047+0000","last_unstale":"2023-10-16T23:28:22.684412+0000","last_undegraded":"2023-10-16T23:28:22.684412+0000","last_fullsized":"2023-10-16T23:28:22.684412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:00:00.805564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962388+0000","last_change":"2023-10-16T23:27:40.763848+0000","last_active":"2023-10-16T23:28:22.962388+0000","last_peered":"2023-10-16T23:28:22.962388+0000","last_clean":"2023-10-16T23:28:22.962388+0000","last_became_active":"2023-10-16T23:27:40.763116+0000","last_became_peered":"2023-10-16T23:27:40.763116+0000","last_unstale":"2023-10-16T23:28:22.962388+0000","last_undegraded":"2023-10-16T23:28:22.962388+0000","last_fullsized":"2023-10-16T23:28:22.962388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.684383+0000","last_change":"2023-10-16T23:27:40.347016+0000","last_active":"2023-10-16T23:28:22.684383+0000","last_peered":"2023-10-16T23:28:22.684383+0000","last_clean":"2023-10-16T23:28:22.684383+0000","last_became_active":"2023-10-16T23:27:40.346439+0000","last_became_peered":"2023-10-16T23:27:40.346439+0000","last_unstale":"2023-10-16T23:28:22.684383+0000","last_undegraded":"2023-10-16T23:28:22.684383+0000","last_fullsized":"2023-10-16T23:28:22.684383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:08:40.047699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246458+0000","last_change":"2023-10-16T23:27:40.714905+0000","last_active":"2023-10-16T23:28:22.246458+0000","last_peered":"2023-10-16T23:28:22.246458+0000","last_clean":"2023-10-16T23:28:22.246458+0000","last_became_active":"2023-10-16T23:27:40.714098+0000","last_became_peered":"2023-10-16T23:27:40.714098+0000","last_unstale":"2023-10-16T23:28:22.246458+0000","last_undegraded":"2023-10-16T23:28:22.246458+0000","last_fullsized":"2023-10-16T23:28:22.246458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:13.934735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.684232+0000","last_change":"2023-10-16T23:27:40.340462+0000","last_active":"2023-10-16T23:28:22.684232+0000","last_peered":"2023-10-16T23:28:22.684232+0000","last_clean":"2023-10-16T23:28:22.684232+0000","last_became_active":"2023-10-16T23:27:40.339531+0000","last_became_peered":"2023-10-16T23:27:40.339531+0000","last_unstale":"2023-10-16T23:28:22.684232+0000","last_undegraded":"2023-10-16T23:28:22.684232+0000","last_fullsized":"2023-10-16T23:28:22.684232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:33:50.768168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246296+0000","last_change":"2023-10-16T23:27:40.713930+0000","last_active":"2023-10-16T23:28:22.246296+0000","last_peered":"2023-10-16T23:28:22.246296+0000","last_clean":"2023-10-16T23:28:22.246296+0000","last_became_active":"2023-10-16T23:27:40.713087+0000","last_became_peered":"2023-10-16T23:27:40.713087+0000","last_unstale":"2023-10-16T23:28:22.246296+0000","last_undegraded":"2023-10-16T23:28:22.246296+0000","last_fullsized":"2023-10-16T23:28:22.246296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:15:24.177529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962633+0000","last_change":"2023-10-16T23:27:40.320848+0000","last_active":"2023-10-16T23:28:22.962633+0000","last_peered":"2023-10-16T23:28:22.962633+0000","last_clean":"2023-10-16T23:28:22.962633+0000","last_became_active":"2023-10-16T23:27:40.319887+0000","last_became_peered":"2023-10-16T23:27:40.319887+0000","last_unstale":"2023-10-16T23:28:22.962633+0000","last_undegraded":"2023-10-16T23:28:22.962633+0000","last_fullsized":"2023-10-16T23:28:22.962633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:33:08.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.311894+0000","last_change":"2023-10-16T23:27:40.726405+0000","last_active":"2023-10-16T23:27:43.311894+0000","last_peered":"2023-10-16T23:27:43.311894+0000","last_clean":"2023-10-16T23:27:43.311894+0000","last_became_active":"2023-10-16T23:27:40.725724+0000","last_became_peered":"2023-10-16T23:27:40.725724+0000","last_unstale":"2023-10-16T23:27:43.311894+0000","last_undegraded":"2023-10-16T23:27:43.311894+0000","last_fullsized":"2023-10-16T23:27:43.311894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689512+0000","last_change":"2023-10-16T23:27:40.337756+0000","last_active":"2023-10-16T23:28:22.689512+0000","last_peered":"2023-10-16T23:28:22.689512+0000","last_clean":"2023-10-16T23:28:22.689512+0000","last_became_active":"2023-10-16T23:27:40.337405+0000","last_became_peered":"2023-10-16T23:27:40.337405+0000","last_unstale":"2023-10-16T23:28:22.689512+0000","last_undegraded":"2023-10-16T23:28:22.689512+0000","last_fullsized":"2023-10-16T23:28:22.689512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:42.154580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248284+0000","last_change":"2023-10-16T23:27:40.722911+0000","last_active":"2023-10-16T23:28:22.248284+0000","last_peered":"2023-10-16T23:28:22.248284+0000","last_clean":"2023-10-16T23:28:22.248284+0000","last_became_active":"2023-10-16T23:27:40.722091+0000","last_became_peered":"2023-10-16T23:27:40.722091+0000","last_unstale":"2023-10-16T23:28:22.248284+0000","last_undegraded":"2023-10-16T23:28:22.248284+0000","last_fullsized":"2023-10-16T23:28:22.248284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246704+0000","last_change":"2023-10-16T23:27:40.343242+0000","last_active":"2023-10-16T23:28:22.246704+0000","last_peered":"2023-10-16T23:28:22.246704+0000","last_clean":"2023-10-16T23:28:22.246704+0000","last_became_active":"2023-10-16T23:27:40.342213+0000","last_became_peered":"2023-10-16T23:27:40.342213+0000","last_unstale":"2023-10-16T23:28:22.246704+0000","last_undegraded":"2023-10-16T23:28:22.246704+0000","last_fullsized":"2023-10-16T23:28:22.246704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:04.095452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248861+0000","last_change":"2023-10-16T23:27:40.733845+0000","last_active":"2023-10-16T23:28:22.248861+0000","last_peered":"2023-10-16T23:28:22.248861+0000","last_clean":"2023-10-16T23:28:22.248861+0000","last_became_active":"2023-10-16T23:27:40.732996+0000","last_became_peered":"2023-10-16T23:27:40.732996+0000","last_unstale":"2023-10-16T23:28:22.248861+0000","last_undegraded":"2023-10-16T23:28:22.248861+0000","last_fullsized":"2023-10-16T23:28:22.248861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:06:04.512089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247175+0000","last_change":"2023-10-16T23:27:40.347984+0000","last_active":"2023-10-16T23:28:22.247175+0000","last_peered":"2023-10-16T23:28:22.247175+0000","last_clean":"2023-10-16T23:28:22.247175+0000","last_became_active":"2023-10-16T23:27:40.347253+0000","last_became_peered":"2023-10-16T23:27:40.347253+0000","last_unstale":"2023-10-16T23:28:22.247175+0000","last_undegraded":"2023-10-16T23:28:22.247175+0000","last_fullsized":"2023-10-16T23:28:22.247175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:42:46.614672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248305+0000","last_change":"2023-10-16T23:27:40.745245+0000","last_active":"2023-10-16T23:28:22.248305+0000","last_peered":"2023-10-16T23:28:22.248305+0000","last_clean":"2023-10-16T23:28:22.248305+0000","last_became_active":"2023-10-16T23:27:40.744571+0000","last_became_peered":"2023-10-16T23:27:40.744571+0000","last_unstale":"2023-10-16T23:28:22.248305+0000","last_undegraded":"2023-10-16T23:28:22.248305+0000","last_fullsized":"2023-10-16T23:28:22.248305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:10:39.974563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689656+0000","last_change":"2023-10-16T23:27:40.314767+0000","last_active":"2023-10-16T23:28:22.689656+0000","last_peered":"2023-10-16T23:28:22.689656+0000","last_clean":"2023-10-16T23:28:22.689656+0000","last_became_active":"2023-10-16T23:27:40.314242+0000","last_became_peered":"2023-10-16T23:27:40.314242+0000","last_unstale":"2023-10-16T23:28:22.689656+0000","last_undegraded":"2023-10-16T23:28:22.689656+0000","last_fullsized":"2023-10-16T23:28:22.689656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967500+0000","last_change":"2023-10-16T23:27:40.709591+0000","last_active":"2023-10-16T23:28:22.967500+0000","last_peered":"2023-10-16T23:28:22.967500+0000","last_clean":"2023-10-16T23:28:22.967500+0000","last_became_active":"2023-10-16T23:27:40.709174+0000","last_became_peered":"2023-10-16T23:27:40.709174+0000","last_unstale":"2023-10-16T23:28:22.967500+0000","last_undegraded":"2023-10-16T23:28:22.967500+0000","last_fullsized":"2023-10-16T23:28:22.967500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:31.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683820+0000","last_change":"2023-10-16T23:27:29.356842+0000","last_active":"2023-10-16T23:28:22.683820+0000","last_peered":"2023-10-16T23:28:22.683820+0000","last_clean":"2023-10-16T23:28:22.683820+0000","last_became_active":"2023-10-16T23:27:29.353846+0000","last_became_peered":"2023-10-16T23:27:29.353846+0000","last_unstale":"2023-10-16T23:28:22.683820+0000","last_undegraded":"2023-10-16T23:28:22.683820+0000","last_fullsized":"2023-10-16T23:28:22.683820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:28.136202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:28.136202+0000","last_clean_scrub_stamp":"2023-10-16T23:27:28.136202+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:34:30.590360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962513+0000","last_change":"2023-10-16T23:27:36.278001+0000","last_active":"2023-10-16T23:28:22.962513+0000","last_peered":"2023-10-16T23:28:22.962513+0000","last_clean":"2023-10-16T23:28:22.962513+0000","last_became_active":"2023-10-16T23:27:36.277096+0000","last_became_peered":"2023-10-16T23:27:36.277096+0000","last_unstale":"2023-10-16T23:28:22.962513+0000","last_undegraded":"2023-10-16T23:28:22.962513+0000","last_fullsized":"2023-10-16T23:28:22.962513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:38:00.468059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689229+0000","last_change":"2023-10-16T23:27:40.331268+0000","last_active":"2023-10-16T23:28:22.689229+0000","last_peered":"2023-10-16T23:28:22.689229+0000","last_clean":"2023-10-16T23:28:22.689229+0000","last_became_active":"2023-10-16T23:27:40.330989+0000","last_became_peered":"2023-10-16T23:27:40.330989+0000","last_unstale":"2023-10-16T23:28:22.689229+0000","last_undegraded":"2023-10-16T23:28:22.689229+0000","last_fullsized":"2023-10-16T23:28:22.689229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:55.630817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247248+0000","last_change":"2023-10-16T23:27:40.726429+0000","last_active":"2023-10-16T23:28:22.247248+0000","last_peered":"2023-10-16T23:28:22.247248+0000","last_clean":"2023-10-16T23:28:22.247248+0000","last_became_active":"2023-10-16T23:27:40.725490+0000","last_became_peered":"2023-10-16T23:27:40.725490+0000","last_unstale":"2023-10-16T23:28:22.247248+0000","last_undegraded":"2023-10-16T23:28:22.247248+0000","last_fullsized":"2023-10-16T23:28:22.247248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:52:41.884757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683589+0000","last_change":"2023-10-16T23:27:36.278865+0000","last_active":"2023-10-16T23:28:22.683589+0000","last_peered":"2023-10-16T23:28:22.683589+0000","last_clean":"2023-10-16T23:28:22.683589+0000","last_became_active":"2023-10-16T23:27:36.277974+0000","last_became_peered":"2023-10-16T23:27:36.277974+0000","last_unstale":"2023-10-16T23:28:22.683589+0000","last_undegraded":"2023-10-16T23:28:22.683589+0000","last_fullsized":"2023-10-16T23:28:22.683589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:31:09.411975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.311739+0000","last_change":"2023-10-16T23:27:40.340025+0000","last_active":"2023-10-16T23:27:43.311739+0000","last_peered":"2023-10-16T23:27:43.311739+0000","last_clean":"2023-10-16T23:27:43.311739+0000","last_became_active":"2023-10-16T23:27:40.339569+0000","last_became_peered":"2023-10-16T23:27:40.339569+0000","last_unstale":"2023-10-16T23:27:43.311739+0000","last_undegraded":"2023-10-16T23:27:43.311739+0000","last_fullsized":"2023-10-16T23:27:43.311739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:42.154580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.312141+0000","last_change":"2023-10-16T23:27:40.727415+0000","last_active":"2023-10-16T23:27:43.312141+0000","last_peered":"2023-10-16T23:27:43.312141+0000","last_clean":"2023-10-16T23:27:43.312141+0000","last_became_active":"2023-10-16T23:27:40.726813+0000","last_became_peered":"2023-10-16T23:27:40.726813+0000","last_unstale":"2023-10-16T23:27:43.312141+0000","last_undegraded":"2023-10-16T23:27:43.312141+0000","last_fullsized":"2023-10-16T23:27:43.312141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.243140+0000","last_change":"2023-10-16T23:27:36.294967+0000","last_active":"2023-10-16T23:28:22.243140+0000","last_peered":"2023-10-16T23:28:22.243140+0000","last_clean":"2023-10-16T23:28:22.243140+0000","last_became_active":"2023-10-16T23:27:36.294489+0000","last_became_peered":"2023-10-16T23:27:36.294489+0000","last_unstale":"2023-10-16T23:28:22.243140+0000","last_undegraded":"2023-10-16T23:28:22.243140+0000","last_fullsized":"2023-10-16T23:28:22.243140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:43:01.777197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.966680+0000","last_change":"2023-10-16T23:27:40.327194+0000","last_active":"2023-10-16T23:28:22.966680+0000","last_peered":"2023-10-16T23:28:22.966680+0000","last_clean":"2023-10-16T23:28:22.966680+0000","last_became_active":"2023-10-16T23:27:40.326396+0000","last_became_peered":"2023-10-16T23:27:40.326396+0000","last_unstale":"2023-10-16T23:28:22.966680+0000","last_undegraded":"2023-10-16T23:28:22.966680+0000","last_fullsized":"2023-10-16T23:28:22.966680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:42.154580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967570+0000","last_change":"2023-10-16T23:27:40.755777+0000","last_active":"2023-10-16T23:28:22.967570+0000","last_peered":"2023-10-16T23:28:22.967570+0000","last_clean":"2023-10-16T23:28:22.967570+0000","last_became_active":"2023-10-16T23:27:40.755489+0000","last_became_peered":"2023-10-16T23:27:40.755489+0000","last_unstale":"2023-10-16T23:28:22.967570+0000","last_undegraded":"2023-10-16T23:28:22.967570+0000","last_fullsized":"2023-10-16T23:28:22.967570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:06.148922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962747+0000","last_change":"2023-10-16T23:27:36.279013+0000","last_active":"2023-10-16T23:28:22.962747+0000","last_peered":"2023-10-16T23:28:22.962747+0000","last_clean":"2023-10-16T23:28:22.962747+0000","last_became_active":"2023-10-16T23:27:36.278134+0000","last_became_peered":"2023-10-16T23:27:36.278134+0000","last_unstale":"2023-10-16T23:28:22.962747+0000","last_undegraded":"2023-10-16T23:28:22.962747+0000","last_fullsized":"2023-10-16T23:28:22.962747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:13:01.266310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248075+0000","last_change":"2023-10-16T23:27:40.342715+0000","last_active":"2023-10-16T23:28:22.248075+0000","last_peered":"2023-10-16T23:28:22.248075+0000","last_clean":"2023-10-16T23:28:22.248075+0000","last_became_active":"2023-10-16T23:27:40.341951+0000","last_became_peered":"2023-10-16T23:27:40.341951+0000","last_unstale":"2023-10-16T23:28:22.248075+0000","last_undegraded":"2023-10-16T23:28:22.248075+0000","last_fullsized":"2023-10-16T23:28:22.248075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:59.765109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967025+0000","last_change":"2023-10-16T23:27:40.731557+0000","last_active":"2023-10-16T23:28:22.967025+0000","last_peered":"2023-10-16T23:28:22.967025+0000","last_clean":"2023-10-16T23:28:22.967025+0000","last_became_active":"2023-10-16T23:27:40.731150+0000","last_became_peered":"2023-10-16T23:27:40.731150+0000","last_unstale":"2023-10-16T23:28:22.967025+0000","last_undegraded":"2023-10-16T23:28:22.967025+0000","last_fullsized":"2023-10-16T23:28:22.967025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.963319+0000","last_change":"2023-10-16T23:27:40.320403+0000","last_active":"2023-10-16T23:28:22.963319+0000","last_peered":"2023-10-16T23:28:22.963319+0000","last_clean":"2023-10-16T23:28:22.963319+0000","last_became_active":"2023-10-16T23:27:40.319571+0000","last_became_peered":"2023-10-16T23:27:40.319571+0000","last_unstale":"2023-10-16T23:28:22.963319+0000","last_undegraded":"2023-10-16T23:28:22.963319+0000","last_fullsized":"2023-10-16T23:28:22.963319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967130+0000","last_change":"2023-10-16T23:27:36.434134+0000","last_active":"2023-10-16T23:28:22.967130+0000","last_peered":"2023-10-16T23:28:22.967130+0000","last_clean":"2023-10-16T23:28:22.967130+0000","last_became_active":"2023-10-16T23:27:36.433808+0000","last_became_peered":"2023-10-16T23:27:36.433808+0000","last_unstale":"2023-10-16T23:28:22.967130+0000","last_undegraded":"2023-10-16T23:28:22.967130+0000","last_fullsized":"2023-10-16T23:28:22.967130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:58:44.833474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.653934+0000","last_change":"2023-10-16T23:28:23.652508+0000","last_active":"2023-10-16T23:28:23.653934+0000","last_peered":"2023-10-16T23:28:23.653934+0000","last_clean":"2023-10-16T23:28:23.653934+0000","last_became_active":"2023-10-16T23:28:23.651881+0000","last_became_peered":"2023-10-16T23:28:23.651881+0000","last_unstale":"2023-10-16T23:28:23.653934+0000","last_undegraded":"2023-10-16T23:28:23.653934+0000","last_fullsized":"2023-10-16T23:28:23.653934+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:45.140655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967037+0000","last_change":"2023-10-16T23:27:40.328161+0000","last_active":"2023-10-16T23:28:22.967037+0000","last_peered":"2023-10-16T23:28:22.967037+0000","last_clean":"2023-10-16T23:28:22.967037+0000","last_became_active":"2023-10-16T23:27:40.327804+0000","last_became_peered":"2023-10-16T23:27:40.327804+0000","last_unstale":"2023-10-16T23:28:22.967037+0000","last_undegraded":"2023-10-16T23:28:22.967037+0000","last_fullsized":"2023-10-16T23:28:22.967037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.684582+0000","last_change":"2023-10-16T23:27:36.434231+0000","last_active":"2023-10-16T23:28:22.684582+0000","last_peered":"2023-10-16T23:28:22.684582+0000","last_clean":"2023-10-16T23:28:22.684582+0000","last_became_active":"2023-10-16T23:27:36.433923+0000","last_became_peered":"2023-10-16T23:27:36.433923+0000","last_unstale":"2023-10-16T23:28:22.684582+0000","last_undegraded":"2023-10-16T23:28:22.684582+0000","last_fullsized":"2023-10-16T23:28:22.684582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:59.590093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.311945+0000","last_change":"2023-10-16T23:27:40.756257+0000","last_active":"2023-10-16T23:27:43.311945+0000","last_peered":"2023-10-16T23:27:43.311945+0000","last_clean":"2023-10-16T23:27:43.311945+0000","last_became_active":"2023-10-16T23:27:40.755822+0000","last_became_peered":"2023-10-16T23:27:40.755822+0000","last_unstale":"2023-10-16T23:27:43.311945+0000","last_undegraded":"2023-10-16T23:27:43.311945+0000","last_fullsized":"2023-10-16T23:27:43.311945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.690282+0000","last_change":"2023-10-16T23:27:40.333672+0000","last_active":"2023-10-16T23:28:22.690282+0000","last_peered":"2023-10-16T23:28:22.690282+0000","last_clean":"2023-10-16T23:28:22.690282+0000","last_became_active":"2023-10-16T23:27:40.333290+0000","last_became_peered":"2023-10-16T23:27:40.333290+0000","last_unstale":"2023-10-16T23:28:22.690282+0000","last_undegraded":"2023-10-16T23:28:22.690282+0000","last_fullsized":"2023-10-16T23:28:22.690282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:15:23.173526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967337+0000","last_change":"2023-10-16T23:27:36.278805+0000","last_active":"2023-10-16T23:28:22.967337+0000","last_peered":"2023-10-16T23:28:22.967337+0000","last_clean":"2023-10-16T23:28:22.967337+0000","last_became_active":"2023-10-16T23:27:36.278209+0000","last_became_peered":"2023-10-16T23:27:36.278209+0000","last_unstale":"2023-10-16T23:28:22.967337+0000","last_undegraded":"2023-10-16T23:28:22.967337+0000","last_fullsized":"2023-10-16T23:28:22.967337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:38:00.468059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.652371+0000","last_change":"2023-10-16T23:28:23.651145+0000","last_active":"2023-10-16T23:28:23.652371+0000","last_peered":"2023-10-16T23:28:23.652371+0000","last_clean":"2023-10-16T23:28:23.652371+0000","last_became_active":"2023-10-16T23:28:23.650570+0000","last_became_peered":"2023-10-16T23:28:23.650570+0000","last_unstale":"2023-10-16T23:28:23.652371+0000","last_undegraded":"2023-10-16T23:28:23.652371+0000","last_fullsized":"2023-10-16T23:28:23.652371+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:46:52.020400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"24'2","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:28:11.395557+0000","last_change":"2023-10-16T23:27:40.332668+0000","last_active":"2023-10-16T23:28:11.395557+0000","last_peered":"2023-10-16T23:28:11.395557+0000","last_clean":"2023-10-16T23:28:11.395557+0000","last_became_active":"2023-10-16T23:27:40.332084+0000","last_became_peered":"2023-10-16T23:27:40.332084+0000","last_unstale":"2023-10-16T23:28:11.395557+0000","last_undegraded":"2023-10-16T23:28:11.395557+0000","last_fullsized":"2023-10-16T23:28:11.395557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:14.260980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248016+0000","last_change":"2023-10-16T23:27:36.281494+0000","last_active":"2023-10-16T23:28:22.248016+0000","last_peered":"2023-10-16T23:28:22.248016+0000","last_clean":"2023-10-16T23:28:22.248016+0000","last_became_active":"2023-10-16T23:27:36.280600+0000","last_became_peered":"2023-10-16T23:27:36.280600+0000","last_unstale":"2023-10-16T23:28:22.248016+0000","last_undegraded":"2023-10-16T23:28:22.248016+0000","last_fullsized":"2023-10-16T23:28:22.248016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:42:59.057101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246844+0000","last_change":"2023-10-16T23:27:40.756574+0000","last_active":"2023-10-16T23:28:22.246844+0000","last_peered":"2023-10-16T23:28:22.246844+0000","last_clean":"2023-10-16T23:28:22.246844+0000","last_became_active":"2023-10-16T23:27:40.755830+0000","last_became_peered":"2023-10-16T23:27:40.755830+0000","last_unstale":"2023-10-16T23:28:22.246844+0000","last_undegraded":"2023-10-16T23:28:22.246844+0000","last_fullsized":"2023-10-16T23:28:22.246844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:55:29.771781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247938+0000","last_change":"2023-10-16T23:27:40.745793+0000","last_active":"2023-10-16T23:28:22.247938+0000","last_peered":"2023-10-16T23:28:22.247938+0000","last_clean":"2023-10-16T23:28:22.247938+0000","last_became_active":"2023-10-16T23:27:40.745143+0000","last_became_peered":"2023-10-16T23:27:40.745143+0000","last_unstale":"2023-10-16T23:28:22.247938+0000","last_undegraded":"2023-10-16T23:28:22.247938+0000","last_fullsized":"2023-10-16T23:28:22.247938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:10:37.103208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"26'15","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.435096+0000","last_change":"2023-10-16T23:27:40.352546+0000","last_active":"2023-10-16T23:28:23.435096+0000","last_peered":"2023-10-16T23:28:23.435096+0000","last_clean":"2023-10-16T23:28:23.435096+0000","last_became_active":"2023-10-16T23:27:40.351687+0000","last_became_peered":"2023-10-16T23:27:40.351687+0000","last_unstale":"2023-10-16T23:28:23.435096+0000","last_undegraded":"2023-10-16T23:28:23.435096+0000","last_fullsized":"2023-10-16T23:28:23.435096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:14.260980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4472,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.966946+0000","last_change":"2023-10-16T23:27:40.727602+0000","last_active":"2023-10-16T23:28:22.966946+0000","last_peered":"2023-10-16T23:28:22.966946+0000","last_clean":"2023-10-16T23:28:22.966946+0000","last_became_active":"2023-10-16T23:27:40.727288+0000","last_became_peered":"2023-10-16T23:27:40.727288+0000","last_unstale":"2023-10-16T23:28:22.966946+0000","last_undegraded":"2023-10-16T23:28:22.966946+0000","last_fullsized":"2023-10-16T23:28:22.966946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:56:41.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683974+0000","last_change":"2023-10-16T23:27:40.332379+0000","last_active":"2023-10-16T23:28:22.683974+0000","last_peered":"2023-10-16T23:28:22.683974+0000","last_clean":"2023-10-16T23:28:22.683974+0000","last_became_active":"2023-10-16T23:27:40.331517+0000","last_became_peered":"2023-10-16T23:27:40.331517+0000","last_unstale":"2023-10-16T23:28:22.683974+0000","last_undegraded":"2023-10-16T23:28:22.683974+0000","last_fullsized":"2023-10-16T23:28:22.683974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:55.534068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962827+0000","last_change":"2023-10-16T23:27:40.336300+0000","last_active":"2023-10-16T23:28:22.962827+0000","last_peered":"2023-10-16T23:28:22.962827+0000","last_clean":"2023-10-16T23:28:22.962827+0000","last_became_active":"2023-10-16T23:27:40.333012+0000","last_became_peered":"2023-10-16T23:27:40.333012+0000","last_unstale":"2023-10-16T23:28:22.962827+0000","last_undegraded":"2023-10-16T23:28:22.962827+0000","last_fullsized":"2023-10-16T23:28:22.962827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689471+0000","last_change":"2023-10-16T23:27:40.760984+0000","last_active":"2023-10-16T23:28:22.689471+0000","last_peered":"2023-10-16T23:28:22.689471+0000","last_clean":"2023-10-16T23:28:22.689471+0000","last_became_active":"2023-10-16T23:27:40.760680+0000","last_became_peered":"2023-10-16T23:27:40.760680+0000","last_unstale":"2023-10-16T23:28:22.689471+0000","last_undegraded":"2023-10-16T23:28:22.689471+0000","last_fullsized":"2023-10-16T23:28:22.689471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:04.722168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.312448+0000","last_change":"2023-10-16T23:27:40.339159+0000","last_active":"2023-10-16T23:27:43.312448+0000","last_peered":"2023-10-16T23:27:43.312448+0000","last_clean":"2023-10-16T23:27:43.312448+0000","last_became_active":"2023-10-16T23:27:40.338706+0000","last_became_peered":"2023-10-16T23:27:40.338706+0000","last_unstale":"2023-10-16T23:27:43.312448+0000","last_undegraded":"2023-10-16T23:27:43.312448+0000","last_fullsized":"2023-10-16T23:27:43.312448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:33:08.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689103+0000","last_change":"2023-10-16T23:27:40.713138+0000","last_active":"2023-10-16T23:28:22.689103+0000","last_peered":"2023-10-16T23:28:22.689103+0000","last_clean":"2023-10-16T23:28:22.689103+0000","last_became_active":"2023-10-16T23:27:40.712756+0000","last_became_peered":"2023-10-16T23:27:40.712756+0000","last_unstale":"2023-10-16T23:28:22.689103+0000","last_undegraded":"2023-10-16T23:28:22.689103+0000","last_fullsized":"2023-10-16T23:28:22.689103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:19:17.463284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247821+0000","last_change":"2023-10-16T23:27:40.756418+0000","last_active":"2023-10-16T23:28:22.247821+0000","last_peered":"2023-10-16T23:28:22.247821+0000","last_clean":"2023-10-16T23:28:22.247821+0000","last_became_active":"2023-10-16T23:27:40.755714+0000","last_became_peered":"2023-10-16T23:27:40.755714+0000","last_unstale":"2023-10-16T23:28:22.247821+0000","last_undegraded":"2023-10-16T23:28:22.247821+0000","last_fullsized":"2023-10-16T23:28:22.247821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:56.634821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689567+0000","last_change":"2023-10-16T23:27:40.332275+0000","last_active":"2023-10-16T23:28:22.689567+0000","last_peered":"2023-10-16T23:28:22.689567+0000","last_clean":"2023-10-16T23:28:22.689567+0000","last_became_active":"2023-10-16T23:27:40.331428+0000","last_became_peered":"2023-10-16T23:27:40.331428+0000","last_unstale":"2023-10-16T23:28:22.689567+0000","last_undegraded":"2023-10-16T23:28:22.689567+0000","last_fullsized":"2023-10-16T23:28:22.689567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.312094+0000","last_change":"2023-10-16T23:27:40.761081+0000","last_active":"2023-10-16T23:27:43.312094+0000","last_peered":"2023-10-16T23:27:43.312094+0000","last_clean":"2023-10-16T23:27:43.312094+0000","last_became_active":"2023-10-16T23:27:40.760779+0000","last_became_peered":"2023-10-16T23:27:40.760779+0000","last_unstale":"2023-10-16T23:27:43.312094+0000","last_undegraded":"2023-10-16T23:27:43.312094+0000","last_fullsized":"2023-10-16T23:27:43.312094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:31.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.966929+0000","last_change":"2023-10-16T23:27:40.318419+0000","last_active":"2023-10-16T23:28:22.966929+0000","last_peered":"2023-10-16T23:28:22.966929+0000","last_clean":"2023-10-16T23:28:22.966929+0000","last_became_active":"2023-10-16T23:27:40.317622+0000","last_became_peered":"2023-10-16T23:27:40.317622+0000","last_unstale":"2023-10-16T23:28:22.966929+0000","last_undegraded":"2023-10-16T23:28:22.966929+0000","last_fullsized":"2023-10-16T23:28:22.966929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689818+0000","last_change":"2023-10-16T23:27:40.706263+0000","last_active":"2023-10-16T23:28:22.689818+0000","last_peered":"2023-10-16T23:28:22.689818+0000","last_clean":"2023-10-16T23:28:22.689818+0000","last_became_active":"2023-10-16T23:27:40.705956+0000","last_became_peered":"2023-10-16T23:27:40.705956+0000","last_unstale":"2023-10-16T23:28:22.689818+0000","last_undegraded":"2023-10-16T23:28:22.689818+0000","last_fullsized":"2023-10-16T23:28:22.689818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247961+0000","last_change":"2023-10-16T23:27:40.344965+0000","last_active":"2023-10-16T23:28:22.247961+0000","last_peered":"2023-10-16T23:28:22.247961+0000","last_clean":"2023-10-16T23:28:22.247961+0000","last_became_active":"2023-10-16T23:27:40.344158+0000","last_became_peered":"2023-10-16T23:27:40.344158+0000","last_unstale":"2023-10-16T23:28:22.247961+0000","last_undegraded":"2023-10-16T23:28:22.247961+0000","last_fullsized":"2023-10-16T23:28:22.247961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:04.095452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.243569+0000","last_change":"2023-10-16T23:27:40.713594+0000","last_active":"2023-10-16T23:28:22.243569+0000","last_peered":"2023-10-16T23:28:22.243569+0000","last_clean":"2023-10-16T23:28:22.243569+0000","last_became_active":"2023-10-16T23:27:40.712632+0000","last_became_peered":"2023-10-16T23:27:40.712632+0000","last_unstale":"2023-10-16T23:28:22.243569+0000","last_undegraded":"2023-10-16T23:28:22.243569+0000","last_fullsized":"2023-10-16T23:28:22.243569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:52.368847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.312045+0000","last_change":"2023-10-16T23:27:40.357300+0000","last_active":"2023-10-16T23:27:43.312045+0000","last_peered":"2023-10-16T23:27:43.312045+0000","last_clean":"2023-10-16T23:27:43.312045+0000","last_became_active":"2023-10-16T23:27:40.356809+0000","last_became_peered":"2023-10-16T23:27:40.356809+0000","last_unstale":"2023-10-16T23:27:43.312045+0000","last_undegraded":"2023-10-16T23:27:43.312045+0000","last_fullsized":"2023-10-16T23:27:43.312045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247826+0000","last_change":"2023-10-16T23:27:40.726018+0000","last_active":"2023-10-16T23:28:22.247826+0000","last_peered":"2023-10-16T23:28:22.247826+0000","last_clean":"2023-10-16T23:28:22.247826+0000","last_became_active":"2023-10-16T23:27:40.724910+0000","last_became_peered":"2023-10-16T23:27:40.724910+0000","last_unstale":"2023-10-16T23:28:22.247826+0000","last_undegraded":"2023-10-16T23:28:22.247826+0000","last_fullsized":"2023-10-16T23:28:22.247826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:25:34.841325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962608+0000","last_change":"2023-10-16T23:27:40.345785+0000","last_active":"2023-10-16T23:28:22.962608+0000","last_peered":"2023-10-16T23:28:22.962608+0000","last_clean":"2023-10-16T23:28:22.962608+0000","last_became_active":"2023-10-16T23:27:40.344531+0000","last_became_peered":"2023-10-16T23:27:40.344531+0000","last_unstale":"2023-10-16T23:28:22.962608+0000","last_undegraded":"2023-10-16T23:28:22.962608+0000","last_fullsized":"2023-10-16T23:28:22.962608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:55.630817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246775+0000","last_change":"2023-10-16T23:27:40.720573+0000","last_active":"2023-10-16T23:28:22.246775+0000","last_peered":"2023-10-16T23:28:22.246775+0000","last_clean":"2023-10-16T23:28:22.246775+0000","last_became_active":"2023-10-16T23:27:40.719758+0000","last_became_peered":"2023-10-16T23:27:40.719758+0000","last_unstale":"2023-10-16T23:28:22.246775+0000","last_undegraded":"2023-10-16T23:28:22.246775+0000","last_fullsized":"2023-10-16T23:28:22.246775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:27:29.534374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.963212+0000","last_change":"2023-10-16T23:27:40.345400+0000","last_active":"2023-10-16T23:28:22.963212+0000","last_peered":"2023-10-16T23:28:22.963212+0000","last_clean":"2023-10-16T23:28:22.963212+0000","last_became_active":"2023-10-16T23:27:40.344589+0000","last_became_peered":"2023-10-16T23:27:40.344589+0000","last_unstale":"2023-10-16T23:28:22.963212+0000","last_undegraded":"2023-10-16T23:28:22.963212+0000","last_fullsized":"2023-10-16T23:28:22.963212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:15:23.173526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689835+0000","last_change":"2023-10-16T23:27:40.711211+0000","last_active":"2023-10-16T23:28:22.689835+0000","last_peered":"2023-10-16T23:28:22.689835+0000","last_clean":"2023-10-16T23:28:22.689835+0000","last_became_active":"2023-10-16T23:27:40.705936+0000","last_became_peered":"2023-10-16T23:27:40.705936+0000","last_unstale":"2023-10-16T23:28:22.689835+0000","last_undegraded":"2023-10-16T23:28:22.689835+0000","last_fullsized":"2023-10-16T23:28:22.689835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689909+0000","last_change":"2023-10-16T23:27:40.323626+0000","last_active":"2023-10-16T23:28:22.689909+0000","last_peered":"2023-10-16T23:28:22.689909+0000","last_clean":"2023-10-16T23:28:22.689909+0000","last_became_active":"2023-10-16T23:27:40.323352+0000","last_became_peered":"2023-10-16T23:27:40.323352+0000","last_unstale":"2023-10-16T23:28:22.689909+0000","last_undegraded":"2023-10-16T23:28:22.689909+0000","last_fullsized":"2023-10-16T23:28:22.689909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:33:08.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246609+0000","last_change":"2023-10-16T23:27:40.749109+0000","last_active":"2023-10-16T23:28:22.246609+0000","last_peered":"2023-10-16T23:28:22.246609+0000","last_clean":"2023-10-16T23:28:22.246609+0000","last_became_active":"2023-10-16T23:27:40.748525+0000","last_became_peered":"2023-10-16T23:27:40.748525+0000","last_unstale":"2023-10-16T23:28:22.246609+0000","last_undegraded":"2023-10-16T23:28:22.246609+0000","last_fullsized":"2023-10-16T23:28:22.246609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:10:38.468420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.312397+0000","last_change":"2023-10-16T23:27:40.338946+0000","last_active":"2023-10-16T23:27:43.312397+0000","last_peered":"2023-10-16T23:27:43.312397+0000","last_clean":"2023-10-16T23:27:43.312397+0000","last_became_active":"2023-10-16T23:27:40.338565+0000","last_became_peered":"2023-10-16T23:27:40.338565+0000","last_unstale":"2023-10-16T23:27:43.312397+0000","last_undegraded":"2023-10-16T23:27:43.312397+0000","last_fullsized":"2023-10-16T23:27:43.312397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:55.630817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5270,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":10540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":103608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]}]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":278528,"data_stored":104260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.383}]}]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":108136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]}]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":103698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.92400000000000004}]},{"osd":1,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.80300000000000005}]},{"osd":2,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":1.0289999999999999}]},{"osd":4,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.323},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":1.2689999999999999}]},{"osd":5,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.115}]},{"osd":6,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.3580000000000001}]},{"osd":7,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":1.2190000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":103608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":868352,"data_stored":694558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]}]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":698664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.0409999999999999}]},{"osd":1,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.0149999999999999}]},{"osd":2,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.89900000000000002}]},{"osd":3,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.105},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.93600000000000005}]},{"osd":4,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.153},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.96299999999999997}]},{"osd":5,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.72699999999999998}]},{"osd":6,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.742,"5min":2.742,"15min":2.742},"last":1.077}]}]},{"osd":2,"up_from":14,"seq":60129542161,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":270336,"data_stored":103608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.5},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.59699999999999998}]},{"osd":1,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.69199999999999995}]},{"osd":3,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.55200000000000005}]},{"osd":4,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.83999999999999997}]},{"osd":5,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.98799999999999999}]},{"osd":6,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.159}]},{"osd":7,"last update":"Mon Oct 16 23:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.071}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T23:28:33.853 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T23:28:34.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.016+0000 7f04d0dec640 1 Processor -- start 2023-10-16T23:28:34.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.016+0000 7f04d0dec640 1 -- start start 2023-10-16T23:28:34.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.016+0000 7f04d0dec640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04cc06e770 0x7f04cc0bb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:34.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.016+0000 7f04d0dec640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f04cc0ba440 0x7f04cc14fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:34.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.016+0000 7f04d0dec640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04cc1533b0 con 0x7f04cc0c1130 2023-10-16T23:28:34.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.016+0000 7f04d0dec640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04cc0b3c50 con 0x7f04cc0ba440 2023-10-16T23:28:34.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.016+0000 7f04d0dec640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc0b3f30 con 0x7f04cc06e770 2023-10-16T23:28:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.016+0000 7f04c9d9b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04cc06e770 0x7f04cc0bb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.016+0000 7f04cad9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f04cc0ba440 0x7f04cc14fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.016+0000 7f04cad9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f04cc0ba440 0x7f04cc14fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.12:40168/0 (socket says 172.21.15.12:40168) 2023-10-16T23:28:34.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.016+0000 7f04cad9d640 1 -- 172.21.15.12:0/3287577080 learned_addr learned my addr 172.21.15.12:0/3287577080 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:34.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.016+0000 7f04c9d9b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04cc06e770 0x7f04cc0bb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:38000/0 (socket says 172.21.15.12:38000) 2023-10-16T23:28:34.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.016+0000 7f04c9d9b640 1 -- 172.21.15.12:0/3287577080 >> v2:172.21.15.31:3300/0 conn(0x7f04cc0ba440 msgr2=0x7f04cc14fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:34.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.016+0000 7f04c9d9b640 1 --2- 172.21.15.12:0/3287577080 >> v2:172.21.15.31:3300/0 conn(0x7f04cc0ba440 0x7f04cc14fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.016+0000 7f04c9d9b640 1 -- 172.21.15.12:0/3287577080 >> v1:172.21.15.31:6789/0 conn(0x7f04cc0c1130 legacy=0x7f04cc0bae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:34.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.016+0000 7f04c9d9b640 1 -- 172.21.15.12:0/3287577080 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc153870 con 0x7f04cc06e770 2023-10-16T23:28:34.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.020+0000 7f04c9d9b640 1 --2- 172.21.15.12:0/3287577080 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04cc06e770 0x7f04cc0bb520 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f04c00097c0 tx=0x7f04c001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e511f633e831427d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:34.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.020+0000 7f04c959a640 1 -- 172.21.15.12:0/3287577080 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c00ab600 con 0x7f04cc06e770 2023-10-16T23:28:34.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.020+0000 7f04c959a640 1 -- 172.21.15.12:0/3287577080 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c00a7050 con 0x7f04cc06e770 2023-10-16T23:28:34.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.020+0000 7f04c959a640 1 -- 172.21.15.12:0/3287577080 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c00ab980 con 0x7f04cc06e770 2023-10-16T23:28:34.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.020+0000 7f04d0dec640 1 -- 172.21.15.12:0/3287577080 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04cc06e770 msgr2=0x7f04cc0bb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:34.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.020+0000 7f04d0dec640 1 --2- 172.21.15.12:0/3287577080 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04cc06e770 0x7f04cc0bb520 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f04c00097c0 tx=0x7f04c001c480 comp rx=0 tx=0).stop 2023-10-16T23:28:34.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.020+0000 7f04d0dec640 1 -- 172.21.15.12:0/3287577080 shutdown_connections 2023-10-16T23:28:34.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.020+0000 7f04d0dec640 1 --2- 172.21.15.12:0/3287577080 >> v2:172.21.15.31:3300/0 conn(0x7f04cc0ba440 0x7f04cc14fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.020+0000 7f04d0dec640 1 --2- 172.21.15.12:0/3287577080 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04cc06e770 0x7f04cc0bb520 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.020+0000 7f04d0dec640 1 -- 172.21.15.12:0/3287577080 >> 172.21.15.12:0/3287577080 conn(0x7f04cc06ba20 msgr2=0x7f04cc0c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:34.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.020+0000 7f04d0dec640 1 -- 172.21.15.12:0/3287577080 shutdown_connections 2023-10-16T23:28:34.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.020+0000 7f04d0dec640 1 -- 172.21.15.12:0/3287577080 wait complete. 2023-10-16T23:28:34.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.020+0000 7f04d0dec640 1 Processor -- start 2023-10-16T23:28:34.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.020+0000 7f04d0dec640 1 -- start start 2023-10-16T23:28:34.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04d0dec640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04cc06e770 0x7f04cc147d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:34.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04d0dec640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04cc0ba440 0x7f04cc14cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:34.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04d0dec640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04cc0c1130 0x7f04cc14d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:34.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04d0dec640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc14d5a0 con 0x7f04cc0ba440 2023-10-16T23:28:34.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04d0dec640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc0b4420 con 0x7f04cc06e770 2023-10-16T23:28:34.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04d0dec640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc0b4700 con 0x7f04cc0c1130 2023-10-16T23:28:34.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04c9d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04cc0ba440 0x7f04cc14cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:34.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04c9d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04cc0ba440 0x7f04cc14cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36396/0 (socket says 172.21.15.12:36396) 2023-10-16T23:28:34.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04c9d9b640 1 -- 172.21.15.12:0/1614876017 learned_addr learned my addr 172.21.15.12:0/1614876017 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:34.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04cad9d640 1 --2- 172.21.15.12:0/1614876017 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04cc0c1130 0x7f04cc14d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:34.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04ca59c640 1 --2- 172.21.15.12:0/1614876017 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04cc06e770 0x7f04cc147d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:34.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04c9d9b640 1 -- 172.21.15.12:0/1614876017 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04cc0c1130 msgr2=0x7f04cc14d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:34.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04c9d9b640 1 --2- 172.21.15.12:0/1614876017 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04cc0c1130 0x7f04cc14d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04c9d9b640 1 -- 172.21.15.12:0/1614876017 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04cc06e770 msgr2=0x7f04cc147d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:34.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04c9d9b640 1 --2- 172.21.15.12:0/1614876017 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04cc06e770 0x7f04cc147d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04c9d9b640 1 -- 172.21.15.12:0/1614876017 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c0009420 con 0x7f04cc0ba440 2023-10-16T23:28:34.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04ca59c640 1 --2- 172.21.15.12:0/1614876017 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04cc06e770 0x7f04cc147d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:28:34.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04c9d9b640 1 --2- 172.21.15.12:0/1614876017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04cc0ba440 0x7f04cc14cb20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f04c001a0b0 tx=0x7f04c0019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:34.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04baffd640 1 -- 172.21.15.12:0/1614876017 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c00b4400 con 0x7f04cc0ba440 2023-10-16T23:28:34.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04baffd640 1 -- 172.21.15.12:0/1614876017 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c00b4580 con 0x7f04cc0ba440 2023-10-16T23:28:34.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04d0dec640 1 -- 172.21.15.12:0/1614876017 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04cc0bac30 con 0x7f04cc0ba440 2023-10-16T23:28:34.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04baffd640 1 -- 172.21.15.12:0/1614876017 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c00b4930 con 0x7f04cc0ba440 2023-10-16T23:28:34.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04d0dec640 1 -- 172.21.15.12:0/1614876017 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04cc0b4f00 con 0x7f04cc0ba440 2023-10-16T23:28:34.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04d0dec640 1 -- 172.21.15.12:0/1614876017 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04cc0bf170 con 0x7f04cc0ba440 2023-10-16T23:28:34.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04baffd640 1 -- 172.21.15.12:0/1614876017 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f04c00b2040 con 0x7f04cc0ba440 2023-10-16T23:28:34.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04baffd640 1 --2- 172.21.15.12:0/1614876017 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f04ac065e60 0x7f04ac068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:34.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04baffd640 1 -- 172.21.15.12:0/1614876017 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f04c011d7d0 con 0x7f04cc0ba440 2023-10-16T23:28:34.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.024+0000 7f04ca59c640 1 --2- 172.21.15.12:0/1614876017 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f04ac065e60 0x7f04ac068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:34.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.028+0000 7f04ca59c640 1 --2- 172.21.15.12:0/1614876017 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f04ac065e60 0x7f04ac068320 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f04bc001670 tx=0x7f04bc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:34.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.032+0000 7f04baffd640 1 -- 172.21.15.12:0/1614876017 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f04c00eae70 con 0x7f04cc0ba440 2023-10-16T23:28:34.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.184+0000 7f04d0dec640 1 -- 172.21.15.12:0/1614876017 --> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f04cc15c520 con 0x7f04ac065e60 2023-10-16T23:28:34.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.208+0000 7f04baffd640 1 -- 172.21.15.12:0/1614876017 <== mgr.4108 v2:172.21.15.31:6832/37949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+295503 (secure 0 0 0) 0x7f04bc001360 con 0x7f04ac065e60 2023-10-16T23:28:34.214 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:28:34.216 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-16T23:28:34.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.212+0000 7f04d0dec640 1 -- 172.21.15.12:0/1614876017 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f04ac065e60 msgr2=0x7f04ac068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:34.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.212+0000 7f04d0dec640 1 --2- 172.21.15.12:0/1614876017 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f04ac065e60 0x7f04ac068320 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f04bc001670 tx=0x7f04bc009040 comp rx=0 tx=0).stop 2023-10-16T23:28:34.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.212+0000 7f04d0dec640 1 -- 172.21.15.12:0/1614876017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04cc0ba440 msgr2=0x7f04cc14cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:34.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.212+0000 7f04d0dec640 1 --2- 172.21.15.12:0/1614876017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04cc0ba440 0x7f04cc14cb20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f04c001a0b0 tx=0x7f04c0019220 comp rx=0 tx=0).stop 2023-10-16T23:28:34.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.212+0000 7f04d0dec640 1 -- 172.21.15.12:0/1614876017 shutdown_connections 2023-10-16T23:28:34.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.212+0000 7f04d0dec640 1 --2- 172.21.15.12:0/1614876017 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f04ac065e60 0x7f04ac068320 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.212+0000 7f04d0dec640 1 --2- 172.21.15.12:0/1614876017 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f04cc0c1130 0x7f04cc14d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.212+0000 7f04d0dec640 1 --2- 172.21.15.12:0/1614876017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04cc0ba440 0x7f04cc14cb20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.212+0000 7f04d0dec640 1 --2- 172.21.15.12:0/1614876017 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04cc06e770 0x7f04cc147d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.212+0000 7f04d0dec640 1 -- 172.21.15.12:0/1614876017 >> 172.21.15.12:0/1614876017 conn(0x7f04cc06ba20 msgr2=0x7f04cc0be7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:34.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.212+0000 7f04d0dec640 1 -- 172.21.15.12:0/1614876017 shutdown_connections 2023-10-16T23:28:34.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.212+0000 7f04d0dec640 1 -- 172.21.15.12:0/1614876017 wait complete. 2023-10-16T23:28:34.231 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2023-10-16T23:28:33.303359+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595638,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":215,"num_write_kb":2441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223048,"kb_used_data":3336,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751672,"statfs":{"total":773094113280,"available":772865712128,"internally_reserved":0,"allocated":3416064,"data_stored":2020140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":282,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003584"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.243979+0000","last_change":"2023-10-16T23:27:40.706600+0000","last_active":"2023-10-16T23:28:22.243979+0000","last_peered":"2023-10-16T23:28:22.243979+0000","last_clean":"2023-10-16T23:28:22.243979+0000","last_became_active":"2023-10-16T23:27:40.706320+0000","last_became_peered":"2023-10-16T23:27:40.706320+0000","last_unstale":"2023-10-16T23:28:22.243979+0000","last_undegraded":"2023-10-16T23:28:22.243979+0000","last_fullsized":"2023-10-16T23:28:22.243979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:48:20.356964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962517+0000","last_change":"2023-10-16T23:27:40.756555+0000","last_active":"2023-10-16T23:28:22.962517+0000","last_peered":"2023-10-16T23:28:22.962517+0000","last_clean":"2023-10-16T23:28:22.962517+0000","last_became_active":"2023-10-16T23:27:40.754736+0000","last_became_peered":"2023-10-16T23:27:40.754736+0000","last_unstale":"2023-10-16T23:28:22.962517+0000","last_undegraded":"2023-10-16T23:28:22.962517+0000","last_fullsized":"2023-10-16T23:28:22.962517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:45.642622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248499+0000","last_change":"2023-10-16T23:27:40.726586+0000","last_active":"2023-10-16T23:28:22.248499+0000","last_peered":"2023-10-16T23:28:22.248499+0000","last_clean":"2023-10-16T23:28:22.248499+0000","last_became_active":"2023-10-16T23:27:40.725731+0000","last_became_peered":"2023-10-16T23:27:40.725731+0000","last_unstale":"2023-10-16T23:28:22.248499+0000","last_undegraded":"2023-10-16T23:28:22.248499+0000","last_fullsized":"2023-10-16T23:28:22.248499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:04:22.434372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247656+0000","last_change":"2023-10-16T23:27:40.715543+0000","last_active":"2023-10-16T23:28:22.247656+0000","last_peered":"2023-10-16T23:28:22.247656+0000","last_clean":"2023-10-16T23:28:22.247656+0000","last_became_active":"2023-10-16T23:27:40.714592+0000","last_became_peered":"2023-10-16T23:27:40.714592+0000","last_unstale":"2023-10-16T23:28:22.247656+0000","last_undegraded":"2023-10-16T23:28:22.247656+0000","last_fullsized":"2023-10-16T23:28:22.247656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:42:37.696897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.311992+0000","last_change":"2023-10-16T23:27:40.722734+0000","last_active":"2023-10-16T23:27:43.311992+0000","last_peered":"2023-10-16T23:27:43.311992+0000","last_clean":"2023-10-16T23:27:43.311992+0000","last_became_active":"2023-10-16T23:27:40.722399+0000","last_became_peered":"2023-10-16T23:27:40.722399+0000","last_unstale":"2023-10-16T23:27:43.311992+0000","last_undegraded":"2023-10-16T23:27:43.311992+0000","last_fullsized":"2023-10-16T23:27:43.311992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:19:17.463284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246458+0000","last_change":"2023-10-16T23:27:40.716139+0000","last_active":"2023-10-16T23:28:22.246458+0000","last_peered":"2023-10-16T23:28:22.246458+0000","last_clean":"2023-10-16T23:28:22.246458+0000","last_became_active":"2023-10-16T23:27:40.715294+0000","last_became_peered":"2023-10-16T23:27:40.715294+0000","last_unstale":"2023-10-16T23:28:22.246458+0000","last_undegraded":"2023-10-16T23:28:22.246458+0000","last_fullsized":"2023-10-16T23:28:22.246458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:19:17.463284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683398+0000","last_change":"2023-10-16T23:27:40.762253+0000","last_active":"2023-10-16T23:28:22.683398+0000","last_peered":"2023-10-16T23:28:22.683398+0000","last_clean":"2023-10-16T23:28:22.683398+0000","last_became_active":"2023-10-16T23:27:40.760726+0000","last_became_peered":"2023-10-16T23:27:40.760726+0000","last_unstale":"2023-10-16T23:28:22.683398+0000","last_undegraded":"2023-10-16T23:28:22.683398+0000","last_fullsized":"2023-10-16T23:28:22.683398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:50:08.569961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962326+0000","last_change":"2023-10-16T23:27:40.756184+0000","last_active":"2023-10-16T23:28:22.962326+0000","last_peered":"2023-10-16T23:28:22.962326+0000","last_clean":"2023-10-16T23:28:22.962326+0000","last_became_active":"2023-10-16T23:27:40.755276+0000","last_became_peered":"2023-10-16T23:27:40.755276+0000","last_unstale":"2023-10-16T23:28:22.962326+0000","last_undegraded":"2023-10-16T23:28:22.962326+0000","last_fullsized":"2023-10-16T23:28:22.962326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.312307+0000","last_change":"2023-10-16T23:27:40.724060+0000","last_active":"2023-10-16T23:27:43.312307+0000","last_peered":"2023-10-16T23:27:43.312307+0000","last_clean":"2023-10-16T23:27:43.312307+0000","last_became_active":"2023-10-16T23:27:40.723701+0000","last_became_peered":"2023-10-16T23:27:40.723701+0000","last_unstale":"2023-10-16T23:27:43.312307+0000","last_undegraded":"2023-10-16T23:27:43.312307+0000","last_fullsized":"2023-10-16T23:27:43.312307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:04.722168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962762+0000","last_change":"2023-10-16T23:27:40.756783+0000","last_active":"2023-10-16T23:28:22.962762+0000","last_peered":"2023-10-16T23:28:22.962762+0000","last_clean":"2023-10-16T23:28:22.962762+0000","last_became_active":"2023-10-16T23:27:40.755772+0000","last_became_peered":"2023-10-16T23:27:40.755772+0000","last_unstale":"2023-10-16T23:28:22.962762+0000","last_undegraded":"2023-10-16T23:28:22.962762+0000","last_fullsized":"2023-10-16T23:28:22.962762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248718+0000","last_change":"2023-10-16T23:27:40.724754+0000","last_active":"2023-10-16T23:28:22.248718+0000","last_peered":"2023-10-16T23:28:22.248718+0000","last_clean":"2023-10-16T23:28:22.248718+0000","last_became_active":"2023-10-16T23:27:40.724031+0000","last_became_peered":"2023-10-16T23:27:40.724031+0000","last_unstale":"2023-10-16T23:28:22.248718+0000","last_undegraded":"2023-10-16T23:28:22.248718+0000","last_fullsized":"2023-10-16T23:28:22.248718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:04.722168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.243519+0000","last_change":"2023-10-16T23:27:40.724453+0000","last_active":"2023-10-16T23:28:22.243519+0000","last_peered":"2023-10-16T23:28:22.243519+0000","last_clean":"2023-10-16T23:28:22.243519+0000","last_became_active":"2023-10-16T23:27:40.724099+0000","last_became_peered":"2023-10-16T23:27:40.724099+0000","last_unstale":"2023-10-16T23:28:22.243519+0000","last_undegraded":"2023-10-16T23:28:22.243519+0000","last_fullsized":"2023-10-16T23:28:22.243519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:01:05.350517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.243081+0000","last_change":"2023-10-16T23:27:40.704484+0000","last_active":"2023-10-16T23:28:22.243081+0000","last_peered":"2023-10-16T23:28:22.243081+0000","last_clean":"2023-10-16T23:28:22.243081+0000","last_became_active":"2023-10-16T23:27:40.704162+0000","last_became_peered":"2023-10-16T23:27:40.704162+0000","last_unstale":"2023-10-16T23:28:22.243081+0000","last_undegraded":"2023-10-16T23:28:22.243081+0000","last_fullsized":"2023-10-16T23:28:22.243081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:15:16.646850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962528+0000","last_change":"2023-10-16T23:27:40.738913+0000","last_active":"2023-10-16T23:28:22.962528+0000","last_peered":"2023-10-16T23:28:22.962528+0000","last_clean":"2023-10-16T23:28:22.962528+0000","last_became_active":"2023-10-16T23:27:40.738070+0000","last_became_peered":"2023-10-16T23:27:40.738070+0000","last_unstale":"2023-10-16T23:28:22.962528+0000","last_undegraded":"2023-10-16T23:28:22.962528+0000","last_fullsized":"2023-10-16T23:28:22.962528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:56:41.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683534+0000","last_change":"2023-10-16T23:27:40.762529+0000","last_active":"2023-10-16T23:28:22.683534+0000","last_peered":"2023-10-16T23:28:22.683534+0000","last_clean":"2023-10-16T23:28:22.683534+0000","last_became_active":"2023-10-16T23:27:40.761570+0000","last_became_peered":"2023-10-16T23:27:40.761570+0000","last_unstale":"2023-10-16T23:28:22.683534+0000","last_undegraded":"2023-10-16T23:28:22.683534+0000","last_fullsized":"2023-10-16T23:28:22.683534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:46.449264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246388+0000","last_change":"2023-10-16T23:27:40.719227+0000","last_active":"2023-10-16T23:28:22.246388+0000","last_peered":"2023-10-16T23:28:22.246388+0000","last_clean":"2023-10-16T23:28:22.246388+0000","last_became_active":"2023-10-16T23:27:40.718276+0000","last_became_peered":"2023-10-16T23:27:40.718276+0000","last_unstale":"2023-10-16T23:28:22.246388+0000","last_undegraded":"2023-10-16T23:28:22.246388+0000","last_fullsized":"2023-10-16T23:28:22.246388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.312350+0000","last_change":"2023-10-16T23:27:40.719723+0000","last_active":"2023-10-16T23:27:43.312350+0000","last_peered":"2023-10-16T23:27:43.312350+0000","last_clean":"2023-10-16T23:27:43.312350+0000","last_became_active":"2023-10-16T23:27:40.719402+0000","last_became_peered":"2023-10-16T23:27:40.719402+0000","last_unstale":"2023-10-16T23:27:43.312350+0000","last_undegraded":"2023-10-16T23:27:43.312350+0000","last_fullsized":"2023-10-16T23:27:43.312350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:04:22.434372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248141+0000","last_change":"2023-10-16T23:27:40.732931+0000","last_active":"2023-10-16T23:28:22.248141+0000","last_peered":"2023-10-16T23:28:22.248141+0000","last_clean":"2023-10-16T23:28:22.248141+0000","last_became_active":"2023-10-16T23:27:40.732102+0000","last_became_peered":"2023-10-16T23:27:40.732102+0000","last_unstale":"2023-10-16T23:28:22.248141+0000","last_undegraded":"2023-10-16T23:28:22.248141+0000","last_fullsized":"2023-10-16T23:28:22.248141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:14.359461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.244017+0000","last_change":"2023-10-16T23:27:40.728920+0000","last_active":"2023-10-16T23:28:22.244017+0000","last_peered":"2023-10-16T23:28:22.244017+0000","last_clean":"2023-10-16T23:28:22.244017+0000","last_became_active":"2023-10-16T23:27:40.728298+0000","last_became_peered":"2023-10-16T23:27:40.728298+0000","last_unstale":"2023-10-16T23:28:22.244017+0000","last_undegraded":"2023-10-16T23:28:22.244017+0000","last_fullsized":"2023-10-16T23:28:22.244017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:28:33.509782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248025+0000","last_change":"2023-10-16T23:27:40.745270+0000","last_active":"2023-10-16T23:28:22.248025+0000","last_peered":"2023-10-16T23:28:22.248025+0000","last_clean":"2023-10-16T23:28:22.248025+0000","last_became_active":"2023-10-16T23:27:40.744483+0000","last_became_peered":"2023-10-16T23:27:40.744483+0000","last_unstale":"2023-10-16T23:28:22.248025+0000","last_undegraded":"2023-10-16T23:28:22.248025+0000","last_fullsized":"2023-10-16T23:28:22.248025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:24:33.998070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683429+0000","last_change":"2023-10-16T23:27:40.761480+0000","last_active":"2023-10-16T23:28:22.683429+0000","last_peered":"2023-10-16T23:28:22.683429+0000","last_clean":"2023-10-16T23:28:22.683429+0000","last_became_active":"2023-10-16T23:27:40.760882+0000","last_became_peered":"2023-10-16T23:27:40.760882+0000","last_unstale":"2023-10-16T23:28:22.683429+0000","last_undegraded":"2023-10-16T23:28:22.683429+0000","last_fullsized":"2023-10-16T23:28:22.683429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:37:38.843931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.311797+0000","last_change":"2023-10-16T23:27:40.722620+0000","last_active":"2023-10-16T23:27:43.311797+0000","last_peered":"2023-10-16T23:27:43.311797+0000","last_clean":"2023-10-16T23:27:43.311797+0000","last_became_active":"2023-10-16T23:27:40.722302+0000","last_became_peered":"2023-10-16T23:27:40.722302+0000","last_unstale":"2023-10-16T23:27:43.311797+0000","last_undegraded":"2023-10-16T23:27:43.311797+0000","last_fullsized":"2023-10-16T23:27:43.311797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689201+0000","last_change":"2023-10-16T23:27:40.716578+0000","last_active":"2023-10-16T23:28:22.689201+0000","last_peered":"2023-10-16T23:28:22.689201+0000","last_clean":"2023-10-16T23:28:22.689201+0000","last_became_active":"2023-10-16T23:27:40.716228+0000","last_became_peered":"2023-10-16T23:27:40.716228+0000","last_unstale":"2023-10-16T23:28:22.689201+0000","last_undegraded":"2023-10-16T23:28:22.689201+0000","last_fullsized":"2023-10-16T23:28:22.689201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:27:29.534374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683349+0000","last_change":"2023-10-16T23:27:40.761323+0000","last_active":"2023-10-16T23:28:22.683349+0000","last_peered":"2023-10-16T23:28:22.683349+0000","last_clean":"2023-10-16T23:28:22.683349+0000","last_became_active":"2023-10-16T23:27:40.760659+0000","last_became_peered":"2023-10-16T23:27:40.760659+0000","last_unstale":"2023-10-16T23:28:22.683349+0000","last_undegraded":"2023-10-16T23:28:22.683349+0000","last_fullsized":"2023-10-16T23:28:22.683349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:09:55.835429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967422+0000","last_change":"2023-10-16T23:27:40.727629+0000","last_active":"2023-10-16T23:28:22.967422+0000","last_peered":"2023-10-16T23:28:22.967422+0000","last_clean":"2023-10-16T23:28:22.967422+0000","last_became_active":"2023-10-16T23:27:40.727334+0000","last_became_peered":"2023-10-16T23:27:40.727334+0000","last_unstale":"2023-10-16T23:28:22.967422+0000","last_undegraded":"2023-10-16T23:28:22.967422+0000","last_fullsized":"2023-10-16T23:28:22.967422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:38:33.383867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967294+0000","last_change":"2023-10-16T23:27:40.704775+0000","last_active":"2023-10-16T23:28:22.967294+0000","last_peered":"2023-10-16T23:28:22.967294+0000","last_clean":"2023-10-16T23:28:22.967294+0000","last_became_active":"2023-10-16T23:27:40.704536+0000","last_became_peered":"2023-10-16T23:27:40.704536+0000","last_unstale":"2023-10-16T23:28:22.967294+0000","last_undegraded":"2023-10-16T23:28:22.967294+0000","last_fullsized":"2023-10-16T23:28:22.967294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962992+0000","last_change":"2023-10-16T23:27:40.764351+0000","last_active":"2023-10-16T23:28:22.962992+0000","last_peered":"2023-10-16T23:28:22.962992+0000","last_clean":"2023-10-16T23:28:22.962992+0000","last_became_active":"2023-10-16T23:27:40.763592+0000","last_became_peered":"2023-10-16T23:27:40.763592+0000","last_unstale":"2023-10-16T23:28:22.962992+0000","last_undegraded":"2023-10-16T23:28:22.962992+0000","last_fullsized":"2023-10-16T23:28:22.962992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967127+0000","last_change":"2023-10-16T23:27:40.760989+0000","last_active":"2023-10-16T23:28:22.967127+0000","last_peered":"2023-10-16T23:28:22.967127+0000","last_clean":"2023-10-16T23:28:22.967127+0000","last_became_active":"2023-10-16T23:27:40.760615+0000","last_became_peered":"2023-10-16T23:27:40.760615+0000","last_unstale":"2023-10-16T23:28:22.967127+0000","last_undegraded":"2023-10-16T23:28:22.967127+0000","last_fullsized":"2023-10-16T23:28:22.967127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689374+0000","last_change":"2023-10-16T23:27:40.760762+0000","last_active":"2023-10-16T23:28:22.689374+0000","last_peered":"2023-10-16T23:28:22.689374+0000","last_clean":"2023-10-16T23:28:22.689374+0000","last_became_active":"2023-10-16T23:27:40.760437+0000","last_became_peered":"2023-10-16T23:27:40.760437+0000","last_unstale":"2023-10-16T23:28:22.689374+0000","last_undegraded":"2023-10-16T23:28:22.689374+0000","last_fullsized":"2023-10-16T23:28:22.689374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:55:29.771781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247695+0000","last_change":"2023-10-16T23:27:40.745197+0000","last_active":"2023-10-16T23:28:22.247695+0000","last_peered":"2023-10-16T23:28:22.247695+0000","last_clean":"2023-10-16T23:28:22.247695+0000","last_became_active":"2023-10-16T23:27:40.744458+0000","last_became_peered":"2023-10-16T23:27:40.744458+0000","last_unstale":"2023-10-16T23:28:22.247695+0000","last_undegraded":"2023-10-16T23:28:22.247695+0000","last_fullsized":"2023-10-16T23:28:22.247695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689184+0000","last_change":"2023-10-16T23:27:40.711795+0000","last_active":"2023-10-16T23:28:22.689184+0000","last_peered":"2023-10-16T23:28:22.689184+0000","last_clean":"2023-10-16T23:28:22.689184+0000","last_became_active":"2023-10-16T23:27:40.711492+0000","last_became_peered":"2023-10-16T23:27:40.711492+0000","last_unstale":"2023-10-16T23:28:22.689184+0000","last_undegraded":"2023-10-16T23:28:22.689184+0000","last_fullsized":"2023-10-16T23:28:22.689184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:04:22.434372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.245860+0000","last_change":"2023-10-16T23:27:40.710149+0000","last_active":"2023-10-16T23:28:22.245860+0000","last_peered":"2023-10-16T23:28:22.245860+0000","last_clean":"2023-10-16T23:28:22.245860+0000","last_became_active":"2023-10-16T23:27:40.709286+0000","last_became_peered":"2023-10-16T23:27:40.709286+0000","last_unstale":"2023-10-16T23:28:22.245860+0000","last_undegraded":"2023-10-16T23:28:22.245860+0000","last_fullsized":"2023-10-16T23:28:22.245860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:22:41.708468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689705+0000","last_change":"2023-10-16T23:27:40.707271+0000","last_active":"2023-10-16T23:28:22.689705+0000","last_peered":"2023-10-16T23:28:22.689705+0000","last_clean":"2023-10-16T23:28:22.689705+0000","last_became_active":"2023-10-16T23:27:40.706864+0000","last_became_peered":"2023-10-16T23:27:40.706864+0000","last_unstale":"2023-10-16T23:28:22.689705+0000","last_undegraded":"2023-10-16T23:28:22.689705+0000","last_fullsized":"2023-10-16T23:28:22.689705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683702+0000","last_change":"2023-10-16T23:27:40.353567+0000","last_active":"2023-10-16T23:28:22.683702+0000","last_peered":"2023-10-16T23:28:22.683702+0000","last_clean":"2023-10-16T23:28:22.683702+0000","last_became_active":"2023-10-16T23:27:40.352775+0000","last_became_peered":"2023-10-16T23:27:40.352775+0000","last_unstale":"2023-10-16T23:28:22.683702+0000","last_undegraded":"2023-10-16T23:28:22.683702+0000","last_fullsized":"2023-10-16T23:28:22.683702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:52:58.351406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.963098+0000","last_change":"2023-10-16T23:27:40.765398+0000","last_active":"2023-10-16T23:28:22.963098+0000","last_peered":"2023-10-16T23:28:22.963098+0000","last_clean":"2023-10-16T23:28:22.963098+0000","last_became_active":"2023-10-16T23:27:40.764517+0000","last_became_peered":"2023-10-16T23:27:40.764517+0000","last_unstale":"2023-10-16T23:28:22.963098+0000","last_undegraded":"2023-10-16T23:28:22.963098+0000","last_fullsized":"2023-10-16T23:28:22.963098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:31.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.311846+0000","last_change":"2023-10-16T23:27:40.335221+0000","last_active":"2023-10-16T23:27:43.311846+0000","last_peered":"2023-10-16T23:27:43.311846+0000","last_clean":"2023-10-16T23:27:43.311846+0000","last_became_active":"2023-10-16T23:27:40.334885+0000","last_became_peered":"2023-10-16T23:27:40.334885+0000","last_unstale":"2023-10-16T23:27:43.311846+0000","last_undegraded":"2023-10-16T23:27:43.311846+0000","last_fullsized":"2023-10-16T23:27:43.311846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.312206+0000","last_change":"2023-10-16T23:27:40.719997+0000","last_active":"2023-10-16T23:27:43.312206+0000","last_peered":"2023-10-16T23:27:43.312206+0000","last_clean":"2023-10-16T23:27:43.312206+0000","last_became_active":"2023-10-16T23:27:40.719811+0000","last_became_peered":"2023-10-16T23:27:40.719811+0000","last_unstale":"2023-10-16T23:27:43.312206+0000","last_undegraded":"2023-10-16T23:27:43.312206+0000","last_fullsized":"2023-10-16T23:27:43.312206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:13.934735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683767+0000","last_change":"2023-10-16T23:27:40.357620+0000","last_active":"2023-10-16T23:28:22.683767+0000","last_peered":"2023-10-16T23:28:22.683767+0000","last_clean":"2023-10-16T23:28:22.683767+0000","last_became_active":"2023-10-16T23:27:40.357009+0000","last_became_peered":"2023-10-16T23:27:40.357009+0000","last_unstale":"2023-10-16T23:28:22.683767+0000","last_undegraded":"2023-10-16T23:28:22.683767+0000","last_fullsized":"2023-10-16T23:28:22.683767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:07:50.847519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.690065+0000","last_change":"2023-10-16T23:27:40.760925+0000","last_active":"2023-10-16T23:28:22.690065+0000","last_peered":"2023-10-16T23:28:22.690065+0000","last_clean":"2023-10-16T23:28:22.690065+0000","last_became_active":"2023-10-16T23:27:40.760365+0000","last_became_peered":"2023-10-16T23:27:40.760365+0000","last_unstale":"2023-10-16T23:28:22.690065+0000","last_undegraded":"2023-10-16T23:28:22.690065+0000","last_fullsized":"2023-10-16T23:28:22.690065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:13.934735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246026+0000","last_change":"2023-10-16T23:27:40.331826+0000","last_active":"2023-10-16T23:28:22.246026+0000","last_peered":"2023-10-16T23:28:22.246026+0000","last_clean":"2023-10-16T23:28:22.246026+0000","last_became_active":"2023-10-16T23:27:40.330857+0000","last_became_peered":"2023-10-16T23:27:40.330857+0000","last_unstale":"2023-10-16T23:28:22.246026+0000","last_undegraded":"2023-10-16T23:28:22.246026+0000","last_fullsized":"2023-10-16T23:28:22.246026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:42:46.614672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.684412+0000","last_change":"2023-10-16T23:27:40.357691+0000","last_active":"2023-10-16T23:28:22.684412+0000","last_peered":"2023-10-16T23:28:22.684412+0000","last_clean":"2023-10-16T23:28:22.684412+0000","last_became_active":"2023-10-16T23:27:40.357047+0000","last_became_peered":"2023-10-16T23:27:40.357047+0000","last_unstale":"2023-10-16T23:28:22.684412+0000","last_undegraded":"2023-10-16T23:28:22.684412+0000","last_fullsized":"2023-10-16T23:28:22.684412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:00:00.805564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962388+0000","last_change":"2023-10-16T23:27:40.763848+0000","last_active":"2023-10-16T23:28:22.962388+0000","last_peered":"2023-10-16T23:28:22.962388+0000","last_clean":"2023-10-16T23:28:22.962388+0000","last_became_active":"2023-10-16T23:27:40.763116+0000","last_became_peered":"2023-10-16T23:27:40.763116+0000","last_unstale":"2023-10-16T23:28:22.962388+0000","last_undegraded":"2023-10-16T23:28:22.962388+0000","last_fullsized":"2023-10-16T23:28:22.962388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.684383+0000","last_change":"2023-10-16T23:27:40.347016+0000","last_active":"2023-10-16T23:28:22.684383+0000","last_peered":"2023-10-16T23:28:22.684383+0000","last_clean":"2023-10-16T23:28:22.684383+0000","last_became_active":"2023-10-16T23:27:40.346439+0000","last_became_peered":"2023-10-16T23:27:40.346439+0000","last_unstale":"2023-10-16T23:28:22.684383+0000","last_undegraded":"2023-10-16T23:28:22.684383+0000","last_fullsized":"2023-10-16T23:28:22.684383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:08:40.047699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246458+0000","last_change":"2023-10-16T23:27:40.714905+0000","last_active":"2023-10-16T23:28:22.246458+0000","last_peered":"2023-10-16T23:28:22.246458+0000","last_clean":"2023-10-16T23:28:22.246458+0000","last_became_active":"2023-10-16T23:27:40.714098+0000","last_became_peered":"2023-10-16T23:27:40.714098+0000","last_unstale":"2023-10-16T23:28:22.246458+0000","last_undegraded":"2023-10-16T23:28:22.246458+0000","last_fullsized":"2023-10-16T23:28:22.246458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:13.934735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.684232+0000","last_change":"2023-10-16T23:27:40.340462+0000","last_active":"2023-10-16T23:28:22.684232+0000","last_peered":"2023-10-16T23:28:22.684232+0000","last_clean":"2023-10-16T23:28:22.684232+0000","last_became_active":"2023-10-16T23:27:40.339531+0000","last_became_peered":"2023-10-16T23:27:40.339531+0000","last_unstale":"2023-10-16T23:28:22.684232+0000","last_undegraded":"2023-10-16T23:28:22.684232+0000","last_fullsized":"2023-10-16T23:28:22.684232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:33:50.768168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246296+0000","last_change":"2023-10-16T23:27:40.713930+0000","last_active":"2023-10-16T23:28:22.246296+0000","last_peered":"2023-10-16T23:28:22.246296+0000","last_clean":"2023-10-16T23:28:22.246296+0000","last_became_active":"2023-10-16T23:27:40.713087+0000","last_became_peered":"2023-10-16T23:27:40.713087+0000","last_unstale":"2023-10-16T23:28:22.246296+0000","last_undegraded":"2023-10-16T23:28:22.246296+0000","last_fullsized":"2023-10-16T23:28:22.246296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:15:24.177529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962633+0000","last_change":"2023-10-16T23:27:40.320848+0000","last_active":"2023-10-16T23:28:22.962633+0000","last_peered":"2023-10-16T23:28:22.962633+0000","last_clean":"2023-10-16T23:28:22.962633+0000","last_became_active":"2023-10-16T23:27:40.319887+0000","last_became_peered":"2023-10-16T23:27:40.319887+0000","last_unstale":"2023-10-16T23:28:22.962633+0000","last_undegraded":"2023-10-16T23:28:22.962633+0000","last_fullsized":"2023-10-16T23:28:22.962633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:33:08.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.311894+0000","last_change":"2023-10-16T23:27:40.726405+0000","last_active":"2023-10-16T23:27:43.311894+0000","last_peered":"2023-10-16T23:27:43.311894+0000","last_clean":"2023-10-16T23:27:43.311894+0000","last_became_active":"2023-10-16T23:27:40.725724+0000","last_became_peered":"2023-10-16T23:27:40.725724+0000","last_unstale":"2023-10-16T23:27:43.311894+0000","last_undegraded":"2023-10-16T23:27:43.311894+0000","last_fullsized":"2023-10-16T23:27:43.311894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689512+0000","last_change":"2023-10-16T23:27:40.337756+0000","last_active":"2023-10-16T23:28:22.689512+0000","last_peered":"2023-10-16T23:28:22.689512+0000","last_clean":"2023-10-16T23:28:22.689512+0000","last_became_active":"2023-10-16T23:27:40.337405+0000","last_became_peered":"2023-10-16T23:27:40.337405+0000","last_unstale":"2023-10-16T23:28:22.689512+0000","last_undegraded":"2023-10-16T23:28:22.689512+0000","last_fullsized":"2023-10-16T23:28:22.689512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:42.154580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248284+0000","last_change":"2023-10-16T23:27:40.722911+0000","last_active":"2023-10-16T23:28:22.248284+0000","last_peered":"2023-10-16T23:28:22.248284+0000","last_clean":"2023-10-16T23:28:22.248284+0000","last_became_active":"2023-10-16T23:27:40.722091+0000","last_became_peered":"2023-10-16T23:27:40.722091+0000","last_unstale":"2023-10-16T23:28:22.248284+0000","last_undegraded":"2023-10-16T23:28:22.248284+0000","last_fullsized":"2023-10-16T23:28:22.248284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246704+0000","last_change":"2023-10-16T23:27:40.343242+0000","last_active":"2023-10-16T23:28:22.246704+0000","last_peered":"2023-10-16T23:28:22.246704+0000","last_clean":"2023-10-16T23:28:22.246704+0000","last_became_active":"2023-10-16T23:27:40.342213+0000","last_became_peered":"2023-10-16T23:27:40.342213+0000","last_unstale":"2023-10-16T23:28:22.246704+0000","last_undegraded":"2023-10-16T23:28:22.246704+0000","last_fullsized":"2023-10-16T23:28:22.246704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:04.095452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248861+0000","last_change":"2023-10-16T23:27:40.733845+0000","last_active":"2023-10-16T23:28:22.248861+0000","last_peered":"2023-10-16T23:28:22.248861+0000","last_clean":"2023-10-16T23:28:22.248861+0000","last_became_active":"2023-10-16T23:27:40.732996+0000","last_became_peered":"2023-10-16T23:27:40.732996+0000","last_unstale":"2023-10-16T23:28:22.248861+0000","last_undegraded":"2023-10-16T23:28:22.248861+0000","last_fullsized":"2023-10-16T23:28:22.248861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:06:04.512089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247175+0000","last_change":"2023-10-16T23:27:40.347984+0000","last_active":"2023-10-16T23:28:22.247175+0000","last_peered":"2023-10-16T23:28:22.247175+0000","last_clean":"2023-10-16T23:28:22.247175+0000","last_became_active":"2023-10-16T23:27:40.347253+0000","last_became_peered":"2023-10-16T23:27:40.347253+0000","last_unstale":"2023-10-16T23:28:22.247175+0000","last_undegraded":"2023-10-16T23:28:22.247175+0000","last_fullsized":"2023-10-16T23:28:22.247175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:42:46.614672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248305+0000","last_change":"2023-10-16T23:27:40.745245+0000","last_active":"2023-10-16T23:28:22.248305+0000","last_peered":"2023-10-16T23:28:22.248305+0000","last_clean":"2023-10-16T23:28:22.248305+0000","last_became_active":"2023-10-16T23:27:40.744571+0000","last_became_peered":"2023-10-16T23:27:40.744571+0000","last_unstale":"2023-10-16T23:28:22.248305+0000","last_undegraded":"2023-10-16T23:28:22.248305+0000","last_fullsized":"2023-10-16T23:28:22.248305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:10:39.974563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689656+0000","last_change":"2023-10-16T23:27:40.314767+0000","last_active":"2023-10-16T23:28:22.689656+0000","last_peered":"2023-10-16T23:28:22.689656+0000","last_clean":"2023-10-16T23:28:22.689656+0000","last_became_active":"2023-10-16T23:27:40.314242+0000","last_became_peered":"2023-10-16T23:27:40.314242+0000","last_unstale":"2023-10-16T23:28:22.689656+0000","last_undegraded":"2023-10-16T23:28:22.689656+0000","last_fullsized":"2023-10-16T23:28:22.689656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967500+0000","last_change":"2023-10-16T23:27:40.709591+0000","last_active":"2023-10-16T23:28:22.967500+0000","last_peered":"2023-10-16T23:28:22.967500+0000","last_clean":"2023-10-16T23:28:22.967500+0000","last_became_active":"2023-10-16T23:27:40.709174+0000","last_became_peered":"2023-10-16T23:27:40.709174+0000","last_unstale":"2023-10-16T23:28:22.967500+0000","last_undegraded":"2023-10-16T23:28:22.967500+0000","last_fullsized":"2023-10-16T23:28:22.967500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:31.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683820+0000","last_change":"2023-10-16T23:27:29.356842+0000","last_active":"2023-10-16T23:28:22.683820+0000","last_peered":"2023-10-16T23:28:22.683820+0000","last_clean":"2023-10-16T23:28:22.683820+0000","last_became_active":"2023-10-16T23:27:29.353846+0000","last_became_peered":"2023-10-16T23:27:29.353846+0000","last_unstale":"2023-10-16T23:28:22.683820+0000","last_undegraded":"2023-10-16T23:28:22.683820+0000","last_fullsized":"2023-10-16T23:28:22.683820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:28.136202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:28.136202+0000","last_clean_scrub_stamp":"2023-10-16T23:27:28.136202+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:34:30.590360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962513+0000","last_change":"2023-10-16T23:27:36.278001+0000","last_active":"2023-10-16T23:28:22.962513+0000","last_peered":"2023-10-16T23:28:22.962513+0000","last_clean":"2023-10-16T23:28:22.962513+0000","last_became_active":"2023-10-16T23:27:36.277096+0000","last_became_peered":"2023-10-16T23:27:36.277096+0000","last_unstale":"2023-10-16T23:28:22.962513+0000","last_undegraded":"2023-10-16T23:28:22.962513+0000","last_fullsized":"2023-10-16T23:28:22.962513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:38:00.468059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689229+0000","last_change":"2023-10-16T23:27:40.331268+0000","last_active":"2023-10-16T23:28:22.689229+0000","last_peered":"2023-10-16T23:28:22.689229+0000","last_clean":"2023-10-16T23:28:22.689229+0000","last_became_active":"2023-10-16T23:27:40.330989+0000","last_became_peered":"2023-10-16T23:27:40.330989+0000","last_unstale":"2023-10-16T23:28:22.689229+0000","last_undegraded":"2023-10-16T23:28:22.689229+0000","last_fullsized":"2023-10-16T23:28:22.689229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:55.630817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247248+0000","last_change":"2023-10-16T23:27:40.726429+0000","last_active":"2023-10-16T23:28:22.247248+0000","last_peered":"2023-10-16T23:28:22.247248+0000","last_clean":"2023-10-16T23:28:22.247248+0000","last_became_active":"2023-10-16T23:27:40.725490+0000","last_became_peered":"2023-10-16T23:27:40.725490+0000","last_unstale":"2023-10-16T23:28:22.247248+0000","last_undegraded":"2023-10-16T23:28:22.247248+0000","last_fullsized":"2023-10-16T23:28:22.247248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:52:41.884757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683589+0000","last_change":"2023-10-16T23:27:36.278865+0000","last_active":"2023-10-16T23:28:22.683589+0000","last_peered":"2023-10-16T23:28:22.683589+0000","last_clean":"2023-10-16T23:28:22.683589+0000","last_became_active":"2023-10-16T23:27:36.277974+0000","last_became_peered":"2023-10-16T23:27:36.277974+0000","last_unstale":"2023-10-16T23:28:22.683589+0000","last_undegraded":"2023-10-16T23:28:22.683589+0000","last_fullsized":"2023-10-16T23:28:22.683589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:31:09.411975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.311739+0000","last_change":"2023-10-16T23:27:40.340025+0000","last_active":"2023-10-16T23:27:43.311739+0000","last_peered":"2023-10-16T23:27:43.311739+0000","last_clean":"2023-10-16T23:27:43.311739+0000","last_became_active":"2023-10-16T23:27:40.339569+0000","last_became_peered":"2023-10-16T23:27:40.339569+0000","last_unstale":"2023-10-16T23:27:43.311739+0000","last_undegraded":"2023-10-16T23:27:43.311739+0000","last_fullsized":"2023-10-16T23:27:43.311739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:42.154580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.312141+0000","last_change":"2023-10-16T23:27:40.727415+0000","last_active":"2023-10-16T23:27:43.312141+0000","last_peered":"2023-10-16T23:27:43.312141+0000","last_clean":"2023-10-16T23:27:43.312141+0000","last_became_active":"2023-10-16T23:27:40.726813+0000","last_became_peered":"2023-10-16T23:27:40.726813+0000","last_unstale":"2023-10-16T23:27:43.312141+0000","last_undegraded":"2023-10-16T23:27:43.312141+0000","last_fullsized":"2023-10-16T23:27:43.312141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.243140+0000","last_change":"2023-10-16T23:27:36.294967+0000","last_active":"2023-10-16T23:28:22.243140+0000","last_peered":"2023-10-16T23:28:22.243140+0000","last_clean":"2023-10-16T23:28:22.243140+0000","last_became_active":"2023-10-16T23:27:36.294489+0000","last_became_peered":"2023-10-16T23:27:36.294489+0000","last_unstale":"2023-10-16T23:28:22.243140+0000","last_undegraded":"2023-10-16T23:28:22.243140+0000","last_fullsized":"2023-10-16T23:28:22.243140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:43:01.777197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.966680+0000","last_change":"2023-10-16T23:27:40.327194+0000","last_active":"2023-10-16T23:28:22.966680+0000","last_peered":"2023-10-16T23:28:22.966680+0000","last_clean":"2023-10-16T23:28:22.966680+0000","last_became_active":"2023-10-16T23:27:40.326396+0000","last_became_peered":"2023-10-16T23:27:40.326396+0000","last_unstale":"2023-10-16T23:28:22.966680+0000","last_undegraded":"2023-10-16T23:28:22.966680+0000","last_fullsized":"2023-10-16T23:28:22.966680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:42.154580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967570+0000","last_change":"2023-10-16T23:27:40.755777+0000","last_active":"2023-10-16T23:28:22.967570+0000","last_peered":"2023-10-16T23:28:22.967570+0000","last_clean":"2023-10-16T23:28:22.967570+0000","last_became_active":"2023-10-16T23:27:40.755489+0000","last_became_peered":"2023-10-16T23:27:40.755489+0000","last_unstale":"2023-10-16T23:28:22.967570+0000","last_undegraded":"2023-10-16T23:28:22.967570+0000","last_fullsized":"2023-10-16T23:28:22.967570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:06.148922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962747+0000","last_change":"2023-10-16T23:27:36.279013+0000","last_active":"2023-10-16T23:28:22.962747+0000","last_peered":"2023-10-16T23:28:22.962747+0000","last_clean":"2023-10-16T23:28:22.962747+0000","last_became_active":"2023-10-16T23:27:36.278134+0000","last_became_peered":"2023-10-16T23:27:36.278134+0000","last_unstale":"2023-10-16T23:28:22.962747+0000","last_undegraded":"2023-10-16T23:28:22.962747+0000","last_fullsized":"2023-10-16T23:28:22.962747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:13:01.266310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248075+0000","last_change":"2023-10-16T23:27:40.342715+0000","last_active":"2023-10-16T23:28:22.248075+0000","last_peered":"2023-10-16T23:28:22.248075+0000","last_clean":"2023-10-16T23:28:22.248075+0000","last_became_active":"2023-10-16T23:27:40.341951+0000","last_became_peered":"2023-10-16T23:27:40.341951+0000","last_unstale":"2023-10-16T23:28:22.248075+0000","last_undegraded":"2023-10-16T23:28:22.248075+0000","last_fullsized":"2023-10-16T23:28:22.248075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:59.765109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967025+0000","last_change":"2023-10-16T23:27:40.731557+0000","last_active":"2023-10-16T23:28:22.967025+0000","last_peered":"2023-10-16T23:28:22.967025+0000","last_clean":"2023-10-16T23:28:22.967025+0000","last_became_active":"2023-10-16T23:27:40.731150+0000","last_became_peered":"2023-10-16T23:27:40.731150+0000","last_unstale":"2023-10-16T23:28:22.967025+0000","last_undegraded":"2023-10-16T23:28:22.967025+0000","last_fullsized":"2023-10-16T23:28:22.967025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.963319+0000","last_change":"2023-10-16T23:27:40.320403+0000","last_active":"2023-10-16T23:28:22.963319+0000","last_peered":"2023-10-16T23:28:22.963319+0000","last_clean":"2023-10-16T23:28:22.963319+0000","last_became_active":"2023-10-16T23:27:40.319571+0000","last_became_peered":"2023-10-16T23:27:40.319571+0000","last_unstale":"2023-10-16T23:28:22.963319+0000","last_undegraded":"2023-10-16T23:28:22.963319+0000","last_fullsized":"2023-10-16T23:28:22.963319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967130+0000","last_change":"2023-10-16T23:27:36.434134+0000","last_active":"2023-10-16T23:28:22.967130+0000","last_peered":"2023-10-16T23:28:22.967130+0000","last_clean":"2023-10-16T23:28:22.967130+0000","last_became_active":"2023-10-16T23:27:36.433808+0000","last_became_peered":"2023-10-16T23:27:36.433808+0000","last_unstale":"2023-10-16T23:28:22.967130+0000","last_undegraded":"2023-10-16T23:28:22.967130+0000","last_fullsized":"2023-10-16T23:28:22.967130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:58:44.833474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.653934+0000","last_change":"2023-10-16T23:28:23.652508+0000","last_active":"2023-10-16T23:28:23.653934+0000","last_peered":"2023-10-16T23:28:23.653934+0000","last_clean":"2023-10-16T23:28:23.653934+0000","last_became_active":"2023-10-16T23:28:23.651881+0000","last_became_peered":"2023-10-16T23:28:23.651881+0000","last_unstale":"2023-10-16T23:28:23.653934+0000","last_undegraded":"2023-10-16T23:28:23.653934+0000","last_fullsized":"2023-10-16T23:28:23.653934+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:45.140655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967037+0000","last_change":"2023-10-16T23:27:40.328161+0000","last_active":"2023-10-16T23:28:22.967037+0000","last_peered":"2023-10-16T23:28:22.967037+0000","last_clean":"2023-10-16T23:28:22.967037+0000","last_became_active":"2023-10-16T23:27:40.327804+0000","last_became_peered":"2023-10-16T23:27:40.327804+0000","last_unstale":"2023-10-16T23:28:22.967037+0000","last_undegraded":"2023-10-16T23:28:22.967037+0000","last_fullsized":"2023-10-16T23:28:22.967037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.684582+0000","last_change":"2023-10-16T23:27:36.434231+0000","last_active":"2023-10-16T23:28:22.684582+0000","last_peered":"2023-10-16T23:28:22.684582+0000","last_clean":"2023-10-16T23:28:22.684582+0000","last_became_active":"2023-10-16T23:27:36.433923+0000","last_became_peered":"2023-10-16T23:27:36.433923+0000","last_unstale":"2023-10-16T23:28:22.684582+0000","last_undegraded":"2023-10-16T23:28:22.684582+0000","last_fullsized":"2023-10-16T23:28:22.684582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:59.590093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.311945+0000","last_change":"2023-10-16T23:27:40.756257+0000","last_active":"2023-10-16T23:27:43.311945+0000","last_peered":"2023-10-16T23:27:43.311945+0000","last_clean":"2023-10-16T23:27:43.311945+0000","last_became_active":"2023-10-16T23:27:40.755822+0000","last_became_peered":"2023-10-16T23:27:40.755822+0000","last_unstale":"2023-10-16T23:27:43.311945+0000","last_undegraded":"2023-10-16T23:27:43.311945+0000","last_fullsized":"2023-10-16T23:27:43.311945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.690282+0000","last_change":"2023-10-16T23:27:40.333672+0000","last_active":"2023-10-16T23:28:22.690282+0000","last_peered":"2023-10-16T23:28:22.690282+0000","last_clean":"2023-10-16T23:28:22.690282+0000","last_became_active":"2023-10-16T23:27:40.333290+0000","last_became_peered":"2023-10-16T23:27:40.333290+0000","last_unstale":"2023-10-16T23:28:22.690282+0000","last_undegraded":"2023-10-16T23:28:22.690282+0000","last_fullsized":"2023-10-16T23:28:22.690282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:15:23.173526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967337+0000","last_change":"2023-10-16T23:27:36.278805+0000","last_active":"2023-10-16T23:28:22.967337+0000","last_peered":"2023-10-16T23:28:22.967337+0000","last_clean":"2023-10-16T23:28:22.967337+0000","last_became_active":"2023-10-16T23:27:36.278209+0000","last_became_peered":"2023-10-16T23:27:36.278209+0000","last_unstale":"2023-10-16T23:28:22.967337+0000","last_undegraded":"2023-10-16T23:28:22.967337+0000","last_fullsized":"2023-10-16T23:28:22.967337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:38:00.468059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.652371+0000","last_change":"2023-10-16T23:28:23.651145+0000","last_active":"2023-10-16T23:28:23.652371+0000","last_peered":"2023-10-16T23:28:23.652371+0000","last_clean":"2023-10-16T23:28:23.652371+0000","last_became_active":"2023-10-16T23:28:23.650570+0000","last_became_peered":"2023-10-16T23:28:23.650570+0000","last_unstale":"2023-10-16T23:28:23.652371+0000","last_undegraded":"2023-10-16T23:28:23.652371+0000","last_fullsized":"2023-10-16T23:28:23.652371+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:46:52.020400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"24'2","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:28:11.395557+0000","last_change":"2023-10-16T23:27:40.332668+0000","last_active":"2023-10-16T23:28:11.395557+0000","last_peered":"2023-10-16T23:28:11.395557+0000","last_clean":"2023-10-16T23:28:11.395557+0000","last_became_active":"2023-10-16T23:27:40.332084+0000","last_became_peered":"2023-10-16T23:27:40.332084+0000","last_unstale":"2023-10-16T23:28:11.395557+0000","last_undegraded":"2023-10-16T23:28:11.395557+0000","last_fullsized":"2023-10-16T23:28:11.395557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:14.260980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248016+0000","last_change":"2023-10-16T23:27:36.281494+0000","last_active":"2023-10-16T23:28:22.248016+0000","last_peered":"2023-10-16T23:28:22.248016+0000","last_clean":"2023-10-16T23:28:22.248016+0000","last_became_active":"2023-10-16T23:27:36.280600+0000","last_became_peered":"2023-10-16T23:27:36.280600+0000","last_unstale":"2023-10-16T23:28:22.248016+0000","last_undegraded":"2023-10-16T23:28:22.248016+0000","last_fullsized":"2023-10-16T23:28:22.248016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:42:59.057101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246844+0000","last_change":"2023-10-16T23:27:40.756574+0000","last_active":"2023-10-16T23:28:22.246844+0000","last_peered":"2023-10-16T23:28:22.246844+0000","last_clean":"2023-10-16T23:28:22.246844+0000","last_became_active":"2023-10-16T23:27:40.755830+0000","last_became_peered":"2023-10-16T23:27:40.755830+0000","last_unstale":"2023-10-16T23:28:22.246844+0000","last_undegraded":"2023-10-16T23:28:22.246844+0000","last_fullsized":"2023-10-16T23:28:22.246844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:55:29.771781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247938+0000","last_change":"2023-10-16T23:27:40.745793+0000","last_active":"2023-10-16T23:28:22.247938+0000","last_peered":"2023-10-16T23:28:22.247938+0000","last_clean":"2023-10-16T23:28:22.247938+0000","last_became_active":"2023-10-16T23:27:40.745143+0000","last_became_peered":"2023-10-16T23:27:40.745143+0000","last_unstale":"2023-10-16T23:28:22.247938+0000","last_undegraded":"2023-10-16T23:28:22.247938+0000","last_fullsized":"2023-10-16T23:28:22.247938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:10:37.103208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"26'15","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.435096+0000","last_change":"2023-10-16T23:27:40.352546+0000","last_active":"2023-10-16T23:28:23.435096+0000","last_peered":"2023-10-16T23:28:23.435096+0000","last_clean":"2023-10-16T23:28:23.435096+0000","last_became_active":"2023-10-16T23:27:40.351687+0000","last_became_peered":"2023-10-16T23:27:40.351687+0000","last_unstale":"2023-10-16T23:28:23.435096+0000","last_undegraded":"2023-10-16T23:28:23.435096+0000","last_fullsized":"2023-10-16T23:28:23.435096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:14.260980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4472,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.966946+0000","last_change":"2023-10-16T23:27:40.727602+0000","last_active":"2023-10-16T23:28:22.966946+0000","last_peered":"2023-10-16T23:28:22.966946+0000","last_clean":"2023-10-16T23:28:22.966946+0000","last_became_active":"2023-10-16T23:27:40.727288+0000","last_became_peered":"2023-10-16T23:27:40.727288+0000","last_unstale":"2023-10-16T23:28:22.966946+0000","last_undegraded":"2023-10-16T23:28:22.966946+0000","last_fullsized":"2023-10-16T23:28:22.966946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:56:41.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683974+0000","last_change":"2023-10-16T23:27:40.332379+0000","last_active":"2023-10-16T23:28:22.683974+0000","last_peered":"2023-10-16T23:28:22.683974+0000","last_clean":"2023-10-16T23:28:22.683974+0000","last_became_active":"2023-10-16T23:27:40.331517+0000","last_became_peered":"2023-10-16T23:27:40.331517+0000","last_unstale":"2023-10-16T23:28:22.683974+0000","last_undegraded":"2023-10-16T23:28:22.683974+0000","last_fullsized":"2023-10-16T23:28:22.683974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:55.534068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962827+0000","last_change":"2023-10-16T23:27:40.336300+0000","last_active":"2023-10-16T23:28:22.962827+0000","last_peered":"2023-10-16T23:28:22.962827+0000","last_clean":"2023-10-16T23:28:22.962827+0000","last_became_active":"2023-10-16T23:27:40.333012+0000","last_became_peered":"2023-10-16T23:27:40.333012+0000","last_unstale":"2023-10-16T23:28:22.962827+0000","last_undegraded":"2023-10-16T23:28:22.962827+0000","last_fullsized":"2023-10-16T23:28:22.962827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689471+0000","last_change":"2023-10-16T23:27:40.760984+0000","last_active":"2023-10-16T23:28:22.689471+0000","last_peered":"2023-10-16T23:28:22.689471+0000","last_clean":"2023-10-16T23:28:22.689471+0000","last_became_active":"2023-10-16T23:27:40.760680+0000","last_became_peered":"2023-10-16T23:27:40.760680+0000","last_unstale":"2023-10-16T23:28:22.689471+0000","last_undegraded":"2023-10-16T23:28:22.689471+0000","last_fullsized":"2023-10-16T23:28:22.689471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:04.722168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.312448+0000","last_change":"2023-10-16T23:27:40.339159+0000","last_active":"2023-10-16T23:27:43.312448+0000","last_peered":"2023-10-16T23:27:43.312448+0000","last_clean":"2023-10-16T23:27:43.312448+0000","last_became_active":"2023-10-16T23:27:40.338706+0000","last_became_peered":"2023-10-16T23:27:40.338706+0000","last_unstale":"2023-10-16T23:27:43.312448+0000","last_undegraded":"2023-10-16T23:27:43.312448+0000","last_fullsized":"2023-10-16T23:27:43.312448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:33:08.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689103+0000","last_change":"2023-10-16T23:27:40.713138+0000","last_active":"2023-10-16T23:28:22.689103+0000","last_peered":"2023-10-16T23:28:22.689103+0000","last_clean":"2023-10-16T23:28:22.689103+0000","last_became_active":"2023-10-16T23:27:40.712756+0000","last_became_peered":"2023-10-16T23:27:40.712756+0000","last_unstale":"2023-10-16T23:28:22.689103+0000","last_undegraded":"2023-10-16T23:28:22.689103+0000","last_fullsized":"2023-10-16T23:28:22.689103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:19:17.463284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247821+0000","last_change":"2023-10-16T23:27:40.756418+0000","last_active":"2023-10-16T23:28:22.247821+0000","last_peered":"2023-10-16T23:28:22.247821+0000","last_clean":"2023-10-16T23:28:22.247821+0000","last_became_active":"2023-10-16T23:27:40.755714+0000","last_became_peered":"2023-10-16T23:27:40.755714+0000","last_unstale":"2023-10-16T23:28:22.247821+0000","last_undegraded":"2023-10-16T23:28:22.247821+0000","last_fullsized":"2023-10-16T23:28:22.247821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:56.634821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689567+0000","last_change":"2023-10-16T23:27:40.332275+0000","last_active":"2023-10-16T23:28:22.689567+0000","last_peered":"2023-10-16T23:28:22.689567+0000","last_clean":"2023-10-16T23:28:22.689567+0000","last_became_active":"2023-10-16T23:27:40.331428+0000","last_became_peered":"2023-10-16T23:27:40.331428+0000","last_unstale":"2023-10-16T23:28:22.689567+0000","last_undegraded":"2023-10-16T23:28:22.689567+0000","last_fullsized":"2023-10-16T23:28:22.689567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.312094+0000","last_change":"2023-10-16T23:27:40.761081+0000","last_active":"2023-10-16T23:27:43.312094+0000","last_peered":"2023-10-16T23:27:43.312094+0000","last_clean":"2023-10-16T23:27:43.312094+0000","last_became_active":"2023-10-16T23:27:40.760779+0000","last_became_peered":"2023-10-16T23:27:40.760779+0000","last_unstale":"2023-10-16T23:27:43.312094+0000","last_undegraded":"2023-10-16T23:27:43.312094+0000","last_fullsized":"2023-10-16T23:27:43.312094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:31.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.966929+0000","last_change":"2023-10-16T23:27:40.318419+0000","last_active":"2023-10-16T23:28:22.966929+0000","last_peered":"2023-10-16T23:28:22.966929+0000","last_clean":"2023-10-16T23:28:22.966929+0000","last_became_active":"2023-10-16T23:27:40.317622+0000","last_became_peered":"2023-10-16T23:27:40.317622+0000","last_unstale":"2023-10-16T23:28:22.966929+0000","last_undegraded":"2023-10-16T23:28:22.966929+0000","last_fullsized":"2023-10-16T23:28:22.966929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689818+0000","last_change":"2023-10-16T23:27:40.706263+0000","last_active":"2023-10-16T23:28:22.689818+0000","last_peered":"2023-10-16T23:28:22.689818+0000","last_clean":"2023-10-16T23:28:22.689818+0000","last_became_active":"2023-10-16T23:27:40.705956+0000","last_became_peered":"2023-10-16T23:27:40.705956+0000","last_unstale":"2023-10-16T23:28:22.689818+0000","last_undegraded":"2023-10-16T23:28:22.689818+0000","last_fullsized":"2023-10-16T23:28:22.689818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247961+0000","last_change":"2023-10-16T23:27:40.344965+0000","last_active":"2023-10-16T23:28:22.247961+0000","last_peered":"2023-10-16T23:28:22.247961+0000","last_clean":"2023-10-16T23:28:22.247961+0000","last_became_active":"2023-10-16T23:27:40.344158+0000","last_became_peered":"2023-10-16T23:27:40.344158+0000","last_unstale":"2023-10-16T23:28:22.247961+0000","last_undegraded":"2023-10-16T23:28:22.247961+0000","last_fullsized":"2023-10-16T23:28:22.247961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:04.095452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.243569+0000","last_change":"2023-10-16T23:27:40.713594+0000","last_active":"2023-10-16T23:28:22.243569+0000","last_peered":"2023-10-16T23:28:22.243569+0000","last_clean":"2023-10-16T23:28:22.243569+0000","last_became_active":"2023-10-16T23:27:40.712632+0000","last_became_peered":"2023-10-16T23:27:40.712632+0000","last_unstale":"2023-10-16T23:28:22.243569+0000","last_undegraded":"2023-10-16T23:28:22.243569+0000","last_fullsized":"2023-10-16T23:28:22.243569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:52.368847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.312045+0000","last_change":"2023-10-16T23:27:40.357300+0000","last_active":"2023-10-16T23:27:43.312045+0000","last_peered":"2023-10-16T23:27:43.312045+0000","last_clean":"2023-10-16T23:27:43.312045+0000","last_became_active":"2023-10-16T23:27:40.356809+0000","last_became_peered":"2023-10-16T23:27:40.356809+0000","last_unstale":"2023-10-16T23:27:43.312045+0000","last_undegraded":"2023-10-16T23:27:43.312045+0000","last_fullsized":"2023-10-16T23:27:43.312045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247826+0000","last_change":"2023-10-16T23:27:40.726018+0000","last_active":"2023-10-16T23:28:22.247826+0000","last_peered":"2023-10-16T23:28:22.247826+0000","last_clean":"2023-10-16T23:28:22.247826+0000","last_became_active":"2023-10-16T23:27:40.724910+0000","last_became_peered":"2023-10-16T23:27:40.724910+0000","last_unstale":"2023-10-16T23:28:22.247826+0000","last_undegraded":"2023-10-16T23:28:22.247826+0000","last_fullsized":"2023-10-16T23:28:22.247826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:25:34.841325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962608+0000","last_change":"2023-10-16T23:27:40.345785+0000","last_active":"2023-10-16T23:28:22.962608+0000","last_peered":"2023-10-16T23:28:22.962608+0000","last_clean":"2023-10-16T23:28:22.962608+0000","last_became_active":"2023-10-16T23:27:40.344531+0000","last_became_peered":"2023-10-16T23:27:40.344531+0000","last_unstale":"2023-10-16T23:28:22.962608+0000","last_undegraded":"2023-10-16T23:28:22.962608+0000","last_fullsized":"2023-10-16T23:28:22.962608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:55.630817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246775+0000","last_change":"2023-10-16T23:27:40.720573+0000","last_active":"2023-10-16T23:28:22.246775+0000","last_peered":"2023-10-16T23:28:22.246775+0000","last_clean":"2023-10-16T23:28:22.246775+0000","last_became_active":"2023-10-16T23:27:40.719758+0000","last_became_peered":"2023-10-16T23:27:40.719758+0000","last_unstale":"2023-10-16T23:28:22.246775+0000","last_undegraded":"2023-10-16T23:28:22.246775+0000","last_fullsized":"2023-10-16T23:28:22.246775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:27:29.534374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.963212+0000","last_change":"2023-10-16T23:27:40.345400+0000","last_active":"2023-10-16T23:28:22.963212+0000","last_peered":"2023-10-16T23:28:22.963212+0000","last_clean":"2023-10-16T23:28:22.963212+0000","last_became_active":"2023-10-16T23:27:40.344589+0000","last_became_peered":"2023-10-16T23:27:40.344589+0000","last_unstale":"2023-10-16T23:28:22.963212+0000","last_undegraded":"2023-10-16T23:28:22.963212+0000","last_fullsized":"2023-10-16T23:28:22.963212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:15:23.173526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689835+0000","last_change":"2023-10-16T23:27:40.711211+0000","last_active":"2023-10-16T23:28:22.689835+0000","last_peered":"2023-10-16T23:28:22.689835+0000","last_clean":"2023-10-16T23:28:22.689835+0000","last_became_active":"2023-10-16T23:27:40.705936+0000","last_became_peered":"2023-10-16T23:27:40.705936+0000","last_unstale":"2023-10-16T23:28:22.689835+0000","last_undegraded":"2023-10-16T23:28:22.689835+0000","last_fullsized":"2023-10-16T23:28:22.689835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689909+0000","last_change":"2023-10-16T23:27:40.323626+0000","last_active":"2023-10-16T23:28:22.689909+0000","last_peered":"2023-10-16T23:28:22.689909+0000","last_clean":"2023-10-16T23:28:22.689909+0000","last_became_active":"2023-10-16T23:27:40.323352+0000","last_became_peered":"2023-10-16T23:27:40.323352+0000","last_unstale":"2023-10-16T23:28:22.689909+0000","last_undegraded":"2023-10-16T23:28:22.689909+0000","last_fullsized":"2023-10-16T23:28:22.689909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:33:08.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246609+0000","last_change":"2023-10-16T23:27:40.749109+0000","last_active":"2023-10-16T23:28:22.246609+0000","last_peered":"2023-10-16T23:28:22.246609+0000","last_clean":"2023-10-16T23:28:22.246609+0000","last_became_active":"2023-10-16T23:27:40.748525+0000","last_became_peered":"2023-10-16T23:27:40.748525+0000","last_unstale":"2023-10-16T23:28:22.246609+0000","last_undegraded":"2023-10-16T23:28:22.246609+0000","last_fullsized":"2023-10-16T23:28:22.246609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:10:38.468420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.312397+0000","last_change":"2023-10-16T23:27:40.338946+0000","last_active":"2023-10-16T23:27:43.312397+0000","last_peered":"2023-10-16T23:27:43.312397+0000","last_clean":"2023-10-16T23:27:43.312397+0000","last_became_active":"2023-10-16T23:27:40.338565+0000","last_became_peered":"2023-10-16T23:27:40.338565+0000","last_unstale":"2023-10-16T23:27:43.312397+0000","last_undegraded":"2023-10-16T23:27:43.312397+0000","last_fullsized":"2023-10-16T23:27:43.312397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:55.630817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5270,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":10540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":103608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]}]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":278528,"data_stored":104260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.383}]}]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":108136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]}]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":103698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.92400000000000004}]},{"osd":1,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.80300000000000005}]},{"osd":2,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":1.0289999999999999}]},{"osd":4,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.323},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":1.2689999999999999}]},{"osd":5,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.115}]},{"osd":6,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.3580000000000001}]},{"osd":7,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":1.2190000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":103608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":868352,"data_stored":694558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]}]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":698664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.0409999999999999}]},{"osd":1,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.0149999999999999}]},{"osd":2,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.89900000000000002}]},{"osd":3,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.105},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.93600000000000005}]},{"osd":4,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.153},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.96299999999999997}]},{"osd":5,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.72699999999999998}]},{"osd":6,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.742,"5min":2.742,"15min":2.742},"last":1.077}]}]},{"osd":2,"up_from":14,"seq":60129542161,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":270336,"data_stored":103608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.5},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.59699999999999998}]},{"osd":1,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.69199999999999995}]},{"osd":3,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.55200000000000005}]},{"osd":4,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.83999999999999997}]},{"osd":5,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.98799999999999999}]},{"osd":6,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.159}]},{"osd":7,"last update":"Mon Oct 16 23:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.071}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T23:28:34.237 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-16T23:28:34.237 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T23:28:34.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.400+0000 7f5cac4a0640 1 Processor -- start 2023-10-16T23:28:34.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.400+0000 7f5cac4a0640 1 -- start start 2023-10-16T23:28:34.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.404+0000 7f5cac4a0640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ca414eff0 0x7f5ca4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:34.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.404+0000 7f5cac4a0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5ca4070110 0x7f5ca414ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:34.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.404+0000 7f5cac4a0640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca40bae10 con 0x7f5ca406ebc0 2023-10-16T23:28:34.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.404+0000 7f5cac4a0640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca40b7710 con 0x7f5ca4070110 2023-10-16T23:28:34.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.404+0000 7f5cac4a0640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca414fb20 con 0x7f5ca414eff0 2023-10-16T23:28:34.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.404+0000 7f5ca9a3b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5ca406ebc0 0x7f5ca414c220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48578/0 (socket says 172.21.15.12:48578) 2023-10-16T23:28:34.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.404+0000 7f5ca9a3b640 1 -- 172.21.15.12:0/2987244777 learned_addr learned my addr 172.21.15.12:0/2987244777 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:34.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.404+0000 7f5caa23c640 1 --2- 172.21.15.12:0/2987244777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ca414eff0 0x7f5ca4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:34.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.404+0000 7f5caaa3d640 1 --2- 172.21.15.12:0/2987244777 >> v2:172.21.15.31:3300/0 conn(0x7f5ca4070110 0x7f5ca414ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:34.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.404+0000 7f5ca923a640 1 -- 172.21.15.12:0/2987244777 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 405948044 0 0) 0x7f5ca40bae10 con 0x7f5ca406ebc0 2023-10-16T23:28:34.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.404+0000 7f5ca923a640 1 -- 172.21.15.12:0/2987244777 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c90003530 con 0x7f5ca406ebc0 2023-10-16T23:28:34.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.404+0000 7f5ca923a640 1 -- 172.21.15.12:0/2987244777 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 949347629 0 0) 0x7f5c90003530 con 0x7f5ca406ebc0 2023-10-16T23:28:34.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.404+0000 7f5caa23c640 1 -- 172.21.15.12:0/2987244777 >> v2:172.21.15.31:3300/0 conn(0x7f5ca4070110 msgr2=0x7f5ca414ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:34.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.404+0000 7f5caa23c640 1 --2- 172.21.15.12:0/2987244777 >> v2:172.21.15.31:3300/0 conn(0x7f5ca4070110 0x7f5ca414ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.404+0000 7f5caa23c640 1 -- 172.21.15.12:0/2987244777 >> v1:172.21.15.12:6789/0 conn(0x7f5ca406ebc0 legacy=0x7f5ca414c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:34.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.404+0000 7f5caa23c640 1 -- 172.21.15.12:0/2987244777 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca40b4000 con 0x7f5ca414eff0 2023-10-16T23:28:34.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.408+0000 7f5caa23c640 1 --2- 172.21.15.12:0/2987244777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ca414eff0 0x7f5ca4070b30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5c9400a960 tx=0x7f5c9401d650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=703eb53a88df0dca server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:34.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.408+0000 7f5ca923a640 1 -- 172.21.15.12:0/2987244777 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca0001680 con 0x7f5ca414eff0 2023-10-16T23:28:34.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.408+0000 7f5ca923a640 1 -- 172.21.15.12:0/2987244777 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c940ab460 con 0x7f5ca414eff0 2023-10-16T23:28:34.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.408+0000 7f5ca923a640 1 -- 172.21.15.12:0/2987244777 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c940ab7d0 con 0x7f5ca414eff0 2023-10-16T23:28:34.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.408+0000 7f5cac4a0640 1 -- 172.21.15.12:0/2987244777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ca414eff0 msgr2=0x7f5ca4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:34.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.408+0000 7f5cac4a0640 1 --2- 172.21.15.12:0/2987244777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ca414eff0 0x7f5ca4070b30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5c9400a960 tx=0x7f5c9401d650 comp rx=0 tx=0).stop 2023-10-16T23:28:34.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.408+0000 7f5cac4a0640 1 -- 172.21.15.12:0/2987244777 shutdown_connections 2023-10-16T23:28:34.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.408+0000 7f5cac4a0640 1 --2- 172.21.15.12:0/2987244777 >> v2:172.21.15.31:3300/0 conn(0x7f5ca4070110 0x7f5ca414ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.408+0000 7f5cac4a0640 1 --2- 172.21.15.12:0/2987244777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ca414eff0 0x7f5ca4070b30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.408+0000 7f5cac4a0640 1 -- 172.21.15.12:0/2987244777 >> 172.21.15.12:0/2987244777 conn(0x7f5ca406ba20 msgr2=0x7f5ca40c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:34.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.408+0000 7f5cac4a0640 1 -- 172.21.15.12:0/2987244777 shutdown_connections 2023-10-16T23:28:34.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.408+0000 7f5cac4a0640 1 -- 172.21.15.12:0/2987244777 wait complete. 2023-10-16T23:28:34.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.408+0000 7f5cac4a0640 1 Processor -- start 2023-10-16T23:28:34.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.408+0000 7f5cac4a0640 1 -- start start 2023-10-16T23:28:34.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.408+0000 7f5cac4a0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ca406ebc0 0x7f5ca4147a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:34.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.408+0000 7f5cac4a0640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ca4070110 0x7f5ca40b5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:34.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.408+0000 7f5cac4a0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ca414eff0 0x7f5ca40b5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:34.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.408+0000 7f5cac4a0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca41524c0 con 0x7f5ca406ebc0 2023-10-16T23:28:34.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.408+0000 7f5cac4a0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca4150b00 con 0x7f5ca414eff0 2023-10-16T23:28:34.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.408+0000 7f5cac4a0640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca4147fa0 con 0x7f5ca4070110 2023-10-16T23:28:34.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.408+0000 7f5caa23c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ca406ebc0 0x7f5ca4147a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:34.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.412+0000 7f5caa23c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ca406ebc0 0x7f5ca4147a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36404/0 (socket says 172.21.15.12:36404) 2023-10-16T23:28:34.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.412+0000 7f5caa23c640 1 -- 172.21.15.12:0/1432120888 learned_addr learned my addr 172.21.15.12:0/1432120888 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:34.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.412+0000 7f5ca9a3b640 1 --2- 172.21.15.12:0/1432120888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ca4070110 0x7f5ca40b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:34.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.412+0000 7f5caaa3d640 1 --2- 172.21.15.12:0/1432120888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ca414eff0 0x7f5ca40b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:34.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.412+0000 7f5caa23c640 1 -- 172.21.15.12:0/1432120888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ca4070110 msgr2=0x7f5ca40b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:34.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.412+0000 7f5caa23c640 1 --2- 172.21.15.12:0/1432120888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ca4070110 0x7f5ca40b5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.412+0000 7f5caa23c640 1 -- 172.21.15.12:0/1432120888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ca414eff0 msgr2=0x7f5ca40b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:34.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.412+0000 7f5caa23c640 1 --2- 172.21.15.12:0/1432120888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ca414eff0 0x7f5ca40b5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.412+0000 7f5caa23c640 1 -- 172.21.15.12:0/1432120888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9400a5c0 con 0x7f5ca406ebc0 2023-10-16T23:28:34.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.412+0000 7f5caaa3d640 1 --2- 172.21.15.12:0/1432120888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ca414eff0 0x7f5ca40b5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:28:34.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.412+0000 7f5caa23c640 1 --2- 172.21.15.12:0/1432120888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ca406ebc0 0x7f5ca4147a60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5c9401bd00 tx=0x7f5c9401a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:34.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.412+0000 7f5c9affd640 1 -- 172.21.15.12:0/1432120888 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c94003e60 con 0x7f5ca406ebc0 2023-10-16T23:28:34.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.412+0000 7f5c9affd640 1 -- 172.21.15.12:0/1432120888 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c94006e20 con 0x7f5ca406ebc0 2023-10-16T23:28:34.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.412+0000 7f5cac4a0640 1 -- 172.21.15.12:0/1432120888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca41e8ee0 con 0x7f5ca406ebc0 2023-10-16T23:28:34.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.412+0000 7f5c9affd640 1 -- 172.21.15.12:0/1432120888 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c940ab7d0 con 0x7f5ca406ebc0 2023-10-16T23:28:34.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.412+0000 7f5cac4a0640 1 -- 172.21.15.12:0/1432120888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca4147300 con 0x7f5ca406ebc0 2023-10-16T23:28:34.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.412+0000 7f5cac4a0640 1 -- 172.21.15.12:0/1432120888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca40673a0 con 0x7f5ca406ebc0 2023-10-16T23:28:34.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.412+0000 7f5c9affd640 1 -- 172.21.15.12:0/1432120888 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f5c940bb070 con 0x7f5ca406ebc0 2023-10-16T23:28:34.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.412+0000 7f5c9affd640 1 --2- 172.21.15.12:0/1432120888 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5c88065e90 0x7f5c88068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:34.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.412+0000 7f5c9affd640 1 -- 172.21.15.12:0/1432120888 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5c940a7040 con 0x7f5ca406ebc0 2023-10-16T23:28:34.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.412+0000 7f5ca9a3b640 1 --2- 172.21.15.12:0/1432120888 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5c88065e90 0x7f5c88068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:34.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.416+0000 7f5ca9a3b640 1 --2- 172.21.15.12:0/1432120888 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5c88065e90 0x7f5c88068350 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5ca4153040 tx=0x7f5ca0001dd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:34.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.416+0000 7f5c9affd640 1 -- 172.21.15.12:0/1432120888 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f5c940ebda0 con 0x7f5ca406ebc0 2023-10-16T23:28:34.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.564+0000 7f5cac4a0640 1 -- 172.21.15.12:0/1432120888 --> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5ca414c930 con 0x7f5c88065e90 2023-10-16T23:28:34.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.584+0000 7f5c9affd640 1 -- 172.21.15.12:0/1432120888 <== mgr.4108 v2:172.21.15.31:6832/37949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+295503 (secure 0 0 0) 0x7f5ca00058e0 con 0x7f5c88065e90 2023-10-16T23:28:34.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:28:34.593 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-16T23:28:34.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.588+0000 7f5cac4a0640 1 -- 172.21.15.12:0/1432120888 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5c88065e90 msgr2=0x7f5c88068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:34.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.588+0000 7f5cac4a0640 1 --2- 172.21.15.12:0/1432120888 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5c88065e90 0x7f5c88068350 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5ca4153040 tx=0x7f5ca0001dd0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.588+0000 7f5cac4a0640 1 -- 172.21.15.12:0/1432120888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ca406ebc0 msgr2=0x7f5ca4147a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:34.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.588+0000 7f5cac4a0640 1 --2- 172.21.15.12:0/1432120888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ca406ebc0 0x7f5ca4147a60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5c9401bd00 tx=0x7f5c9401a3f0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.588+0000 7f5cac4a0640 1 -- 172.21.15.12:0/1432120888 shutdown_connections 2023-10-16T23:28:34.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.588+0000 7f5cac4a0640 1 --2- 172.21.15.12:0/1432120888 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5c88065e90 0x7f5c88068350 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.588+0000 7f5cac4a0640 1 --2- 172.21.15.12:0/1432120888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ca414eff0 0x7f5ca40b5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.588+0000 7f5cac4a0640 1 --2- 172.21.15.12:0/1432120888 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5ca4070110 0x7f5ca40b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.588+0000 7f5cac4a0640 1 --2- 172.21.15.12:0/1432120888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ca406ebc0 0x7f5ca4147a60 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.588+0000 7f5cac4a0640 1 -- 172.21.15.12:0/1432120888 >> 172.21.15.12:0/1432120888 conn(0x7f5ca406ba20 msgr2=0x7f5ca40bb310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:34.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.588+0000 7f5cac4a0640 1 -- 172.21.15.12:0/1432120888 shutdown_connections 2023-10-16T23:28:34.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.588+0000 7f5cac4a0640 1 -- 172.21.15.12:0/1432120888 wait complete. 2023-10-16T23:28:34.611 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2023-10-16T23:28:33.303359+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595638,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":215,"num_write_kb":2441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223048,"kb_used_data":3336,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751672,"statfs":{"total":773094113280,"available":772865712128,"internally_reserved":0,"allocated":3416064,"data_stored":2020140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":282,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003584"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.243979+0000","last_change":"2023-10-16T23:27:40.706600+0000","last_active":"2023-10-16T23:28:22.243979+0000","last_peered":"2023-10-16T23:28:22.243979+0000","last_clean":"2023-10-16T23:28:22.243979+0000","last_became_active":"2023-10-16T23:27:40.706320+0000","last_became_peered":"2023-10-16T23:27:40.706320+0000","last_unstale":"2023-10-16T23:28:22.243979+0000","last_undegraded":"2023-10-16T23:28:22.243979+0000","last_fullsized":"2023-10-16T23:28:22.243979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:48:20.356964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962517+0000","last_change":"2023-10-16T23:27:40.756555+0000","last_active":"2023-10-16T23:28:22.962517+0000","last_peered":"2023-10-16T23:28:22.962517+0000","last_clean":"2023-10-16T23:28:22.962517+0000","last_became_active":"2023-10-16T23:27:40.754736+0000","last_became_peered":"2023-10-16T23:27:40.754736+0000","last_unstale":"2023-10-16T23:28:22.962517+0000","last_undegraded":"2023-10-16T23:28:22.962517+0000","last_fullsized":"2023-10-16T23:28:22.962517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:45.642622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248499+0000","last_change":"2023-10-16T23:27:40.726586+0000","last_active":"2023-10-16T23:28:22.248499+0000","last_peered":"2023-10-16T23:28:22.248499+0000","last_clean":"2023-10-16T23:28:22.248499+0000","last_became_active":"2023-10-16T23:27:40.725731+0000","last_became_peered":"2023-10-16T23:27:40.725731+0000","last_unstale":"2023-10-16T23:28:22.248499+0000","last_undegraded":"2023-10-16T23:28:22.248499+0000","last_fullsized":"2023-10-16T23:28:22.248499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:04:22.434372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247656+0000","last_change":"2023-10-16T23:27:40.715543+0000","last_active":"2023-10-16T23:28:22.247656+0000","last_peered":"2023-10-16T23:28:22.247656+0000","last_clean":"2023-10-16T23:28:22.247656+0000","last_became_active":"2023-10-16T23:27:40.714592+0000","last_became_peered":"2023-10-16T23:27:40.714592+0000","last_unstale":"2023-10-16T23:28:22.247656+0000","last_undegraded":"2023-10-16T23:28:22.247656+0000","last_fullsized":"2023-10-16T23:28:22.247656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:42:37.696897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.311992+0000","last_change":"2023-10-16T23:27:40.722734+0000","last_active":"2023-10-16T23:27:43.311992+0000","last_peered":"2023-10-16T23:27:43.311992+0000","last_clean":"2023-10-16T23:27:43.311992+0000","last_became_active":"2023-10-16T23:27:40.722399+0000","last_became_peered":"2023-10-16T23:27:40.722399+0000","last_unstale":"2023-10-16T23:27:43.311992+0000","last_undegraded":"2023-10-16T23:27:43.311992+0000","last_fullsized":"2023-10-16T23:27:43.311992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:19:17.463284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246458+0000","last_change":"2023-10-16T23:27:40.716139+0000","last_active":"2023-10-16T23:28:22.246458+0000","last_peered":"2023-10-16T23:28:22.246458+0000","last_clean":"2023-10-16T23:28:22.246458+0000","last_became_active":"2023-10-16T23:27:40.715294+0000","last_became_peered":"2023-10-16T23:27:40.715294+0000","last_unstale":"2023-10-16T23:28:22.246458+0000","last_undegraded":"2023-10-16T23:28:22.246458+0000","last_fullsized":"2023-10-16T23:28:22.246458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:19:17.463284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683398+0000","last_change":"2023-10-16T23:27:40.762253+0000","last_active":"2023-10-16T23:28:22.683398+0000","last_peered":"2023-10-16T23:28:22.683398+0000","last_clean":"2023-10-16T23:28:22.683398+0000","last_became_active":"2023-10-16T23:27:40.760726+0000","last_became_peered":"2023-10-16T23:27:40.760726+0000","last_unstale":"2023-10-16T23:28:22.683398+0000","last_undegraded":"2023-10-16T23:28:22.683398+0000","last_fullsized":"2023-10-16T23:28:22.683398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:50:08.569961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962326+0000","last_change":"2023-10-16T23:27:40.756184+0000","last_active":"2023-10-16T23:28:22.962326+0000","last_peered":"2023-10-16T23:28:22.962326+0000","last_clean":"2023-10-16T23:28:22.962326+0000","last_became_active":"2023-10-16T23:27:40.755276+0000","last_became_peered":"2023-10-16T23:27:40.755276+0000","last_unstale":"2023-10-16T23:28:22.962326+0000","last_undegraded":"2023-10-16T23:28:22.962326+0000","last_fullsized":"2023-10-16T23:28:22.962326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.312307+0000","last_change":"2023-10-16T23:27:40.724060+0000","last_active":"2023-10-16T23:27:43.312307+0000","last_peered":"2023-10-16T23:27:43.312307+0000","last_clean":"2023-10-16T23:27:43.312307+0000","last_became_active":"2023-10-16T23:27:40.723701+0000","last_became_peered":"2023-10-16T23:27:40.723701+0000","last_unstale":"2023-10-16T23:27:43.312307+0000","last_undegraded":"2023-10-16T23:27:43.312307+0000","last_fullsized":"2023-10-16T23:27:43.312307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:04.722168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962762+0000","last_change":"2023-10-16T23:27:40.756783+0000","last_active":"2023-10-16T23:28:22.962762+0000","last_peered":"2023-10-16T23:28:22.962762+0000","last_clean":"2023-10-16T23:28:22.962762+0000","last_became_active":"2023-10-16T23:27:40.755772+0000","last_became_peered":"2023-10-16T23:27:40.755772+0000","last_unstale":"2023-10-16T23:28:22.962762+0000","last_undegraded":"2023-10-16T23:28:22.962762+0000","last_fullsized":"2023-10-16T23:28:22.962762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248718+0000","last_change":"2023-10-16T23:27:40.724754+0000","last_active":"2023-10-16T23:28:22.248718+0000","last_peered":"2023-10-16T23:28:22.248718+0000","last_clean":"2023-10-16T23:28:22.248718+0000","last_became_active":"2023-10-16T23:27:40.724031+0000","last_became_peered":"2023-10-16T23:27:40.724031+0000","last_unstale":"2023-10-16T23:28:22.248718+0000","last_undegraded":"2023-10-16T23:28:22.248718+0000","last_fullsized":"2023-10-16T23:28:22.248718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:04.722168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.243519+0000","last_change":"2023-10-16T23:27:40.724453+0000","last_active":"2023-10-16T23:28:22.243519+0000","last_peered":"2023-10-16T23:28:22.243519+0000","last_clean":"2023-10-16T23:28:22.243519+0000","last_became_active":"2023-10-16T23:27:40.724099+0000","last_became_peered":"2023-10-16T23:27:40.724099+0000","last_unstale":"2023-10-16T23:28:22.243519+0000","last_undegraded":"2023-10-16T23:28:22.243519+0000","last_fullsized":"2023-10-16T23:28:22.243519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:01:05.350517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.243081+0000","last_change":"2023-10-16T23:27:40.704484+0000","last_active":"2023-10-16T23:28:22.243081+0000","last_peered":"2023-10-16T23:28:22.243081+0000","last_clean":"2023-10-16T23:28:22.243081+0000","last_became_active":"2023-10-16T23:27:40.704162+0000","last_became_peered":"2023-10-16T23:27:40.704162+0000","last_unstale":"2023-10-16T23:28:22.243081+0000","last_undegraded":"2023-10-16T23:28:22.243081+0000","last_fullsized":"2023-10-16T23:28:22.243081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:15:16.646850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962528+0000","last_change":"2023-10-16T23:27:40.738913+0000","last_active":"2023-10-16T23:28:22.962528+0000","last_peered":"2023-10-16T23:28:22.962528+0000","last_clean":"2023-10-16T23:28:22.962528+0000","last_became_active":"2023-10-16T23:27:40.738070+0000","last_became_peered":"2023-10-16T23:27:40.738070+0000","last_unstale":"2023-10-16T23:28:22.962528+0000","last_undegraded":"2023-10-16T23:28:22.962528+0000","last_fullsized":"2023-10-16T23:28:22.962528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:56:41.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683534+0000","last_change":"2023-10-16T23:27:40.762529+0000","last_active":"2023-10-16T23:28:22.683534+0000","last_peered":"2023-10-16T23:28:22.683534+0000","last_clean":"2023-10-16T23:28:22.683534+0000","last_became_active":"2023-10-16T23:27:40.761570+0000","last_became_peered":"2023-10-16T23:27:40.761570+0000","last_unstale":"2023-10-16T23:28:22.683534+0000","last_undegraded":"2023-10-16T23:28:22.683534+0000","last_fullsized":"2023-10-16T23:28:22.683534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:46.449264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246388+0000","last_change":"2023-10-16T23:27:40.719227+0000","last_active":"2023-10-16T23:28:22.246388+0000","last_peered":"2023-10-16T23:28:22.246388+0000","last_clean":"2023-10-16T23:28:22.246388+0000","last_became_active":"2023-10-16T23:27:40.718276+0000","last_became_peered":"2023-10-16T23:27:40.718276+0000","last_unstale":"2023-10-16T23:28:22.246388+0000","last_undegraded":"2023-10-16T23:28:22.246388+0000","last_fullsized":"2023-10-16T23:28:22.246388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.312350+0000","last_change":"2023-10-16T23:27:40.719723+0000","last_active":"2023-10-16T23:27:43.312350+0000","last_peered":"2023-10-16T23:27:43.312350+0000","last_clean":"2023-10-16T23:27:43.312350+0000","last_became_active":"2023-10-16T23:27:40.719402+0000","last_became_peered":"2023-10-16T23:27:40.719402+0000","last_unstale":"2023-10-16T23:27:43.312350+0000","last_undegraded":"2023-10-16T23:27:43.312350+0000","last_fullsized":"2023-10-16T23:27:43.312350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:04:22.434372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248141+0000","last_change":"2023-10-16T23:27:40.732931+0000","last_active":"2023-10-16T23:28:22.248141+0000","last_peered":"2023-10-16T23:28:22.248141+0000","last_clean":"2023-10-16T23:28:22.248141+0000","last_became_active":"2023-10-16T23:27:40.732102+0000","last_became_peered":"2023-10-16T23:27:40.732102+0000","last_unstale":"2023-10-16T23:28:22.248141+0000","last_undegraded":"2023-10-16T23:28:22.248141+0000","last_fullsized":"2023-10-16T23:28:22.248141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:57:14.359461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.244017+0000","last_change":"2023-10-16T23:27:40.728920+0000","last_active":"2023-10-16T23:28:22.244017+0000","last_peered":"2023-10-16T23:28:22.244017+0000","last_clean":"2023-10-16T23:28:22.244017+0000","last_became_active":"2023-10-16T23:27:40.728298+0000","last_became_peered":"2023-10-16T23:27:40.728298+0000","last_unstale":"2023-10-16T23:28:22.244017+0000","last_undegraded":"2023-10-16T23:28:22.244017+0000","last_fullsized":"2023-10-16T23:28:22.244017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:28:33.509782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248025+0000","last_change":"2023-10-16T23:27:40.745270+0000","last_active":"2023-10-16T23:28:22.248025+0000","last_peered":"2023-10-16T23:28:22.248025+0000","last_clean":"2023-10-16T23:28:22.248025+0000","last_became_active":"2023-10-16T23:27:40.744483+0000","last_became_peered":"2023-10-16T23:27:40.744483+0000","last_unstale":"2023-10-16T23:28:22.248025+0000","last_undegraded":"2023-10-16T23:28:22.248025+0000","last_fullsized":"2023-10-16T23:28:22.248025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:24:33.998070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683429+0000","last_change":"2023-10-16T23:27:40.761480+0000","last_active":"2023-10-16T23:28:22.683429+0000","last_peered":"2023-10-16T23:28:22.683429+0000","last_clean":"2023-10-16T23:28:22.683429+0000","last_became_active":"2023-10-16T23:27:40.760882+0000","last_became_peered":"2023-10-16T23:27:40.760882+0000","last_unstale":"2023-10-16T23:28:22.683429+0000","last_undegraded":"2023-10-16T23:28:22.683429+0000","last_fullsized":"2023-10-16T23:28:22.683429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:37:38.843931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.311797+0000","last_change":"2023-10-16T23:27:40.722620+0000","last_active":"2023-10-16T23:27:43.311797+0000","last_peered":"2023-10-16T23:27:43.311797+0000","last_clean":"2023-10-16T23:27:43.311797+0000","last_became_active":"2023-10-16T23:27:40.722302+0000","last_became_peered":"2023-10-16T23:27:40.722302+0000","last_unstale":"2023-10-16T23:27:43.311797+0000","last_undegraded":"2023-10-16T23:27:43.311797+0000","last_fullsized":"2023-10-16T23:27:43.311797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689201+0000","last_change":"2023-10-16T23:27:40.716578+0000","last_active":"2023-10-16T23:28:22.689201+0000","last_peered":"2023-10-16T23:28:22.689201+0000","last_clean":"2023-10-16T23:28:22.689201+0000","last_became_active":"2023-10-16T23:27:40.716228+0000","last_became_peered":"2023-10-16T23:27:40.716228+0000","last_unstale":"2023-10-16T23:28:22.689201+0000","last_undegraded":"2023-10-16T23:28:22.689201+0000","last_fullsized":"2023-10-16T23:28:22.689201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:27:29.534374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683349+0000","last_change":"2023-10-16T23:27:40.761323+0000","last_active":"2023-10-16T23:28:22.683349+0000","last_peered":"2023-10-16T23:28:22.683349+0000","last_clean":"2023-10-16T23:28:22.683349+0000","last_became_active":"2023-10-16T23:27:40.760659+0000","last_became_peered":"2023-10-16T23:27:40.760659+0000","last_unstale":"2023-10-16T23:28:22.683349+0000","last_undegraded":"2023-10-16T23:28:22.683349+0000","last_fullsized":"2023-10-16T23:28:22.683349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:09:55.835429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967422+0000","last_change":"2023-10-16T23:27:40.727629+0000","last_active":"2023-10-16T23:28:22.967422+0000","last_peered":"2023-10-16T23:28:22.967422+0000","last_clean":"2023-10-16T23:28:22.967422+0000","last_became_active":"2023-10-16T23:27:40.727334+0000","last_became_peered":"2023-10-16T23:27:40.727334+0000","last_unstale":"2023-10-16T23:28:22.967422+0000","last_undegraded":"2023-10-16T23:28:22.967422+0000","last_fullsized":"2023-10-16T23:28:22.967422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:38:33.383867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967294+0000","last_change":"2023-10-16T23:27:40.704775+0000","last_active":"2023-10-16T23:28:22.967294+0000","last_peered":"2023-10-16T23:28:22.967294+0000","last_clean":"2023-10-16T23:28:22.967294+0000","last_became_active":"2023-10-16T23:27:40.704536+0000","last_became_peered":"2023-10-16T23:27:40.704536+0000","last_unstale":"2023-10-16T23:28:22.967294+0000","last_undegraded":"2023-10-16T23:28:22.967294+0000","last_fullsized":"2023-10-16T23:28:22.967294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962992+0000","last_change":"2023-10-16T23:27:40.764351+0000","last_active":"2023-10-16T23:28:22.962992+0000","last_peered":"2023-10-16T23:28:22.962992+0000","last_clean":"2023-10-16T23:28:22.962992+0000","last_became_active":"2023-10-16T23:27:40.763592+0000","last_became_peered":"2023-10-16T23:27:40.763592+0000","last_unstale":"2023-10-16T23:28:22.962992+0000","last_undegraded":"2023-10-16T23:28:22.962992+0000","last_fullsized":"2023-10-16T23:28:22.962992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967127+0000","last_change":"2023-10-16T23:27:40.760989+0000","last_active":"2023-10-16T23:28:22.967127+0000","last_peered":"2023-10-16T23:28:22.967127+0000","last_clean":"2023-10-16T23:28:22.967127+0000","last_became_active":"2023-10-16T23:27:40.760615+0000","last_became_peered":"2023-10-16T23:27:40.760615+0000","last_unstale":"2023-10-16T23:28:22.967127+0000","last_undegraded":"2023-10-16T23:28:22.967127+0000","last_fullsized":"2023-10-16T23:28:22.967127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689374+0000","last_change":"2023-10-16T23:27:40.760762+0000","last_active":"2023-10-16T23:28:22.689374+0000","last_peered":"2023-10-16T23:28:22.689374+0000","last_clean":"2023-10-16T23:28:22.689374+0000","last_became_active":"2023-10-16T23:27:40.760437+0000","last_became_peered":"2023-10-16T23:27:40.760437+0000","last_unstale":"2023-10-16T23:28:22.689374+0000","last_undegraded":"2023-10-16T23:28:22.689374+0000","last_fullsized":"2023-10-16T23:28:22.689374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:55:29.771781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247695+0000","last_change":"2023-10-16T23:27:40.745197+0000","last_active":"2023-10-16T23:28:22.247695+0000","last_peered":"2023-10-16T23:28:22.247695+0000","last_clean":"2023-10-16T23:28:22.247695+0000","last_became_active":"2023-10-16T23:27:40.744458+0000","last_became_peered":"2023-10-16T23:27:40.744458+0000","last_unstale":"2023-10-16T23:28:22.247695+0000","last_undegraded":"2023-10-16T23:28:22.247695+0000","last_fullsized":"2023-10-16T23:28:22.247695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689184+0000","last_change":"2023-10-16T23:27:40.711795+0000","last_active":"2023-10-16T23:28:22.689184+0000","last_peered":"2023-10-16T23:28:22.689184+0000","last_clean":"2023-10-16T23:28:22.689184+0000","last_became_active":"2023-10-16T23:27:40.711492+0000","last_became_peered":"2023-10-16T23:27:40.711492+0000","last_unstale":"2023-10-16T23:28:22.689184+0000","last_undegraded":"2023-10-16T23:28:22.689184+0000","last_fullsized":"2023-10-16T23:28:22.689184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:04:22.434372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.245860+0000","last_change":"2023-10-16T23:27:40.710149+0000","last_active":"2023-10-16T23:28:22.245860+0000","last_peered":"2023-10-16T23:28:22.245860+0000","last_clean":"2023-10-16T23:28:22.245860+0000","last_became_active":"2023-10-16T23:27:40.709286+0000","last_became_peered":"2023-10-16T23:27:40.709286+0000","last_unstale":"2023-10-16T23:28:22.245860+0000","last_undegraded":"2023-10-16T23:28:22.245860+0000","last_fullsized":"2023-10-16T23:28:22.245860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:22:41.708468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689705+0000","last_change":"2023-10-16T23:27:40.707271+0000","last_active":"2023-10-16T23:28:22.689705+0000","last_peered":"2023-10-16T23:28:22.689705+0000","last_clean":"2023-10-16T23:28:22.689705+0000","last_became_active":"2023-10-16T23:27:40.706864+0000","last_became_peered":"2023-10-16T23:27:40.706864+0000","last_unstale":"2023-10-16T23:28:22.689705+0000","last_undegraded":"2023-10-16T23:28:22.689705+0000","last_fullsized":"2023-10-16T23:28:22.689705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683702+0000","last_change":"2023-10-16T23:27:40.353567+0000","last_active":"2023-10-16T23:28:22.683702+0000","last_peered":"2023-10-16T23:28:22.683702+0000","last_clean":"2023-10-16T23:28:22.683702+0000","last_became_active":"2023-10-16T23:27:40.352775+0000","last_became_peered":"2023-10-16T23:27:40.352775+0000","last_unstale":"2023-10-16T23:28:22.683702+0000","last_undegraded":"2023-10-16T23:28:22.683702+0000","last_fullsized":"2023-10-16T23:28:22.683702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:52:58.351406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.963098+0000","last_change":"2023-10-16T23:27:40.765398+0000","last_active":"2023-10-16T23:28:22.963098+0000","last_peered":"2023-10-16T23:28:22.963098+0000","last_clean":"2023-10-16T23:28:22.963098+0000","last_became_active":"2023-10-16T23:27:40.764517+0000","last_became_peered":"2023-10-16T23:27:40.764517+0000","last_unstale":"2023-10-16T23:28:22.963098+0000","last_undegraded":"2023-10-16T23:28:22.963098+0000","last_fullsized":"2023-10-16T23:28:22.963098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:31.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.311846+0000","last_change":"2023-10-16T23:27:40.335221+0000","last_active":"2023-10-16T23:27:43.311846+0000","last_peered":"2023-10-16T23:27:43.311846+0000","last_clean":"2023-10-16T23:27:43.311846+0000","last_became_active":"2023-10-16T23:27:40.334885+0000","last_became_peered":"2023-10-16T23:27:40.334885+0000","last_unstale":"2023-10-16T23:27:43.311846+0000","last_undegraded":"2023-10-16T23:27:43.311846+0000","last_fullsized":"2023-10-16T23:27:43.311846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.312206+0000","last_change":"2023-10-16T23:27:40.719997+0000","last_active":"2023-10-16T23:27:43.312206+0000","last_peered":"2023-10-16T23:27:43.312206+0000","last_clean":"2023-10-16T23:27:43.312206+0000","last_became_active":"2023-10-16T23:27:40.719811+0000","last_became_peered":"2023-10-16T23:27:40.719811+0000","last_unstale":"2023-10-16T23:27:43.312206+0000","last_undegraded":"2023-10-16T23:27:43.312206+0000","last_fullsized":"2023-10-16T23:27:43.312206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:13.934735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683767+0000","last_change":"2023-10-16T23:27:40.357620+0000","last_active":"2023-10-16T23:28:22.683767+0000","last_peered":"2023-10-16T23:28:22.683767+0000","last_clean":"2023-10-16T23:28:22.683767+0000","last_became_active":"2023-10-16T23:27:40.357009+0000","last_became_peered":"2023-10-16T23:27:40.357009+0000","last_unstale":"2023-10-16T23:28:22.683767+0000","last_undegraded":"2023-10-16T23:28:22.683767+0000","last_fullsized":"2023-10-16T23:28:22.683767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:07:50.847519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.690065+0000","last_change":"2023-10-16T23:27:40.760925+0000","last_active":"2023-10-16T23:28:22.690065+0000","last_peered":"2023-10-16T23:28:22.690065+0000","last_clean":"2023-10-16T23:28:22.690065+0000","last_became_active":"2023-10-16T23:27:40.760365+0000","last_became_peered":"2023-10-16T23:27:40.760365+0000","last_unstale":"2023-10-16T23:28:22.690065+0000","last_undegraded":"2023-10-16T23:28:22.690065+0000","last_fullsized":"2023-10-16T23:28:22.690065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:13.934735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246026+0000","last_change":"2023-10-16T23:27:40.331826+0000","last_active":"2023-10-16T23:28:22.246026+0000","last_peered":"2023-10-16T23:28:22.246026+0000","last_clean":"2023-10-16T23:28:22.246026+0000","last_became_active":"2023-10-16T23:27:40.330857+0000","last_became_peered":"2023-10-16T23:27:40.330857+0000","last_unstale":"2023-10-16T23:28:22.246026+0000","last_undegraded":"2023-10-16T23:28:22.246026+0000","last_fullsized":"2023-10-16T23:28:22.246026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:42:46.614672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.684412+0000","last_change":"2023-10-16T23:27:40.357691+0000","last_active":"2023-10-16T23:28:22.684412+0000","last_peered":"2023-10-16T23:28:22.684412+0000","last_clean":"2023-10-16T23:28:22.684412+0000","last_became_active":"2023-10-16T23:27:40.357047+0000","last_became_peered":"2023-10-16T23:27:40.357047+0000","last_unstale":"2023-10-16T23:28:22.684412+0000","last_undegraded":"2023-10-16T23:28:22.684412+0000","last_fullsized":"2023-10-16T23:28:22.684412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:00:00.805564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962388+0000","last_change":"2023-10-16T23:27:40.763848+0000","last_active":"2023-10-16T23:28:22.962388+0000","last_peered":"2023-10-16T23:28:22.962388+0000","last_clean":"2023-10-16T23:28:22.962388+0000","last_became_active":"2023-10-16T23:27:40.763116+0000","last_became_peered":"2023-10-16T23:27:40.763116+0000","last_unstale":"2023-10-16T23:28:22.962388+0000","last_undegraded":"2023-10-16T23:28:22.962388+0000","last_fullsized":"2023-10-16T23:28:22.962388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.684383+0000","last_change":"2023-10-16T23:27:40.347016+0000","last_active":"2023-10-16T23:28:22.684383+0000","last_peered":"2023-10-16T23:28:22.684383+0000","last_clean":"2023-10-16T23:28:22.684383+0000","last_became_active":"2023-10-16T23:27:40.346439+0000","last_became_peered":"2023-10-16T23:27:40.346439+0000","last_unstale":"2023-10-16T23:28:22.684383+0000","last_undegraded":"2023-10-16T23:28:22.684383+0000","last_fullsized":"2023-10-16T23:28:22.684383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:08:40.047699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246458+0000","last_change":"2023-10-16T23:27:40.714905+0000","last_active":"2023-10-16T23:28:22.246458+0000","last_peered":"2023-10-16T23:28:22.246458+0000","last_clean":"2023-10-16T23:28:22.246458+0000","last_became_active":"2023-10-16T23:27:40.714098+0000","last_became_peered":"2023-10-16T23:27:40.714098+0000","last_unstale":"2023-10-16T23:28:22.246458+0000","last_undegraded":"2023-10-16T23:28:22.246458+0000","last_fullsized":"2023-10-16T23:28:22.246458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:29:13.934735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.684232+0000","last_change":"2023-10-16T23:27:40.340462+0000","last_active":"2023-10-16T23:28:22.684232+0000","last_peered":"2023-10-16T23:28:22.684232+0000","last_clean":"2023-10-16T23:28:22.684232+0000","last_became_active":"2023-10-16T23:27:40.339531+0000","last_became_peered":"2023-10-16T23:27:40.339531+0000","last_unstale":"2023-10-16T23:28:22.684232+0000","last_undegraded":"2023-10-16T23:28:22.684232+0000","last_fullsized":"2023-10-16T23:28:22.684232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:33:50.768168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246296+0000","last_change":"2023-10-16T23:27:40.713930+0000","last_active":"2023-10-16T23:28:22.246296+0000","last_peered":"2023-10-16T23:28:22.246296+0000","last_clean":"2023-10-16T23:28:22.246296+0000","last_became_active":"2023-10-16T23:27:40.713087+0000","last_became_peered":"2023-10-16T23:27:40.713087+0000","last_unstale":"2023-10-16T23:28:22.246296+0000","last_undegraded":"2023-10-16T23:28:22.246296+0000","last_fullsized":"2023-10-16T23:28:22.246296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:15:24.177529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962633+0000","last_change":"2023-10-16T23:27:40.320848+0000","last_active":"2023-10-16T23:28:22.962633+0000","last_peered":"2023-10-16T23:28:22.962633+0000","last_clean":"2023-10-16T23:28:22.962633+0000","last_became_active":"2023-10-16T23:27:40.319887+0000","last_became_peered":"2023-10-16T23:27:40.319887+0000","last_unstale":"2023-10-16T23:28:22.962633+0000","last_undegraded":"2023-10-16T23:28:22.962633+0000","last_fullsized":"2023-10-16T23:28:22.962633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:33:08.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.311894+0000","last_change":"2023-10-16T23:27:40.726405+0000","last_active":"2023-10-16T23:27:43.311894+0000","last_peered":"2023-10-16T23:27:43.311894+0000","last_clean":"2023-10-16T23:27:43.311894+0000","last_became_active":"2023-10-16T23:27:40.725724+0000","last_became_peered":"2023-10-16T23:27:40.725724+0000","last_unstale":"2023-10-16T23:27:43.311894+0000","last_undegraded":"2023-10-16T23:27:43.311894+0000","last_fullsized":"2023-10-16T23:27:43.311894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689512+0000","last_change":"2023-10-16T23:27:40.337756+0000","last_active":"2023-10-16T23:28:22.689512+0000","last_peered":"2023-10-16T23:28:22.689512+0000","last_clean":"2023-10-16T23:28:22.689512+0000","last_became_active":"2023-10-16T23:27:40.337405+0000","last_became_peered":"2023-10-16T23:27:40.337405+0000","last_unstale":"2023-10-16T23:28:22.689512+0000","last_undegraded":"2023-10-16T23:28:22.689512+0000","last_fullsized":"2023-10-16T23:28:22.689512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:42.154580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248284+0000","last_change":"2023-10-16T23:27:40.722911+0000","last_active":"2023-10-16T23:28:22.248284+0000","last_peered":"2023-10-16T23:28:22.248284+0000","last_clean":"2023-10-16T23:28:22.248284+0000","last_became_active":"2023-10-16T23:27:40.722091+0000","last_became_peered":"2023-10-16T23:27:40.722091+0000","last_unstale":"2023-10-16T23:28:22.248284+0000","last_undegraded":"2023-10-16T23:28:22.248284+0000","last_fullsized":"2023-10-16T23:28:22.248284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246704+0000","last_change":"2023-10-16T23:27:40.343242+0000","last_active":"2023-10-16T23:28:22.246704+0000","last_peered":"2023-10-16T23:28:22.246704+0000","last_clean":"2023-10-16T23:28:22.246704+0000","last_became_active":"2023-10-16T23:27:40.342213+0000","last_became_peered":"2023-10-16T23:27:40.342213+0000","last_unstale":"2023-10-16T23:28:22.246704+0000","last_undegraded":"2023-10-16T23:28:22.246704+0000","last_fullsized":"2023-10-16T23:28:22.246704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:04.095452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248861+0000","last_change":"2023-10-16T23:27:40.733845+0000","last_active":"2023-10-16T23:28:22.248861+0000","last_peered":"2023-10-16T23:28:22.248861+0000","last_clean":"2023-10-16T23:28:22.248861+0000","last_became_active":"2023-10-16T23:27:40.732996+0000","last_became_peered":"2023-10-16T23:27:40.732996+0000","last_unstale":"2023-10-16T23:28:22.248861+0000","last_undegraded":"2023-10-16T23:28:22.248861+0000","last_fullsized":"2023-10-16T23:28:22.248861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:06:04.512089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247175+0000","last_change":"2023-10-16T23:27:40.347984+0000","last_active":"2023-10-16T23:28:22.247175+0000","last_peered":"2023-10-16T23:28:22.247175+0000","last_clean":"2023-10-16T23:28:22.247175+0000","last_became_active":"2023-10-16T23:27:40.347253+0000","last_became_peered":"2023-10-16T23:27:40.347253+0000","last_unstale":"2023-10-16T23:28:22.247175+0000","last_undegraded":"2023-10-16T23:28:22.247175+0000","last_fullsized":"2023-10-16T23:28:22.247175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:42:46.614672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248305+0000","last_change":"2023-10-16T23:27:40.745245+0000","last_active":"2023-10-16T23:28:22.248305+0000","last_peered":"2023-10-16T23:28:22.248305+0000","last_clean":"2023-10-16T23:28:22.248305+0000","last_became_active":"2023-10-16T23:27:40.744571+0000","last_became_peered":"2023-10-16T23:27:40.744571+0000","last_unstale":"2023-10-16T23:28:22.248305+0000","last_undegraded":"2023-10-16T23:28:22.248305+0000","last_fullsized":"2023-10-16T23:28:22.248305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:10:39.974563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689656+0000","last_change":"2023-10-16T23:27:40.314767+0000","last_active":"2023-10-16T23:28:22.689656+0000","last_peered":"2023-10-16T23:28:22.689656+0000","last_clean":"2023-10-16T23:28:22.689656+0000","last_became_active":"2023-10-16T23:27:40.314242+0000","last_became_peered":"2023-10-16T23:27:40.314242+0000","last_unstale":"2023-10-16T23:28:22.689656+0000","last_undegraded":"2023-10-16T23:28:22.689656+0000","last_fullsized":"2023-10-16T23:28:22.689656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967500+0000","last_change":"2023-10-16T23:27:40.709591+0000","last_active":"2023-10-16T23:28:22.967500+0000","last_peered":"2023-10-16T23:28:22.967500+0000","last_clean":"2023-10-16T23:28:22.967500+0000","last_became_active":"2023-10-16T23:27:40.709174+0000","last_became_peered":"2023-10-16T23:27:40.709174+0000","last_unstale":"2023-10-16T23:28:22.967500+0000","last_undegraded":"2023-10-16T23:28:22.967500+0000","last_fullsized":"2023-10-16T23:28:22.967500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:31.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683820+0000","last_change":"2023-10-16T23:27:29.356842+0000","last_active":"2023-10-16T23:28:22.683820+0000","last_peered":"2023-10-16T23:28:22.683820+0000","last_clean":"2023-10-16T23:28:22.683820+0000","last_became_active":"2023-10-16T23:27:29.353846+0000","last_became_peered":"2023-10-16T23:27:29.353846+0000","last_unstale":"2023-10-16T23:28:22.683820+0000","last_undegraded":"2023-10-16T23:28:22.683820+0000","last_fullsized":"2023-10-16T23:28:22.683820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:28.136202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:28.136202+0000","last_clean_scrub_stamp":"2023-10-16T23:27:28.136202+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:34:30.590360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962513+0000","last_change":"2023-10-16T23:27:36.278001+0000","last_active":"2023-10-16T23:28:22.962513+0000","last_peered":"2023-10-16T23:28:22.962513+0000","last_clean":"2023-10-16T23:28:22.962513+0000","last_became_active":"2023-10-16T23:27:36.277096+0000","last_became_peered":"2023-10-16T23:27:36.277096+0000","last_unstale":"2023-10-16T23:28:22.962513+0000","last_undegraded":"2023-10-16T23:28:22.962513+0000","last_fullsized":"2023-10-16T23:28:22.962513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:38:00.468059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689229+0000","last_change":"2023-10-16T23:27:40.331268+0000","last_active":"2023-10-16T23:28:22.689229+0000","last_peered":"2023-10-16T23:28:22.689229+0000","last_clean":"2023-10-16T23:28:22.689229+0000","last_became_active":"2023-10-16T23:27:40.330989+0000","last_became_peered":"2023-10-16T23:27:40.330989+0000","last_unstale":"2023-10-16T23:28:22.689229+0000","last_undegraded":"2023-10-16T23:28:22.689229+0000","last_fullsized":"2023-10-16T23:28:22.689229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:55.630817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247248+0000","last_change":"2023-10-16T23:27:40.726429+0000","last_active":"2023-10-16T23:28:22.247248+0000","last_peered":"2023-10-16T23:28:22.247248+0000","last_clean":"2023-10-16T23:28:22.247248+0000","last_became_active":"2023-10-16T23:27:40.725490+0000","last_became_peered":"2023-10-16T23:27:40.725490+0000","last_unstale":"2023-10-16T23:28:22.247248+0000","last_undegraded":"2023-10-16T23:28:22.247248+0000","last_fullsized":"2023-10-16T23:28:22.247248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:52:41.884757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683589+0000","last_change":"2023-10-16T23:27:36.278865+0000","last_active":"2023-10-16T23:28:22.683589+0000","last_peered":"2023-10-16T23:28:22.683589+0000","last_clean":"2023-10-16T23:28:22.683589+0000","last_became_active":"2023-10-16T23:27:36.277974+0000","last_became_peered":"2023-10-16T23:27:36.277974+0000","last_unstale":"2023-10-16T23:28:22.683589+0000","last_undegraded":"2023-10-16T23:28:22.683589+0000","last_fullsized":"2023-10-16T23:28:22.683589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:31:09.411975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.311739+0000","last_change":"2023-10-16T23:27:40.340025+0000","last_active":"2023-10-16T23:27:43.311739+0000","last_peered":"2023-10-16T23:27:43.311739+0000","last_clean":"2023-10-16T23:27:43.311739+0000","last_became_active":"2023-10-16T23:27:40.339569+0000","last_became_peered":"2023-10-16T23:27:40.339569+0000","last_unstale":"2023-10-16T23:27:43.311739+0000","last_undegraded":"2023-10-16T23:27:43.311739+0000","last_fullsized":"2023-10-16T23:27:43.311739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:42.154580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.312141+0000","last_change":"2023-10-16T23:27:40.727415+0000","last_active":"2023-10-16T23:27:43.312141+0000","last_peered":"2023-10-16T23:27:43.312141+0000","last_clean":"2023-10-16T23:27:43.312141+0000","last_became_active":"2023-10-16T23:27:40.726813+0000","last_became_peered":"2023-10-16T23:27:40.726813+0000","last_unstale":"2023-10-16T23:27:43.312141+0000","last_undegraded":"2023-10-16T23:27:43.312141+0000","last_fullsized":"2023-10-16T23:27:43.312141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.243140+0000","last_change":"2023-10-16T23:27:36.294967+0000","last_active":"2023-10-16T23:28:22.243140+0000","last_peered":"2023-10-16T23:28:22.243140+0000","last_clean":"2023-10-16T23:28:22.243140+0000","last_became_active":"2023-10-16T23:27:36.294489+0000","last_became_peered":"2023-10-16T23:27:36.294489+0000","last_unstale":"2023-10-16T23:28:22.243140+0000","last_undegraded":"2023-10-16T23:28:22.243140+0000","last_fullsized":"2023-10-16T23:28:22.243140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:43:01.777197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.966680+0000","last_change":"2023-10-16T23:27:40.327194+0000","last_active":"2023-10-16T23:28:22.966680+0000","last_peered":"2023-10-16T23:28:22.966680+0000","last_clean":"2023-10-16T23:28:22.966680+0000","last_became_active":"2023-10-16T23:27:40.326396+0000","last_became_peered":"2023-10-16T23:27:40.326396+0000","last_unstale":"2023-10-16T23:28:22.966680+0000","last_undegraded":"2023-10-16T23:28:22.966680+0000","last_fullsized":"2023-10-16T23:28:22.966680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:27:42.154580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967570+0000","last_change":"2023-10-16T23:27:40.755777+0000","last_active":"2023-10-16T23:28:22.967570+0000","last_peered":"2023-10-16T23:28:22.967570+0000","last_clean":"2023-10-16T23:28:22.967570+0000","last_became_active":"2023-10-16T23:27:40.755489+0000","last_became_peered":"2023-10-16T23:27:40.755489+0000","last_unstale":"2023-10-16T23:28:22.967570+0000","last_undegraded":"2023-10-16T23:28:22.967570+0000","last_fullsized":"2023-10-16T23:28:22.967570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:06.148922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962747+0000","last_change":"2023-10-16T23:27:36.279013+0000","last_active":"2023-10-16T23:28:22.962747+0000","last_peered":"2023-10-16T23:28:22.962747+0000","last_clean":"2023-10-16T23:28:22.962747+0000","last_became_active":"2023-10-16T23:27:36.278134+0000","last_became_peered":"2023-10-16T23:27:36.278134+0000","last_unstale":"2023-10-16T23:28:22.962747+0000","last_undegraded":"2023-10-16T23:28:22.962747+0000","last_fullsized":"2023-10-16T23:28:22.962747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:13:01.266310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248075+0000","last_change":"2023-10-16T23:27:40.342715+0000","last_active":"2023-10-16T23:28:22.248075+0000","last_peered":"2023-10-16T23:28:22.248075+0000","last_clean":"2023-10-16T23:28:22.248075+0000","last_became_active":"2023-10-16T23:27:40.341951+0000","last_became_peered":"2023-10-16T23:27:40.341951+0000","last_unstale":"2023-10-16T23:28:22.248075+0000","last_undegraded":"2023-10-16T23:28:22.248075+0000","last_fullsized":"2023-10-16T23:28:22.248075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:55:59.765109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967025+0000","last_change":"2023-10-16T23:27:40.731557+0000","last_active":"2023-10-16T23:28:22.967025+0000","last_peered":"2023-10-16T23:28:22.967025+0000","last_clean":"2023-10-16T23:28:22.967025+0000","last_became_active":"2023-10-16T23:27:40.731150+0000","last_became_peered":"2023-10-16T23:27:40.731150+0000","last_unstale":"2023-10-16T23:28:22.967025+0000","last_undegraded":"2023-10-16T23:28:22.967025+0000","last_fullsized":"2023-10-16T23:28:22.967025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.963319+0000","last_change":"2023-10-16T23:27:40.320403+0000","last_active":"2023-10-16T23:28:22.963319+0000","last_peered":"2023-10-16T23:28:22.963319+0000","last_clean":"2023-10-16T23:28:22.963319+0000","last_became_active":"2023-10-16T23:27:40.319571+0000","last_became_peered":"2023-10-16T23:27:40.319571+0000","last_unstale":"2023-10-16T23:28:22.963319+0000","last_undegraded":"2023-10-16T23:28:22.963319+0000","last_fullsized":"2023-10-16T23:28:22.963319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967130+0000","last_change":"2023-10-16T23:27:36.434134+0000","last_active":"2023-10-16T23:28:22.967130+0000","last_peered":"2023-10-16T23:28:22.967130+0000","last_clean":"2023-10-16T23:28:22.967130+0000","last_became_active":"2023-10-16T23:27:36.433808+0000","last_became_peered":"2023-10-16T23:27:36.433808+0000","last_unstale":"2023-10-16T23:28:22.967130+0000","last_undegraded":"2023-10-16T23:28:22.967130+0000","last_fullsized":"2023-10-16T23:28:22.967130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:58:44.833474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.653934+0000","last_change":"2023-10-16T23:28:23.652508+0000","last_active":"2023-10-16T23:28:23.653934+0000","last_peered":"2023-10-16T23:28:23.653934+0000","last_clean":"2023-10-16T23:28:23.653934+0000","last_became_active":"2023-10-16T23:28:23.651881+0000","last_became_peered":"2023-10-16T23:28:23.651881+0000","last_unstale":"2023-10-16T23:28:23.653934+0000","last_undegraded":"2023-10-16T23:28:23.653934+0000","last_fullsized":"2023-10-16T23:28:23.653934+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:45.140655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967037+0000","last_change":"2023-10-16T23:27:40.328161+0000","last_active":"2023-10-16T23:28:22.967037+0000","last_peered":"2023-10-16T23:28:22.967037+0000","last_clean":"2023-10-16T23:28:22.967037+0000","last_became_active":"2023-10-16T23:27:40.327804+0000","last_became_peered":"2023-10-16T23:27:40.327804+0000","last_unstale":"2023-10-16T23:28:22.967037+0000","last_undegraded":"2023-10-16T23:28:22.967037+0000","last_fullsized":"2023-10-16T23:28:22.967037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.684582+0000","last_change":"2023-10-16T23:27:36.434231+0000","last_active":"2023-10-16T23:28:22.684582+0000","last_peered":"2023-10-16T23:28:22.684582+0000","last_clean":"2023-10-16T23:28:22.684582+0000","last_became_active":"2023-10-16T23:27:36.433923+0000","last_became_peered":"2023-10-16T23:27:36.433923+0000","last_unstale":"2023-10-16T23:28:22.684582+0000","last_undegraded":"2023-10-16T23:28:22.684582+0000","last_fullsized":"2023-10-16T23:28:22.684582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:59.590093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.311945+0000","last_change":"2023-10-16T23:27:40.756257+0000","last_active":"2023-10-16T23:27:43.311945+0000","last_peered":"2023-10-16T23:27:43.311945+0000","last_clean":"2023-10-16T23:27:43.311945+0000","last_became_active":"2023-10-16T23:27:40.755822+0000","last_became_peered":"2023-10-16T23:27:40.755822+0000","last_unstale":"2023-10-16T23:27:43.311945+0000","last_undegraded":"2023-10-16T23:27:43.311945+0000","last_fullsized":"2023-10-16T23:27:43.311945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.690282+0000","last_change":"2023-10-16T23:27:40.333672+0000","last_active":"2023-10-16T23:28:22.690282+0000","last_peered":"2023-10-16T23:28:22.690282+0000","last_clean":"2023-10-16T23:28:22.690282+0000","last_became_active":"2023-10-16T23:27:40.333290+0000","last_became_peered":"2023-10-16T23:27:40.333290+0000","last_unstale":"2023-10-16T23:28:22.690282+0000","last_undegraded":"2023-10-16T23:28:22.690282+0000","last_fullsized":"2023-10-16T23:28:22.690282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:15:23.173526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.967337+0000","last_change":"2023-10-16T23:27:36.278805+0000","last_active":"2023-10-16T23:28:22.967337+0000","last_peered":"2023-10-16T23:28:22.967337+0000","last_clean":"2023-10-16T23:28:22.967337+0000","last_became_active":"2023-10-16T23:27:36.278209+0000","last_became_peered":"2023-10-16T23:27:36.278209+0000","last_unstale":"2023-10-16T23:28:22.967337+0000","last_undegraded":"2023-10-16T23:28:22.967337+0000","last_fullsized":"2023-10-16T23:28:22.967337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:38:00.468059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.652371+0000","last_change":"2023-10-16T23:28:23.651145+0000","last_active":"2023-10-16T23:28:23.652371+0000","last_peered":"2023-10-16T23:28:23.652371+0000","last_clean":"2023-10-16T23:28:23.652371+0000","last_became_active":"2023-10-16T23:28:23.650570+0000","last_became_peered":"2023-10-16T23:28:23.650570+0000","last_unstale":"2023-10-16T23:28:23.652371+0000","last_undegraded":"2023-10-16T23:28:23.652371+0000","last_fullsized":"2023-10-16T23:28:23.652371+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:46:52.020400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"24'2","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:28:11.395557+0000","last_change":"2023-10-16T23:27:40.332668+0000","last_active":"2023-10-16T23:28:11.395557+0000","last_peered":"2023-10-16T23:28:11.395557+0000","last_clean":"2023-10-16T23:28:11.395557+0000","last_became_active":"2023-10-16T23:27:40.332084+0000","last_became_peered":"2023-10-16T23:27:40.332084+0000","last_unstale":"2023-10-16T23:28:11.395557+0000","last_undegraded":"2023-10-16T23:28:11.395557+0000","last_fullsized":"2023-10-16T23:28:11.395557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:14.260980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248016+0000","last_change":"2023-10-16T23:27:36.281494+0000","last_active":"2023-10-16T23:28:22.248016+0000","last_peered":"2023-10-16T23:28:22.248016+0000","last_clean":"2023-10-16T23:28:22.248016+0000","last_became_active":"2023-10-16T23:27:36.280600+0000","last_became_peered":"2023-10-16T23:27:36.280600+0000","last_unstale":"2023-10-16T23:28:22.248016+0000","last_undegraded":"2023-10-16T23:28:22.248016+0000","last_fullsized":"2023-10-16T23:28:22.248016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:42:59.057101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246844+0000","last_change":"2023-10-16T23:27:40.756574+0000","last_active":"2023-10-16T23:28:22.246844+0000","last_peered":"2023-10-16T23:28:22.246844+0000","last_clean":"2023-10-16T23:28:22.246844+0000","last_became_active":"2023-10-16T23:27:40.755830+0000","last_became_peered":"2023-10-16T23:27:40.755830+0000","last_unstale":"2023-10-16T23:28:22.246844+0000","last_undegraded":"2023-10-16T23:28:22.246844+0000","last_fullsized":"2023-10-16T23:28:22.246844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:55:29.771781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247938+0000","last_change":"2023-10-16T23:27:40.745793+0000","last_active":"2023-10-16T23:28:22.247938+0000","last_peered":"2023-10-16T23:28:22.247938+0000","last_clean":"2023-10-16T23:28:22.247938+0000","last_became_active":"2023-10-16T23:27:40.745143+0000","last_became_peered":"2023-10-16T23:27:40.745143+0000","last_unstale":"2023-10-16T23:28:22.247938+0000","last_undegraded":"2023-10-16T23:28:22.247938+0000","last_fullsized":"2023-10-16T23:28:22.247938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:10:37.103208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"26'15","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.435096+0000","last_change":"2023-10-16T23:27:40.352546+0000","last_active":"2023-10-16T23:28:23.435096+0000","last_peered":"2023-10-16T23:28:23.435096+0000","last_clean":"2023-10-16T23:28:23.435096+0000","last_became_active":"2023-10-16T23:27:40.351687+0000","last_became_peered":"2023-10-16T23:27:40.351687+0000","last_unstale":"2023-10-16T23:28:23.435096+0000","last_undegraded":"2023-10-16T23:28:23.435096+0000","last_fullsized":"2023-10-16T23:28:23.435096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:14.260980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4472,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.966946+0000","last_change":"2023-10-16T23:27:40.727602+0000","last_active":"2023-10-16T23:28:22.966946+0000","last_peered":"2023-10-16T23:28:22.966946+0000","last_clean":"2023-10-16T23:28:22.966946+0000","last_became_active":"2023-10-16T23:27:40.727288+0000","last_became_peered":"2023-10-16T23:27:40.727288+0000","last_unstale":"2023-10-16T23:28:22.966946+0000","last_undegraded":"2023-10-16T23:28:22.966946+0000","last_fullsized":"2023-10-16T23:28:22.966946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:56:41.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683974+0000","last_change":"2023-10-16T23:27:40.332379+0000","last_active":"2023-10-16T23:28:22.683974+0000","last_peered":"2023-10-16T23:28:22.683974+0000","last_clean":"2023-10-16T23:28:22.683974+0000","last_became_active":"2023-10-16T23:27:40.331517+0000","last_became_peered":"2023-10-16T23:27:40.331517+0000","last_unstale":"2023-10-16T23:28:22.683974+0000","last_undegraded":"2023-10-16T23:28:22.683974+0000","last_fullsized":"2023-10-16T23:28:22.683974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:55.534068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962827+0000","last_change":"2023-10-16T23:27:40.336300+0000","last_active":"2023-10-16T23:28:22.962827+0000","last_peered":"2023-10-16T23:28:22.962827+0000","last_clean":"2023-10-16T23:28:22.962827+0000","last_became_active":"2023-10-16T23:27:40.333012+0000","last_became_peered":"2023-10-16T23:27:40.333012+0000","last_unstale":"2023-10-16T23:28:22.962827+0000","last_undegraded":"2023-10-16T23:28:22.962827+0000","last_fullsized":"2023-10-16T23:28:22.962827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689471+0000","last_change":"2023-10-16T23:27:40.760984+0000","last_active":"2023-10-16T23:28:22.689471+0000","last_peered":"2023-10-16T23:28:22.689471+0000","last_clean":"2023-10-16T23:28:22.689471+0000","last_became_active":"2023-10-16T23:27:40.760680+0000","last_became_peered":"2023-10-16T23:27:40.760680+0000","last_unstale":"2023-10-16T23:28:22.689471+0000","last_undegraded":"2023-10-16T23:28:22.689471+0000","last_fullsized":"2023-10-16T23:28:22.689471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:07:04.722168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.312448+0000","last_change":"2023-10-16T23:27:40.339159+0000","last_active":"2023-10-16T23:27:43.312448+0000","last_peered":"2023-10-16T23:27:43.312448+0000","last_clean":"2023-10-16T23:27:43.312448+0000","last_became_active":"2023-10-16T23:27:40.338706+0000","last_became_peered":"2023-10-16T23:27:40.338706+0000","last_unstale":"2023-10-16T23:27:43.312448+0000","last_undegraded":"2023-10-16T23:27:43.312448+0000","last_fullsized":"2023-10-16T23:27:43.312448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:33:08.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689103+0000","last_change":"2023-10-16T23:27:40.713138+0000","last_active":"2023-10-16T23:28:22.689103+0000","last_peered":"2023-10-16T23:28:22.689103+0000","last_clean":"2023-10-16T23:28:22.689103+0000","last_became_active":"2023-10-16T23:27:40.712756+0000","last_became_peered":"2023-10-16T23:27:40.712756+0000","last_unstale":"2023-10-16T23:28:22.689103+0000","last_undegraded":"2023-10-16T23:28:22.689103+0000","last_fullsized":"2023-10-16T23:28:22.689103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:19:17.463284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247821+0000","last_change":"2023-10-16T23:27:40.756418+0000","last_active":"2023-10-16T23:28:22.247821+0000","last_peered":"2023-10-16T23:28:22.247821+0000","last_clean":"2023-10-16T23:28:22.247821+0000","last_became_active":"2023-10-16T23:27:40.755714+0000","last_became_peered":"2023-10-16T23:27:40.755714+0000","last_unstale":"2023-10-16T23:28:22.247821+0000","last_undegraded":"2023-10-16T23:28:22.247821+0000","last_fullsized":"2023-10-16T23:28:22.247821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:56.634821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689567+0000","last_change":"2023-10-16T23:27:40.332275+0000","last_active":"2023-10-16T23:28:22.689567+0000","last_peered":"2023-10-16T23:28:22.689567+0000","last_clean":"2023-10-16T23:28:22.689567+0000","last_became_active":"2023-10-16T23:27:40.331428+0000","last_became_peered":"2023-10-16T23:27:40.331428+0000","last_unstale":"2023-10-16T23:28:22.689567+0000","last_undegraded":"2023-10-16T23:28:22.689567+0000","last_fullsized":"2023-10-16T23:28:22.689567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.312094+0000","last_change":"2023-10-16T23:27:40.761081+0000","last_active":"2023-10-16T23:27:43.312094+0000","last_peered":"2023-10-16T23:27:43.312094+0000","last_clean":"2023-10-16T23:27:43.312094+0000","last_became_active":"2023-10-16T23:27:40.760779+0000","last_became_peered":"2023-10-16T23:27:40.760779+0000","last_unstale":"2023-10-16T23:27:43.312094+0000","last_undegraded":"2023-10-16T23:27:43.312094+0000","last_fullsized":"2023-10-16T23:27:43.312094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:31.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.966929+0000","last_change":"2023-10-16T23:27:40.318419+0000","last_active":"2023-10-16T23:28:22.966929+0000","last_peered":"2023-10-16T23:28:22.966929+0000","last_clean":"2023-10-16T23:28:22.966929+0000","last_became_active":"2023-10-16T23:27:40.317622+0000","last_became_peered":"2023-10-16T23:27:40.317622+0000","last_unstale":"2023-10-16T23:28:22.966929+0000","last_undegraded":"2023-10-16T23:28:22.966929+0000","last_fullsized":"2023-10-16T23:28:22.966929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689818+0000","last_change":"2023-10-16T23:27:40.706263+0000","last_active":"2023-10-16T23:28:22.689818+0000","last_peered":"2023-10-16T23:28:22.689818+0000","last_clean":"2023-10-16T23:28:22.689818+0000","last_became_active":"2023-10-16T23:27:40.705956+0000","last_became_peered":"2023-10-16T23:27:40.705956+0000","last_unstale":"2023-10-16T23:28:22.689818+0000","last_undegraded":"2023-10-16T23:28:22.689818+0000","last_fullsized":"2023-10-16T23:28:22.689818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247961+0000","last_change":"2023-10-16T23:27:40.344965+0000","last_active":"2023-10-16T23:28:22.247961+0000","last_peered":"2023-10-16T23:28:22.247961+0000","last_clean":"2023-10-16T23:28:22.247961+0000","last_became_active":"2023-10-16T23:27:40.344158+0000","last_became_peered":"2023-10-16T23:27:40.344158+0000","last_unstale":"2023-10-16T23:28:22.247961+0000","last_undegraded":"2023-10-16T23:28:22.247961+0000","last_fullsized":"2023-10-16T23:28:22.247961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:04.095452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.243569+0000","last_change":"2023-10-16T23:27:40.713594+0000","last_active":"2023-10-16T23:28:22.243569+0000","last_peered":"2023-10-16T23:28:22.243569+0000","last_clean":"2023-10-16T23:28:22.243569+0000","last_became_active":"2023-10-16T23:27:40.712632+0000","last_became_peered":"2023-10-16T23:27:40.712632+0000","last_unstale":"2023-10-16T23:28:22.243569+0000","last_undegraded":"2023-10-16T23:28:22.243569+0000","last_fullsized":"2023-10-16T23:28:22.243569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:52.368847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.312045+0000","last_change":"2023-10-16T23:27:40.357300+0000","last_active":"2023-10-16T23:27:43.312045+0000","last_peered":"2023-10-16T23:27:43.312045+0000","last_clean":"2023-10-16T23:27:43.312045+0000","last_became_active":"2023-10-16T23:27:40.356809+0000","last_became_peered":"2023-10-16T23:27:40.356809+0000","last_unstale":"2023-10-16T23:27:43.312045+0000","last_undegraded":"2023-10-16T23:27:43.312045+0000","last_fullsized":"2023-10-16T23:27:43.312045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247826+0000","last_change":"2023-10-16T23:27:40.726018+0000","last_active":"2023-10-16T23:28:22.247826+0000","last_peered":"2023-10-16T23:28:22.247826+0000","last_clean":"2023-10-16T23:28:22.247826+0000","last_became_active":"2023-10-16T23:27:40.724910+0000","last_became_peered":"2023-10-16T23:27:40.724910+0000","last_unstale":"2023-10-16T23:28:22.247826+0000","last_undegraded":"2023-10-16T23:28:22.247826+0000","last_fullsized":"2023-10-16T23:28:22.247826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:25:34.841325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962608+0000","last_change":"2023-10-16T23:27:40.345785+0000","last_active":"2023-10-16T23:28:22.962608+0000","last_peered":"2023-10-16T23:28:22.962608+0000","last_clean":"2023-10-16T23:28:22.962608+0000","last_became_active":"2023-10-16T23:27:40.344531+0000","last_became_peered":"2023-10-16T23:27:40.344531+0000","last_unstale":"2023-10-16T23:28:22.962608+0000","last_undegraded":"2023-10-16T23:28:22.962608+0000","last_fullsized":"2023-10-16T23:28:22.962608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:55.630817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246775+0000","last_change":"2023-10-16T23:27:40.720573+0000","last_active":"2023-10-16T23:28:22.246775+0000","last_peered":"2023-10-16T23:28:22.246775+0000","last_clean":"2023-10-16T23:28:22.246775+0000","last_became_active":"2023-10-16T23:27:40.719758+0000","last_became_peered":"2023-10-16T23:27:40.719758+0000","last_unstale":"2023-10-16T23:28:22.246775+0000","last_undegraded":"2023-10-16T23:28:22.246775+0000","last_fullsized":"2023-10-16T23:28:22.246775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:27:29.534374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.963212+0000","last_change":"2023-10-16T23:27:40.345400+0000","last_active":"2023-10-16T23:28:22.963212+0000","last_peered":"2023-10-16T23:28:22.963212+0000","last_clean":"2023-10-16T23:28:22.963212+0000","last_became_active":"2023-10-16T23:27:40.344589+0000","last_became_peered":"2023-10-16T23:27:40.344589+0000","last_unstale":"2023-10-16T23:28:22.963212+0000","last_undegraded":"2023-10-16T23:28:22.963212+0000","last_fullsized":"2023-10-16T23:28:22.963212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:15:23.173526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689835+0000","last_change":"2023-10-16T23:27:40.711211+0000","last_active":"2023-10-16T23:28:22.689835+0000","last_peered":"2023-10-16T23:28:22.689835+0000","last_clean":"2023-10-16T23:28:22.689835+0000","last_became_active":"2023-10-16T23:27:40.705936+0000","last_became_peered":"2023-10-16T23:27:40.705936+0000","last_unstale":"2023-10-16T23:28:22.689835+0000","last_undegraded":"2023-10-16T23:28:22.689835+0000","last_fullsized":"2023-10-16T23:28:22.689835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.689909+0000","last_change":"2023-10-16T23:27:40.323626+0000","last_active":"2023-10-16T23:28:22.689909+0000","last_peered":"2023-10-16T23:28:22.689909+0000","last_clean":"2023-10-16T23:28:22.689909+0000","last_became_active":"2023-10-16T23:27:40.323352+0000","last_became_peered":"2023-10-16T23:27:40.323352+0000","last_unstale":"2023-10-16T23:28:22.689909+0000","last_undegraded":"2023-10-16T23:28:22.689909+0000","last_fullsized":"2023-10-16T23:28:22.689909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:33:08.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246609+0000","last_change":"2023-10-16T23:27:40.749109+0000","last_active":"2023-10-16T23:28:22.246609+0000","last_peered":"2023-10-16T23:28:22.246609+0000","last_clean":"2023-10-16T23:28:22.246609+0000","last_became_active":"2023-10-16T23:27:40.748525+0000","last_became_peered":"2023-10-16T23:27:40.748525+0000","last_unstale":"2023-10-16T23:28:22.246609+0000","last_undegraded":"2023-10-16T23:28:22.246609+0000","last_fullsized":"2023-10-16T23:28:22.246609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:10:38.468420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-16T23:27:43.312397+0000","last_change":"2023-10-16T23:27:40.338946+0000","last_active":"2023-10-16T23:27:43.312397+0000","last_peered":"2023-10-16T23:27:43.312397+0000","last_clean":"2023-10-16T23:27:43.312397+0000","last_became_active":"2023-10-16T23:27:40.338565+0000","last_became_peered":"2023-10-16T23:27:40.338565+0000","last_unstale":"2023-10-16T23:27:43.312397+0000","last_undegraded":"2023-10-16T23:27:43.312397+0000","last_fullsized":"2023-10-16T23:27:43.312397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:55.630817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5270,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":10540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":103608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]}]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":278528,"data_stored":104260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.383}]}]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":108136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]}]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":103698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.92400000000000004}]},{"osd":1,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.80300000000000005}]},{"osd":2,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":1.0289999999999999}]},{"osd":4,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.323},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":1.2689999999999999}]},{"osd":5,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.115}]},{"osd":6,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.3580000000000001}]},{"osd":7,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":1.2190000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":103608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":868352,"data_stored":694558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]}]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":698664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.0409999999999999}]},{"osd":1,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.0149999999999999}]},{"osd":2,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.89900000000000002}]},{"osd":3,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.105},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.93600000000000005}]},{"osd":4,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.153},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.96299999999999997}]},{"osd":5,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.72699999999999998}]},{"osd":6,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.742,"5min":2.742,"15min":2.742},"last":1.077}]}]},{"osd":2,"up_from":14,"seq":60129542161,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":270336,"data_stored":103608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.5},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.59699999999999998}]},{"osd":1,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.69199999999999995}]},{"osd":3,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.55200000000000005}]},{"osd":4,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.83999999999999997}]},{"osd":5,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.98799999999999999}]},{"osd":6,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.159}]},{"osd":7,"last update":"Mon Oct 16 23:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.071}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T23:28:34.617 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T23:28:34.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.772+0000 7fa5c19d7640 1 Processor -- start 2023-10-16T23:28:34.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.776+0000 7fa5c19d7640 1 -- start start 2023-10-16T23:28:34.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.776+0000 7fa5c19d7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa5bc06ebc0 0x7fa5bc14eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:34.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.776+0000 7fa5c19d7640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5bc070b30 0x7fa5bc0c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:34.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.776+0000 7fa5c19d7640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa5bc14c220 0x7fa5bc14ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:34.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.776+0000 7fa5c19d7640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5bc0b7710 con 0x7fa5bc06ebc0 2023-10-16T23:28:34.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.776+0000 7fa5c19d7640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5bc0bae10 con 0x7fa5bc14c220 2023-10-16T23:28:34.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.776+0000 7fa5c19d7640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc14fb20 con 0x7fa5bc070b30 2023-10-16T23:28:34.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.776+0000 7fa5baffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa5bc06ebc0 0x7fa5bc14eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:34.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.776+0000 7fa5baffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa5bc06ebc0 0x7fa5bc14eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36416/0 (socket says 172.21.15.12:36416) 2023-10-16T23:28:34.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.776+0000 7fa5baffd640 1 -- 172.21.15.12:0/1695392442 learned_addr learned my addr 172.21.15.12:0/1695392442 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:34.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.776+0000 7fa5bb7fe640 1 --2- 172.21.15.12:0/1695392442 >> v2:172.21.15.31:3300/0 conn(0x7fa5bc14c220 0x7fa5bc14ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:34.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.776+0000 7fa5baffd640 1 -- 172.21.15.12:0/1695392442 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5bc070b30 msgr2=0x7fa5bc0c0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:34.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.776+0000 7fa5baffd640 1 --2- 172.21.15.12:0/1695392442 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5bc070b30 0x7fa5bc0c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.776+0000 7fa5baffd640 1 -- 172.21.15.12:0/1695392442 >> v2:172.21.15.31:3300/0 conn(0x7fa5bc14c220 msgr2=0x7fa5bc14ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:34.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.776+0000 7fa5baffd640 1 --2- 172.21.15.12:0/1695392442 >> v2:172.21.15.31:3300/0 conn(0x7fa5bc14c220 0x7fa5bc14ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.776+0000 7fa5baffd640 1 -- 172.21.15.12:0/1695392442 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc14f530 con 0x7fa5bc06ebc0 2023-10-16T23:28:34.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.776+0000 7fa5bb7fe640 1 --2- 172.21.15.12:0/1695392442 >> v2:172.21.15.31:3300/0 conn(0x7fa5bc14c220 0x7fa5bc14ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:34.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.776+0000 7fa5baffd640 1 --2- 172.21.15.12:0/1695392442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5bc06ebc0 0x7fa5bc14eff0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc071770 tx=0x7fa5ac01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99039c47144126d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:34.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.776+0000 7fa5b9ffb640 1 -- 172.21.15.12:0/1695392442 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac0ab600 con 0x7fa5bc06ebc0 2023-10-16T23:28:34.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5b9ffb640 1 -- 172.21.15.12:0/1695392442 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac0a7050 con 0x7fa5bc06ebc0 2023-10-16T23:28:34.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5b9ffb640 1 -- 172.21.15.12:0/1695392442 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac0ab980 con 0x7fa5bc06ebc0 2023-10-16T23:28:34.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5c19d7640 1 -- 172.21.15.12:0/1695392442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5bc06ebc0 msgr2=0x7fa5bc14eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:34.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5c19d7640 1 --2- 172.21.15.12:0/1695392442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5bc06ebc0 0x7fa5bc14eff0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc071770 tx=0x7fa5ac01c3e0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5c19d7640 1 -- 172.21.15.12:0/1695392442 shutdown_connections 2023-10-16T23:28:34.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5c19d7640 1 --2- 172.21.15.12:0/1695392442 >> v2:172.21.15.31:3300/0 conn(0x7fa5bc14c220 0x7fa5bc14ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5c19d7640 1 --2- 172.21.15.12:0/1695392442 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5bc070b30 0x7fa5bc0c0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5c19d7640 1 --2- 172.21.15.12:0/1695392442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5bc06ebc0 0x7fa5bc14eff0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5c19d7640 1 -- 172.21.15.12:0/1695392442 >> 172.21.15.12:0/1695392442 conn(0x7fa5bc06ba20 msgr2=0x7fa5bc0c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:34.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5c19d7640 1 -- 172.21.15.12:0/1695392442 shutdown_connections 2023-10-16T23:28:34.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5c19d7640 1 -- 172.21.15.12:0/1695392442 wait complete. 2023-10-16T23:28:34.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5c19d7640 1 Processor -- start 2023-10-16T23:28:34.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5c19d7640 1 -- start start 2023-10-16T23:28:34.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5c19d7640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5bc06ebc0 0x7fa5bc146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:34.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5c19d7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5bc070b30 0x7fa5bc142030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:34.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5c19d7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5bc14c220 0x7fa5bc142570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:34.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5c19d7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc0b6190 con 0x7fa5bc070b30 2023-10-16T23:28:34.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5c19d7640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc070f30 con 0x7fa5bc14c220 2023-10-16T23:28:34.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5c19d7640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc1e93d0 con 0x7fa5bc06ebc0 2023-10-16T23:28:34.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5ba7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5bc070b30 0x7fa5bc142030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:34.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5ba7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5bc070b30 0x7fa5bc142030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36430/0 (socket says 172.21.15.12:36430) 2023-10-16T23:28:34.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5ba7fc640 1 -- 172.21.15.12:0/3449734000 learned_addr learned my addr 172.21.15.12:0/3449734000 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:34.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5baffd640 1 --2- 172.21.15.12:0/3449734000 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5bc06ebc0 0x7fa5bc146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:34.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5bb7fe640 1 --2- 172.21.15.12:0/3449734000 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5bc14c220 0x7fa5bc142570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:34.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5ba7fc640 1 -- 172.21.15.12:0/3449734000 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5bc06ebc0 msgr2=0x7fa5bc146c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:34.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5ba7fc640 1 --2- 172.21.15.12:0/3449734000 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5bc06ebc0 0x7fa5bc146c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5ba7fc640 1 -- 172.21.15.12:0/3449734000 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5bc14c220 msgr2=0x7fa5bc142570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:34.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5ba7fc640 1 --2- 172.21.15.12:0/3449734000 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5bc14c220 0x7fa5bc142570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5ba7fc640 1 -- 172.21.15.12:0/3449734000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac0094d0 con 0x7fa5bc070b30 2023-10-16T23:28:34.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5ba7fc640 1 --2- 172.21.15.12:0/3449734000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5bc070b30 0x7fa5bc142030 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000b550 tx=0x7fa5b000ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:34.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5a3fff640 1 -- 172.21.15.12:0/3449734000 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0010870 con 0x7fa5bc070b30 2023-10-16T23:28:34.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5a3fff640 1 -- 172.21.15.12:0/3449734000 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b00109f0 con 0x7fa5bc070b30 2023-10-16T23:28:34.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5a3fff640 1 -- 172.21.15.12:0/3449734000 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0010da0 con 0x7fa5bc070b30 2023-10-16T23:28:34.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5c19d7640 1 -- 172.21.15.12:0/3449734000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5bc1e9860 con 0x7fa5bc070b30 2023-10-16T23:28:34.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.780+0000 7fa5c19d7640 1 -- 172.21.15.12:0/3449734000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5bc147190 con 0x7fa5bc070b30 2023-10-16T23:28:34.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.784+0000 7fa5c19d7640 1 -- 172.21.15.12:0/3449734000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5bc1e9540 con 0x7fa5bc070b30 2023-10-16T23:28:34.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.784+0000 7fa5a3fff640 1 -- 172.21.15.12:0/3449734000 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fa5b000f3c0 con 0x7fa5bc070b30 2023-10-16T23:28:34.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.784+0000 7fa5a3fff640 1 --2- 172.21.15.12:0/3449734000 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fa5a8065e90 0x7fa5a8068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:34.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.784+0000 7fa5a3fff640 1 -- 172.21.15.12:0/3449734000 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa5b00837b0 con 0x7fa5bc070b30 2023-10-16T23:28:34.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.784+0000 7fa5baffd640 1 --2- 172.21.15.12:0/3449734000 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fa5a8065e90 0x7fa5a8068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:34.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.784+0000 7fa5baffd640 1 --2- 172.21.15.12:0/3449734000 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fa5a8065e90 0x7fa5a8068350 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0ad000 tx=0x7fa5ac0a6000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:34.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.788+0000 7fa5a3fff640 1 -- 172.21.15.12:0/3449734000 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fa5b0050e50 con 0x7fa5bc070b30 2023-10-16T23:28:34.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.944+0000 7fa5c19d7640 1 -- 172.21.15.12:0/3449734000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5bc0673a0 con 0x7fa5bc070b30 2023-10-16T23:28:34.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.948+0000 7fa5a3fff640 1 -- 172.21.15.12:0/3449734000 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17857 (secure 0 0 0) 0x7fa5b0054470 con 0x7fa5bc070b30 2023-10-16T23:28:34.951 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:28:34.951 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":26,"fsid":"0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51","created":"2023-10-16T23:27:16.468087+0000","modified":"2023-10-16T23:28:23.417777+0000","last_up_change":"2023-10-16T23:27:28.136202+0000","last_in_change":"2023-10-16T23:27:18.793212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T23:27:27.354025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-16T23:27:34.786446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-16T23:27:39.130341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-16T23:27:39.674572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73e70f98-6f5e-4464-b34e-931faac41cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":38075},{"type":"v1","addr":"172.21.15.12:6814","nonce":38075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":38075},{"type":"v1","addr":"172.21.15.12:6819","nonce":38075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":38075},{"type":"v1","addr":"172.21.15.12:6827","nonce":38075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":38075},{"type":"v1","addr":"172.21.15.12:6823","nonce":38075}]},"public_addr":"172.21.15.12:6814/38075","cluster_addr":"172.21.15.12:6819/38075","heartbeat_back_addr":"172.21.15.12:6827/38075","heartbeat_front_addr":"172.21.15.12:6823/38075","state":["exists","up"]},{"osd":1,"uuid":"ff722efe-b3f9-4cc0-bbde-f4d4d8055a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":38076},{"type":"v1","addr":"172.21.15.12:6811","nonce":38076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":38076},{"type":"v1","addr":"172.21.15.12:6818","nonce":38076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":38076},{"type":"v1","addr":"172.21.15.12:6831","nonce":38076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":38076},{"type":"v1","addr":"172.21.15.12:6825","nonce":38076}]},"public_addr":"172.21.15.12:6811/38076","cluster_addr":"172.21.15.12:6818/38076","heartbeat_back_addr":"172.21.15.12:6831/38076","heartbeat_front_addr":"172.21.15.12:6825/38076","state":["exists","up"]},{"osd":2,"uuid":"9baf25db-dce0-4065-90d6-f35867286be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6809","nonce":38073},{"type":"v1","addr":"172.21.15.12:6810","nonce":38073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":38073},{"type":"v1","addr":"172.21.15.12:6817","nonce":38073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":38073},{"type":"v1","addr":"172.21.15.12:6830","nonce":38073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":38073},{"type":"v1","addr":"172.21.15.12:6826","nonce":38073}]},"public_addr":"172.21.15.12:6810/38073","cluster_addr":"172.21.15.12:6817/38073","heartbeat_back_addr":"172.21.15.12:6830/38073","heartbeat_front_addr":"172.21.15.12:6826/38073","state":["exists","up"]},{"osd":3,"uuid":"8a620ad3-2294-470d-8a8c-66f177f5fbe7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":38074},{"type":"v1","addr":"172.21.15.12:6801","nonce":38074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":38074},{"type":"v1","addr":"172.21.15.12:6803","nonce":38074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":38074},{"type":"v1","addr":"172.21.15.12:6807","nonce":38074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":38074},{"type":"v1","addr":"172.21.15.12:6805","nonce":38074}]},"public_addr":"172.21.15.12:6801/38074","cluster_addr":"172.21.15.12:6803/38074","heartbeat_back_addr":"172.21.15.12:6807/38074","heartbeat_front_addr":"172.21.15.12:6805/38074","state":["exists","up"]},{"osd":4,"uuid":"a8824d77-7405-40f5-9234-60889802b184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":38266},{"type":"v1","addr":"172.21.15.31:6817","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":38266},{"type":"v1","addr":"172.21.15.31:6819","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":38266},{"type":"v1","addr":"172.21.15.31:6823","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":38266},{"type":"v1","addr":"172.21.15.31:6821","nonce":38266}]},"public_addr":"172.21.15.31:6817/38266","cluster_addr":"172.21.15.31:6819/38266","heartbeat_back_addr":"172.21.15.31:6823/38266","heartbeat_front_addr":"172.21.15.31:6821/38266","state":["exists","up"]},{"osd":5,"uuid":"3bb01192-a47c-48e9-9662-285e3f6f4b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":38264},{"type":"v1","addr":"172.21.15.31:6807","nonce":38264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":38264},{"type":"v1","addr":"172.21.15.31:6811","nonce":38264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":38264},{"type":"v1","addr":"172.21.15.31:6815","nonce":38264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":38264},{"type":"v1","addr":"172.21.15.31:6813","nonce":38264}]},"public_addr":"172.21.15.31:6807/38264","cluster_addr":"172.21.15.31:6811/38264","heartbeat_back_addr":"172.21.15.31:6815/38264","heartbeat_front_addr":"172.21.15.31:6813/38264","state":["exists","up"]},{"osd":6,"uuid":"1e2d18e4-73e6-4a37-826c-35eca4d96935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":38263},{"type":"v1","addr":"172.21.15.31:6825","nonce":38263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":38263},{"type":"v1","addr":"172.21.15.31:6827","nonce":38263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":38263},{"type":"v1","addr":"172.21.15.31:6831","nonce":38263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":38263},{"type":"v1","addr":"172.21.15.31:6829","nonce":38263}]},"public_addr":"172.21.15.31:6825/38263","cluster_addr":"172.21.15.31:6827/38263","heartbeat_back_addr":"172.21.15.31:6831/38263","heartbeat_front_addr":"172.21.15.31:6829/38263","state":["exists","up"]},{"osd":7,"uuid":"e0f369c0-562b-4440-a5aa-12275c29412b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":38265},{"type":"v1","addr":"172.21.15.31:6801","nonce":38265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":38265},{"type":"v1","addr":"172.21.15.31:6803","nonce":38265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":38265},{"type":"v1","addr":"172.21.15.31:6810","nonce":38265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":38265},{"type":"v1","addr":"172.21.15.31:6806","nonce":38265}]},"public_addr":"172.21.15.31:6801/38265","cluster_addr":"172.21.15.31:6803/38265","heartbeat_back_addr":"172.21.15.31:6810/38265","heartbeat_front_addr":"172.21.15.31:6806/38265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.411815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.372565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.209700+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.414619+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.316843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.300348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.359800+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.219854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T23:28:34.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.948+0000 7fa5c19d7640 1 -- 172.21.15.12:0/3449734000 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fa5a8065e90 msgr2=0x7fa5a8068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:34.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.948+0000 7fa5c19d7640 1 --2- 172.21.15.12:0/3449734000 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fa5a8065e90 0x7fa5a8068350 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0ad000 tx=0x7fa5ac0a6000 comp rx=0 tx=0).stop 2023-10-16T23:28:34.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.948+0000 7fa5c19d7640 1 -- 172.21.15.12:0/3449734000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5bc070b30 msgr2=0x7fa5bc142030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:34.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.948+0000 7fa5c19d7640 1 --2- 172.21.15.12:0/3449734000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5bc070b30 0x7fa5bc142030 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000b550 tx=0x7fa5b000ba10 comp rx=0 tx=0).stop 2023-10-16T23:28:34.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.948+0000 7fa5c19d7640 1 -- 172.21.15.12:0/3449734000 shutdown_connections 2023-10-16T23:28:34.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.948+0000 7fa5c19d7640 1 --2- 172.21.15.12:0/3449734000 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fa5a8065e90 0x7fa5a8068350 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.948+0000 7fa5c19d7640 1 --2- 172.21.15.12:0/3449734000 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5bc14c220 0x7fa5bc142570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.948+0000 7fa5c19d7640 1 --2- 172.21.15.12:0/3449734000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5bc070b30 0x7fa5bc142030 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.948+0000 7fa5c19d7640 1 --2- 172.21.15.12:0/3449734000 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5bc06ebc0 0x7fa5bc146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:34.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.948+0000 7fa5c19d7640 1 -- 172.21.15.12:0/3449734000 >> 172.21.15.12:0/3449734000 conn(0x7fa5bc06ba20 msgr2=0x7fa5bc1498c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:34.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.948+0000 7fa5c19d7640 1 -- 172.21.15.12:0/3449734000 shutdown_connections 2023-10-16T23:28:34.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:34.948+0000 7fa5c19d7640 1 -- 172.21.15.12:0/3449734000 wait complete. 2023-10-16T23:28:35.971 INFO:tasks.ceph:Scrubbing osd.0 2023-10-16T23:28:35.972 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-16T23:28:36.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.112+0000 7fea64081640 1 Processor -- start 2023-10-16T23:28:36.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.112+0000 7fea64081640 1 -- start start 2023-10-16T23:28:36.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.112+0000 7fea64081640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fea5c0ba9a0 0x7fea5c0bc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.112+0000 7fea64081640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea5c0b86f0 0x7fea5c14c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.112+0000 7fea64081640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea5c0b7c50 con 0x7fea5c070b40 2023-10-16T23:28:36.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.112+0000 7fea64081640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea5c0b4160 con 0x7fea5c0ba9a0 2023-10-16T23:28:36.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.112+0000 7fea64081640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c0b8340 con 0x7fea5c0b86f0 2023-10-16T23:28:36.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.112+0000 7fea6161c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fea5c0ba9a0 0x7fea5c0bc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.112+0000 7fea6261e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea5c0b86f0 0x7fea5c14c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.112+0000 7fea61e1d640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fea5c070b40 0x7fea5c0b3a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:43218/0 (socket says 172.21.15.12:43218) 2023-10-16T23:28:36.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.112+0000 7fea61e1d640 1 -- 172.21.15.12:0/1749883143 learned_addr learned my addr 172.21.15.12:0/1749883143 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:36.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.112+0000 7fea6261e640 1 -- 172.21.15.12:0/1749883143 >> v2:172.21.15.31:3300/0 conn(0x7fea5c0ba9a0 msgr2=0x7fea5c0bc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:36.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.112+0000 7fea6261e640 1 --2- 172.21.15.12:0/1749883143 >> v2:172.21.15.31:3300/0 conn(0x7fea5c0ba9a0 0x7fea5c0bc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.112+0000 7fea6261e640 1 -- 172.21.15.12:0/1749883143 >> v1:172.21.15.31:6789/0 conn(0x7fea5c070b40 legacy=0x7fea5c0b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:36.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.112+0000 7fea6261e640 1 -- 172.21.15.12:0/1749883143 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c0b7ea0 con 0x7fea5c0b86f0 2023-10-16T23:28:36.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.112+0000 7fea6161c640 1 --2- 172.21.15.12:0/1749883143 >> v2:172.21.15.31:3300/0 conn(0x7fea5c0ba9a0 0x7fea5c0bc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T23:28:36.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.116+0000 7fea6261e640 1 --2- 172.21.15.12:0/1749883143 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea5c0b86f0 0x7fea5c14c870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fea540097c0 tx=0x7fea5401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e46c9cc19ba010e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:36.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.116+0000 7fea60e1b640 1 -- 172.21.15.12:0/1749883143 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea540ab610 con 0x7fea5c0b86f0 2023-10-16T23:28:36.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.116+0000 7fea60e1b640 1 -- 172.21.15.12:0/1749883143 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea540ab770 con 0x7fea5c0b86f0 2023-10-16T23:28:36.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.116+0000 7fea60e1b640 1 -- 172.21.15.12:0/1749883143 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea540abb00 con 0x7fea5c0b86f0 2023-10-16T23:28:36.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.116+0000 7fea64081640 1 -- 172.21.15.12:0/1749883143 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea5c0b86f0 msgr2=0x7fea5c14c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:36.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.116+0000 7fea64081640 1 --2- 172.21.15.12:0/1749883143 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea5c0b86f0 0x7fea5c14c870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fea540097c0 tx=0x7fea5401c3f0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.116+0000 7fea64081640 1 -- 172.21.15.12:0/1749883143 shutdown_connections 2023-10-16T23:28:36.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.116+0000 7fea64081640 1 --2- 172.21.15.12:0/1749883143 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea5c0b86f0 0x7fea5c14c870 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.116+0000 7fea64081640 1 --2- 172.21.15.12:0/1749883143 >> v2:172.21.15.31:3300/0 conn(0x7fea5c0ba9a0 0x7fea5c0bc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.116+0000 7fea64081640 1 -- 172.21.15.12:0/1749883143 >> 172.21.15.12:0/1749883143 conn(0x7fea5c0bd240 msgr2=0x7fea5c0bd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:36.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.116+0000 7fea64081640 1 -- 172.21.15.12:0/1749883143 shutdown_connections 2023-10-16T23:28:36.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.116+0000 7fea64081640 1 -- 172.21.15.12:0/1749883143 wait complete. 2023-10-16T23:28:36.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.116+0000 7fea64081640 1 Processor -- start 2023-10-16T23:28:36.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.116+0000 7fea64081640 1 -- start start 2023-10-16T23:28:36.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea64081640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea5c070b40 0x7fea5c0bb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea64081640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea5c0b86f0 0x7fea5c14fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea64081640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea5c0ba9a0 0x7fea5c1eabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea64081640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c0b7710 con 0x7fea5c070b40 2023-10-16T23:28:36.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea64081640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c14e820 con 0x7fea5c0b86f0 2023-10-16T23:28:36.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea64081640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c0bbc20 con 0x7fea5c0ba9a0 2023-10-16T23:28:36.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea61e1d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea5c070b40 0x7fea5c0bb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea61e1d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea5c070b40 0x7fea5c0bb6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36438/0 (socket says 172.21.15.12:36438) 2023-10-16T23:28:36.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea61e1d640 1 -- 172.21.15.12:0/3872678468 learned_addr learned my addr 172.21.15.12:0/3872678468 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:36.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea6161c640 1 --2- 172.21.15.12:0/3872678468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea5c0b86f0 0x7fea5c14fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea6261e640 1 --2- 172.21.15.12:0/3872678468 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea5c0ba9a0 0x7fea5c1eabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea61e1d640 1 -- 172.21.15.12:0/3872678468 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea5c0ba9a0 msgr2=0x7fea5c1eabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:36.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea61e1d640 1 --2- 172.21.15.12:0/3872678468 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fea5c0ba9a0 0x7fea5c1eabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea61e1d640 1 -- 172.21.15.12:0/3872678468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea5c0b86f0 msgr2=0x7fea5c14fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:36.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea61e1d640 1 --2- 172.21.15.12:0/3872678468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea5c0b86f0 0x7fea5c14fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea61e1d640 1 -- 172.21.15.12:0/3872678468 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea50009a70 con 0x7fea5c070b40 2023-10-16T23:28:36.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea6161c640 1 --2- 172.21.15.12:0/3872678468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea5c0b86f0 0x7fea5c14fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:28:36.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea61e1d640 1 --2- 172.21.15.12:0/3872678468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea5c070b40 0x7fea5c0bb6e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fea4800c530 tx=0x7fea4800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:36.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea5a7fc640 1 -- 172.21.15.12:0/3872678468 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea48005cf0 con 0x7fea5c070b40 2023-10-16T23:28:36.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea5a7fc640 1 -- 172.21.15.12:0/3872678468 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea48005e50 con 0x7fea5c070b40 2023-10-16T23:28:36.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea64081640 1 -- 172.21.15.12:0/3872678468 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea54009420 con 0x7fea5c070b40 2023-10-16T23:28:36.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea5a7fc640 1 -- 172.21.15.12:0/3872678468 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea48007270 con 0x7fea5c070b40 2023-10-16T23:28:36.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea64081640 1 -- 172.21.15.12:0/3872678468 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5c14ed70 con 0x7fea5c070b40 2023-10-16T23:28:36.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea64081640 1 -- 172.21.15.12:0/3872678468 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fea5c0673a0 con 0x7fea5c070b40 2023-10-16T23:28:36.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea5a7fc640 1 -- 172.21.15.12:0/3872678468 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fea480073d0 con 0x7fea5c070b40 2023-10-16T23:28:36.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea5a7fc640 1 --2- 172.21.15.12:0/3872678468 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fea40065e60 0x7fea40068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea5a7fc640 1 -- 172.21.15.12:0/3872678468 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fea48083460 con 0x7fea5c070b40 2023-10-16T23:28:36.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea5a7fc640 1 --2- 172.21.15.12:0/3872678468 >> [v2:172.21.15.12:6812/38075,v1:172.21.15.12:6814/38075] conn(0x7fea4006e760 0x7fea40070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea5a7fc640 1 -- 172.21.15.12:0/3872678468 --> [v2:172.21.15.12:6812/38075,v1:172.21.15.12:6814/38075] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fea40071270 con 0x7fea4006e760 2023-10-16T23:28:36.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea5a7fc640 1 -- 172.21.15.12:0/3872678468 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea480838b0 con 0x7fea5c070b40 2023-10-16T23:28:36.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea6161c640 1 --2- 172.21.15.12:0/3872678468 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fea40065e60 0x7fea40068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.120+0000 7fea6261e640 1 --2- 172.21.15.12:0/3872678468 >> [v2:172.21.15.12:6812/38075,v1:172.21.15.12:6814/38075] conn(0x7fea4006e760 0x7fea40070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.124+0000 7fea6261e640 1 --2- 172.21.15.12:0/3872678468 >> [v2:172.21.15.12:6812/38075,v1:172.21.15.12:6814/38075] conn(0x7fea4006e760 0x7fea40070ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:36.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.124+0000 7fea6161c640 1 --2- 172.21.15.12:0/3872678468 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fea40065e60 0x7fea40068320 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fea5c146700 tx=0x7fea5000b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:36.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.124+0000 7fea5a7fc640 1 -- 172.21.15.12:0/3872678468 <== osd.0 v2:172.21.15.12:6812/38075 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fea40071270 con 0x7fea4006e760 2023-10-16T23:28:36.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.136+0000 7fea64081640 1 -- 172.21.15.12:0/3872678468 --> [v2:172.21.15.12:6812/38075,v1:172.21.15.12:6814/38075] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fea5c1e76b0 con 0x7fea4006e760 2023-10-16T23:28:36.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.136+0000 7fea5a7fc640 1 -- 172.21.15.12:0/3872678468 <== osd.0 v2:172.21.15.12:6812/38075 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fea5c1e76b0 con 0x7fea4006e760 2023-10-16T23:28:36.141 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-16T23:28:36.141 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T23:28:36.141 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-16T23:28:36.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.136+0000 7fea64081640 1 -- 172.21.15.12:0/3872678468 >> [v2:172.21.15.12:6812/38075,v1:172.21.15.12:6814/38075] conn(0x7fea4006e760 msgr2=0x7fea40070ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:36.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.136+0000 7fea64081640 1 --2- 172.21.15.12:0/3872678468 >> [v2:172.21.15.12:6812/38075,v1:172.21.15.12:6814/38075] conn(0x7fea4006e760 0x7fea40070ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.136+0000 7fea64081640 1 -- 172.21.15.12:0/3872678468 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fea40065e60 msgr2=0x7fea40068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:36.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.136+0000 7fea64081640 1 --2- 172.21.15.12:0/3872678468 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fea40065e60 0x7fea40068320 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fea5c146700 tx=0x7fea5000b040 comp rx=0 tx=0).stop 2023-10-16T23:28:36.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.136+0000 7fea64081640 1 -- 172.21.15.12:0/3872678468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea5c070b40 msgr2=0x7fea5c0bb6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:36.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.136+0000 7fea64081640 1 --2- 172.21.15.12:0/3872678468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea5c070b40 0x7fea5c0bb6e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fea4800c530 tx=0x7fea4800c9f0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.136+0000 7fea6261e640 1 -- 172.21.15.12:0/3872678468 reap_dead start 2023-10-16T23:28:36.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.136+0000 7fea64081640 1 -- 172.21.15.12:0/3872678468 shutdown_connections 2023-10-16T23:28:36.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.136+0000 7fea64081640 1 -- 172.21.15.12:0/3872678468 >> 172.21.15.12:0/3872678468 conn(0x7fea5c0bd240 msgr2=0x7fea5c14a020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:36.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.136+0000 7fea64081640 1 -- 172.21.15.12:0/3872678468 shutdown_connections 2023-10-16T23:28:36.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.136+0000 7fea64081640 1 -- 172.21.15.12:0/3872678468 wait complete. 2023-10-16T23:28:36.155 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-16T23:28:36.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.264+0000 7f92c2e0b640 1 Processor -- start 2023-10-16T23:28:36.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.264+0000 7f92c2e0b640 1 -- start start 2023-10-16T23:28:36.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.264+0000 7f92c2e0b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f92bc0c1130 0x7f92bc0b8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.264+0000 7f92c2e0b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92bc0b9f40 0x7f92bc0ba390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.264+0000 7f92c2e0b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92bc14d0c0 con 0x7f92bc14c520 2023-10-16T23:28:36.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.264+0000 7f92c2e0b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92bc0b3ca0 con 0x7f92bc0c1130 2023-10-16T23:28:36.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.264+0000 7f92c2e0b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc0b40c0 con 0x7f92bc0b9f40 2023-10-16T23:28:36.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.264+0000 7f92c13a8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92bc0b9f40 0x7f92bc0ba390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.264+0000 7f92c0ba7640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f92bc0c1130 0x7f92bc0b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.264+0000 7f92c13a8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92bc0b9f40 0x7f92bc0ba390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:38064/0 (socket says 172.21.15.12:38064) 2023-10-16T23:28:36.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.264+0000 7f92c13a8640 1 -- 172.21.15.12:0/1362421955 learned_addr learned my addr 172.21.15.12:0/1362421955 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:36.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.264+0000 7f92c13a8640 1 -- 172.21.15.12:0/1362421955 >> v2:172.21.15.31:3300/0 conn(0x7f92bc0c1130 msgr2=0x7f92bc0b8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:36.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.264+0000 7f92c13a8640 1 --2- 172.21.15.12:0/1362421955 >> v2:172.21.15.31:3300/0 conn(0x7f92bc0c1130 0x7f92bc0b8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.264+0000 7f92c13a8640 1 -- 172.21.15.12:0/1362421955 >> v1:172.21.15.31:6789/0 conn(0x7f92bc14c520 legacy=0x7f92bc14c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:36.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.264+0000 7f92c13a8640 1 -- 172.21.15.12:0/1362421955 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc0b7ce0 con 0x7f92bc0b9f40 2023-10-16T23:28:36.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.268+0000 7f92c13a8640 1 --2- 172.21.15.12:0/1362421955 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92bc0b9f40 0x7f92bc0ba390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f92b4009e50 tx=0x7f92b401c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c625db26a62c20c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:36.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.268+0000 7f92bb7fe640 1 -- 172.21.15.12:0/1362421955 <== mon.2 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b40a57d0 con 0x7f92bc0b9f40 2023-10-16T23:28:36.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.268+0000 7f92bb7fe640 1 -- 172.21.15.12:0/1362421955 <== mon.2 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b40a5930 con 0x7f92bc0b9f40 2023-10-16T23:28:36.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.268+0000 7f92bb7fe640 1 -- 172.21.15.12:0/1362421955 <== mon.2 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b40a5cc0 con 0x7f92bc0b9f40 2023-10-16T23:28:36.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.268+0000 7f92c2e0b640 1 -- 172.21.15.12:0/1362421955 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92bc0b9f40 msgr2=0x7f92bc0ba390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:36.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.268+0000 7f92c2e0b640 1 --2- 172.21.15.12:0/1362421955 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92bc0b9f40 0x7f92bc0ba390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f92b4009e50 tx=0x7f92b401c8f0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.268+0000 7f92c2e0b640 1 -- 172.21.15.12:0/1362421955 shutdown_connections 2023-10-16T23:28:36.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.268+0000 7f92c2e0b640 1 --2- 172.21.15.12:0/1362421955 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92bc0b9f40 0x7f92bc0ba390 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.268+0000 7f92c2e0b640 1 --2- 172.21.15.12:0/1362421955 >> v2:172.21.15.31:3300/0 conn(0x7f92bc0c1130 0x7f92bc0b8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.268+0000 7f92c2e0b640 1 -- 172.21.15.12:0/1362421955 >> 172.21.15.12:0/1362421955 conn(0x7f92bc06ba20 msgr2=0x7f92bc0c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:36.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.268+0000 7f92c2e0b640 1 -- 172.21.15.12:0/1362421955 shutdown_connections 2023-10-16T23:28:36.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.268+0000 7f92c2e0b640 1 -- 172.21.15.12:0/1362421955 wait complete. 2023-10-16T23:28:36.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.268+0000 7f92c2e0b640 1 Processor -- start 2023-10-16T23:28:36.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.268+0000 7f92c2e0b640 1 -- start start 2023-10-16T23:28:36.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.268+0000 7f92c2e0b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92bc0b9f40 0x7f92bc148c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.268+0000 7f92c2e0b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92bc0c1130 0x7f92bc0b6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.268+0000 7f92c2e0b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92bc14c520 0x7f92bc0b71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.268+0000 7f92c2e0b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc0b4540 con 0x7f92bc14c520 2023-10-16T23:28:36.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.268+0000 7f92c2e0b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc149170 con 0x7f92bc0b9f40 2023-10-16T23:28:36.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.268+0000 7f92c2e0b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc0c05a0 con 0x7f92bc0c1130 2023-10-16T23:28:36.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.268+0000 7f92c13a8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92bc14c520 0x7f92bc0b71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.268+0000 7f92c13a8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92bc14c520 0x7f92bc0b71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36440/0 (socket says 172.21.15.12:36440) 2023-10-16T23:28:36.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.268+0000 7f92c13a8640 1 -- 172.21.15.12:0/1540409010 learned_addr learned my addr 172.21.15.12:0/1540409010 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:36.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.268+0000 7f92bbfff640 1 --2- 172.21.15.12:0/1540409010 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92bc0c1130 0x7f92bc0b6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.268+0000 7f92c0ba7640 1 --2- 172.21.15.12:0/1540409010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92bc0b9f40 0x7f92bc148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.272+0000 7f92c13a8640 1 -- 172.21.15.12:0/1540409010 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92bc0c1130 msgr2=0x7f92bc0b6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:36.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.272+0000 7f92c13a8640 1 --2- 172.21.15.12:0/1540409010 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92bc0c1130 0x7f92bc0b6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.272+0000 7f92c13a8640 1 -- 172.21.15.12:0/1540409010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92bc0b9f40 msgr2=0x7f92bc148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:36.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.272+0000 7f92c13a8640 1 --2- 172.21.15.12:0/1540409010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92bc0b9f40 0x7f92bc148c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.272+0000 7f92c13a8640 1 -- 172.21.15.12:0/1540409010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b4009b30 con 0x7f92bc14c520 2023-10-16T23:28:36.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.272+0000 7f92c13a8640 1 --2- 172.21.15.12:0/1540409010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92bc14c520 0x7f92bc0b71f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f92b401a520 tx=0x7f92b4019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:36.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.272+0000 7f92b97fa640 1 -- 172.21.15.12:0/1540409010 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b40b8670 con 0x7f92bc14c520 2023-10-16T23:28:36.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.272+0000 7f92b97fa640 1 -- 172.21.15.12:0/1540409010 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b40b87d0 con 0x7f92bc14c520 2023-10-16T23:28:36.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.272+0000 7f92c2e0b640 1 -- 172.21.15.12:0/1540409010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92bc1493f0 con 0x7f92bc14c520 2023-10-16T23:28:36.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.272+0000 7f92b97fa640 1 -- 172.21.15.12:0/1540409010 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b40b8b80 con 0x7f92bc14c520 2023-10-16T23:28:36.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.272+0000 7f92c2e0b640 1 -- 172.21.15.12:0/1540409010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92bc0b4960 con 0x7f92bc14c520 2023-10-16T23:28:36.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.272+0000 7f92c2e0b640 1 -- 172.21.15.12:0/1540409010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92bc0b4680 con 0x7f92bc14c520 2023-10-16T23:28:36.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.272+0000 7f92b97fa640 1 -- 172.21.15.12:0/1540409010 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f92b40b8ce0 con 0x7f92bc14c520 2023-10-16T23:28:36.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.272+0000 7f92b97fa640 1 --2- 172.21.15.12:0/1540409010 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f92a0065e60 0x7f92a0068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.272+0000 7f92b97fa640 1 -- 172.21.15.12:0/1540409010 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f92b411ec50 con 0x7f92bc14c520 2023-10-16T23:28:36.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.272+0000 7f92c0ba7640 1 --2- 172.21.15.12:0/1540409010 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f92a0065e60 0x7f92a0068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.272+0000 7f92c0ba7640 1 --2- 172.21.15.12:0/1540409010 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f92a0065e60 0x7f92a0068320 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f92b0009b60 tx=0x7f92b0009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:36.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.276+0000 7f92b97fa640 1 -- 172.21.15.12:0/1540409010 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f92bc0b4680 con 0x7f92bc14c520 2023-10-16T23:28:36.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.432+0000 7f92c2e0b640 1 -- 172.21.15.12:0/1540409010 --> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f92bc15a2c0 con 0x7f92a0065e60 2023-10-16T23:28:36.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.432+0000 7f92b97fa640 1 -- 172.21.15.12:0/1540409010 <== mgr.4108 v2:172.21.15.31:6832/37949 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f92b0011ac0 con 0x7f92a0065e60 2023-10-16T23:28:36.437 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 0 to deep-scrub 2023-10-16T23:28:36.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.436+0000 7f92c2e0b640 1 -- 172.21.15.12:0/1540409010 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f92a0065e60 msgr2=0x7f92a0068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:36.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.436+0000 7f92c2e0b640 1 --2- 172.21.15.12:0/1540409010 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f92a0065e60 0x7f92a0068320 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f92b0009b60 tx=0x7f92b0009190 comp rx=0 tx=0).stop 2023-10-16T23:28:36.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.436+0000 7f92c2e0b640 1 -- 172.21.15.12:0/1540409010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92bc14c520 msgr2=0x7f92bc0b71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:36.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.436+0000 7f92c2e0b640 1 --2- 172.21.15.12:0/1540409010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92bc14c520 0x7f92bc0b71f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f92b401a520 tx=0x7f92b4019690 comp rx=0 tx=0).stop 2023-10-16T23:28:36.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.436+0000 7f92c2e0b640 1 -- 172.21.15.12:0/1540409010 shutdown_connections 2023-10-16T23:28:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.436+0000 7f92c2e0b640 1 --2- 172.21.15.12:0/1540409010 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f92a0065e60 0x7f92a0068320 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.436+0000 7f92c2e0b640 1 --2- 172.21.15.12:0/1540409010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92bc14c520 0x7f92bc0b71f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.436+0000 7f92c2e0b640 1 --2- 172.21.15.12:0/1540409010 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f92bc0c1130 0x7f92bc0b6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.436+0000 7f92c2e0b640 1 --2- 172.21.15.12:0/1540409010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92bc0b9f40 0x7f92bc148c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.436+0000 7f92c2e0b640 1 -- 172.21.15.12:0/1540409010 >> 172.21.15.12:0/1540409010 conn(0x7f92bc06ba20 msgr2=0x7f92bc14c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:36.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.436+0000 7f92c2e0b640 1 -- 172.21.15.12:0/1540409010 shutdown_connections 2023-10-16T23:28:36.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.436+0000 7f92c2e0b640 1 -- 172.21.15.12:0/1540409010 wait complete. 2023-10-16T23:28:36.456 INFO:tasks.ceph:Scrubbing osd.1 2023-10-16T23:28:36.456 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-16T23:28:36.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.580+0000 7fd768ce2640 1 Processor -- start 2023-10-16T23:28:36.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.580+0000 7fd768ce2640 1 -- start start 2023-10-16T23:28:36.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.580+0000 7fd768ce2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd7640bca10 0x7fd76414f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.580+0000 7fd768ce2640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd7640b9980 0x7fd76414fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.580+0000 7fd768ce2640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7640ba670 con 0x7fd7640bb010 2023-10-16T23:28:36.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.580+0000 7fd768ce2640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7640b7df0 con 0x7fd7640bca10 2023-10-16T23:28:36.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.580+0000 7fd768ce2640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7640ba3d0 con 0x7fd7640b9980 2023-10-16T23:28:36.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.580+0000 7fd76259c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd7640bca10 0x7fd76414f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.580+0000 7fd76259c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd7640bca10 0x7fd76414f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36444/0 (socket says 172.21.15.12:36444) 2023-10-16T23:28:36.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.580+0000 7fd76259c640 1 -- 172.21.15.12:0/4188960023 learned_addr learned my addr 172.21.15.12:0/4188960023 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:36.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.584+0000 7fd761d9b640 1 --2- 172.21.15.12:0/4188960023 >> v2:172.21.15.31:3300/0 conn(0x7fd7640b9980 0x7fd76414fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.584+0000 7fd76259c640 1 -- 172.21.15.12:0/4188960023 >> v2:172.21.15.31:3300/0 conn(0x7fd7640b9980 msgr2=0x7fd76414fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:36.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.584+0000 7fd76259c640 1 --2- 172.21.15.12:0/4188960023 >> v2:172.21.15.31:3300/0 conn(0x7fd7640b9980 0x7fd76414fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.584+0000 7fd76259c640 1 -- 172.21.15.12:0/4188960023 >> v1:172.21.15.31:6789/0 conn(0x7fd7640bb010 legacy=0x7fd76414b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:36.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.584+0000 7fd76259c640 1 -- 172.21.15.12:0/4188960023 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7640b9e10 con 0x7fd7640bca10 2023-10-16T23:28:36.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.584+0000 7fd76259c640 1 --2- 172.21.15.12:0/4188960023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7640bca10 0x7fd76414f850 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd75400bb10 tx=0x7fd75401ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2578621b6f3a47d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:36.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.584+0000 7fd76159a640 1 -- 172.21.15.12:0/4188960023 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7540a7840 con 0x7fd7640bca10 2023-10-16T23:28:36.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.584+0000 7fd76159a640 1 -- 172.21.15.12:0/4188960023 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7540a79a0 con 0x7fd7640bca10 2023-10-16T23:28:36.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.584+0000 7fd76159a640 1 -- 172.21.15.12:0/4188960023 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7540a7d30 con 0x7fd7640bca10 2023-10-16T23:28:36.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.584+0000 7fd768ce2640 1 -- 172.21.15.12:0/4188960023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7640bca10 msgr2=0x7fd76414f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:36.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.584+0000 7fd768ce2640 1 --2- 172.21.15.12:0/4188960023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7640bca10 0x7fd76414f850 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd75400bb10 tx=0x7fd75401ea70 comp rx=0 tx=0).stop 2023-10-16T23:28:36.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.584+0000 7fd768ce2640 1 -- 172.21.15.12:0/4188960023 shutdown_connections 2023-10-16T23:28:36.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.584+0000 7fd768ce2640 1 --2- 172.21.15.12:0/4188960023 >> v2:172.21.15.31:3300/0 conn(0x7fd7640b9980 0x7fd76414fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.584+0000 7fd768ce2640 1 --2- 172.21.15.12:0/4188960023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7640bca10 0x7fd76414f850 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.584+0000 7fd768ce2640 1 -- 172.21.15.12:0/4188960023 >> 172.21.15.12:0/4188960023 conn(0x7fd7640bd240 msgr2=0x7fd7640bd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:36.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.584+0000 7fd768ce2640 1 -- 172.21.15.12:0/4188960023 shutdown_connections 2023-10-16T23:28:36.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.584+0000 7fd768ce2640 1 -- 172.21.15.12:0/4188960023 wait complete. 2023-10-16T23:28:36.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd768ce2640 1 Processor -- start 2023-10-16T23:28:36.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd768ce2640 1 -- start start 2023-10-16T23:28:36.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd768ce2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7640bb010 0x7fd764156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd768ce2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7640bca10 0x7fd76414a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd768ce2640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7641566d0 0x7fd76414ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd768ce2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76414cd90 con 0x7fd7640bb010 2023-10-16T23:28:36.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd768ce2640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76414c010 con 0x7fd7640bca10 2023-10-16T23:28:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd768ce2640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76414c2f0 con 0x7fd7641566d0 2023-10-16T23:28:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd76259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7640bb010 0x7fd764156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd76259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7640bb010 0x7fd764156190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36452/0 (socket says 172.21.15.12:36452) 2023-10-16T23:28:36.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd76259c640 1 -- 172.21.15.12:0/760974108 learned_addr learned my addr 172.21.15.12:0/760974108 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:36.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd761d9b640 1 --2- 172.21.15.12:0/760974108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7640bca10 0x7fd76414a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd762d9d640 1 --2- 172.21.15.12:0/760974108 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7641566d0 0x7fd76414ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd76259c640 1 -- 172.21.15.12:0/760974108 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7641566d0 msgr2=0x7fd76414ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd76259c640 1 --2- 172.21.15.12:0/760974108 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7641566d0 0x7fd76414ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd76259c640 1 -- 172.21.15.12:0/760974108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7640bca10 msgr2=0x7fd76414a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd76259c640 1 --2- 172.21.15.12:0/760974108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7640bca10 0x7fd76414a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd76259c640 1 -- 172.21.15.12:0/760974108 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75400b770 con 0x7fd7640bb010 2023-10-16T23:28:36.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd76259c640 1 --2- 172.21.15.12:0/760974108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7640bb010 0x7fd764156190 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd75400b2c0 tx=0x7fd75401b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:36.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd75affd640 1 -- 172.21.15.12:0/760974108 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7540af850 con 0x7fd7640bb010 2023-10-16T23:28:36.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd75affd640 1 -- 172.21.15.12:0/760974108 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7540af9b0 con 0x7fd7640bb010 2023-10-16T23:28:36.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd768ce2640 1 -- 172.21.15.12:0/760974108 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7640b38f0 con 0x7fd7640bb010 2023-10-16T23:28:36.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd75affd640 1 -- 172.21.15.12:0/760974108 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7540afd60 con 0x7fd7640bb010 2023-10-16T23:28:36.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd768ce2640 1 -- 172.21.15.12:0/760974108 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76414b310 con 0x7fd7640bb010 2023-10-16T23:28:36.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd768ce2640 1 -- 172.21.15.12:0/760974108 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7641506e0 con 0x7fd7640bb010 2023-10-16T23:28:36.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd75affd640 1 -- 172.21.15.12:0/760974108 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fd7540b6040 con 0x7fd7640bb010 2023-10-16T23:28:36.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.588+0000 7fd75affd640 1 --2- 172.21.15.12:0/760974108 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd744065e90 0x7fd744068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.592+0000 7fd75affd640 1 -- 172.21.15.12:0/760974108 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd754120720 con 0x7fd7640bb010 2023-10-16T23:28:36.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.592+0000 7fd75affd640 1 --2- 172.21.15.12:0/760974108 >> [v2:172.21.15.12:6808/38076,v1:172.21.15.12:6811/38076] conn(0x7fd74406e790 0x7fd744070bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.592+0000 7fd75affd640 1 -- 172.21.15.12:0/760974108 --> [v2:172.21.15.12:6808/38076,v1:172.21.15.12:6811/38076] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd7440712a0 con 0x7fd74406e790 2023-10-16T23:28:36.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.592+0000 7fd75affd640 1 -- 172.21.15.12:0/760974108 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd754120b70 con 0x7fd7640bb010 2023-10-16T23:28:36.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.592+0000 7fd761d9b640 1 --2- 172.21.15.12:0/760974108 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd744065e90 0x7fd744068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.592+0000 7fd762d9d640 1 --2- 172.21.15.12:0/760974108 >> [v2:172.21.15.12:6808/38076,v1:172.21.15.12:6811/38076] conn(0x7fd74406e790 0x7fd744070bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.592+0000 7fd762d9d640 1 --2- 172.21.15.12:0/760974108 >> [v2:172.21.15.12:6808/38076,v1:172.21.15.12:6811/38076] conn(0x7fd74406e790 0x7fd744070bd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:36.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.592+0000 7fd761d9b640 1 --2- 172.21.15.12:0/760974108 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd744065e90 0x7fd744068350 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd764150c00 tx=0x7fd74c00b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:36.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.592+0000 7fd75affd640 1 -- 172.21.15.12:0/760974108 <== osd.1 v2:172.21.15.12:6808/38076 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd7440712a0 con 0x7fd74406e790 2023-10-16T23:28:36.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.604+0000 7fd768ce2640 1 -- 172.21.15.12:0/760974108 --> [v2:172.21.15.12:6808/38076,v1:172.21.15.12:6811/38076] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd76414c150 con 0x7fd74406e790 2023-10-16T23:28:36.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.604+0000 7fd75affd640 1 -- 172.21.15.12:0/760974108 <== osd.1 v2:172.21.15.12:6808/38076 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd75c0050f0 con 0x7fd74406e790 2023-10-16T23:28:36.608 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-16T23:28:36.609 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T23:28:36.609 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-16T23:28:36.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.604+0000 7fd768ce2640 1 -- 172.21.15.12:0/760974108 >> [v2:172.21.15.12:6808/38076,v1:172.21.15.12:6811/38076] conn(0x7fd74406e790 msgr2=0x7fd744070bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:36.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.604+0000 7fd768ce2640 1 --2- 172.21.15.12:0/760974108 >> [v2:172.21.15.12:6808/38076,v1:172.21.15.12:6811/38076] conn(0x7fd74406e790 0x7fd744070bd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.604+0000 7fd768ce2640 1 -- 172.21.15.12:0/760974108 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd744065e90 msgr2=0x7fd744068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:36.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.604+0000 7fd768ce2640 1 --2- 172.21.15.12:0/760974108 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd744065e90 0x7fd744068350 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd764150c00 tx=0x7fd74c00b040 comp rx=0 tx=0).stop 2023-10-16T23:28:36.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.604+0000 7fd768ce2640 1 -- 172.21.15.12:0/760974108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7640bb010 msgr2=0x7fd764156190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:36.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.604+0000 7fd768ce2640 1 --2- 172.21.15.12:0/760974108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7640bb010 0x7fd764156190 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd75400b2c0 tx=0x7fd75401b810 comp rx=0 tx=0).stop 2023-10-16T23:28:36.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.604+0000 7fd762d9d640 1 -- 172.21.15.12:0/760974108 reap_dead start 2023-10-16T23:28:36.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.604+0000 7fd768ce2640 1 -- 172.21.15.12:0/760974108 shutdown_connections 2023-10-16T23:28:36.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.604+0000 7fd768ce2640 1 -- 172.21.15.12:0/760974108 >> 172.21.15.12:0/760974108 conn(0x7fd7640bd240 msgr2=0x7fd7640be6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:36.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.604+0000 7fd768ce2640 1 -- 172.21.15.12:0/760974108 shutdown_connections 2023-10-16T23:28:36.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.604+0000 7fd768ce2640 1 -- 172.21.15.12:0/760974108 wait complete. 2023-10-16T23:28:36.623 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-16T23:28:36.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.732+0000 7f1cd53b7640 1 Processor -- start 2023-10-16T23:28:36.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.732+0000 7f1cd53b7640 1 -- start start 2023-10-16T23:28:36.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1cd53b7640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cd00a85e0 0x7f1cd00b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1cd53b7640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd00a7470 con 0x7f1cd00b9290 2023-10-16T23:28:36.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1cd53b7640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd014d750 con 0x7f1cd00bf740 2023-10-16T23:28:36.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1cd53b7640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd00b9980 con 0x7f1cd00a85e0 2023-10-16T23:28:36.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1ccf7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1cd00b9290 0x7f1cd0136080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48592/0 (socket says 172.21.15.12:48592) 2023-10-16T23:28:36.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1ccf7fe640 1 -- 172.21.15.12:0/4149950575 learned_addr learned my addr 172.21.15.12:0/4149950575 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:36.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1cce7fc640 1 --2- 172.21.15.12:0/4149950575 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cd00a85e0 0x7f1cd00b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1ccdffb640 1 -- 172.21.15.12:0/4149950575 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3297387138 0 0) 0x7f1cd00a7470 con 0x7f1cd00b9290 2023-10-16T23:28:36.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1ccdffb640 1 -- 172.21.15.12:0/4149950575 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cbc003530 con 0x7f1cd00b9290 2023-10-16T23:28:36.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1ccdffb640 1 -- 172.21.15.12:0/4149950575 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 639352947 0 0) 0x7f1cbc003530 con 0x7f1cd00b9290 2023-10-16T23:28:36.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1ccdffb640 1 -- 172.21.15.12:0/4149950575 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cd00a85e0 msgr2=0x7f1cd00b7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:36.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1ccdffb640 1 --2- 172.21.15.12:0/4149950575 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cd00a85e0 0x7f1cd00b7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1ccdffb640 1 -- 172.21.15.12:0/4149950575 >> v1:172.21.15.31:6789/0 conn(0x7f1cd00bf740 legacy=0x7f1cd014dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:36.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1ccdffb640 1 -- 172.21.15.12:0/4149950575 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd00b7ff0 con 0x7f1cd00b9290 2023-10-16T23:28:36.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1ccdffb640 1 -- 172.21.15.12:0/4149950575 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7f1cc8001a00 con 0x7f1cd00b9290 2023-10-16T23:28:36.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1cce7fc640 1 --2- 172.21.15.12:0/4149950575 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cd00a85e0 0x7f1cd00b7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T23:28:36.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1ccdffb640 1 -- 172.21.15.12:0/4149950575 >> v1:172.21.15.12:6789/0 conn(0x7f1cd00b9290 legacy=0x7f1cd0136080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:36.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1ccdffb640 1 --2- 172.21.15.12:0/4149950575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cbc0039b0 0x7f1cbc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1ccdffb640 1 --2- 172.21.15.12:0/4149950575 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cd00a85e0 0x7f1cbc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1ccdffb640 1 --2- 172.21.15.12:0/4149950575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cbc004d10 0x7f1cbc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1ccdffb640 1 -- 172.21.15.12:0/4149950575 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc00b990 con 0x7f1cbc004d10 2023-10-16T23:28:36.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1ccdffb640 1 -- 172.21.15.12:0/4149950575 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc00bad0 con 0x7f1cbc0039b0 2023-10-16T23:28:36.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1ccdffb640 1 -- 172.21.15.12:0/4149950575 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc00bc40 con 0x7f1cd00a85e0 2023-10-16T23:28:36.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1ccf7fe640 1 --2- 172.21.15.12:0/4149950575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cbc004d10 0x7f1cbc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1cce7fc640 1 --2- 172.21.15.12:0/4149950575 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cd00a85e0 0x7f1cbc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1cceffd640 1 --2- 172.21.15.12:0/4149950575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cbc0039b0 0x7f1cbc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1ccf7fe640 1 -- 172.21.15.12:0/4149950575 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cd00a85e0 msgr2=0x7f1cbc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:36.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1ccf7fe640 1 --2- 172.21.15.12:0/4149950575 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cd00a85e0 0x7f1cbc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1ccf7fe640 1 -- 172.21.15.12:0/4149950575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cbc0039b0 msgr2=0x7f1cbc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:36.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1ccf7fe640 1 --2- 172.21.15.12:0/4149950575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cbc0039b0 0x7f1cbc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.736+0000 7f1ccf7fe640 1 -- 172.21.15.12:0/4149950575 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb8009420 con 0x7f1cbc004d10 2023-10-16T23:28:36.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1ccf7fe640 1 --2- 172.21.15.12:0/4149950575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cbc004d10 0x7f1cbc005190 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800a840 tx=0x7f1cc801fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92ea0d503cadb6c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:36.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1ccdffb640 1 -- 172.21.15.12:0/4149950575 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc80aa6b0 con 0x7f1cbc004d10 2023-10-16T23:28:36.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1ccdffb640 1 -- 172.21.15.12:0/4149950575 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc80aa810 con 0x7f1cbc004d10 2023-10-16T23:28:36.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1ccdffb640 1 -- 172.21.15.12:0/4149950575 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc80aabc0 con 0x7f1cbc004d10 2023-10-16T23:28:36.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cd53b7640 1 -- 172.21.15.12:0/4149950575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cbc004d10 msgr2=0x7f1cbc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:36.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cd53b7640 1 --2- 172.21.15.12:0/4149950575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cbc004d10 0x7f1cbc005190 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1cc800a840 tx=0x7f1cc801fa80 comp rx=0 tx=0).stop 2023-10-16T23:28:36.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1ccf7fe640 1 -- 172.21.15.12:0/4149950575 reap_dead start 2023-10-16T23:28:36.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cd53b7640 1 -- 172.21.15.12:0/4149950575 shutdown_connections 2023-10-16T23:28:36.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cd53b7640 1 -- 172.21.15.12:0/4149950575 >> 172.21.15.12:0/4149950575 conn(0x7f1cd00c2b50 msgr2=0x7f1cd00c2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:36.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cd53b7640 1 -- 172.21.15.12:0/4149950575 shutdown_connections 2023-10-16T23:28:36.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cd53b7640 1 -- 172.21.15.12:0/4149950575 wait complete. 2023-10-16T23:28:36.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cd53b7640 1 Processor -- start 2023-10-16T23:28:36.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cd53b7640 1 -- start start 2023-10-16T23:28:36.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cd53b7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cbc004d10 0x7f1cd01e2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cd53b7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cd00701f0 0x7f1cd01d7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cd53b7640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cd01d7da0 0x7f1cd006e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cd53b7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd01e7ad0 con 0x7f1cbc004d10 2023-10-16T23:28:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cd53b7640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd00bd170 con 0x7f1cd00701f0 2023-10-16T23:28:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cd53b7640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd00bce00 con 0x7f1cd01d7da0 2023-10-16T23:28:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cceffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cbc004d10 0x7f1cd01e2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cceffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cbc004d10 0x7f1cd01e2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36484/0 (socket says 172.21.15.12:36484) 2023-10-16T23:28:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cceffd640 1 -- 172.21.15.12:0/814655574 learned_addr learned my addr 172.21.15.12:0/814655574 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cce7fc640 1 --2- 172.21.15.12:0/814655574 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cd00701f0 0x7f1cd01d7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1ccf7fe640 1 --2- 172.21.15.12:0/814655574 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cd01d7da0 0x7f1cd006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cceffd640 1 -- 172.21.15.12:0/814655574 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cd01d7da0 msgr2=0x7f1cd006e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:36.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cceffd640 1 --2- 172.21.15.12:0/814655574 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cd01d7da0 0x7f1cd006e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cceffd640 1 -- 172.21.15.12:0/814655574 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cd00701f0 msgr2=0x7f1cd01d7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:36.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cceffd640 1 --2- 172.21.15.12:0/814655574 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cd00701f0 0x7f1cd01d7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cceffd640 1 -- 172.21.15.12:0/814655574 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd014aea0 con 0x7f1cbc004d10 2023-10-16T23:28:36.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cce7fc640 1 --2- 172.21.15.12:0/814655574 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cd00701f0 0x7f1cd01d7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:36.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cceffd640 1 --2- 172.21.15.12:0/814655574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cbc004d10 0x7f1cd01e2cc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1cc000e580 tx=0x7f1cc000ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:36.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cc77fe640 1 -- 172.21.15.12:0/814655574 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc00052e0 con 0x7f1cbc004d10 2023-10-16T23:28:36.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cc77fe640 1 -- 172.21.15.12:0/814655574 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc0005440 con 0x7f1cbc004d10 2023-10-16T23:28:36.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.740+0000 7f1cc77fe640 1 -- 172.21.15.12:0/814655574 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc0003840 con 0x7f1cbc004d10 2023-10-16T23:28:36.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.744+0000 7f1cd53b7640 1 -- 172.21.15.12:0/814655574 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd01e3200 con 0x7f1cbc004d10 2023-10-16T23:28:36.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.744+0000 7f1cd53b7640 1 -- 172.21.15.12:0/814655574 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd01e7730 con 0x7f1cbc004d10 2023-10-16T23:28:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.744+0000 7f1cd53b7640 1 -- 172.21.15.12:0/814655574 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd014b030 con 0x7f1cbc004d10 2023-10-16T23:28:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.744+0000 7f1cc77fe640 1 -- 172.21.15.12:0/814655574 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f1cc00039a0 con 0x7f1cbc004d10 2023-10-16T23:28:36.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.744+0000 7f1cc77fe640 1 --2- 172.21.15.12:0/814655574 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1cb0065e90 0x7f1cb0068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:36.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.744+0000 7f1cc77fe640 1 -- 172.21.15.12:0/814655574 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1cc0083710 con 0x7f1cbc004d10 2023-10-16T23:28:36.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.744+0000 7f1cce7fc640 1 --2- 172.21.15.12:0/814655574 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1cb0065e90 0x7f1cb0068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:36.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.744+0000 7f1cce7fc640 1 --2- 172.21.15.12:0/814655574 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1cb0065e90 0x7f1cb0068350 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0132b20 tx=0x7f1cb8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:36.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.748+0000 7f1cc77fe640 1 -- 172.21.15.12:0/814655574 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f1cd014b030 con 0x7f1cbc004d10 2023-10-16T23:28:36.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.896+0000 7f1cd53b7640 1 -- 172.21.15.12:0/814655574 --> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f1cd01e7950 con 0x7f1cb0065e90 2023-10-16T23:28:36.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.900+0000 7f1cc77fe640 1 -- 172.21.15.12:0/814655574 <== mgr.4108 v2:172.21.15.31:6832/37949 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1cb8012ab0 con 0x7f1cb0065e90 2023-10-16T23:28:36.902 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 1 to deep-scrub 2023-10-16T23:28:36.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.900+0000 7f1cd53b7640 1 -- 172.21.15.12:0/814655574 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1cb0065e90 msgr2=0x7f1cb0068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:36.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.900+0000 7f1cd53b7640 1 --2- 172.21.15.12:0/814655574 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1cb0065e90 0x7f1cb0068350 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0132b20 tx=0x7f1cb8008040 comp rx=0 tx=0).stop 2023-10-16T23:28:36.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.900+0000 7f1cd53b7640 1 -- 172.21.15.12:0/814655574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cbc004d10 msgr2=0x7f1cd01e2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:36.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.900+0000 7f1cd53b7640 1 --2- 172.21.15.12:0/814655574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cbc004d10 0x7f1cd01e2cc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1cc000e580 tx=0x7f1cc000ea40 comp rx=0 tx=0).stop 2023-10-16T23:28:36.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.900+0000 7f1cd53b7640 1 -- 172.21.15.12:0/814655574 shutdown_connections 2023-10-16T23:28:36.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.900+0000 7f1cd53b7640 1 --2- 172.21.15.12:0/814655574 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1cb0065e90 0x7f1cb0068350 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.900+0000 7f1cd53b7640 1 --2- 172.21.15.12:0/814655574 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cd01d7da0 0x7f1cd006e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.900+0000 7f1cd53b7640 1 --2- 172.21.15.12:0/814655574 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cd00701f0 0x7f1cd01d7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.900+0000 7f1cd53b7640 1 --2- 172.21.15.12:0/814655574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1cbc004d10 0x7f1cd01e2cc0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:36.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.900+0000 7f1cd53b7640 1 -- 172.21.15.12:0/814655574 >> 172.21.15.12:0/814655574 conn(0x7f1cd00c2b50 msgr2=0x7f1cd014c730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:36.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.900+0000 7f1cd53b7640 1 -- 172.21.15.12:0/814655574 shutdown_connections 2023-10-16T23:28:36.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:36.900+0000 7f1cd53b7640 1 -- 172.21.15.12:0/814655574 wait complete. 2023-10-16T23:28:36.919 INFO:tasks.ceph:Scrubbing osd.2 2023-10-16T23:28:36.919 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-16T23:28:37.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.032+0000 7f33c5105640 1 Processor -- start 2023-10-16T23:28:37.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.032+0000 7f33c5105640 1 -- start start 2023-10-16T23:28:37.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.032+0000 7f33c5105640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f33c014d1f0 0x7f33c00b7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.032+0000 7f33c5105640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f33c014e170 0x7f33c00b6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.032+0000 7f33c5105640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c00b5ee0 con 0x7f33c00bf210 2023-10-16T23:28:37.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.032+0000 7f33c5105640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c00b6130 con 0x7f33c014e170 2023-10-16T23:28:37.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.032+0000 7f33c5105640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c00b6410 con 0x7f33c014d1f0 2023-10-16T23:28:37.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.032+0000 7f33bf59e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f33c014e170 0x7f33c00b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.032+0000 7f33bed9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f33c00bf210 0x7f33c00bf5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48598/0 (socket says 172.21.15.12:48598) 2023-10-16T23:28:37.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.032+0000 7f33bed9d640 1 -- 172.21.15.12:0/2035268078 learned_addr learned my addr 172.21.15.12:0/2035268078 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:37.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.032+0000 7f33b659c640 1 --2- 172.21.15.12:0/2035268078 >> v2:172.21.15.31:3300/0 conn(0x7f33c014d1f0 0x7f33c00b7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.032+0000 7f33bf59e640 1 -- 172.21.15.12:0/2035268078 >> v2:172.21.15.31:3300/0 conn(0x7f33c014d1f0 msgr2=0x7f33c00b7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:37.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.032+0000 7f33bf59e640 1 --2- 172.21.15.12:0/2035268078 >> v2:172.21.15.31:3300/0 conn(0x7f33c014d1f0 0x7f33c00b7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.032+0000 7f33bf59e640 1 -- 172.21.15.12:0/2035268078 >> v1:172.21.15.12:6789/0 conn(0x7f33c00bf210 legacy=0x7f33c00bf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.032+0000 7f33bf59e640 1 -- 172.21.15.12:0/2035268078 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c00b6e70 con 0x7f33c014e170 2023-10-16T23:28:37.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.032+0000 7f33be59c640 1 -- 172.21.15.12:0/2035268078 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083784661 0 0) 0x7f33c00b5ee0 con 0x7f33c00bf210 2023-10-16T23:28:37.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.036+0000 7f33bf59e640 1 --2- 172.21.15.12:0/2035268078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33c014e170 0x7f33c00b6930 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f33c00bfd30 tx=0x7f33b801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4bc2aa5285e03d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:37.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.036+0000 7f33be59c640 1 -- 172.21.15.12:0/2035268078 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b80a5960 con 0x7f33c014e170 2023-10-16T23:28:37.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.036+0000 7f33be59c640 1 -- 172.21.15.12:0/2035268078 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b80a5ac0 con 0x7f33c014e170 2023-10-16T23:28:37.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.036+0000 7f33be59c640 1 -- 172.21.15.12:0/2035268078 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b80a5e50 con 0x7f33c014e170 2023-10-16T23:28:37.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.036+0000 7f33c5105640 1 -- 172.21.15.12:0/2035268078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33c014e170 msgr2=0x7f33c00b6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.036+0000 7f33c5105640 1 --2- 172.21.15.12:0/2035268078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33c014e170 0x7f33c00b6930 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f33c00bfd30 tx=0x7f33b801c880 comp rx=0 tx=0).stop 2023-10-16T23:28:37.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.036+0000 7f33c5105640 1 -- 172.21.15.12:0/2035268078 shutdown_connections 2023-10-16T23:28:37.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.036+0000 7f33c5105640 1 --2- 172.21.15.12:0/2035268078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33c014e170 0x7f33c00b6930 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.036+0000 7f33c5105640 1 --2- 172.21.15.12:0/2035268078 >> v2:172.21.15.31:3300/0 conn(0x7f33c014d1f0 0x7f33c00b7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.036+0000 7f33c5105640 1 -- 172.21.15.12:0/2035268078 >> 172.21.15.12:0/2035268078 conn(0x7f33c00c2960 msgr2=0x7f33c00c2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:37.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.036+0000 7f33c5105640 1 -- 172.21.15.12:0/2035268078 shutdown_connections 2023-10-16T23:28:37.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.036+0000 7f33c5105640 1 -- 172.21.15.12:0/2035268078 wait complete. 2023-10-16T23:28:37.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.036+0000 7f33c5105640 1 Processor -- start 2023-10-16T23:28:37.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.036+0000 7f33c5105640 1 -- start start 2023-10-16T23:28:37.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.036+0000 7f33c5105640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33c00bf210 0x7f33c006ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.036+0000 7f33c5105640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33c014d1f0 0x7f33c012c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.036+0000 7f33c5105640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33c014e170 0x7f33c012c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.036+0000 7f33c5105640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c0132e70 con 0x7f33c00bf210 2023-10-16T23:28:37.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.036+0000 7f33c5105640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c012cb80 con 0x7f33c014e170 2023-10-16T23:28:37.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.036+0000 7f33c5105640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c012ef10 con 0x7f33c014d1f0 2023-10-16T23:28:37.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.036+0000 7f33bed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33c00bf210 0x7f33c006ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.036+0000 7f33bed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33c00bf210 0x7f33c006ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36498/0 (socket says 172.21.15.12:36498) 2023-10-16T23:28:37.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.036+0000 7f33bed9d640 1 -- 172.21.15.12:0/2475315619 learned_addr learned my addr 172.21.15.12:0/2475315619 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:37.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.036+0000 7f33bf59e640 1 --2- 172.21.15.12:0/2475315619 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33c014e170 0x7f33c012c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.036+0000 7f33b659c640 1 --2- 172.21.15.12:0/2475315619 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33c014d1f0 0x7f33c012c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.036+0000 7f33bed9d640 1 -- 172.21.15.12:0/2475315619 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33c014d1f0 msgr2=0x7f33c012c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.040+0000 7f33bed9d640 1 --2- 172.21.15.12:0/2475315619 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f33c014d1f0 0x7f33c012c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.040+0000 7f33bed9d640 1 -- 172.21.15.12:0/2475315619 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33c014e170 msgr2=0x7f33c012c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.040+0000 7f33bed9d640 1 --2- 172.21.15.12:0/2475315619 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33c014e170 0x7f33c012c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.040+0000 7f33bed9d640 1 -- 172.21.15.12:0/2475315619 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b8009a70 con 0x7f33c00bf210 2023-10-16T23:28:37.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.040+0000 7f33bed9d640 1 --2- 172.21.15.12:0/2475315619 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33c00bf210 0x7f33c006ff70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f33b00011f0 tx=0x7f33b000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:37.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.040+0000 7f33b7fff640 1 -- 172.21.15.12:0/2475315619 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b00074e0 con 0x7f33c00bf210 2023-10-16T23:28:37.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.040+0000 7f33b7fff640 1 -- 172.21.15.12:0/2475315619 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b0007640 con 0x7f33c00bf210 2023-10-16T23:28:37.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.040+0000 7f33c5105640 1 -- 172.21.15.12:0/2475315619 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c00704b0 con 0x7f33c00bf210 2023-10-16T23:28:37.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.040+0000 7f33b7fff640 1 -- 172.21.15.12:0/2475315619 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b0004a10 con 0x7f33c00bf210 2023-10-16T23:28:37.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.040+0000 7f33c5105640 1 -- 172.21.15.12:0/2475315619 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c012f400 con 0x7f33c00bf210 2023-10-16T23:28:37.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.040+0000 7f33c5105640 1 -- 172.21.15.12:0/2475315619 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f33c0159bb0 con 0x7f33c00bf210 2023-10-16T23:28:37.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.040+0000 7f33b7fff640 1 -- 172.21.15.12:0/2475315619 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f33b0004b70 con 0x7f33c00bf210 2023-10-16T23:28:37.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.040+0000 7f33b7fff640 1 --2- 172.21.15.12:0/2475315619 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f33a0065e60 0x7f33a0068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.040+0000 7f33b7fff640 1 -- 172.21.15.12:0/2475315619 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f33b00829b0 con 0x7f33c00bf210 2023-10-16T23:28:37.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.040+0000 7f33b7fff640 1 --2- 172.21.15.12:0/2475315619 >> [v2:172.21.15.12:6809/38073,v1:172.21.15.12:6810/38073] conn(0x7f33a006e760 0x7f33a0070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.040+0000 7f33b7fff640 1 -- 172.21.15.12:0/2475315619 --> [v2:172.21.15.12:6809/38073,v1:172.21.15.12:6810/38073] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f33a0071270 con 0x7f33a006e760 2023-10-16T23:28:37.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.040+0000 7f33b7fff640 1 -- 172.21.15.12:0/2475315619 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33b00872c0 con 0x7f33c00bf210 2023-10-16T23:28:37.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.040+0000 7f33bf59e640 1 --2- 172.21.15.12:0/2475315619 >> [v2:172.21.15.12:6809/38073,v1:172.21.15.12:6810/38073] conn(0x7f33a006e760 0x7f33a0070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.040+0000 7f33b659c640 1 --2- 172.21.15.12:0/2475315619 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f33a0065e60 0x7f33a0068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.040+0000 7f33bf59e640 1 --2- 172.21.15.12:0/2475315619 >> [v2:172.21.15.12:6809/38073,v1:172.21.15.12:6810/38073] conn(0x7f33a006e760 0x7f33a0070ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:37.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.040+0000 7f33b659c640 1 --2- 172.21.15.12:0/2475315619 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f33a0065e60 0x7f33a0068320 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f33c012fea0 tx=0x7f33a8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:37.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.040+0000 7f33b7fff640 1 -- 172.21.15.12:0/2475315619 <== osd.2 v2:172.21.15.12:6809/38073 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f33a0071270 con 0x7f33a006e760 2023-10-16T23:28:37.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.052+0000 7f33c5105640 1 -- 172.21.15.12:0/2475315619 --> [v2:172.21.15.12:6809/38073,v1:172.21.15.12:6810/38073] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f33c00b7860 con 0x7f33a006e760 2023-10-16T23:28:37.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.052+0000 7f33b7fff640 1 -- 172.21.15.12:0/2475315619 <== osd.2 v2:172.21.15.12:6809/38073 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f33c00b7860 con 0x7f33a006e760 2023-10-16T23:28:37.061 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-16T23:28:37.062 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T23:28:37.062 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-16T23:28:37.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.052+0000 7f33c5105640 1 -- 172.21.15.12:0/2475315619 >> [v2:172.21.15.12:6809/38073,v1:172.21.15.12:6810/38073] conn(0x7f33a006e760 msgr2=0x7f33a0070ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.052+0000 7f33c5105640 1 --2- 172.21.15.12:0/2475315619 >> [v2:172.21.15.12:6809/38073,v1:172.21.15.12:6810/38073] conn(0x7f33a006e760 0x7f33a0070ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.052+0000 7f33c5105640 1 -- 172.21.15.12:0/2475315619 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f33a0065e60 msgr2=0x7f33a0068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.052+0000 7f33c5105640 1 --2- 172.21.15.12:0/2475315619 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f33a0065e60 0x7f33a0068320 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f33c012fea0 tx=0x7f33a8008040 comp rx=0 tx=0).stop 2023-10-16T23:28:37.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.052+0000 7f33c5105640 1 -- 172.21.15.12:0/2475315619 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33c00bf210 msgr2=0x7f33c006ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.052+0000 7f33c5105640 1 --2- 172.21.15.12:0/2475315619 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33c00bf210 0x7f33c006ff70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f33b00011f0 tx=0x7f33b000c9b0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.052+0000 7f33bf59e640 1 -- 172.21.15.12:0/2475315619 reap_dead start 2023-10-16T23:28:37.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.056+0000 7f33c5105640 1 -- 172.21.15.12:0/2475315619 shutdown_connections 2023-10-16T23:28:37.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.056+0000 7f33c5105640 1 -- 172.21.15.12:0/2475315619 >> 172.21.15.12:0/2475315619 conn(0x7f33c00c2960 msgr2=0x7f33c00c1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:37.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.056+0000 7f33c5105640 1 -- 172.21.15.12:0/2475315619 shutdown_connections 2023-10-16T23:28:37.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.056+0000 7f33c5105640 1 -- 172.21.15.12:0/2475315619 wait complete. 2023-10-16T23:28:37.072 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-16T23:28:37.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.172+0000 7fb9b06e8640 1 Processor -- start 2023-10-16T23:28:37.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.172+0000 7fb9b06e8640 1 -- start start 2023-10-16T23:28:37.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.172+0000 7fb9b06e8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb9a80bd9b0 0x7fb9a80bdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.172+0000 7fb9b06e8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb9a81458b0 0x7fb9a814b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.172+0000 7fb9b06e8640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a80709f0 con 0x7fb9a80710c0 2023-10-16T23:28:37.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.172+0000 7fb9b06e8640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9a80be2d0 con 0x7fb9a80bd9b0 2023-10-16T23:28:37.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.172+0000 7fb9b06e8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9a8070710 con 0x7fb9a81458b0 2023-10-16T23:28:37.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.172+0000 7fb9ae484640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb9a80bd9b0 0x7fb9a80bdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.172+0000 7fb9adc83640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb9a80710c0 0x7fb9a81451a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48608/0 (socket says 172.21.15.12:48608) 2023-10-16T23:28:37.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.172+0000 7fb9adc83640 1 -- 172.21.15.12:0/3346650590 learned_addr learned my addr 172.21.15.12:0/3346650590 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:37.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.172+0000 7fb9aec85640 1 --2- 172.21.15.12:0/3346650590 >> v2:172.21.15.31:3300/0 conn(0x7fb9a81458b0 0x7fb9a814b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.172+0000 7fb9ae484640 1 -- 172.21.15.12:0/3346650590 >> v2:172.21.15.31:3300/0 conn(0x7fb9a81458b0 msgr2=0x7fb9a814b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:37.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.172+0000 7fb9ae484640 1 --2- 172.21.15.12:0/3346650590 >> v2:172.21.15.31:3300/0 conn(0x7fb9a81458b0 0x7fb9a814b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.172+0000 7fb9ae484640 1 -- 172.21.15.12:0/3346650590 >> v1:172.21.15.12:6789/0 conn(0x7fb9a80710c0 legacy=0x7fb9a81451a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.172+0000 7fb9ae484640 1 -- 172.21.15.12:0/3346650590 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a814f6e0 con 0x7fb9a80bd9b0 2023-10-16T23:28:37.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.172+0000 7fb9aec85640 1 --2- 172.21.15.12:0/3346650590 >> v2:172.21.15.31:3300/0 conn(0x7fb9a81458b0 0x7fb9a814b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:37.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.176+0000 7fb9ae484640 1 --2- 172.21.15.12:0/3346650590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9a80bd9b0 0x7fb9a80bdd90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb9a806aa80 tx=0x7fb9a001d2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49138e24219c381 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:37.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.176+0000 7fb9ad482640 1 -- 172.21.15.12:0/3346650590 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a00a57a0 con 0x7fb9a80bd9b0 2023-10-16T23:28:37.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.176+0000 7fb9ad482640 1 -- 172.21.15.12:0/3346650590 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a00a5900 con 0x7fb9a80bd9b0 2023-10-16T23:28:37.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.176+0000 7fb9ad482640 1 -- 172.21.15.12:0/3346650590 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a00a5c90 con 0x7fb9a80bd9b0 2023-10-16T23:28:37.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.176+0000 7fb9b06e8640 1 -- 172.21.15.12:0/3346650590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9a80bd9b0 msgr2=0x7fb9a80bdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.176+0000 7fb9b06e8640 1 --2- 172.21.15.12:0/3346650590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9a80bd9b0 0x7fb9a80bdd90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb9a806aa80 tx=0x7fb9a001d2b0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.176+0000 7fb9b06e8640 1 -- 172.21.15.12:0/3346650590 shutdown_connections 2023-10-16T23:28:37.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.176+0000 7fb9b06e8640 1 --2- 172.21.15.12:0/3346650590 >> v2:172.21.15.31:3300/0 conn(0x7fb9a81458b0 0x7fb9a814b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.176+0000 7fb9b06e8640 1 --2- 172.21.15.12:0/3346650590 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9a80bd9b0 0x7fb9a80bdd90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.176+0000 7fb9b06e8640 1 -- 172.21.15.12:0/3346650590 >> 172.21.15.12:0/3346650590 conn(0x7fb9a8069d30 msgr2=0x7fb9a806a140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:37.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.176+0000 7fb9b06e8640 1 -- 172.21.15.12:0/3346650590 shutdown_connections 2023-10-16T23:28:37.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.176+0000 7fb9b06e8640 1 -- 172.21.15.12:0/3346650590 wait complete. 2023-10-16T23:28:37.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.176+0000 7fb9b06e8640 1 Processor -- start 2023-10-16T23:28:37.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.176+0000 7fb9b06e8640 1 -- start start 2023-10-16T23:28:37.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.176+0000 7fb9b06e8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9a80710c0 0x7fb9a813ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.176+0000 7fb9b06e8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9a80bd9b0 0x7fb9a81ea8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.176+0000 7fb9b06e8640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9a81458b0 0x7fb9a81eae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.176+0000 7fb9b06e8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a813bfa0 con 0x7fb9a80bd9b0 2023-10-16T23:28:37.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.176+0000 7fb9b06e8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a813b560 con 0x7fb9a80710c0 2023-10-16T23:28:37.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.176+0000 7fb9b06e8640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a813bab0 con 0x7fb9a81458b0 2023-10-16T23:28:37.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.176+0000 7fb9adc83640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9a80bd9b0 0x7fb9a81ea8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.176+0000 7fb9adc83640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9a80bd9b0 0x7fb9a81ea8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36512/0 (socket says 172.21.15.12:36512) 2023-10-16T23:28:37.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.176+0000 7fb9adc83640 1 -- 172.21.15.12:0/1479048302 learned_addr learned my addr 172.21.15.12:0/1479048302 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:37.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.180+0000 7fb9aec85640 1 --2- 172.21.15.12:0/1479048302 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9a81458b0 0x7fb9a81eae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.180+0000 7fb9ae484640 1 --2- 172.21.15.12:0/1479048302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9a80710c0 0x7fb9a813ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.180+0000 7fb9adc83640 1 -- 172.21.15.12:0/1479048302 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9a81458b0 msgr2=0x7fb9a81eae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.180+0000 7fb9adc83640 1 --2- 172.21.15.12:0/1479048302 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9a81458b0 0x7fb9a81eae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.180+0000 7fb9adc83640 1 -- 172.21.15.12:0/1479048302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9a80710c0 msgr2=0x7fb9a813ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.180+0000 7fb9adc83640 1 --2- 172.21.15.12:0/1479048302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9a80710c0 0x7fb9a813ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.180+0000 7fb9adc83640 1 -- 172.21.15.12:0/1479048302 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a0009a70 con 0x7fb9a80bd9b0 2023-10-16T23:28:37.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.180+0000 7fb9aec85640 1 --2- 172.21.15.12:0/1479048302 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9a81458b0 0x7fb9a81eae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:37.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.180+0000 7fb9adc83640 1 --2- 172.21.15.12:0/1479048302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9a80bd9b0 0x7fb9a81ea8c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb99800c530 tx=0x7fb99800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:37.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.180+0000 7fb99effd640 1 -- 172.21.15.12:0/1479048302 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb998005cf0 con 0x7fb9a80bd9b0 2023-10-16T23:28:37.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.180+0000 7fb99effd640 1 -- 172.21.15.12:0/1479048302 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb998005e50 con 0x7fb9a80bd9b0 2023-10-16T23:28:37.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.180+0000 7fb9b06e8640 1 -- 172.21.15.12:0/1479048302 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a80bf200 con 0x7fb9a80bd9b0 2023-10-16T23:28:37.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.180+0000 7fb99effd640 1 -- 172.21.15.12:0/1479048302 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb998007270 con 0x7fb9a80bd9b0 2023-10-16T23:28:37.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.180+0000 7fb9b06e8640 1 -- 172.21.15.12:0/1479048302 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a815a060 con 0x7fb9a80bd9b0 2023-10-16T23:28:37.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.180+0000 7fb9b06e8640 1 -- 172.21.15.12:0/1479048302 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a80b7f10 con 0x7fb9a80bd9b0 2023-10-16T23:28:37.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.180+0000 7fb99effd640 1 -- 172.21.15.12:0/1479048302 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fb9980073d0 con 0x7fb9a80bd9b0 2023-10-16T23:28:37.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.180+0000 7fb99effd640 1 --2- 172.21.15.12:0/1479048302 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb98c065e60 0x7fb98c068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.180+0000 7fb99effd640 1 -- 172.21.15.12:0/1479048302 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb998082d00 con 0x7fb9a80bd9b0 2023-10-16T23:28:37.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.180+0000 7fb9ae484640 1 --2- 172.21.15.12:0/1479048302 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb98c065e60 0x7fb98c068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.180+0000 7fb9ae484640 1 --2- 172.21.15.12:0/1479048302 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb98c065e60 0x7fb98c068320 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00af000 tx=0x7fb9a0004ac0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:37.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.184+0000 7fb99effd640 1 -- 172.21.15.12:0/1479048302 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fb9980503b0 con 0x7fb9a80bd9b0 2023-10-16T23:28:37.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.332+0000 7fb9b06e8640 1 -- 172.21.15.12:0/1479048302 --> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9a80b5ee0 con 0x7fb98c065e60 2023-10-16T23:28:37.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.332+0000 7fb99effd640 1 -- 172.21.15.12:0/1479048302 <== mgr.4108 v2:172.21.15.31:6832/37949 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb9a0009450 con 0x7fb98c065e60 2023-10-16T23:28:37.338 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 2 to deep-scrub 2023-10-16T23:28:37.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.336+0000 7fb9b06e8640 1 -- 172.21.15.12:0/1479048302 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb98c065e60 msgr2=0x7fb98c068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.336+0000 7fb9b06e8640 1 --2- 172.21.15.12:0/1479048302 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb98c065e60 0x7fb98c068320 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00af000 tx=0x7fb9a0004ac0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.336+0000 7fb9b06e8640 1 -- 172.21.15.12:0/1479048302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9a80bd9b0 msgr2=0x7fb9a81ea8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.336+0000 7fb9b06e8640 1 --2- 172.21.15.12:0/1479048302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9a80bd9b0 0x7fb9a81ea8c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb99800c530 tx=0x7fb99800c9f0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.336+0000 7fb9b06e8640 1 -- 172.21.15.12:0/1479048302 shutdown_connections 2023-10-16T23:28:37.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.336+0000 7fb9b06e8640 1 --2- 172.21.15.12:0/1479048302 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb98c065e60 0x7fb98c068320 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.336+0000 7fb9b06e8640 1 --2- 172.21.15.12:0/1479048302 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb9a81458b0 0x7fb9a81eae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.336+0000 7fb9b06e8640 1 --2- 172.21.15.12:0/1479048302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9a80bd9b0 0x7fb9a81ea8c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.336+0000 7fb9b06e8640 1 --2- 172.21.15.12:0/1479048302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9a80710c0 0x7fb9a813ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.336+0000 7fb9b06e8640 1 -- 172.21.15.12:0/1479048302 >> 172.21.15.12:0/1479048302 conn(0x7fb9a8069d30 msgr2=0x7fb9a80c0640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:37.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.336+0000 7fb9b06e8640 1 -- 172.21.15.12:0/1479048302 shutdown_connections 2023-10-16T23:28:37.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.336+0000 7fb9b06e8640 1 -- 172.21.15.12:0/1479048302 wait complete. 2023-10-16T23:28:37.355 INFO:tasks.ceph:Scrubbing osd.3 2023-10-16T23:28:37.355 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-16T23:28:37.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.476+0000 7f412c622640 1 Processor -- start 2023-10-16T23:28:37.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.476+0000 7f412c622640 1 -- start start 2023-10-16T23:28:37.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.476+0000 7f412c622640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f41240bd3a0 0x7f41240bd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.476+0000 7f412c622640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f412414ba90 0x7f41240b7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.476+0000 7f412c622640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4124150370 con 0x7f41240b5ee0 2023-10-16T23:28:37.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.476+0000 7f412c622640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41240bdda0 con 0x7f412414ba90 2023-10-16T23:28:37.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.476+0000 7f412c622640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4124150000 con 0x7f41240bd3a0 2023-10-16T23:28:37.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.480+0000 7f412abbf640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f412414ba90 0x7f41240b7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.480+0000 7f412abbf640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f412414ba90 0x7f41240b7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36514/0 (socket says 172.21.15.12:36514) 2023-10-16T23:28:37.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.480+0000 7f412abbf640 1 -- 172.21.15.12:0/2549721423 learned_addr learned my addr 172.21.15.12:0/2549721423 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:37.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.480+0000 7f412a3be640 1 --2- 172.21.15.12:0/2549721423 >> v2:172.21.15.31:3300/0 conn(0x7f41240bd3a0 0x7f41240bd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.480+0000 7f412abbf640 1 -- 172.21.15.12:0/2549721423 >> v2:172.21.15.31:3300/0 conn(0x7f41240bd3a0 msgr2=0x7f41240bd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.480+0000 7f412abbf640 1 --2- 172.21.15.12:0/2549721423 >> v2:172.21.15.31:3300/0 conn(0x7f41240bd3a0 0x7f41240bd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.480+0000 7f412abbf640 1 -- 172.21.15.12:0/2549721423 >> v1:172.21.15.31:6789/0 conn(0x7f41240b5ee0 legacy=0x7f412414b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:37.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.480+0000 7f412abbf640 1 -- 172.21.15.12:0/2549721423 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41240b66b0 con 0x7f412414ba90 2023-10-16T23:28:37.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.480+0000 7f412abbf640 1 --2- 172.21.15.12:0/2549721423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f412414ba90 0x7f41240b7ed0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f41240c1a10 tx=0x7f411c01eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a7ec683283c2059 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:37.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.480+0000 7f41293bc640 1 -- 172.21.15.12:0/2549721423 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c0a7b70 con 0x7f412414ba90 2023-10-16T23:28:37.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.480+0000 7f41293bc640 1 -- 172.21.15.12:0/2549721423 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411c0a7cd0 con 0x7f412414ba90 2023-10-16T23:28:37.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.480+0000 7f41293bc640 1 -- 172.21.15.12:0/2549721423 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c0af660 con 0x7f412414ba90 2023-10-16T23:28:37.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.480+0000 7f412c622640 1 -- 172.21.15.12:0/2549721423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f412414ba90 msgr2=0x7f41240b7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.480+0000 7f412c622640 1 --2- 172.21.15.12:0/2549721423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f412414ba90 0x7f41240b7ed0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f41240c1a10 tx=0x7f411c01eb90 comp rx=0 tx=0).stop 2023-10-16T23:28:37.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.480+0000 7f412c622640 1 -- 172.21.15.12:0/2549721423 shutdown_connections 2023-10-16T23:28:37.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.480+0000 7f412c622640 1 --2- 172.21.15.12:0/2549721423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f412414ba90 0x7f41240b7ed0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.480+0000 7f412c622640 1 --2- 172.21.15.12:0/2549721423 >> v2:172.21.15.31:3300/0 conn(0x7f41240bd3a0 0x7f41240bd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.480+0000 7f412c622640 1 -- 172.21.15.12:0/2549721423 >> 172.21.15.12:0/2549721423 conn(0x7f41240c0bf0 msgr2=0x7f41240c1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:37.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.480+0000 7f412c622640 1 -- 172.21.15.12:0/2549721423 shutdown_connections 2023-10-16T23:28:37.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.480+0000 7f412c622640 1 -- 172.21.15.12:0/2549721423 wait complete. 2023-10-16T23:28:37.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f412c622640 1 Processor -- start 2023-10-16T23:28:37.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f412c622640 1 -- start start 2023-10-16T23:28:37.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f412c622640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41240b5ee0 0x7f4124146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f412c622640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41240bd3a0 0x7f4124139590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f412c622640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f412414ba90 0x7f41240ba000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f412c622640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41240bbc90 con 0x7f412414ba90 2023-10-16T23:28:37.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f412c622640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4124147090 con 0x7f41240bd3a0 2023-10-16T23:28:37.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f412c622640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4124146870 con 0x7f41240b5ee0 2023-10-16T23:28:37.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f412abbf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f412414ba90 0x7f41240ba000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f412abbf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f412414ba90 0x7f41240ba000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36516/0 (socket says 172.21.15.12:36516) 2023-10-16T23:28:37.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f412abbf640 1 -- 172.21.15.12:0/223409671 learned_addr learned my addr 172.21.15.12:0/223409671 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:37.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f412a3be640 1 --2- 172.21.15.12:0/223409671 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41240b5ee0 0x7f4124146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f4129bbd640 1 --2- 172.21.15.12:0/223409671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41240bd3a0 0x7f4124139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f412abbf640 1 -- 172.21.15.12:0/223409671 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41240b5ee0 msgr2=0x7f4124146b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f412abbf640 1 --2- 172.21.15.12:0/223409671 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41240b5ee0 0x7f4124146b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f412abbf640 1 -- 172.21.15.12:0/223409671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41240bd3a0 msgr2=0x7f4124139590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f412abbf640 1 --2- 172.21.15.12:0/223409671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41240bd3a0 0x7f4124139590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f412abbf640 1 -- 172.21.15.12:0/223409671 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411c00b770 con 0x7f412414ba90 2023-10-16T23:28:37.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f412a3be640 1 --2- 172.21.15.12:0/223409671 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f41240b5ee0 0x7f4124146b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:37.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f412abbf640 1 --2- 172.21.15.12:0/223409671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f412414ba90 0x7f41240ba000 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f411c00b2c0 tx=0x7f411c01b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:37.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f411affd640 1 -- 172.21.15.12:0/223409671 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c0b8750 con 0x7f412414ba90 2023-10-16T23:28:37.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f411affd640 1 -- 172.21.15.12:0/223409671 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411c0b88d0 con 0x7f412414ba90 2023-10-16T23:28:37.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f412c622640 1 -- 172.21.15.12:0/223409671 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41240bb770 con 0x7f412414ba90 2023-10-16T23:28:37.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f411affd640 1 -- 172.21.15.12:0/223409671 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c0b8c80 con 0x7f412414ba90 2023-10-16T23:28:37.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f412c622640 1 -- 172.21.15.12:0/223409671 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4124139ad0 con 0x7f412414ba90 2023-10-16T23:28:37.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f412c622640 1 -- 172.21.15.12:0/223409671 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f41240bc370 con 0x7f412414ba90 2023-10-16T23:28:37.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f411affd640 1 -- 172.21.15.12:0/223409671 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f411c0b93e0 con 0x7f412414ba90 2023-10-16T23:28:37.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.484+0000 7f411affd640 1 --2- 172.21.15.12:0/223409671 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4108065e60 0x7f4108068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.488+0000 7f411affd640 1 -- 172.21.15.12:0/223409671 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f411c0a7e40 con 0x7f412414ba90 2023-10-16T23:28:37.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.488+0000 7f411affd640 1 --2- 172.21.15.12:0/223409671 >> [v2:172.21.15.12:6800/38074,v1:172.21.15.12:6801/38074] conn(0x7f410806e760 0x7f4108070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.488+0000 7f411affd640 1 -- 172.21.15.12:0/223409671 --> [v2:172.21.15.12:6800/38074,v1:172.21.15.12:6801/38074] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4108071270 con 0x7f410806e760 2023-10-16T23:28:37.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.488+0000 7f411affd640 1 -- 172.21.15.12:0/223409671 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f411c11ee50 con 0x7f412414ba90 2023-10-16T23:28:37.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.488+0000 7f412a3be640 1 --2- 172.21.15.12:0/223409671 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4108065e60 0x7f4108068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.488+0000 7f4129bbd640 1 --2- 172.21.15.12:0/223409671 >> [v2:172.21.15.12:6800/38074,v1:172.21.15.12:6801/38074] conn(0x7f410806e760 0x7f4108070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.488+0000 7f4129bbd640 1 --2- 172.21.15.12:0/223409671 >> [v2:172.21.15.12:6800/38074,v1:172.21.15.12:6801/38074] conn(0x7f410806e760 0x7f4108070ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:37.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.488+0000 7f412a3be640 1 --2- 172.21.15.12:0/223409671 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4108065e60 0x7f4108068320 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4120007f50 tx=0x7f41200074a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:37.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.488+0000 7f411affd640 1 -- 172.21.15.12:0/223409671 <== osd.3 v2:172.21.15.12:6800/38074 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4108071270 con 0x7f410806e760 2023-10-16T23:28:37.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.500+0000 7f412c622640 1 -- 172.21.15.12:0/223409671 --> [v2:172.21.15.12:6800/38074,v1:172.21.15.12:6801/38074] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f41240bb9b0 con 0x7f410806e760 2023-10-16T23:28:37.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.500+0000 7f411affd640 1 -- 172.21.15.12:0/223409671 <== osd.3 v2:172.21.15.12:6800/38074 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f41240bb9b0 con 0x7f410806e760 2023-10-16T23:28:37.505 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-16T23:28:37.505 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T23:28:37.506 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-16T23:28:37.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.500+0000 7f412c622640 1 -- 172.21.15.12:0/223409671 >> [v2:172.21.15.12:6800/38074,v1:172.21.15.12:6801/38074] conn(0x7f410806e760 msgr2=0x7f4108070ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.500+0000 7f412c622640 1 --2- 172.21.15.12:0/223409671 >> [v2:172.21.15.12:6800/38074,v1:172.21.15.12:6801/38074] conn(0x7f410806e760 0x7f4108070ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.500+0000 7f412c622640 1 -- 172.21.15.12:0/223409671 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4108065e60 msgr2=0x7f4108068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.500+0000 7f412c622640 1 --2- 172.21.15.12:0/223409671 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4108065e60 0x7f4108068320 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4120007f50 tx=0x7f41200074a0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.500+0000 7f412c622640 1 -- 172.21.15.12:0/223409671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f412414ba90 msgr2=0x7f41240ba000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.500+0000 7f412c622640 1 --2- 172.21.15.12:0/223409671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f412414ba90 0x7f41240ba000 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f411c00b2c0 tx=0x7f411c01b930 comp rx=0 tx=0).stop 2023-10-16T23:28:37.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.500+0000 7f412abbf640 1 -- 172.21.15.12:0/223409671 reap_dead start 2023-10-16T23:28:37.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.500+0000 7f412c622640 1 -- 172.21.15.12:0/223409671 shutdown_connections 2023-10-16T23:28:37.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.500+0000 7f412c622640 1 -- 172.21.15.12:0/223409671 >> 172.21.15.12:0/223409671 conn(0x7f41240c0bf0 msgr2=0x7f4124155b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:37.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.500+0000 7f412c622640 1 -- 172.21.15.12:0/223409671 shutdown_connections 2023-10-16T23:28:37.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.500+0000 7f412c622640 1 -- 172.21.15.12:0/223409671 wait complete. 2023-10-16T23:28:37.519 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-16T23:28:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec7ec6c640 1 Processor -- start 2023-10-16T23:28:37.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec7ec6c640 1 -- start start 2023-10-16T23:28:37.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec7ec6c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec78152540 0x7fec780beb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec7ec6c640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec780c1650 con 0x7fec7806b660 2023-10-16T23:28:37.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec7ec6c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec780bfd10 con 0x7fec780bff80 2023-10-16T23:28:37.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec7ec6c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7806cc50 con 0x7fec78152540 2023-10-16T23:28:37.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec7ca08640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fec7806b660 0x7fec78151e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48624/0 (socket says 172.21.15.12:48624) 2023-10-16T23:28:37.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec7ca08640 1 -- 172.21.15.12:0/3364926668 learned_addr learned my addr 172.21.15.12:0/3364926668 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:37.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec777fe640 1 -- 172.21.15.12:0/3364926668 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165339095 0 0) 0x7fec780c1650 con 0x7fec7806b660 2023-10-16T23:28:37.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec7d209640 1 --2- 172.21.15.12:0/3364926668 >> v2:172.21.15.31:3300/0 conn(0x7fec78152540 0x7fec780beb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec777fe640 1 -- 172.21.15.12:0/3364926668 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec60003530 con 0x7fec7806b660 2023-10-16T23:28:37.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec777fe640 1 -- 172.21.15.12:0/3364926668 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2745390436 0 0) 0x7fec60003530 con 0x7fec7806b660 2023-10-16T23:28:37.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec777fe640 1 -- 172.21.15.12:0/3364926668 >> v2:172.21.15.31:3300/0 conn(0x7fec78152540 msgr2=0x7fec780beb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:37.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec777fe640 1 --2- 172.21.15.12:0/3364926668 >> v2:172.21.15.31:3300/0 conn(0x7fec78152540 0x7fec780beb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec777fe640 1 -- 172.21.15.12:0/3364926668 >> v1:172.21.15.31:6789/0 conn(0x7fec780bff80 legacy=0x7fec78157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec777fe640 1 -- 172.21.15.12:0/3364926668 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec780bf9b0 con 0x7fec7806b660 2023-10-16T23:28:37.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec777fe640 1 -- 172.21.15.12:0/3364926668 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7fec68001680 con 0x7fec7806b660 2023-10-16T23:28:37.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec777fe640 1 -- 172.21.15.12:0/3364926668 >> v1:172.21.15.12:6789/0 conn(0x7fec7806b660 legacy=0x7fec78151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec777fe640 1 --2- 172.21.15.12:0/3364926668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec60003980 0x7fec60003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec777fe640 1 --2- 172.21.15.12:0/3364926668 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec600047d0 0x7fec60004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec777fe640 1 --2- 172.21.15.12:0/3364926668 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec600052b0 0x7fec6000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec777fe640 1 -- 172.21.15.12:0/3364926668 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7806cc50 con 0x7fec60003980 2023-10-16T23:28:37.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec777fe640 1 -- 172.21.15.12:0/3364926668 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6000c180 con 0x7fec600047d0 2023-10-16T23:28:37.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec777fe640 1 -- 172.21.15.12:0/3364926668 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6000c340 con 0x7fec600052b0 2023-10-16T23:28:37.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec7ca08640 1 --2- 172.21.15.12:0/3364926668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec60003980 0x7fec60003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec7ca08640 1 -- 172.21.15.12:0/3364926668 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec600052b0 msgr2=0x7fec6000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:37.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec77fff640 1 --2- 172.21.15.12:0/3364926668 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec600047d0 0x7fec60004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec7ca08640 1 --2- 172.21.15.12:0/3364926668 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec600052b0 0x7fec6000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec7ca08640 1 -- 172.21.15.12:0/3364926668 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec600047d0 msgr2=0x7fec60004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:37.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec7ca08640 1 --2- 172.21.15.12:0/3364926668 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec600047d0 0x7fec60004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec7d209640 1 -- 172.21.15.12:0/3364926668 reap_dead start 2023-10-16T23:28:37.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec7ca08640 1 -- 172.21.15.12:0/3364926668 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec60003530 con 0x7fec60003980 2023-10-16T23:28:37.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.628+0000 7fec77fff640 1 --2- 172.21.15.12:0/3364926668 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec600047d0 0x7fec60004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:37.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.632+0000 7fec7ca08640 1 --2- 172.21.15.12:0/3364926668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec60003980 0x7fec60003da0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fec6800c210 tx=0x7fec6801cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3be7845aca7be9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:37.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.632+0000 7fec777fe640 1 -- 172.21.15.12:0/3364926668 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68005ae0 con 0x7fec60003980 2023-10-16T23:28:37.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.632+0000 7fec777fe640 1 -- 172.21.15.12:0/3364926668 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec68005c40 con 0x7fec60003980 2023-10-16T23:28:37.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.632+0000 7fec777fe640 1 -- 172.21.15.12:0/3364926668 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec680072b0 con 0x7fec60003980 2023-10-16T23:28:37.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.632+0000 7fec7ec6c640 1 -- 172.21.15.12:0/3364926668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec60003980 msgr2=0x7fec60003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.632+0000 7fec7ec6c640 1 --2- 172.21.15.12:0/3364926668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec60003980 0x7fec60003da0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fec6800c210 tx=0x7fec6801cb40 comp rx=0 tx=0).stop 2023-10-16T23:28:37.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.632+0000 7fec7ec6c640 1 -- 172.21.15.12:0/3364926668 shutdown_connections 2023-10-16T23:28:37.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.632+0000 7fec7ec6c640 1 --2- 172.21.15.12:0/3364926668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec60003980 0x7fec60003da0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.632+0000 7fec7ec6c640 1 -- 172.21.15.12:0/3364926668 >> 172.21.15.12:0/3364926668 conn(0x7fec780a3f20 msgr2=0x7fec780c1880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:37.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.632+0000 7fec7ec6c640 1 -- 172.21.15.12:0/3364926668 shutdown_connections 2023-10-16T23:28:37.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.632+0000 7fec7ec6c640 1 -- 172.21.15.12:0/3364926668 wait complete. 2023-10-16T23:28:37.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.632+0000 7fec7ec6c640 1 Processor -- start 2023-10-16T23:28:37.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.632+0000 7fec7ec6c640 1 -- start start 2023-10-16T23:28:37.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.632+0000 7fec7ec6c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec60003980 0x7fec780a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.632+0000 7fec7ec6c640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec781dce80 0x7fec78070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.632+0000 7fec7ec6c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec781eb350 0x7fec7814b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.632+0000 7fec7ec6c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec781eaf30 con 0x7fec60003980 2023-10-16T23:28:37.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.632+0000 7fec7ec6c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec780a1320 con 0x7fec781eb350 2023-10-16T23:28:37.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.632+0000 7fec7ec6c640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec78071240 con 0x7fec781dce80 2023-10-16T23:28:37.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.632+0000 7fec7ca08640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec60003980 0x7fec780a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.632+0000 7fec7ca08640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec60003980 0x7fec780a0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36522/0 (socket says 172.21.15.12:36522) 2023-10-16T23:28:37.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.632+0000 7fec7ca08640 1 -- 172.21.15.12:0/1868275636 learned_addr learned my addr 172.21.15.12:0/1868275636 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:37.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.632+0000 7fec77fff640 1 --2- 172.21.15.12:0/1868275636 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec781dce80 0x7fec78070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.636+0000 7fec7ca08640 1 -- 172.21.15.12:0/1868275636 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec781dce80 msgr2=0x7fec78070d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.636+0000 7fec7d209640 1 --2- 172.21.15.12:0/1868275636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec781eb350 0x7fec7814b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.636+0000 7fec7ca08640 1 --2- 172.21.15.12:0/1868275636 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec781dce80 0x7fec78070d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.636+0000 7fec7ca08640 1 -- 172.21.15.12:0/1868275636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec781eb350 msgr2=0x7fec7814b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.636+0000 7fec7ca08640 1 --2- 172.21.15.12:0/1868275636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec781eb350 0x7fec7814b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.636+0000 7fec7ca08640 1 -- 172.21.15.12:0/1868275636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec781eab90 con 0x7fec60003980 2023-10-16T23:28:37.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.636+0000 7fec7d209640 1 --2- 172.21.15.12:0/1868275636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec781eb350 0x7fec7814b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:37.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.636+0000 7fec77fff640 1 --2- 172.21.15.12:0/1868275636 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec781dce80 0x7fec78070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:37.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.636+0000 7fec7ca08640 1 --2- 172.21.15.12:0/1868275636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec60003980 0x7fec780a0d30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fec6800c210 tx=0x7fec60005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:37.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.636+0000 7fec757fa640 1 -- 172.21.15.12:0/1868275636 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec680b4070 con 0x7fec60003980 2023-10-16T23:28:37.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.636+0000 7fec757fa640 1 -- 172.21.15.12:0/1868275636 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec68005db0 con 0x7fec60003980 2023-10-16T23:28:37.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.636+0000 7fec7ec6c640 1 -- 172.21.15.12:0/1868275636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec781eb7b0 con 0x7fec60003980 2023-10-16T23:28:37.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.636+0000 7fec757fa640 1 -- 172.21.15.12:0/1868275636 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68007090 con 0x7fec60003980 2023-10-16T23:28:37.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.636+0000 7fec7ec6c640 1 -- 172.21.15.12:0/1868275636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec7814c020 con 0x7fec60003980 2023-10-16T23:28:37.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.636+0000 7fec7ec6c640 1 -- 172.21.15.12:0/1868275636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec781eb1a0 con 0x7fec60003980 2023-10-16T23:28:37.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.636+0000 7fec757fa640 1 -- 172.21.15.12:0/1868275636 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fec680071f0 con 0x7fec60003980 2023-10-16T23:28:37.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.636+0000 7fec757fa640 1 --2- 172.21.15.12:0/1868275636 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fec64065e60 0x7fec64068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.636+0000 7fec757fa640 1 -- 172.21.15.12:0/1868275636 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fec6811d140 con 0x7fec60003980 2023-10-16T23:28:37.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.636+0000 7fec77fff640 1 --2- 172.21.15.12:0/1868275636 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fec64065e60 0x7fec64068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.636+0000 7fec77fff640 1 --2- 172.21.15.12:0/1868275636 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fec64065e60 0x7fec64068320 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fec780bd7a0 tx=0x7fec6c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:37.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.640+0000 7fec757fa640 1 -- 172.21.15.12:0/1868275636 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fec680ea750 con 0x7fec60003980 2023-10-16T23:28:37.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.788+0000 7fec7ec6c640 1 -- 172.21.15.12:0/1868275636 --> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fec7806de30 con 0x7fec64065e60 2023-10-16T23:28:37.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.788+0000 7fec757fa640 1 -- 172.21.15.12:0/1868275636 <== mgr.4108 v2:172.21.15.31:6832/37949 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fec6c00d040 con 0x7fec64065e60 2023-10-16T23:28:37.793 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 3 to deep-scrub 2023-10-16T23:28:37.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.792+0000 7fec7ec6c640 1 -- 172.21.15.12:0/1868275636 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fec64065e60 msgr2=0x7fec64068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.792+0000 7fec7ec6c640 1 --2- 172.21.15.12:0/1868275636 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fec64065e60 0x7fec64068320 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fec780bd7a0 tx=0x7fec6c009040 comp rx=0 tx=0).stop 2023-10-16T23:28:37.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.792+0000 7fec7ec6c640 1 -- 172.21.15.12:0/1868275636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec60003980 msgr2=0x7fec780a0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.792+0000 7fec7ec6c640 1 --2- 172.21.15.12:0/1868275636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec60003980 0x7fec780a0d30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fec6800c210 tx=0x7fec60005800 comp rx=0 tx=0).stop 2023-10-16T23:28:37.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.792+0000 7fec7ec6c640 1 -- 172.21.15.12:0/1868275636 shutdown_connections 2023-10-16T23:28:37.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.792+0000 7fec7ec6c640 1 --2- 172.21.15.12:0/1868275636 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fec64065e60 0x7fec64068320 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.792+0000 7fec7ec6c640 1 --2- 172.21.15.12:0/1868275636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec781eb350 0x7fec7814b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.792+0000 7fec7ec6c640 1 --2- 172.21.15.12:0/1868275636 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec781dce80 0x7fec78070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.792+0000 7fec7ec6c640 1 --2- 172.21.15.12:0/1868275636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec60003980 0x7fec780a0d30 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.792+0000 7fec7ec6c640 1 -- 172.21.15.12:0/1868275636 >> 172.21.15.12:0/1868275636 conn(0x7fec780a3f20 msgr2=0x7fec780c1630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:37.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.792+0000 7fec7ec6c640 1 -- 172.21.15.12:0/1868275636 shutdown_connections 2023-10-16T23:28:37.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.792+0000 7fec7ec6c640 1 -- 172.21.15.12:0/1868275636 wait complete. 2023-10-16T23:28:37.810 INFO:tasks.ceph:Scrubbing osd.4 2023-10-16T23:28:37.811 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-16T23:28:37.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.924+0000 7ffaf7dc6640 1 Processor -- start 2023-10-16T23:28:37.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.924+0000 7ffaf7dc6640 1 -- start start 2023-10-16T23:28:37.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.924+0000 7ffaf7dc6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffaf00bf210 0x7ffaf00b7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.924+0000 7ffaf7dc6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffaf014e170 0x7ffaf00b6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.924+0000 7ffaf7dc6640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf00b5ee0 con 0x7ffaf014d1f0 2023-10-16T23:28:37.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.924+0000 7ffaf7dc6640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf00b6130 con 0x7ffaf014e170 2023-10-16T23:28:37.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.924+0000 7ffaf7dc6640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf00b6410 con 0x7ffaf00bf210 2023-10-16T23:28:37.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.928+0000 7ffaf6363640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffaf014e170 0x7ffaf00b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.928+0000 7ffaf5361640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ffaf014d1f0 0x7ffaf00bf5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48640/0 (socket says 172.21.15.12:48640) 2023-10-16T23:28:37.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.928+0000 7ffaf5361640 1 -- 172.21.15.12:0/2403757218 learned_addr learned my addr 172.21.15.12:0/2403757218 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:37.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.928+0000 7ffaf5b62640 1 --2- 172.21.15.12:0/2403757218 >> v2:172.21.15.31:3300/0 conn(0x7ffaf00bf210 0x7ffaf00b7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.928+0000 7ffaf6363640 1 -- 172.21.15.12:0/2403757218 >> v2:172.21.15.31:3300/0 conn(0x7ffaf00bf210 msgr2=0x7ffaf00b7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:37.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.928+0000 7ffaf6363640 1 --2- 172.21.15.12:0/2403757218 >> v2:172.21.15.31:3300/0 conn(0x7ffaf00bf210 0x7ffaf00b7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.928+0000 7ffaf6363640 1 -- 172.21.15.12:0/2403757218 >> v1:172.21.15.12:6789/0 conn(0x7ffaf014d1f0 legacy=0x7ffaf00bf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.928+0000 7ffaf6363640 1 -- 172.21.15.12:0/2403757218 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf00b6e70 con 0x7ffaf014e170 2023-10-16T23:28:37.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.928+0000 7ffaf4b60640 1 -- 172.21.15.12:0/2403757218 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3102798750 0 0) 0x7ffaf00b5ee0 con 0x7ffaf014d1f0 2023-10-16T23:28:37.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.928+0000 7ffaf6363640 1 --2- 172.21.15.12:0/2403757218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf014e170 0x7ffaf00b6930 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00bfea0 tx=0x7ffae801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca5c5f94439fbcd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:37.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.928+0000 7ffaf4b60640 1 -- 172.21.15.12:0/2403757218 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae80a5960 con 0x7ffaf014e170 2023-10-16T23:28:37.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.928+0000 7ffaf4b60640 1 -- 172.21.15.12:0/2403757218 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae80a5ac0 con 0x7ffaf014e170 2023-10-16T23:28:37.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.928+0000 7ffaf4b60640 1 -- 172.21.15.12:0/2403757218 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae80a5e50 con 0x7ffaf014e170 2023-10-16T23:28:37.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.928+0000 7ffaf7dc6640 1 -- 172.21.15.12:0/2403757218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf014e170 msgr2=0x7ffaf00b6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.928+0000 7ffaf7dc6640 1 --2- 172.21.15.12:0/2403757218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf014e170 0x7ffaf00b6930 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00bfea0 tx=0x7ffae801c880 comp rx=0 tx=0).stop 2023-10-16T23:28:37.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.928+0000 7ffaf7dc6640 1 -- 172.21.15.12:0/2403757218 shutdown_connections 2023-10-16T23:28:37.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.928+0000 7ffaf7dc6640 1 --2- 172.21.15.12:0/2403757218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf014e170 0x7ffaf00b6930 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.928+0000 7ffaf7dc6640 1 --2- 172.21.15.12:0/2403757218 >> v2:172.21.15.31:3300/0 conn(0x7ffaf00bf210 0x7ffaf00b7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.928+0000 7ffaf7dc6640 1 -- 172.21.15.12:0/2403757218 >> 172.21.15.12:0/2403757218 conn(0x7ffaf00c2960 msgr2=0x7ffaf00c2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:37.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.928+0000 7ffaf7dc6640 1 -- 172.21.15.12:0/2403757218 shutdown_connections 2023-10-16T23:28:37.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.928+0000 7ffaf7dc6640 1 -- 172.21.15.12:0/2403757218 wait complete. 2023-10-16T23:28:37.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffaf7dc6640 1 Processor -- start 2023-10-16T23:28:37.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffaf7dc6640 1 -- start start 2023-10-16T23:28:37.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffaf7dc6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaf00bf210 0x7ffaf014a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffaf7dc6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf014d1f0 0x7ffaf012fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffaf7dc6640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf014e170 0x7ffaf0147000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffaf7dc6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf00bc8b0 con 0x7ffaf014d1f0 2023-10-16T23:28:37.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffaf7dc6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf00bede0 con 0x7ffaf00bf210 2023-10-16T23:28:37.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffaf7dc6640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf0130160 con 0x7ffaf014e170 2023-10-16T23:28:37.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffaf5361640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf014d1f0 0x7ffaf012fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffaf5361640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf014d1f0 0x7ffaf012fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36546/0 (socket says 172.21.15.12:36546) 2023-10-16T23:28:37.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffaf5361640 1 -- 172.21.15.12:0/1448082756 learned_addr learned my addr 172.21.15.12:0/1448082756 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:37.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffaf5b62640 1 --2- 172.21.15.12:0/1448082756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaf00bf210 0x7ffaf014a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffaf6363640 1 --2- 172.21.15.12:0/1448082756 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf014e170 0x7ffaf0147000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffaf5361640 1 -- 172.21.15.12:0/1448082756 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf014e170 msgr2=0x7ffaf0147000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffaf5361640 1 --2- 172.21.15.12:0/1448082756 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffaf014e170 0x7ffaf0147000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffaf5361640 1 -- 172.21.15.12:0/1448082756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaf00bf210 msgr2=0x7ffaf014a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffaf5361640 1 --2- 172.21.15.12:0/1448082756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaf00bf210 0x7ffaf014a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffaf5361640 1 -- 172.21.15.12:0/1448082756 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae8009a70 con 0x7ffaf014d1f0 2023-10-16T23:28:37.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffaf5361640 1 --2- 172.21.15.12:0/1448082756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf014d1f0 0x7ffaf012fc20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ffae000c4e0 tx=0x7ffae000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:37.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffae67fc640 1 -- 172.21.15.12:0/1448082756 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae00074e0 con 0x7ffaf014d1f0 2023-10-16T23:28:37.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffae67fc640 1 -- 172.21.15.12:0/1448082756 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae0007660 con 0x7ffaf014d1f0 2023-10-16T23:28:37.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffaf7dc6640 1 -- 172.21.15.12:0/1448082756 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf00be7f0 con 0x7ffaf014d1f0 2023-10-16T23:28:37.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffae67fc640 1 -- 172.21.15.12:0/1448082756 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae0004a30 con 0x7ffaf014d1f0 2023-10-16T23:28:37.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffaf7dc6640 1 -- 172.21.15.12:0/1448082756 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf014a9b0 con 0x7ffaf014d1f0 2023-10-16T23:28:37.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffaf7dc6640 1 -- 172.21.15.12:0/1448082756 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffaf00bebe0 con 0x7ffaf014d1f0 2023-10-16T23:28:37.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffae67fc640 1 -- 172.21.15.12:0/1448082756 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7ffae001c3b0 con 0x7ffaf014d1f0 2023-10-16T23:28:37.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffae67fc640 1 --2- 172.21.15.12:0/1448082756 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7ffad4065e60 0x7ffad4068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffae67fc640 1 -- 172.21.15.12:0/1448082756 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ffae00833c0 con 0x7ffaf014d1f0 2023-10-16T23:28:37.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffae67fc640 1 --2- 172.21.15.12:0/1448082756 >> [v2:172.21.15.31:6816/38266,v1:172.21.15.31:6817/38266] conn(0x7ffad406e760 0x7ffad4070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:37.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffae67fc640 1 -- 172.21.15.12:0/1448082756 --> [v2:172.21.15.31:6816/38266,v1:172.21.15.31:6817/38266] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffad4071270 con 0x7ffad406e760 2023-10-16T23:28:37.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffae67fc640 1 -- 172.21.15.12:0/1448082756 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffae0083730 con 0x7ffaf014d1f0 2023-10-16T23:28:37.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.932+0000 7ffaf5b62640 1 --2- 172.21.15.12:0/1448082756 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7ffad4065e60 0x7ffad4068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.936+0000 7ffaf6363640 1 --2- 172.21.15.12:0/1448082756 >> [v2:172.21.15.31:6816/38266,v1:172.21.15.31:6817/38266] conn(0x7ffad406e760 0x7ffad4070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:37.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.936+0000 7ffaf6363640 1 --2- 172.21.15.12:0/1448082756 >> [v2:172.21.15.31:6816/38266,v1:172.21.15.31:6817/38266] conn(0x7ffad406e760 0x7ffad4070ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:37.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.936+0000 7ffaf5b62640 1 --2- 172.21.15.12:0/1448082756 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7ffad4065e60 0x7ffad4068320 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffaf014cfe0 tx=0x7ffaec008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:37.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.936+0000 7ffae67fc640 1 -- 172.21.15.12:0/1448082756 <== osd.4 v2:172.21.15.31:6816/38266 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ffad4071270 con 0x7ffad406e760 2023-10-16T23:28:37.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.948+0000 7ffaf7dc6640 1 -- 172.21.15.12:0/1448082756 --> [v2:172.21.15.31:6816/38266,v1:172.21.15.31:6817/38266] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffaf00be610 con 0x7ffad406e760 2023-10-16T23:28:37.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.948+0000 7ffae67fc640 1 -- 172.21.15.12:0/1448082756 <== osd.4 v2:172.21.15.31:6816/38266 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ffae8009450 con 0x7ffad406e760 2023-10-16T23:28:37.958 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-16T23:28:37.958 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T23:28:37.958 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-16T23:28:37.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.948+0000 7ffaf7dc6640 1 -- 172.21.15.12:0/1448082756 >> [v2:172.21.15.31:6816/38266,v1:172.21.15.31:6817/38266] conn(0x7ffad406e760 msgr2=0x7ffad4070ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.948+0000 7ffaf7dc6640 1 --2- 172.21.15.12:0/1448082756 >> [v2:172.21.15.31:6816/38266,v1:172.21.15.31:6817/38266] conn(0x7ffad406e760 0x7ffad4070ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.952+0000 7ffaf7dc6640 1 -- 172.21.15.12:0/1448082756 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7ffad4065e60 msgr2=0x7ffad4068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.952+0000 7ffaf7dc6640 1 --2- 172.21.15.12:0/1448082756 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7ffad4065e60 0x7ffad4068320 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffaf014cfe0 tx=0x7ffaec008040 comp rx=0 tx=0).stop 2023-10-16T23:28:37.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.952+0000 7ffaf7dc6640 1 -- 172.21.15.12:0/1448082756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf014d1f0 msgr2=0x7ffaf012fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:37.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.952+0000 7ffaf7dc6640 1 --2- 172.21.15.12:0/1448082756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf014d1f0 0x7ffaf012fc20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ffae000c4e0 tx=0x7ffae000c9a0 comp rx=0 tx=0).stop 2023-10-16T23:28:37.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.952+0000 7ffaf6363640 1 -- 172.21.15.12:0/1448082756 reap_dead start 2023-10-16T23:28:37.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.952+0000 7ffaf7dc6640 1 -- 172.21.15.12:0/1448082756 shutdown_connections 2023-10-16T23:28:37.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.952+0000 7ffaf7dc6640 1 -- 172.21.15.12:0/1448082756 >> 172.21.15.12:0/1448082756 conn(0x7ffaf00c2960 msgr2=0x7ffaf0132370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:37.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.952+0000 7ffaf7dc6640 1 -- 172.21.15.12:0/1448082756 shutdown_connections 2023-10-16T23:28:37.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:37.952+0000 7ffaf7dc6640 1 -- 172.21.15.12:0/1448082756 wait complete. 2023-10-16T23:28:37.967 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-16T23:28:38.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.076+0000 7f6300896640 1 Processor -- start 2023-10-16T23:28:38.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.076+0000 7f6300896640 1 -- start start 2023-10-16T23:28:38.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.076+0000 7f6300896640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f62fc0c1130 0x7f62fc0b8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.076+0000 7f6300896640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f62fc0b9f40 0x7f62fc0ba370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.076+0000 7f6300896640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62fc14d0c0 con 0x7f62fc14c520 2023-10-16T23:28:38.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.076+0000 7f6300896640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62fc0b3ca0 con 0x7f62fc0b9f40 2023-10-16T23:28:38.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.076+0000 7f6300896640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62fc0b40c0 con 0x7f62fc0c1130 2023-10-16T23:28:38.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.076+0000 7f62fad9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f62fc0b9f40 0x7f62fc0ba370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.076+0000 7f62f9d9b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f62fc14c520 0x7f62fc14c9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48646/0 (socket says 172.21.15.12:48646) 2023-10-16T23:28:38.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.076+0000 7f62f9d9b640 1 -- 172.21.15.12:0/1870930395 learned_addr learned my addr 172.21.15.12:0/1870930395 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:38.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.076+0000 7f62fa59c640 1 --2- 172.21.15.12:0/1870930395 >> v2:172.21.15.31:3300/0 conn(0x7f62fc0c1130 0x7f62fc0b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.076+0000 7f62fad9d640 1 -- 172.21.15.12:0/1870930395 >> v2:172.21.15.31:3300/0 conn(0x7f62fc0c1130 msgr2=0x7f62fc0b8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:38.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.076+0000 7f62fad9d640 1 --2- 172.21.15.12:0/1870930395 >> v2:172.21.15.31:3300/0 conn(0x7f62fc0c1130 0x7f62fc0b8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.076+0000 7f62fad9d640 1 -- 172.21.15.12:0/1870930395 >> v1:172.21.15.12:6789/0 conn(0x7f62fc14c520 legacy=0x7f62fc14c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.076+0000 7f62fad9d640 1 -- 172.21.15.12:0/1870930395 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62fc0b7ce0 con 0x7f62fc0b9f40 2023-10-16T23:28:38.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.076+0000 7f62f959a640 1 -- 172.21.15.12:0/1870930395 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835747908 0 0) 0x7f62fc14d0c0 con 0x7f62fc14c520 2023-10-16T23:28:38.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.076+0000 7f62fa59c640 1 --2- 172.21.15.12:0/1870930395 >> v2:172.21.15.31:3300/0 conn(0x7f62fc0c1130 0x7f62fc0b8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:38.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.080+0000 7f62fad9d640 1 --2- 172.21.15.12:0/1870930395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62fc0b9f40 0x7f62fc0ba370 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f62fc06b470 tx=0x7f62ec01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf87a35b45cfdc9a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.080+0000 7f62f959a640 1 -- 172.21.15.12:0/1870930395 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec0ab600 con 0x7f62fc0b9f40 2023-10-16T23:28:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.080+0000 7f62f959a640 1 -- 172.21.15.12:0/1870930395 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ec0a7050 con 0x7f62fc0b9f40 2023-10-16T23:28:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.080+0000 7f62f959a640 1 -- 172.21.15.12:0/1870930395 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec0ab980 con 0x7f62fc0b9f40 2023-10-16T23:28:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.080+0000 7f6300896640 1 -- 172.21.15.12:0/1870930395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62fc0b9f40 msgr2=0x7f62fc0ba370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.080+0000 7f6300896640 1 --2- 172.21.15.12:0/1870930395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62fc0b9f40 0x7f62fc0ba370 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f62fc06b470 tx=0x7f62ec01c340 comp rx=0 tx=0).stop 2023-10-16T23:28:38.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.080+0000 7f6300896640 1 -- 172.21.15.12:0/1870930395 shutdown_connections 2023-10-16T23:28:38.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.080+0000 7f6300896640 1 --2- 172.21.15.12:0/1870930395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62fc0b9f40 0x7f62fc0ba370 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.080+0000 7f6300896640 1 --2- 172.21.15.12:0/1870930395 >> v2:172.21.15.31:3300/0 conn(0x7f62fc0c1130 0x7f62fc0b8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.080+0000 7f6300896640 1 -- 172.21.15.12:0/1870930395 >> 172.21.15.12:0/1870930395 conn(0x7f62fc06ba20 msgr2=0x7f62fc0c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:38.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.080+0000 7f6300896640 1 -- 172.21.15.12:0/1870930395 shutdown_connections 2023-10-16T23:28:38.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.080+0000 7f6300896640 1 -- 172.21.15.12:0/1870930395 wait complete. 2023-10-16T23:28:38.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.080+0000 7f6300896640 1 Processor -- start 2023-10-16T23:28:38.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.080+0000 7f6300896640 1 -- start start 2023-10-16T23:28:38.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.080+0000 7f6300896640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f62fc0b9f40 0x7f62fc0b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.080+0000 7f6300896640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62fc0c1130 0x7f62fc0bd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.080+0000 7f6300896640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62fc14c520 0x7f62fc157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.080+0000 7f6300896640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc142c00 con 0x7f62fc14c520 2023-10-16T23:28:38.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.080+0000 7f6300896640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc0b8840 con 0x7f62fc0c1130 2023-10-16T23:28:38.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.080+0000 7f6300896640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc14e6b0 con 0x7f62fc0b9f40 2023-10-16T23:28:38.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.080+0000 7f62fad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62fc14c520 0x7f62fc157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.080+0000 7f62fad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62fc14c520 0x7f62fc157010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36568/0 (socket says 172.21.15.12:36568) 2023-10-16T23:28:38.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.080+0000 7f62fad9d640 1 -- 172.21.15.12:0/3450570798 learned_addr learned my addr 172.21.15.12:0/3450570798 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:38.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.084+0000 7f62fa59c640 1 --2- 172.21.15.12:0/3450570798 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f62fc0b9f40 0x7f62fc0b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.084+0000 7f62f9d9b640 1 --2- 172.21.15.12:0/3450570798 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62fc0c1130 0x7f62fc0bd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.084+0000 7f62fad9d640 1 -- 172.21.15.12:0/3450570798 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f62fc0b9f40 msgr2=0x7f62fc0b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.084+0000 7f62fad9d640 1 --2- 172.21.15.12:0/3450570798 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f62fc0b9f40 0x7f62fc0b4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.084+0000 7f62fad9d640 1 -- 172.21.15.12:0/3450570798 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62fc0c1130 msgr2=0x7f62fc0bd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.084+0000 7f62fad9d640 1 --2- 172.21.15.12:0/3450570798 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62fc0c1130 0x7f62fc0bd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.084+0000 7f62fad9d640 1 -- 172.21.15.12:0/3450570798 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ec009420 con 0x7f62fc14c520 2023-10-16T23:28:38.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.084+0000 7f62fad9d640 1 --2- 172.21.15.12:0/3450570798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62fc14c520 0x7f62fc157010 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f62ec01c820 tx=0x7f62ec0190e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:38.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.084+0000 7f62eaffd640 1 -- 172.21.15.12:0/3450570798 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec004230 con 0x7f62fc14c520 2023-10-16T23:28:38.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.084+0000 7f62eaffd640 1 -- 172.21.15.12:0/3450570798 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ec004390 con 0x7f62fc14c520 2023-10-16T23:28:38.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.084+0000 7f6300896640 1 -- 172.21.15.12:0/3450570798 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62fc0b8480 con 0x7f62fc14c520 2023-10-16T23:28:38.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.084+0000 7f62eaffd640 1 -- 172.21.15.12:0/3450570798 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec003820 con 0x7f62fc14c520 2023-10-16T23:28:38.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.084+0000 7f6300896640 1 -- 172.21.15.12:0/3450570798 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62fc0bde80 con 0x7f62fc14c520 2023-10-16T23:28:38.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.084+0000 7f6300896640 1 -- 172.21.15.12:0/3450570798 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62fc0b8980 con 0x7f62fc14c520 2023-10-16T23:28:38.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.084+0000 7f62eaffd640 1 -- 172.21.15.12:0/3450570798 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f62ec0b2040 con 0x7f62fc14c520 2023-10-16T23:28:38.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.084+0000 7f62eaffd640 1 --2- 172.21.15.12:0/3450570798 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f62dc065e90 0x7f62dc068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.084+0000 7f62eaffd640 1 -- 172.21.15.12:0/3450570798 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f62ec11d820 con 0x7f62fc14c520 2023-10-16T23:28:38.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.084+0000 7f62fa59c640 1 --2- 172.21.15.12:0/3450570798 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f62dc065e90 0x7f62dc068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.084+0000 7f62fa59c640 1 --2- 172.21.15.12:0/3450570798 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f62dc065e90 0x7f62dc068350 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f62f40075b0 tx=0x7f62f4007540 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:38.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.088+0000 7f62eaffd640 1 -- 172.21.15.12:0/3450570798 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f62fc0b8980 con 0x7f62fc14c520 2023-10-16T23:28:38.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.244+0000 7f6300896640 1 -- 172.21.15.12:0/3450570798 --> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f62fc1427a0 con 0x7f62dc065e90 2023-10-16T23:28:38.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.244+0000 7f62eaffd640 1 -- 172.21.15.12:0/3450570798 <== mgr.4108 v2:172.21.15.31:6832/37949 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f62f4007cf0 con 0x7f62dc065e90 2023-10-16T23:28:38.249 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 4 to deep-scrub 2023-10-16T23:28:38.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.248+0000 7f6300896640 1 -- 172.21.15.12:0/3450570798 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f62dc065e90 msgr2=0x7f62dc068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.248+0000 7f6300896640 1 --2- 172.21.15.12:0/3450570798 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f62dc065e90 0x7f62dc068350 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f62f40075b0 tx=0x7f62f4007540 comp rx=0 tx=0).stop 2023-10-16T23:28:38.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.248+0000 7f6300896640 1 -- 172.21.15.12:0/3450570798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62fc14c520 msgr2=0x7f62fc157010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.248+0000 7f6300896640 1 --2- 172.21.15.12:0/3450570798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62fc14c520 0x7f62fc157010 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f62ec01c820 tx=0x7f62ec0190e0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.248+0000 7f6300896640 1 -- 172.21.15.12:0/3450570798 shutdown_connections 2023-10-16T23:28:38.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.248+0000 7f6300896640 1 --2- 172.21.15.12:0/3450570798 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f62dc065e90 0x7f62dc068350 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.248+0000 7f6300896640 1 --2- 172.21.15.12:0/3450570798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62fc14c520 0x7f62fc157010 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.248+0000 7f6300896640 1 --2- 172.21.15.12:0/3450570798 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62fc0c1130 0x7f62fc0bd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.248+0000 7f6300896640 1 --2- 172.21.15.12:0/3450570798 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f62fc0b9f40 0x7f62fc0b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.248+0000 7f6300896640 1 -- 172.21.15.12:0/3450570798 >> 172.21.15.12:0/3450570798 conn(0x7f62fc06ba20 msgr2=0x7f62fc0bec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:38.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.248+0000 7f6300896640 1 -- 172.21.15.12:0/3450570798 shutdown_connections 2023-10-16T23:28:38.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.248+0000 7f6300896640 1 -- 172.21.15.12:0/3450570798 wait complete. 2023-10-16T23:28:38.268 INFO:tasks.ceph:Scrubbing osd.5 2023-10-16T23:28:38.268 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-16T23:28:38.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f52381ab640 1 Processor -- start 2023-10-16T23:28:38.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f52381ab640 1 -- start start 2023-10-16T23:28:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f52381ab640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5230070b40 0x7f52300bc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f52381ab640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52300ba9a0 0x7f52300b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f52381ab640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52300b7c50 con 0x7f52300b86f0 2023-10-16T23:28:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f52381ab640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52300b8340 con 0x7f5230070b40 2023-10-16T23:28:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f52381ab640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52300b7ea0 con 0x7f52300ba9a0 2023-10-16T23:28:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5236748640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f52300b86f0 0x7f523014c870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51952/0 (socket says 172.21.15.12:51952) 2023-10-16T23:28:38.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5236748640 1 -- 172.21.15.12:0/268314377 learned_addr learned my addr 172.21.15.12:0/268314377 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:38.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5235746640 1 --2- 172.21.15.12:0/268314377 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52300ba9a0 0x7f52300b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5235f47640 1 --2- 172.21.15.12:0/268314377 >> v2:172.21.15.31:3300/0 conn(0x7f5230070b40 0x7f52300bc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5234f45640 1 -- 172.21.15.12:0/268314377 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797521347 0 0) 0x7f52300b7c50 con 0x7f52300b86f0 2023-10-16T23:28:38.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5234f45640 1 -- 172.21.15.12:0/268314377 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f521c003530 con 0x7f52300b86f0 2023-10-16T23:28:38.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5234f45640 1 -- 172.21.15.12:0/268314377 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1576597290 0 0) 0x7f521c003530 con 0x7f52300b86f0 2023-10-16T23:28:38.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5234f45640 1 -- 172.21.15.12:0/268314377 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52300ba9a0 msgr2=0x7f52300b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:38.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5234f45640 1 --2- 172.21.15.12:0/268314377 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52300ba9a0 0x7f52300b3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5234f45640 1 -- 172.21.15.12:0/268314377 >> v2:172.21.15.31:3300/0 conn(0x7f5230070b40 msgr2=0x7f52300bc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:38.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5234f45640 1 --2- 172.21.15.12:0/268314377 >> v2:172.21.15.31:3300/0 conn(0x7f5230070b40 0x7f52300bc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5234f45640 1 -- 172.21.15.12:0/268314377 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52300b7970 con 0x7f52300b86f0 2023-10-16T23:28:38.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5234f45640 1 -- 172.21.15.12:0/268314377 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7f522c001680 con 0x7f52300b86f0 2023-10-16T23:28:38.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5234f45640 1 -- 172.21.15.12:0/268314377 >> v1:172.21.15.12:6789/0 conn(0x7f52300b86f0 legacy=0x7f523014c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5234f45640 1 --2- 172.21.15.12:0/268314377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f521c003980 0x7f521c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5234f45640 1 --2- 172.21.15.12:0/268314377 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52300ba9a0 0x7f521c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5234f45640 1 --2- 172.21.15.12:0/268314377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f521c004d10 0x7f521c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5234f45640 1 -- 172.21.15.12:0/268314377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52300b8340 con 0x7f521c003980 2023-10-16T23:28:38.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5234f45640 1 -- 172.21.15.12:0/268314377 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52300b7ea0 con 0x7f521c004d10 2023-10-16T23:28:38.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5234f45640 1 -- 172.21.15.12:0/268314377 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521c00b990 con 0x7f52300ba9a0 2023-10-16T23:28:38.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5235f47640 1 --2- 172.21.15.12:0/268314377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f521c003980 0x7f521c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5235746640 1 --2- 172.21.15.12:0/268314377 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52300ba9a0 0x7f521c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5235f47640 1 -- 172.21.15.12:0/268314377 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52300ba9a0 msgr2=0x7f521c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:38.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5235f47640 1 --2- 172.21.15.12:0/268314377 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f52300ba9a0 0x7f521c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5235f47640 1 -- 172.21.15.12:0/268314377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f521c004d10 msgr2=0x7f521c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:38.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5235f47640 1 --2- 172.21.15.12:0/268314377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f521c004d10 0x7f521c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.392+0000 7f5235f47640 1 -- 172.21.15.12:0/268314377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521c003530 con 0x7f521c003980 2023-10-16T23:28:38.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.396+0000 7f5235f47640 1 --2- 172.21.15.12:0/268314377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f521c003980 0x7f521c003da0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5228009fc0 tx=0x7f522801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1a55accd74fd99 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:38.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.396+0000 7f5234f45640 1 -- 172.21.15.12:0/268314377 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52280a5b60 con 0x7f521c003980 2023-10-16T23:28:38.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.396+0000 7f5234f45640 1 -- 172.21.15.12:0/268314377 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522800f040 con 0x7f521c003980 2023-10-16T23:28:38.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.396+0000 7f5234f45640 1 -- 172.21.15.12:0/268314377 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52280ad440 con 0x7f521c003980 2023-10-16T23:28:38.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.396+0000 7f52381ab640 1 -- 172.21.15.12:0/268314377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f521c003980 msgr2=0x7f521c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.396+0000 7f52381ab640 1 --2- 172.21.15.12:0/268314377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f521c003980 0x7f521c003da0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5228009fc0 tx=0x7f522801cca0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.396+0000 7f5236748640 1 -- 172.21.15.12:0/268314377 reap_dead start 2023-10-16T23:28:38.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.396+0000 7f52381ab640 1 -- 172.21.15.12:0/268314377 shutdown_connections 2023-10-16T23:28:38.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.396+0000 7f52381ab640 1 -- 172.21.15.12:0/268314377 >> 172.21.15.12:0/268314377 conn(0x7f52300bd240 msgr2=0x7f52300bd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:38.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.396+0000 7f52381ab640 1 -- 172.21.15.12:0/268314377 shutdown_connections 2023-10-16T23:28:38.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.396+0000 7f52381ab640 1 -- 172.21.15.12:0/268314377 wait complete. 2023-10-16T23:28:38.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.396+0000 7f52381ab640 1 Processor -- start 2023-10-16T23:28:38.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.396+0000 7f52381ab640 1 -- start start 2023-10-16T23:28:38.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f52381ab640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f521c003980 0x7f5230151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f52381ab640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5230141830 0x7f5230146710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f52381ab640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5230146c50 0x7f52301e6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f52381ab640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5230142020 con 0x7f521c003980 2023-10-16T23:28:38.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f52381ab640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52301479b0 con 0x7f5230146c50 2023-10-16T23:28:38.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f52381ab640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5230147ca0 con 0x7f5230141830 2023-10-16T23:28:38.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f5235f47640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f521c003980 0x7f5230151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f5235f47640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f521c003980 0x7f5230151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33006/0 (socket says 172.21.15.12:33006) 2023-10-16T23:28:38.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f5235f47640 1 -- 172.21.15.12:0/1608492483 learned_addr learned my addr 172.21.15.12:0/1608492483 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:38.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f5236748640 1 --2- 172.21.15.12:0/1608492483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5230146c50 0x7f52301e6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f5235746640 1 --2- 172.21.15.12:0/1608492483 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5230141830 0x7f5230146710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f5235f47640 1 -- 172.21.15.12:0/1608492483 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5230141830 msgr2=0x7f5230146710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f5235f47640 1 --2- 172.21.15.12:0/1608492483 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5230141830 0x7f5230146710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f5235f47640 1 -- 172.21.15.12:0/1608492483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5230146c50 msgr2=0x7f52301e6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f5235f47640 1 --2- 172.21.15.12:0/1608492483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5230146c50 0x7f52301e6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f5235f47640 1 -- 172.21.15.12:0/1608492483 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5230151740 con 0x7f521c003980 2023-10-16T23:28:38.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f5236748640 1 --2- 172.21.15.12:0/1608492483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5230146c50 0x7f52301e6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:38.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f5235f47640 1 --2- 172.21.15.12:0/1608492483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f521c003980 0x7f5230151200 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5228098680 tx=0x7f5228009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:38.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f52267fc640 1 -- 172.21.15.12:0/1608492483 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52280ad700 con 0x7f521c003980 2023-10-16T23:28:38.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f52267fc640 1 -- 172.21.15.12:0/1608492483 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52280ad860 con 0x7f521c003980 2023-10-16T23:28:38.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f52381ab640 1 -- 172.21.15.12:0/1608492483 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52301e3280 con 0x7f521c003980 2023-10-16T23:28:38.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f52267fc640 1 -- 172.21.15.12:0/1608492483 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52280adbf0 con 0x7f521c003980 2023-10-16T23:28:38.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f52381ab640 1 -- 172.21.15.12:0/1608492483 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5230147380 con 0x7f521c003980 2023-10-16T23:28:38.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f52381ab640 1 -- 172.21.15.12:0/1608492483 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5230147540 con 0x7f521c003980 2023-10-16T23:28:38.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f52267fc640 1 -- 172.21.15.12:0/1608492483 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f52280b4040 con 0x7f521c003980 2023-10-16T23:28:38.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f52267fc640 1 --2- 172.21.15.12:0/1608492483 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5214065e60 0x7f5214068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f52267fc640 1 -- 172.21.15.12:0/1608492483 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f522811e1b0 con 0x7f521c003980 2023-10-16T23:28:38.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f52267fc640 1 --2- 172.21.15.12:0/1608492483 >> [v2:172.21.15.31:6805/38264,v1:172.21.15.31:6807/38264] conn(0x7f521406e760 0x7f5214070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f52267fc640 1 -- 172.21.15.12:0/1608492483 --> [v2:172.21.15.31:6805/38264,v1:172.21.15.31:6807/38264] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5214071270 con 0x7f521406e760 2023-10-16T23:28:38.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f52267fc640 1 -- 172.21.15.12:0/1608492483 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f522811e520 con 0x7f521c003980 2023-10-16T23:28:38.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f5235746640 1 --2- 172.21.15.12:0/1608492483 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5214065e60 0x7f5214068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.400+0000 7f5236748640 1 --2- 172.21.15.12:0/1608492483 >> [v2:172.21.15.31:6805/38264,v1:172.21.15.31:6807/38264] conn(0x7f521406e760 0x7f5214070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.404+0000 7f5235746640 1 --2- 172.21.15.12:0/1608492483 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5214065e60 0x7f5214068320 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5230150780 tx=0x7f5220008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:38.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.404+0000 7f5236748640 1 --2- 172.21.15.12:0/1608492483 >> [v2:172.21.15.31:6805/38264,v1:172.21.15.31:6807/38264] conn(0x7f521406e760 0x7f5214070ba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:38.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.404+0000 7f52267fc640 1 -- 172.21.15.12:0/1608492483 <== osd.5 v2:172.21.15.31:6805/38264 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5214071270 con 0x7f521406e760 2023-10-16T23:28:38.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.416+0000 7f52381ab640 1 -- 172.21.15.12:0/1608492483 --> [v2:172.21.15.31:6805/38264,v1:172.21.15.31:6807/38264] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f52300673a0 con 0x7f521406e760 2023-10-16T23:28:38.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.416+0000 7f52267fc640 1 -- 172.21.15.12:0/1608492483 <== osd.5 v2:172.21.15.31:6805/38264 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f52300673a0 con 0x7f521406e760 2023-10-16T23:28:38.429 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-16T23:28:38.429 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T23:28:38.430 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-16T23:28:38.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.416+0000 7f52381ab640 1 -- 172.21.15.12:0/1608492483 >> [v2:172.21.15.31:6805/38264,v1:172.21.15.31:6807/38264] conn(0x7f521406e760 msgr2=0x7f5214070ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.416+0000 7f52381ab640 1 --2- 172.21.15.12:0/1608492483 >> [v2:172.21.15.31:6805/38264,v1:172.21.15.31:6807/38264] conn(0x7f521406e760 0x7f5214070ba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.416+0000 7f52381ab640 1 -- 172.21.15.12:0/1608492483 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5214065e60 msgr2=0x7f5214068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.416+0000 7f52381ab640 1 --2- 172.21.15.12:0/1608492483 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f5214065e60 0x7f5214068320 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5230150780 tx=0x7f5220008040 comp rx=0 tx=0).stop 2023-10-16T23:28:38.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.416+0000 7f52381ab640 1 -- 172.21.15.12:0/1608492483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f521c003980 msgr2=0x7f5230151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.416+0000 7f52381ab640 1 --2- 172.21.15.12:0/1608492483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f521c003980 0x7f5230151200 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5228098680 tx=0x7f5228009750 comp rx=0 tx=0).stop 2023-10-16T23:28:38.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.416+0000 7f5236748640 1 -- 172.21.15.12:0/1608492483 reap_dead start 2023-10-16T23:28:38.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.416+0000 7f52381ab640 1 -- 172.21.15.12:0/1608492483 shutdown_connections 2023-10-16T23:28:38.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.416+0000 7f52381ab640 1 -- 172.21.15.12:0/1608492483 >> 172.21.15.12:0/1608492483 conn(0x7f52300bd240 msgr2=0x7f523013e800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:38.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.416+0000 7f52381ab640 1 -- 172.21.15.12:0/1608492483 shutdown_connections 2023-10-16T23:28:38.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.416+0000 7f52381ab640 1 -- 172.21.15.12:0/1608492483 wait complete. 2023-10-16T23:28:38.435 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-16T23:28:38.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.544+0000 7f076e0a1640 1 Processor -- start 2023-10-16T23:28:38.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.544+0000 7f076e0a1640 1 -- start start 2023-10-16T23:28:38.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.544+0000 7f076e0a1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f07680c1130 0x7f07680b8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.544+0000 7f076e0a1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f076814c520 0x7f076814c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.544+0000 7f076e0a1640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07680b40c0 con 0x7f076814cec0 2023-10-16T23:28:38.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.544+0000 7f076e0a1640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07680b3ca0 con 0x7f07680c1130 2023-10-16T23:28:38.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.544+0000 7f076e0a1640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07680b7ce0 con 0x7f076814c520 2023-10-16T23:28:38.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.544+0000 7f0767fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f076814cec0 0x7f07680b9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51968/0 (socket says 172.21.15.12:51968) 2023-10-16T23:28:38.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.544+0000 7f0767fff640 1 -- 172.21.15.12:0/697514616 learned_addr learned my addr 172.21.15.12:0/697514616 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:38.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.544+0000 7f07677fe640 1 --2- 172.21.15.12:0/697514616 >> v2:172.21.15.12:3300/0 conn(0x7f07680c1130 0x7f07680b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.544+0000 7f0766ffd640 1 --2- 172.21.15.12:0/697514616 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f076814c520 0x7f076814c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.544+0000 7f07667fc640 1 -- 172.21.15.12:0/697514616 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2261799785 0 0) 0x7f07680b40c0 con 0x7f076814cec0 2023-10-16T23:28:38.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.544+0000 7f07667fc640 1 -- 172.21.15.12:0/697514616 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0750003530 con 0x7f076814cec0 2023-10-16T23:28:38.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.544+0000 7f07677fe640 1 -- 172.21.15.12:0/697514616 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f076814c520 msgr2=0x7f076814c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:38.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.544+0000 7f07677fe640 1 --2- 172.21.15.12:0/697514616 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f076814c520 0x7f076814c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.544+0000 7f07677fe640 1 -- 172.21.15.12:0/697514616 >> v1:172.21.15.12:6789/0 conn(0x7f076814cec0 legacy=0x7f07680b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.544+0000 7f07677fe640 1 -- 172.21.15.12:0/697514616 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07680c1510 con 0x7f07680c1130 2023-10-16T23:28:38.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.544+0000 7f0766ffd640 1 --2- 172.21.15.12:0/697514616 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f076814c520 0x7f076814c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:28:38.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f07677fe640 1 --2- 172.21.15.12:0/697514616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07680c1130 0x7f07680b8630 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f07580097c0 tx=0x7f075801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef2586065471d8d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:38.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f07667fc640 1 -- 172.21.15.12:0/697514616 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07680bac70 con 0x7f07680c1130 2023-10-16T23:28:38.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f07667fc640 1 -- 172.21.15.12:0/697514616 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07580ad680 con 0x7f07680c1130 2023-10-16T23:28:38.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f07667fc640 1 -- 172.21.15.12:0/697514616 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07580ad9f0 con 0x7f07680c1130 2023-10-16T23:28:38.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f076e0a1640 1 -- 172.21.15.12:0/697514616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07680c1130 msgr2=0x7f07680b8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f076e0a1640 1 --2- 172.21.15.12:0/697514616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07680c1130 0x7f07680b8630 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f07580097c0 tx=0x7f075801c360 comp rx=0 tx=0).stop 2023-10-16T23:28:38.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f076e0a1640 1 -- 172.21.15.12:0/697514616 shutdown_connections 2023-10-16T23:28:38.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f076e0a1640 1 --2- 172.21.15.12:0/697514616 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f076814c520 0x7f076814c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f076e0a1640 1 --2- 172.21.15.12:0/697514616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07680c1130 0x7f07680b8630 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f076e0a1640 1 -- 172.21.15.12:0/697514616 >> 172.21.15.12:0/697514616 conn(0x7f076806ba20 msgr2=0x7f07680c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:38.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f076e0a1640 1 -- 172.21.15.12:0/697514616 shutdown_connections 2023-10-16T23:28:38.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f076e0a1640 1 -- 172.21.15.12:0/697514616 wait complete. 2023-10-16T23:28:38.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f076e0a1640 1 Processor -- start 2023-10-16T23:28:38.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f076e0a1640 1 -- start start 2023-10-16T23:28:38.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f076e0a1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07680c1130 0x7f07680b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f076e0a1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f076814c520 0x7f0768143950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f076e0a1640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f076814cec0 0x7f0768148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f076e0a1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07680b62d0 con 0x7f07680c1130 2023-10-16T23:28:38.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f076e0a1640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0768141ec0 con 0x7f076814c520 2023-10-16T23:28:38.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f076e0a1640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0768149360 con 0x7f076814cec0 2023-10-16T23:28:38.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f07677fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07680c1130 0x7f07680b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f07677fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07680c1130 0x7f07680b5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33028/0 (socket says 172.21.15.12:33028) 2023-10-16T23:28:38.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f07677fe640 1 -- 172.21.15.12:0/1293583284 learned_addr learned my addr 172.21.15.12:0/1293583284 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:38.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f0767fff640 1 --2- 172.21.15.12:0/1293583284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f076814cec0 0x7f0768148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f0766ffd640 1 --2- 172.21.15.12:0/1293583284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f076814c520 0x7f0768143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f07677fe640 1 -- 172.21.15.12:0/1293583284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f076814cec0 msgr2=0x7f0768148e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f07677fe640 1 --2- 172.21.15.12:0/1293583284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f076814cec0 0x7f0768148e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f07677fe640 1 -- 172.21.15.12:0/1293583284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f076814c520 msgr2=0x7f0768143950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f07677fe640 1 --2- 172.21.15.12:0/1293583284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f076814c520 0x7f0768143950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f07677fe640 1 -- 172.21.15.12:0/1293583284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0758009420 con 0x7f07680c1130 2023-10-16T23:28:38.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f0767fff640 1 --2- 172.21.15.12:0/1293583284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f076814cec0 0x7f0768148e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:38.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f0766ffd640 1 --2- 172.21.15.12:0/1293583284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f076814c520 0x7f0768143950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:38.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f07677fe640 1 --2- 172.21.15.12:0/1293583284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07680c1130 0x7f07680b5630 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f075801c840 tx=0x7f0758019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:38.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.548+0000 7f074ffff640 1 -- 172.21.15.12:0/1293583284 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758004450 con 0x7f07680c1130 2023-10-16T23:28:38.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.552+0000 7f074ffff640 1 -- 172.21.15.12:0/1293583284 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07580ad7f0 con 0x7f07680c1130 2023-10-16T23:28:38.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.552+0000 7f076e0a1640 1 -- 172.21.15.12:0/1293583284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0768157340 con 0x7f07680c1130 2023-10-16T23:28:38.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.552+0000 7f074ffff640 1 -- 172.21.15.12:0/1293583284 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07580adb60 con 0x7f07680c1130 2023-10-16T23:28:38.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.552+0000 7f076e0a1640 1 -- 172.21.15.12:0/1293583284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07681e92c0 con 0x7f07680c1130 2023-10-16T23:28:38.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.552+0000 7f076e0a1640 1 -- 172.21.15.12:0/1293583284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07681571a0 con 0x7f07680c1130 2023-10-16T23:28:38.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.552+0000 7f074ffff640 1 -- 172.21.15.12:0/1293583284 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f07580b4040 con 0x7f07680c1130 2023-10-16T23:28:38.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.552+0000 7f074ffff640 1 --2- 172.21.15.12:0/1293583284 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f0754065e90 0x7f0754068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.552+0000 7f074ffff640 1 -- 172.21.15.12:0/1293583284 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f075811d8d0 con 0x7f07680c1130 2023-10-16T23:28:38.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.552+0000 7f0766ffd640 1 --2- 172.21.15.12:0/1293583284 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f0754065e90 0x7f0754068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.552+0000 7f0766ffd640 1 --2- 172.21.15.12:0/1293583284 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f0754065e90 0x7f0754068350 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0768149cc0 tx=0x7f075c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:38.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.556+0000 7f074ffff640 1 -- 172.21.15.12:0/1293583284 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f07681571a0 con 0x7f07680c1130 2023-10-16T23:28:38.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.712+0000 7f076e0a1640 1 -- 172.21.15.12:0/1293583284 --> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f076815a2c0 con 0x7f0754065e90 2023-10-16T23:28:38.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.712+0000 7f074ffff640 1 -- 172.21.15.12:0/1293583284 <== mgr.4108 v2:172.21.15.31:6832/37949 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f075c009120 con 0x7f0754065e90 2023-10-16T23:28:38.715 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 5 to deep-scrub 2023-10-16T23:28:38.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.712+0000 7f076e0a1640 1 -- 172.21.15.12:0/1293583284 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f0754065e90 msgr2=0x7f0754068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.712+0000 7f076e0a1640 1 --2- 172.21.15.12:0/1293583284 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f0754065e90 0x7f0754068350 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0768149cc0 tx=0x7f075c008040 comp rx=0 tx=0).stop 2023-10-16T23:28:38.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.712+0000 7f076e0a1640 1 -- 172.21.15.12:0/1293583284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07680c1130 msgr2=0x7f07680b5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.712+0000 7f076e0a1640 1 --2- 172.21.15.12:0/1293583284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07680c1130 0x7f07680b5630 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f075801c840 tx=0x7f0758019100 comp rx=0 tx=0).stop 2023-10-16T23:28:38.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.712+0000 7f076e0a1640 1 -- 172.21.15.12:0/1293583284 shutdown_connections 2023-10-16T23:28:38.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.712+0000 7f076e0a1640 1 --2- 172.21.15.12:0/1293583284 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f0754065e90 0x7f0754068350 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.712+0000 7f076e0a1640 1 --2- 172.21.15.12:0/1293583284 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f076814cec0 0x7f0768148e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.712+0000 7f076e0a1640 1 --2- 172.21.15.12:0/1293583284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f076814c520 0x7f0768143950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.712+0000 7f076e0a1640 1 --2- 172.21.15.12:0/1293583284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07680c1130 0x7f07680b5630 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.712+0000 7f076e0a1640 1 -- 172.21.15.12:0/1293583284 >> 172.21.15.12:0/1293583284 conn(0x7f076806ba20 msgr2=0x7f076814a600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:38.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.712+0000 7f076e0a1640 1 -- 172.21.15.12:0/1293583284 shutdown_connections 2023-10-16T23:28:38.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.716+0000 7f076e0a1640 1 -- 172.21.15.12:0/1293583284 wait complete. 2023-10-16T23:28:38.733 INFO:tasks.ceph:Scrubbing osd.6 2023-10-16T23:28:38.734 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-16T23:28:38.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.848+0000 7f4d4721e640 1 Processor -- start 2023-10-16T23:28:38.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.848+0000 7f4d4721e640 1 -- start start 2023-10-16T23:28:38.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d4721e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d4014f1b0 0x7f4d400bb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d4721e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4006e9b0 con 0x7f4d4014f590 2023-10-16T23:28:38.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d4721e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4014fa70 con 0x7f4d4014ad30 2023-10-16T23:28:38.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d4721e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d40071280 con 0x7f4d4014f1b0 2023-10-16T23:28:38.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3ffff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4d4014f590 0x7f4d4014c3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51974/0 (socket says 172.21.15.12:51974) 2023-10-16T23:28:38.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3ffff640 1 -- 172.21.15.12:0/471543926 learned_addr learned my addr 172.21.15.12:0/471543926 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:38.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d44fba640 1 --2- 172.21.15.12:0/471543926 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d4014f1b0 0x7f4d400bb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3f7fe640 1 -- 172.21.15.12:0/471543926 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4110979397 0 0) 0x7f4d4006e9b0 con 0x7f4d4014f590 2023-10-16T23:28:38.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3f7fe640 1 -- 172.21.15.12:0/471543926 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d30003530 con 0x7f4d4014f590 2023-10-16T23:28:38.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3f7fe640 1 -- 172.21.15.12:0/471543926 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4076705601 0 0) 0x7f4d30003530 con 0x7f4d4014f590 2023-10-16T23:28:38.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3f7fe640 1 -- 172.21.15.12:0/471543926 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d4014f1b0 msgr2=0x7f4d400bb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:38.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3f7fe640 1 --2- 172.21.15.12:0/471543926 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d4014f1b0 0x7f4d400bb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3f7fe640 1 -- 172.21.15.12:0/471543926 >> v1:172.21.15.31:6789/0 conn(0x7f4d4014ad30 legacy=0x7f4d4014b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3f7fe640 1 -- 172.21.15.12:0/471543926 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4014caf0 con 0x7f4d4014f590 2023-10-16T23:28:38.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3f7fe640 1 -- 172.21.15.12:0/471543926 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7f4d2c001680 con 0x7f4d4014f590 2023-10-16T23:28:38.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3f7fe640 1 -- 172.21.15.12:0/471543926 >> v1:172.21.15.12:6789/0 conn(0x7f4d4014f590 legacy=0x7f4d4014c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3f7fe640 1 --2- 172.21.15.12:0/471543926 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d300039b0 0x7f4d30003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3f7fe640 1 --2- 172.21.15.12:0/471543926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d300043a0 0x7f4d30004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3f7fe640 1 --2- 172.21.15.12:0/471543926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d30005110 0x7f4d3000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3f7fe640 1 -- 172.21.15.12:0/471543926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d40071280 con 0x7f4d300043a0 2023-10-16T23:28:38.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3f7fe640 1 -- 172.21.15.12:0/471543926 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3000e240 con 0x7f4d30005110 2023-10-16T23:28:38.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3f7fe640 1 -- 172.21.15.12:0/471543926 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3000e400 con 0x7f4d300039b0 2023-10-16T23:28:38.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d44fba640 1 --2- 172.21.15.12:0/471543926 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d4014f1b0 0x7f4d400bb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T23:28:38.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3ffff640 1 --2- 172.21.15.12:0/471543926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d300043a0 0x7f4d30004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d457bb640 1 --2- 172.21.15.12:0/471543926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d30005110 0x7f4d3000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3ffff640 1 -- 172.21.15.12:0/471543926 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d300039b0 msgr2=0x7f4d30003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:38.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3ffff640 1 --2- 172.21.15.12:0/471543926 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d300039b0 0x7f4d30003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3ffff640 1 -- 172.21.15.12:0/471543926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d30005110 msgr2=0x7f4d3000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:38.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3ffff640 1 --2- 172.21.15.12:0/471543926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d30005110 0x7f4d3000dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3ffff640 1 -- 172.21.15.12:0/471543926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d30003530 con 0x7f4d300043a0 2023-10-16T23:28:38.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3ffff640 1 --2- 172.21.15.12:0/471543926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d300043a0 0x7f4d30004870 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00c1c0 tx=0x7f4d2c01cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741b2bf1775907a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:38.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3f7fe640 1 -- 172.21.15.12:0/471543926 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c005ae0 con 0x7f4d300043a0 2023-10-16T23:28:38.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3f7fe640 1 -- 172.21.15.12:0/471543926 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2c005c40 con 0x7f4d300043a0 2023-10-16T23:28:38.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.852+0000 7f4d3f7fe640 1 -- 172.21.15.12:0/471543926 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c0072b0 con 0x7f4d300043a0 2023-10-16T23:28:38.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d4721e640 1 -- 172.21.15.12:0/471543926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d300043a0 msgr2=0x7f4d30004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d4721e640 1 --2- 172.21.15.12:0/471543926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d300043a0 0x7f4d30004870 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00c1c0 tx=0x7f4d2c01cb60 comp rx=0 tx=0).stop 2023-10-16T23:28:38.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d457bb640 1 -- 172.21.15.12:0/471543926 reap_dead start 2023-10-16T23:28:38.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d4721e640 1 -- 172.21.15.12:0/471543926 shutdown_connections 2023-10-16T23:28:38.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d4721e640 1 -- 172.21.15.12:0/471543926 >> 172.21.15.12:0/471543926 conn(0x7f4d400bd240 msgr2=0x7f4d400bd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:38.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d4721e640 1 -- 172.21.15.12:0/471543926 shutdown_connections 2023-10-16T23:28:38.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d4721e640 1 -- 172.21.15.12:0/471543926 wait complete. 2023-10-16T23:28:38.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d4721e640 1 Processor -- start 2023-10-16T23:28:38.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d4721e640 1 -- start start 2023-10-16T23:28:38.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d4721e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d300043a0 0x7f4d400b9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d4721e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d400b31a0 0x7f4d400b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d4721e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d400b4640 0x7f4d401e6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d4721e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d400b6260 con 0x7f4d300043a0 2023-10-16T23:28:38.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d4721e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d400ba100 con 0x7f4d400b4640 2023-10-16T23:28:38.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d4721e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d40146720 con 0x7f4d400b31a0 2023-10-16T23:28:38.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d44fba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d300043a0 0x7f4d400b9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d44fba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d300043a0 0x7f4d400b9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33044/0 (socket says 172.21.15.12:33044) 2023-10-16T23:28:38.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d44fba640 1 -- 172.21.15.12:0/668880421 learned_addr learned my addr 172.21.15.12:0/668880421 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:38.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d3ffff640 1 --2- 172.21.15.12:0/668880421 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d400b31a0 0x7f4d400b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d457bb640 1 --2- 172.21.15.12:0/668880421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d400b4640 0x7f4d401e6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d44fba640 1 -- 172.21.15.12:0/668880421 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d400b31a0 msgr2=0x7f4d400b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d44fba640 1 --2- 172.21.15.12:0/668880421 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d400b31a0 0x7f4d400b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d44fba640 1 -- 172.21.15.12:0/668880421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d400b4640 msgr2=0x7f4d401e6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d44fba640 1 --2- 172.21.15.12:0/668880421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d400b4640 0x7f4d401e6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d44fba640 1 -- 172.21.15.12:0/668880421 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d401eb090 con 0x7f4d300043a0 2023-10-16T23:28:38.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d3ffff640 1 --2- 172.21.15.12:0/668880421 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d400b31a0 0x7f4d400b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:28:38.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d457bb640 1 --2- 172.21.15.12:0/668880421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d400b4640 0x7f4d401e6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:28:38.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d44fba640 1 --2- 172.21.15.12:0/668880421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d300043a0 0x7f4d400b9bc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400afd0 tx=0x7f4d3400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:38.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d3d7fa640 1 -- 172.21.15.12:0/668880421 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3400cbc0 con 0x7f4d300043a0 2023-10-16T23:28:38.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d3d7fa640 1 -- 172.21.15.12:0/668880421 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3400cd20 con 0x7f4d300043a0 2023-10-16T23:28:38.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d3d7fa640 1 -- 172.21.15.12:0/668880421 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34004270 con 0x7f4d300043a0 2023-10-16T23:28:38.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d4721e640 1 -- 172.21.15.12:0/668880421 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d401eb370 con 0x7f4d300043a0 2023-10-16T23:28:38.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.856+0000 7f4d4721e640 1 -- 172.21.15.12:0/668880421 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d401479b0 con 0x7f4d300043a0 2023-10-16T23:28:38.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.860+0000 7f4d4721e640 1 -- 172.21.15.12:0/668880421 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4d400b7550 con 0x7f4d300043a0 2023-10-16T23:28:38.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.860+0000 7f4d3d7fa640 1 -- 172.21.15.12:0/668880421 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f4d340043d0 con 0x7f4d300043a0 2023-10-16T23:28:38.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.860+0000 7f4d3d7fa640 1 --2- 172.21.15.12:0/668880421 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4d24065e90 0x7f4d24068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.860+0000 7f4d3d7fa640 1 -- 172.21.15.12:0/668880421 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4d340837b0 con 0x7f4d300043a0 2023-10-16T23:28:38.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.860+0000 7f4d3d7fa640 1 --2- 172.21.15.12:0/668880421 >> [v2:172.21.15.31:6824/38263,v1:172.21.15.31:6825/38263] conn(0x7f4d2406e790 0x7f4d24070bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:38.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.860+0000 7f4d3d7fa640 1 -- 172.21.15.12:0/668880421 --> [v2:172.21.15.31:6824/38263,v1:172.21.15.31:6825/38263] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d240712a0 con 0x7f4d2406e790 2023-10-16T23:28:38.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.860+0000 7f4d3d7fa640 1 -- 172.21.15.12:0/668880421 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d34083b20 con 0x7f4d300043a0 2023-10-16T23:28:38.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.860+0000 7f4d3ffff640 1 --2- 172.21.15.12:0/668880421 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4d24065e90 0x7f4d24068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.860+0000 7f4d457bb640 1 --2- 172.21.15.12:0/668880421 >> [v2:172.21.15.31:6824/38263,v1:172.21.15.31:6825/38263] conn(0x7f4d2406e790 0x7f4d24070bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:38.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.860+0000 7f4d457bb640 1 --2- 172.21.15.12:0/668880421 >> [v2:172.21.15.31:6824/38263,v1:172.21.15.31:6825/38263] conn(0x7f4d2406e790 0x7f4d24070bd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:38.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.860+0000 7f4d3ffff640 1 --2- 172.21.15.12:0/668880421 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4d24065e90 0x7f4d24068350 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0ab000 tx=0x7f4d2c0a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:38.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.864+0000 7f4d3d7fa640 1 -- 172.21.15.12:0/668880421 <== osd.6 v2:172.21.15.31:6824/38263 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4d240712a0 con 0x7f4d2406e790 2023-10-16T23:28:38.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.876+0000 7f4d4721e640 1 -- 172.21.15.12:0/668880421 --> [v2:172.21.15.31:6824/38263,v1:172.21.15.31:6825/38263] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4d400b60c0 con 0x7f4d2406e790 2023-10-16T23:28:38.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.876+0000 7f4d3d7fa640 1 -- 172.21.15.12:0/668880421 <== osd.6 v2:172.21.15.31:6824/38263 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4d400b60c0 con 0x7f4d2406e790 2023-10-16T23:28:38.885 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-16T23:28:38.885 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T23:28:38.885 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-16T23:28:38.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.876+0000 7f4d4721e640 1 -- 172.21.15.12:0/668880421 >> [v2:172.21.15.31:6824/38263,v1:172.21.15.31:6825/38263] conn(0x7f4d2406e790 msgr2=0x7f4d24070bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.876+0000 7f4d4721e640 1 --2- 172.21.15.12:0/668880421 >> [v2:172.21.15.31:6824/38263,v1:172.21.15.31:6825/38263] conn(0x7f4d2406e790 0x7f4d24070bd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.876+0000 7f4d4721e640 1 -- 172.21.15.12:0/668880421 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4d24065e90 msgr2=0x7f4d24068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.876+0000 7f4d4721e640 1 --2- 172.21.15.12:0/668880421 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f4d24065e90 0x7f4d24068350 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0ab000 tx=0x7f4d2c0a7070 comp rx=0 tx=0).stop 2023-10-16T23:28:38.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.876+0000 7f4d4721e640 1 -- 172.21.15.12:0/668880421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d300043a0 msgr2=0x7f4d400b9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:38.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.876+0000 7f4d4721e640 1 --2- 172.21.15.12:0/668880421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d300043a0 0x7f4d400b9bc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400afd0 tx=0x7f4d3400eca0 comp rx=0 tx=0).stop 2023-10-16T23:28:38.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.876+0000 7f4d457bb640 1 -- 172.21.15.12:0/668880421 reap_dead start 2023-10-16T23:28:38.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.876+0000 7f4d4721e640 1 -- 172.21.15.12:0/668880421 shutdown_connections 2023-10-16T23:28:38.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.876+0000 7f4d4721e640 1 -- 172.21.15.12:0/668880421 >> 172.21.15.12:0/668880421 conn(0x7f4d400bd240 msgr2=0x7f4d40149e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:38.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.876+0000 7f4d4721e640 1 -- 172.21.15.12:0/668880421 shutdown_connections 2023-10-16T23:28:38.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:38.876+0000 7f4d4721e640 1 -- 172.21.15.12:0/668880421 wait complete. 2023-10-16T23:28:38.893 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-16T23:28:39.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.004+0000 7fabdd794640 1 Processor -- start 2023-10-16T23:28:39.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.004+0000 7fabdd794640 1 -- start start 2023-10-16T23:28:39.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.004+0000 7fabdd794640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fabd80c1130 0x7fabd80b8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:39.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.004+0000 7fabdd794640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabd814c520 0x7fabd814c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:39.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.004+0000 7fabdd794640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fabd814cec0 0x7fabd80b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:39.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.004+0000 7fabdd794640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd80b3ca0 con 0x7fabd814cec0 2023-10-16T23:28:39.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.004+0000 7fabdd794640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd80b40c0 con 0x7fabd80c1130 2023-10-16T23:28:39.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.004+0000 7fabdd794640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd80b7ce0 con 0x7fabd814c520 2023-10-16T23:28:39.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.004+0000 7fabd77fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fabd814cec0 0x7fabd80b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:39.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.004+0000 7fabd77fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fabd814cec0 0x7fabd80b9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33056/0 (socket says 172.21.15.12:33056) 2023-10-16T23:28:39.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.004+0000 7fabd77fe640 1 -- 172.21.15.12:0/872447278 learned_addr learned my addr 172.21.15.12:0/872447278 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:39.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.004+0000 7fabd67fc640 1 --2- 172.21.15.12:0/872447278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabd814c520 0x7fabd814c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:39.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.004+0000 7fabd6ffd640 1 --2- 172.21.15.12:0/872447278 >> v2:172.21.15.31:3300/0 conn(0x7fabd80c1130 0x7fabd80b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:39.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.004+0000 7fabd77fe640 1 -- 172.21.15.12:0/872447278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabd814c520 msgr2=0x7fabd814c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:39.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.004+0000 7fabd77fe640 1 --2- 172.21.15.12:0/872447278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabd814c520 0x7fabd814c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.004+0000 7fabd77fe640 1 -- 172.21.15.12:0/872447278 >> v2:172.21.15.31:3300/0 conn(0x7fabd80c1130 msgr2=0x7fabd80b8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:39.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.004+0000 7fabd77fe640 1 --2- 172.21.15.12:0/872447278 >> v2:172.21.15.31:3300/0 conn(0x7fabd80c1130 0x7fabd80b8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.004+0000 7fabd77fe640 1 -- 172.21.15.12:0/872447278 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd80c1510 con 0x7fabd814cec0 2023-10-16T23:28:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.008+0000 7fabd77fe640 1 --2- 172.21.15.12:0/872447278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabd814cec0 0x7fabd80b9f40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fabd806b470 tx=0x7fabd001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524d331d4b7a3a0c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.008+0000 7fabd5ffb640 1 -- 172.21.15.12:0/872447278 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd00a5750 con 0x7fabd814cec0 2023-10-16T23:28:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.008+0000 7fabd5ffb640 1 -- 172.21.15.12:0/872447278 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd00a58b0 con 0x7fabd814cec0 2023-10-16T23:28:39.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.008+0000 7fabd5ffb640 1 -- 172.21.15.12:0/872447278 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd00a5c40 con 0x7fabd814cec0 2023-10-16T23:28:39.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.008+0000 7fabdd794640 1 -- 172.21.15.12:0/872447278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabd814cec0 msgr2=0x7fabd80b9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:39.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.008+0000 7fabdd794640 1 --2- 172.21.15.12:0/872447278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabd814cec0 0x7fabd80b9f40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fabd806b470 tx=0x7fabd001c8b0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.008+0000 7fabdd794640 1 -- 172.21.15.12:0/872447278 shutdown_connections 2023-10-16T23:28:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.008+0000 7fabdd794640 1 --2- 172.21.15.12:0/872447278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabd814cec0 0x7fabd80b9f40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.008+0000 7fabdd794640 1 --2- 172.21.15.12:0/872447278 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabd814c520 0x7fabd814c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.008+0000 7fabdd794640 1 --2- 172.21.15.12:0/872447278 >> v2:172.21.15.31:3300/0 conn(0x7fabd80c1130 0x7fabd80b8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.008+0000 7fabdd794640 1 -- 172.21.15.12:0/872447278 >> 172.21.15.12:0/872447278 conn(0x7fabd806ba20 msgr2=0x7fabd80c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.008+0000 7fabdd794640 1 -- 172.21.15.12:0/872447278 shutdown_connections 2023-10-16T23:28:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.008+0000 7fabdd794640 1 -- 172.21.15.12:0/872447278 wait complete. 2023-10-16T23:28:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.008+0000 7fabdd794640 1 Processor -- start 2023-10-16T23:28:39.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.008+0000 7fabdd794640 1 -- start start 2023-10-16T23:28:39.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.008+0000 7fabdd794640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabd80c1130 0x7fabd814f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:39.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.008+0000 7fabdd794640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabd814c520 0x7fabd8140b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:39.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.008+0000 7fabdd794640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabd814cec0 0x7fabd81410d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:39.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.008+0000 7fabdd794640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd8146800 con 0x7fabd814cec0 2023-10-16T23:28:39.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.008+0000 7fabdd794640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd80b74e0 con 0x7fabd814c520 2023-10-16T23:28:39.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.008+0000 7fabdd794640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd8141610 con 0x7fabd80c1130 2023-10-16T23:28:39.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.008+0000 7fabd77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabd814cec0 0x7fabd81410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:39.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.008+0000 7fabd77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabd814cec0 0x7fabd81410d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33070/0 (socket says 172.21.15.12:33070) 2023-10-16T23:28:39.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.008+0000 7fabd77fe640 1 -- 172.21.15.12:0/2796308193 learned_addr learned my addr 172.21.15.12:0/2796308193 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:39.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.012+0000 7fabd6ffd640 1 --2- 172.21.15.12:0/2796308193 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabd80c1130 0x7fabd814f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:39.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.012+0000 7fabd67fc640 1 --2- 172.21.15.12:0/2796308193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabd814c520 0x7fabd8140b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:39.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.012+0000 7fabd77fe640 1 -- 172.21.15.12:0/2796308193 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabd80c1130 msgr2=0x7fabd814f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:39.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.012+0000 7fabd77fe640 1 --2- 172.21.15.12:0/2796308193 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabd80c1130 0x7fabd814f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.012+0000 7fabd77fe640 1 -- 172.21.15.12:0/2796308193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabd814c520 msgr2=0x7fabd8140b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:39.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.012+0000 7fabd77fe640 1 --2- 172.21.15.12:0/2796308193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabd814c520 0x7fabd8140b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.012+0000 7fabd77fe640 1 -- 172.21.15.12:0/2796308193 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd0009b30 con 0x7fabd814cec0 2023-10-16T23:28:39.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.012+0000 7fabd77fe640 1 --2- 172.21.15.12:0/2796308193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabd814cec0 0x7fabd81410d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fabd00af040 tx=0x7fabd0019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:39.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.012+0000 7fabbf7fe640 1 -- 172.21.15.12:0/2796308193 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd00b8670 con 0x7fabd814cec0 2023-10-16T23:28:39.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.012+0000 7fabbf7fe640 1 -- 172.21.15.12:0/2796308193 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd00b87d0 con 0x7fabd814cec0 2023-10-16T23:28:39.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.012+0000 7fabdd794640 1 -- 172.21.15.12:0/2796308193 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd814fe00 con 0x7fabd814cec0 2023-10-16T23:28:39.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.012+0000 7fabbf7fe640 1 -- 172.21.15.12:0/2796308193 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd00b8b80 con 0x7fabd814cec0 2023-10-16T23:28:39.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.012+0000 7fabdd794640 1 -- 172.21.15.12:0/2796308193 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd81481e0 con 0x7fabd814cec0 2023-10-16T23:28:39.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.012+0000 7fabdd794640 1 -- 172.21.15.12:0/2796308193 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd80673a0 con 0x7fabd814cec0 2023-10-16T23:28:39.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.012+0000 7fabbf7fe640 1 -- 172.21.15.12:0/2796308193 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fabd00b8ce0 con 0x7fabd814cec0 2023-10-16T23:28:39.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.012+0000 7fabbf7fe640 1 --2- 172.21.15.12:0/2796308193 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fabc4065e60 0x7fabc4068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:39.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.012+0000 7fabbf7fe640 1 -- 172.21.15.12:0/2796308193 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fabd011ec20 con 0x7fabd814cec0 2023-10-16T23:28:39.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.012+0000 7fabd6ffd640 1 --2- 172.21.15.12:0/2796308193 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fabc4065e60 0x7fabc4068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:39.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.012+0000 7fabd6ffd640 1 --2- 172.21.15.12:0/2796308193 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fabc4065e60 0x7fabc4068320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fabc800ba30 tx=0x7fabc8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:39.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.016+0000 7fabbf7fe640 1 -- 172.21.15.12:0/2796308193 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fabd00ec490 con 0x7fabd814cec0 2023-10-16T23:28:39.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.172+0000 7fabdd794640 1 -- 172.21.15.12:0/2796308193 --> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fabd80b7aa0 con 0x7fabc4065e60 2023-10-16T23:28:39.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.172+0000 7fabbf7fe640 1 -- 172.21.15.12:0/2796308193 <== mgr.4108 v2:172.21.15.31:6832/37949 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fabd80b7aa0 con 0x7fabc4065e60 2023-10-16T23:28:39.176 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 6 to deep-scrub 2023-10-16T23:28:39.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.176+0000 7fabdd794640 1 -- 172.21.15.12:0/2796308193 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fabc4065e60 msgr2=0x7fabc4068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:39.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.176+0000 7fabdd794640 1 --2- 172.21.15.12:0/2796308193 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fabc4065e60 0x7fabc4068320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fabc800ba30 tx=0x7fabc8008040 comp rx=0 tx=0).stop 2023-10-16T23:28:39.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.176+0000 7fabdd794640 1 -- 172.21.15.12:0/2796308193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabd814cec0 msgr2=0x7fabd81410d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:39.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.176+0000 7fabdd794640 1 --2- 172.21.15.12:0/2796308193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabd814cec0 0x7fabd81410d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fabd00af040 tx=0x7fabd0019650 comp rx=0 tx=0).stop 2023-10-16T23:28:39.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.176+0000 7fabdd794640 1 -- 172.21.15.12:0/2796308193 shutdown_connections 2023-10-16T23:28:39.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.176+0000 7fabdd794640 1 --2- 172.21.15.12:0/2796308193 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fabc4065e60 0x7fabc4068320 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.176+0000 7fabdd794640 1 --2- 172.21.15.12:0/2796308193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabd814cec0 0x7fabd81410d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.176+0000 7fabdd794640 1 --2- 172.21.15.12:0/2796308193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabd814c520 0x7fabd8140b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.176+0000 7fabdd794640 1 --2- 172.21.15.12:0/2796308193 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabd80c1130 0x7fabd814f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.176+0000 7fabdd794640 1 -- 172.21.15.12:0/2796308193 >> 172.21.15.12:0/2796308193 conn(0x7fabd806ba20 msgr2=0x7fabd814da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:39.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.176+0000 7fabdd794640 1 -- 172.21.15.12:0/2796308193 shutdown_connections 2023-10-16T23:28:39.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.176+0000 7fabdd794640 1 -- 172.21.15.12:0/2796308193 wait complete. 2023-10-16T23:28:39.194 INFO:tasks.ceph:Scrubbing osd.7 2023-10-16T23:28:39.195 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-16T23:28:39.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.320+0000 7f95ea9e9640 1 Processor -- start 2023-10-16T23:28:39.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.320+0000 7f95ea9e9640 1 -- start start 2023-10-16T23:28:39.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.320+0000 7f95ea9e9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f95e40c5560 0x7f95e41458e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:39.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.320+0000 7f95ea9e9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f95e4145e20 0x7f95e406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:39.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.320+0000 7f95ea9e9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e40ba2f0 con 0x7f95e4070690 2023-10-16T23:28:39.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.320+0000 7f95ea9e9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e4146290 con 0x7f95e4145e20 2023-10-16T23:28:39.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.320+0000 7f95ea9e9640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e41535b0 con 0x7f95e40c5560 2023-10-16T23:28:39.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.324+0000 7f95e8f86640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f95e4145e20 0x7f95e406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:39.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.324+0000 7f95e37fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f95e4070690 0x7f95e406e6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51978/0 (socket says 172.21.15.12:51978) 2023-10-16T23:28:39.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.324+0000 7f95e37fe640 1 -- 172.21.15.12:0/3636586715 learned_addr learned my addr 172.21.15.12:0/3636586715 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:28:39.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.324+0000 7f95e3fff640 1 --2- 172.21.15.12:0/3636586715 >> v2:172.21.15.31:3300/0 conn(0x7f95e40c5560 0x7f95e41458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:39.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.324+0000 7f95e8f86640 1 -- 172.21.15.12:0/3636586715 >> v2:172.21.15.31:3300/0 conn(0x7f95e40c5560 msgr2=0x7f95e41458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:39.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.324+0000 7f95e8f86640 1 --2- 172.21.15.12:0/3636586715 >> v2:172.21.15.31:3300/0 conn(0x7f95e40c5560 0x7f95e41458e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.324+0000 7f95e8f86640 1 -- 172.21.15.12:0/3636586715 >> v1:172.21.15.12:6789/0 conn(0x7f95e4070690 legacy=0x7f95e406e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:39.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.324+0000 7f95e2ffd640 1 -- 172.21.15.12:0/3636586715 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1731404614 0 0) 0x7f95e40ba2f0 con 0x7f95e4070690 2023-10-16T23:28:39.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.324+0000 7f95e8f86640 1 -- 172.21.15.12:0/3636586715 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e4071360 con 0x7f95e4145e20 2023-10-16T23:28:39.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.324+0000 7f95e8f86640 1 --2- 172.21.15.12:0/3636586715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95e4145e20 0x7f95e406ede0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f95e406db70 tx=0x7f95dc01c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8313f81d1bf603d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:39.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.324+0000 7f95e2ffd640 1 -- 172.21.15.12:0/3636586715 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc0a58d0 con 0x7f95e4145e20 2023-10-16T23:28:39.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.324+0000 7f95e2ffd640 1 -- 172.21.15.12:0/3636586715 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95dc0a5a30 con 0x7f95e4145e20 2023-10-16T23:28:39.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.324+0000 7f95e2ffd640 1 -- 172.21.15.12:0/3636586715 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc0a5dc0 con 0x7f95e4145e20 2023-10-16T23:28:39.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.324+0000 7f95ea9e9640 1 -- 172.21.15.12:0/3636586715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95e4145e20 msgr2=0x7f95e406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:39.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.324+0000 7f95ea9e9640 1 --2- 172.21.15.12:0/3636586715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95e4145e20 0x7f95e406ede0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f95e406db70 tx=0x7f95dc01c7f0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.324+0000 7f95ea9e9640 1 -- 172.21.15.12:0/3636586715 shutdown_connections 2023-10-16T23:28:39.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.324+0000 7f95ea9e9640 1 --2- 172.21.15.12:0/3636586715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95e4145e20 0x7f95e406ede0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.324+0000 7f95ea9e9640 1 --2- 172.21.15.12:0/3636586715 >> v2:172.21.15.31:3300/0 conn(0x7f95e40c5560 0x7f95e41458e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.324+0000 7f95ea9e9640 1 -- 172.21.15.12:0/3636586715 >> 172.21.15.12:0/3636586715 conn(0x7f95e406ba00 msgr2=0x7f95e40c4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:39.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.324+0000 7f95ea9e9640 1 -- 172.21.15.12:0/3636586715 shutdown_connections 2023-10-16T23:28:39.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.324+0000 7f95ea9e9640 1 -- 172.21.15.12:0/3636586715 wait complete. 2023-10-16T23:28:39.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95ea9e9640 1 Processor -- start 2023-10-16T23:28:39.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95ea9e9640 1 -- start start 2023-10-16T23:28:39.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95ea9e9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95e4070690 0x7f95e4149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:39.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95ea9e9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95e40c5560 0x7f95e413f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:39.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95ea9e9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95e4145e20 0x7f95e413fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:39.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95ea9e9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e4148c50 con 0x7f95e40c5560 2023-10-16T23:28:39.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95ea9e9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e41495d0 con 0x7f95e4145e20 2023-10-16T23:28:39.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95ea9e9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e40be3f0 con 0x7f95e4070690 2023-10-16T23:28:39.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95e37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95e40c5560 0x7f95e413f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:39.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95e37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95e40c5560 0x7f95e413f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33094/0 (socket says 172.21.15.12:33094) 2023-10-16T23:28:39.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95e37fe640 1 -- 172.21.15.12:0/833368229 learned_addr learned my addr 172.21.15.12:0/833368229 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:39.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95e3fff640 1 --2- 172.21.15.12:0/833368229 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95e4070690 0x7f95e4149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:39.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95e8f86640 1 --2- 172.21.15.12:0/833368229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95e4145e20 0x7f95e413fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:39.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95e37fe640 1 -- 172.21.15.12:0/833368229 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95e4070690 msgr2=0x7f95e4149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:39.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95e37fe640 1 --2- 172.21.15.12:0/833368229 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95e4070690 0x7f95e4149090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95e37fe640 1 -- 172.21.15.12:0/833368229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95e4145e20 msgr2=0x7f95e413fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:39.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95e37fe640 1 --2- 172.21.15.12:0/833368229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95e4145e20 0x7f95e413fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95e37fe640 1 -- 172.21.15.12:0/833368229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95dc009a70 con 0x7f95e40c5560 2023-10-16T23:28:39.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95e8f86640 1 --2- 172.21.15.12:0/833368229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95e4145e20 0x7f95e413fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:28:39.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95e37fe640 1 --2- 172.21.15.12:0/833368229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95e40c5560 0x7f95e413f6f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f95cc00c520 tx=0x7f95cc00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:39.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95e0ff9640 1 -- 172.21.15.12:0/833368229 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc0074e0 con 0x7f95e40c5560 2023-10-16T23:28:39.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95e0ff9640 1 -- 172.21.15.12:0/833368229 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95cc007640 con 0x7f95e40c5560 2023-10-16T23:28:39.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95ea9e9640 1 -- 172.21.15.12:0/833368229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e41eaff0 con 0x7f95e40c5560 2023-10-16T23:28:39.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95e0ff9640 1 -- 172.21.15.12:0/833368229 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc0049f0 con 0x7f95e40c5560 2023-10-16T23:28:39.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95ea9e9640 1 -- 172.21.15.12:0/833368229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e4147ed0 con 0x7f95e40c5560 2023-10-16T23:28:39.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95ea9e9640 1 -- 172.21.15.12:0/833368229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f95e406f320 con 0x7f95e40c5560 2023-10-16T23:28:39.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.328+0000 7f95e0ff9640 1 -- 172.21.15.12:0/833368229 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f95cc01d440 con 0x7f95e40c5560 2023-10-16T23:28:39.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.332+0000 7f95e0ff9640 1 --2- 172.21.15.12:0/833368229 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f95c4065e60 0x7f95c4068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:39.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.332+0000 7f95e0ff9640 1 -- 172.21.15.12:0/833368229 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f95cc083020 con 0x7f95e40c5560 2023-10-16T23:28:39.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.332+0000 7f95e0ff9640 1 --2- 172.21.15.12:0/833368229 >> [v2:172.21.15.31:6800/38265,v1:172.21.15.31:6801/38265] conn(0x7f95c406e760 0x7f95c4070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:39.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.332+0000 7f95e0ff9640 1 -- 172.21.15.12:0/833368229 --> [v2:172.21.15.31:6800/38265,v1:172.21.15.31:6801/38265] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95c4071270 con 0x7f95c406e760 2023-10-16T23:28:39.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.332+0000 7f95e0ff9640 1 -- 172.21.15.12:0/833368229 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95cc083470 con 0x7f95e40c5560 2023-10-16T23:28:39.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.332+0000 7f95e3fff640 1 --2- 172.21.15.12:0/833368229 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f95c4065e60 0x7f95c4068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:39.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.332+0000 7f95e8f86640 1 --2- 172.21.15.12:0/833368229 >> [v2:172.21.15.31:6800/38265,v1:172.21.15.31:6801/38265] conn(0x7f95c406e760 0x7f95c4070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:39.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.332+0000 7f95e3fff640 1 --2- 172.21.15.12:0/833368229 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f95c4065e60 0x7f95c4068320 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f95e40bf1a0 tx=0x7f95d4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:39.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.332+0000 7f95e8f86640 1 --2- 172.21.15.12:0/833368229 >> [v2:172.21.15.31:6800/38265,v1:172.21.15.31:6801/38265] conn(0x7f95c406e760 0x7f95c4070ba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:39.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.332+0000 7f95e0ff9640 1 -- 172.21.15.12:0/833368229 <== osd.7 v2:172.21.15.31:6800/38265 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f95c4071270 con 0x7f95c406e760 2023-10-16T23:28:39.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.344+0000 7f95ea9e9640 1 -- 172.21.15.12:0/833368229 --> [v2:172.21.15.31:6800/38265,v1:172.21.15.31:6801/38265] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f95e40673a0 con 0x7f95c406e760 2023-10-16T23:28:39.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.348+0000 7f95e0ff9640 1 -- 172.21.15.12:0/833368229 <== osd.7 v2:172.21.15.31:6800/38265 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f95e40673a0 con 0x7f95c406e760 2023-10-16T23:28:39.351 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-16T23:28:39.352 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-16T23:28:39.352 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-16T23:28:39.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.348+0000 7f95ea9e9640 1 -- 172.21.15.12:0/833368229 >> [v2:172.21.15.31:6800/38265,v1:172.21.15.31:6801/38265] conn(0x7f95c406e760 msgr2=0x7f95c4070ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:39.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.348+0000 7f95ea9e9640 1 --2- 172.21.15.12:0/833368229 >> [v2:172.21.15.31:6800/38265,v1:172.21.15.31:6801/38265] conn(0x7f95c406e760 0x7f95c4070ba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.348+0000 7f95ea9e9640 1 -- 172.21.15.12:0/833368229 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f95c4065e60 msgr2=0x7f95c4068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:39.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.348+0000 7f95ea9e9640 1 --2- 172.21.15.12:0/833368229 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f95c4065e60 0x7f95c4068320 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f95e40bf1a0 tx=0x7f95d4008040 comp rx=0 tx=0).stop 2023-10-16T23:28:39.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.348+0000 7f95ea9e9640 1 -- 172.21.15.12:0/833368229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95e40c5560 msgr2=0x7f95e413f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:39.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.348+0000 7f95ea9e9640 1 --2- 172.21.15.12:0/833368229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95e40c5560 0x7f95e413f6f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f95cc00c520 tx=0x7f95cc00c9e0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.348+0000 7f95e8f86640 1 -- 172.21.15.12:0/833368229 reap_dead start 2023-10-16T23:28:39.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.348+0000 7f95ea9e9640 1 -- 172.21.15.12:0/833368229 shutdown_connections 2023-10-16T23:28:39.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.348+0000 7f95ea9e9640 1 -- 172.21.15.12:0/833368229 >> 172.21.15.12:0/833368229 conn(0x7f95e406ba00 msgr2=0x7f95e406e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:39.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.348+0000 7f95ea9e9640 1 -- 172.21.15.12:0/833368229 shutdown_connections 2023-10-16T23:28:39.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.348+0000 7f95ea9e9640 1 -- 172.21.15.12:0/833368229 wait complete. 2023-10-16T23:28:39.366 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-16T23:28:39.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.476+0000 7f3240374640 1 Processor -- start 2023-10-16T23:28:39.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.476+0000 7f3240374640 1 -- start start 2023-10-16T23:28:39.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.476+0000 7f3240374640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f32381492b0 0x7f323814fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:39.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.476+0000 7f3240374640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f32380bd9f0 0x7f32380bddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:39.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.476+0000 7f3240374640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3238149690 con 0x7f32380bd4f0 2023-10-16T23:28:39.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.476+0000 7f3240374640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f323814f920 con 0x7f32380bd9f0 2023-10-16T23:28:39.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.476+0000 7f3240374640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f323814f540 con 0x7f32381492b0 2023-10-16T23:28:39.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.476+0000 7f323e911640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f32380bd9f0 0x7f32380bddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:39.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.476+0000 7f323e911640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f32380bd9f0 0x7f32380bddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33106/0 (socket says 172.21.15.12:33106) 2023-10-16T23:28:39.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.476+0000 7f323e911640 1 -- 172.21.15.12:0/21395609 learned_addr learned my addr 172.21.15.12:0/21395609 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:39.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.476+0000 7f323e911640 1 -- 172.21.15.12:0/21395609 >> v2:172.21.15.31:3300/0 conn(0x7f32381492b0 msgr2=0x7f323814fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:39.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.476+0000 7f323e911640 1 --2- 172.21.15.12:0/21395609 >> v2:172.21.15.31:3300/0 conn(0x7f32381492b0 0x7f323814fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.476+0000 7f323e911640 1 -- 172.21.15.12:0/21395609 >> v1:172.21.15.31:6789/0 conn(0x7f32380bd4f0 legacy=0x7f3238070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:39.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.476+0000 7f323e911640 1 -- 172.21.15.12:0/21395609 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323814f190 con 0x7f32380bd9f0 2023-10-16T23:28:39.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f323e911640 1 --2- 172.21.15.12:0/21395609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32380bd9f0 0x7f32380bddf0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3238072e70 tx=0x7f322801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5321d1ce5624ad10 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:39.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f323d10e640 1 -- 172.21.15.12:0/21395609 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32280ab650 con 0x7f32380bd9f0 2023-10-16T23:28:39.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f323d10e640 1 -- 172.21.15.12:0/21395609 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32280ab7b0 con 0x7f32380bd9f0 2023-10-16T23:28:39.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f323d10e640 1 -- 172.21.15.12:0/21395609 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32280abb40 con 0x7f32380bd9f0 2023-10-16T23:28:39.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f3240374640 1 -- 172.21.15.12:0/21395609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32380bd9f0 msgr2=0x7f32380bddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:39.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f3240374640 1 --2- 172.21.15.12:0/21395609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32380bd9f0 0x7f32380bddf0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3238072e70 tx=0x7f322801c430 comp rx=0 tx=0).stop 2023-10-16T23:28:39.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f3240374640 1 -- 172.21.15.12:0/21395609 shutdown_connections 2023-10-16T23:28:39.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f3240374640 1 --2- 172.21.15.12:0/21395609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32380bd9f0 0x7f32380bddf0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f3240374640 1 --2- 172.21.15.12:0/21395609 >> v2:172.21.15.31:3300/0 conn(0x7f32381492b0 0x7f323814fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f3240374640 1 -- 172.21.15.12:0/21395609 >> 172.21.15.12:0/21395609 conn(0x7f3238069d30 msgr2=0x7f323806a140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:39.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f3240374640 1 -- 172.21.15.12:0/21395609 shutdown_connections 2023-10-16T23:28:39.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f3240374640 1 -- 172.21.15.12:0/21395609 wait complete. 2023-10-16T23:28:39.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f3240374640 1 Processor -- start 2023-10-16T23:28:39.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f3240374640 1 -- start start 2023-10-16T23:28:39.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f3240374640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32380bd4f0 0x7f32381325d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:39.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f3240374640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32380bd9f0 0x7f3238137fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:39.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f3240374640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32381492b0 0x7f323812f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:39.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f3240374640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323814d1c0 con 0x7f32380bd4f0 2023-10-16T23:28:39.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f3240374640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32381eb730 con 0x7f32381492b0 2023-10-16T23:28:39.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f3240374640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3238159870 con 0x7f32380bd9f0 2023-10-16T23:28:39.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f323e110640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32380bd4f0 0x7f32381325d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:39.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f323e110640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32380bd4f0 0x7f32381325d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33124/0 (socket says 172.21.15.12:33124) 2023-10-16T23:28:39.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f323e110640 1 -- 172.21.15.12:0/3660978176 learned_addr learned my addr 172.21.15.12:0/3660978176 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:39.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f323e911640 1 --2- 172.21.15.12:0/3660978176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32381492b0 0x7f323812f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:39.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f323d90f640 1 --2- 172.21.15.12:0/3660978176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32380bd9f0 0x7f3238137fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:39.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f323e110640 1 -- 172.21.15.12:0/3660978176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32380bd9f0 msgr2=0x7f3238137fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:39.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f323e110640 1 --2- 172.21.15.12:0/3660978176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32380bd9f0 0x7f3238137fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f323e110640 1 -- 172.21.15.12:0/3660978176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32381492b0 msgr2=0x7f323812f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:39.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f323e110640 1 --2- 172.21.15.12:0/3660978176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32381492b0 0x7f323812f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f323e110640 1 -- 172.21.15.12:0/3660978176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32280094d0 con 0x7f32380bd4f0 2023-10-16T23:28:39.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f323e110640 1 --2- 172.21.15.12:0/3660978176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32380bd4f0 0x7f32381325d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f323000b410 tx=0x7f323000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:39.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f322effd640 1 -- 172.21.15.12:0/3660978176 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3230011830 con 0x7f32380bd4f0 2023-10-16T23:28:39.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f322effd640 1 -- 172.21.15.12:0/3660978176 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3230011990 con 0x7f32380bd4f0 2023-10-16T23:28:39.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f322effd640 1 -- 172.21.15.12:0/3660978176 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3230011d40 con 0x7f32380bd4f0 2023-10-16T23:28:39.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f3240374640 1 -- 172.21.15.12:0/3660978176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3238138500 con 0x7f32380bd4f0 2023-10-16T23:28:39.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.480+0000 7f3240374640 1 -- 172.21.15.12:0/3660978176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323814ce00 con 0x7f32380bd4f0 2023-10-16T23:28:39.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.484+0000 7f3240374640 1 -- 172.21.15.12:0/3660978176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3238159360 con 0x7f32380bd4f0 2023-10-16T23:28:39.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.484+0000 7f322effd640 1 -- 172.21.15.12:0/3660978176 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f323001a400 con 0x7f32380bd4f0 2023-10-16T23:28:39.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.484+0000 7f322effd640 1 --2- 172.21.15.12:0/3660978176 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f321c065e60 0x7f321c068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:39.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.484+0000 7f322effd640 1 -- 172.21.15.12:0/3660978176 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f32300839b0 con 0x7f32380bd4f0 2023-10-16T23:28:39.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.484+0000 7f323d90f640 1 --2- 172.21.15.12:0/3660978176 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f321c065e60 0x7f321c068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:39.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.484+0000 7f323d90f640 1 --2- 172.21.15.12:0/3660978176 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f321c065e60 0x7f321c068320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3238134e10 tx=0x7f3234009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:39.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.488+0000 7f322effd640 1 -- 172.21.15.12:0/3660978176 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f3238159360 con 0x7f32380bd4f0 2023-10-16T23:28:39.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.640+0000 7f3240374640 1 -- 172.21.15.12:0/3660978176 --> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f3238159360 con 0x7f321c065e60 2023-10-16T23:28:39.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.640+0000 7f322effd640 1 -- 172.21.15.12:0/3660978176 <== mgr.4108 v2:172.21.15.31:6832/37949 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3238159360 con 0x7f321c065e60 2023-10-16T23:28:39.644 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 7 to deep-scrub 2023-10-16T23:28:39.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.640+0000 7f3240374640 1 -- 172.21.15.12:0/3660978176 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f321c065e60 msgr2=0x7f321c068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:39.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.640+0000 7f3240374640 1 --2- 172.21.15.12:0/3660978176 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f321c065e60 0x7f321c068320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3238134e10 tx=0x7f3234009040 comp rx=0 tx=0).stop 2023-10-16T23:28:39.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.640+0000 7f3240374640 1 -- 172.21.15.12:0/3660978176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32380bd4f0 msgr2=0x7f32381325d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:39.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.640+0000 7f3240374640 1 --2- 172.21.15.12:0/3660978176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32380bd4f0 0x7f32381325d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f323000b410 tx=0x7f323000b8d0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.640+0000 7f3240374640 1 -- 172.21.15.12:0/3660978176 shutdown_connections 2023-10-16T23:28:39.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.640+0000 7f3240374640 1 --2- 172.21.15.12:0/3660978176 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f321c065e60 0x7f321c068320 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.640+0000 7f3240374640 1 --2- 172.21.15.12:0/3660978176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32381492b0 0x7f323812f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.640+0000 7f3240374640 1 --2- 172.21.15.12:0/3660978176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f32380bd9f0 0x7f3238137fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.640+0000 7f3240374640 1 --2- 172.21.15.12:0/3660978176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f32380bd4f0 0x7f32381325d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.640+0000 7f3240374640 1 -- 172.21.15.12:0/3660978176 >> 172.21.15.12:0/3660978176 conn(0x7f3238069d30 msgr2=0x7f32380bc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.640+0000 7f3240374640 1 -- 172.21.15.12:0/3660978176 shutdown_connections 2023-10-16T23:28:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.640+0000 7f3240374640 1 -- 172.21.15.12:0/3660978176 wait complete. 2023-10-16T23:28:39.660 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T23:28:39.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.764+0000 7f1ea3deb640 1 Processor -- start 2023-10-16T23:28:39.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.768+0000 7f1ea3deb640 1 -- start start 2023-10-16T23:28:39.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.768+0000 7f1ea3deb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1e9c153080 0x7f1e9c153460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:39.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.768+0000 7f1ea3deb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1e9c06ef60 0x7f1e9c06f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:39.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.768+0000 7f1ea3deb640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e9c071410 con 0x7f1e9c0bc930 2023-10-16T23:28:39.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.768+0000 7f1ea3deb640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e9c06eb50 con 0x7f1e9c153080 2023-10-16T23:28:39.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.768+0000 7f1ea3deb640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e9c1577f0 con 0x7f1e9c06ef60 2023-10-16T23:28:39.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.768+0000 7f1ea1b87640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1e9c153080 0x7f1e9c153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:39.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.768+0000 7f1ea1b87640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1e9c153080 0x7f1e9c153460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33132/0 (socket says 172.21.15.12:33132) 2023-10-16T23:28:39.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.768+0000 7f1ea1b87640 1 -- 172.21.15.12:0/1642465879 learned_addr learned my addr 172.21.15.12:0/1642465879 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:39.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.768+0000 7f1ea2388640 1 --2- 172.21.15.12:0/1642465879 >> v2:172.21.15.31:3300/0 conn(0x7f1e9c06ef60 0x7f1e9c06f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:39.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.768+0000 7f1ea1b87640 1 -- 172.21.15.12:0/1642465879 >> v2:172.21.15.31:3300/0 conn(0x7f1e9c06ef60 msgr2=0x7f1e9c06f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:39.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.768+0000 7f1ea1b87640 1 --2- 172.21.15.12:0/1642465879 >> v2:172.21.15.31:3300/0 conn(0x7f1e9c06ef60 0x7f1e9c06f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.768+0000 7f1ea1b87640 1 -- 172.21.15.12:0/1642465879 >> v1:172.21.15.31:6789/0 conn(0x7f1e9c0bc930 legacy=0x7f1e9c0c0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:28:39.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.768+0000 7f1ea1b87640 1 -- 172.21.15.12:0/1642465879 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9c157ad0 con 0x7f1e9c153080 2023-10-16T23:28:39.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea1b87640 1 --2- 172.21.15.12:0/1642465879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e9c153080 0x7f1e9c153460 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c06d260 tx=0x7f1e9801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c36631d1c7234a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:39.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea0b85640 1 -- 172.21.15.12:0/1642465879 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e980ad640 con 0x7f1e9c153080 2023-10-16T23:28:39.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea0b85640 1 -- 172.21.15.12:0/1642465879 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e980ad7a0 con 0x7f1e9c153080 2023-10-16T23:28:39.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea0b85640 1 -- 172.21.15.12:0/1642465879 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e980adb30 con 0x7f1e9c153080 2023-10-16T23:28:39.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea3deb640 1 -- 172.21.15.12:0/1642465879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e9c153080 msgr2=0x7f1e9c153460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:39.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea3deb640 1 --2- 172.21.15.12:0/1642465879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e9c153080 0x7f1e9c153460 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c06d260 tx=0x7f1e9801c3d0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea3deb640 1 -- 172.21.15.12:0/1642465879 shutdown_connections 2023-10-16T23:28:39.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea3deb640 1 --2- 172.21.15.12:0/1642465879 >> v2:172.21.15.31:3300/0 conn(0x7f1e9c06ef60 0x7f1e9c06f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea3deb640 1 --2- 172.21.15.12:0/1642465879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e9c153080 0x7f1e9c153460 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea3deb640 1 -- 172.21.15.12:0/1642465879 >> 172.21.15.12:0/1642465879 conn(0x7f1e9c06ba20 msgr2=0x7f1e9c0c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:39.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea3deb640 1 -- 172.21.15.12:0/1642465879 shutdown_connections 2023-10-16T23:28:39.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea3deb640 1 -- 172.21.15.12:0/1642465879 wait complete. 2023-10-16T23:28:39.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea3deb640 1 Processor -- start 2023-10-16T23:28:39.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea3deb640 1 -- start start 2023-10-16T23:28:39.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea3deb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e9c06ef60 0x7f1e9c0ba230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:39.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea3deb640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e9c0bc930 0x7f1e9c1eeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:39.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea3deb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e9c153080 0x7f1e9c1ef0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:39.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea3deb640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c1ef600 con 0x7f1e9c153080 2023-10-16T23:28:39.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea3deb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c1efad0 con 0x7f1e9c06ef60 2023-10-16T23:28:39.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea3deb640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c1ec210 con 0x7f1e9c0bc930 2023-10-16T23:28:39.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea2388640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e9c153080 0x7f1e9c1ef0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:39.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea2388640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e9c153080 0x7f1e9c1ef0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33144/0 (socket says 172.21.15.12:33144) 2023-10-16T23:28:39.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea2388640 1 -- 172.21.15.12:0/3826407331 learned_addr learned my addr 172.21.15.12:0/3826407331 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:28:39.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea1386640 1 --2- 172.21.15.12:0/3826407331 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e9c0bc930 0x7f1e9c1eeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:39.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea1b87640 1 --2- 172.21.15.12:0/3826407331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e9c06ef60 0x7f1e9c0ba230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:39.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea2388640 1 -- 172.21.15.12:0/3826407331 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e9c0bc930 msgr2=0x7f1e9c1eeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:39.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea2388640 1 --2- 172.21.15.12:0/3826407331 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e9c0bc930 0x7f1e9c1eeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea2388640 1 -- 172.21.15.12:0/3826407331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e9c06ef60 msgr2=0x7f1e9c0ba230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:39.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea2388640 1 --2- 172.21.15.12:0/3826407331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e9c06ef60 0x7f1e9c0ba230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea2388640 1 -- 172.21.15.12:0/3826407331 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e980094d0 con 0x7f1e9c153080 2023-10-16T23:28:39.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.772+0000 7f1ea2388640 1 --2- 172.21.15.12:0/3826407331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e9c153080 0x7f1e9c1ef0c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1e94007e40 tx=0x7f1e9400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:39.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.776+0000 7f1e927fc640 1 -- 172.21.15.12:0/3826407331 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e94014620 con 0x7f1e9c153080 2023-10-16T23:28:39.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.776+0000 7f1e927fc640 1 -- 172.21.15.12:0/3826407331 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9400ee90 con 0x7f1e9c153080 2023-10-16T23:28:39.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.776+0000 7f1ea3deb640 1 -- 172.21.15.12:0/3826407331 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e9c0703b0 con 0x7f1e9c153080 2023-10-16T23:28:39.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.776+0000 7f1e927fc640 1 -- 172.21.15.12:0/3826407331 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e940149e0 con 0x7f1e9c153080 2023-10-16T23:28:39.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.776+0000 7f1ea3deb640 1 -- 172.21.15.12:0/3826407331 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e9c1ec6d0 con 0x7f1e9c153080 2023-10-16T23:28:39.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.776+0000 7f1ea3deb640 1 -- 172.21.15.12:0/3826407331 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e9c1ec080 con 0x7f1e9c153080 2023-10-16T23:28:39.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.776+0000 7f1e927fc640 1 -- 172.21.15.12:0/3826407331 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f1e94014b40 con 0x7f1e9c153080 2023-10-16T23:28:39.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.776+0000 7f1e927fc640 1 --2- 172.21.15.12:0/3826407331 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1e80065e90 0x7f1e80068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:28:39.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.776+0000 7f1e927fc640 1 -- 172.21.15.12:0/3826407331 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1e940840f0 con 0x7f1e9c153080 2023-10-16T23:28:39.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.776+0000 7f1ea1b87640 1 --2- 172.21.15.12:0/3826407331 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1e80065e90 0x7f1e80068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:28:39.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.776+0000 7f1ea1b87640 1 --2- 172.21.15.12:0/3826407331 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1e80065e90 0x7f1e80068350 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1e980af000 tx=0x7f1e98008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:28:39.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.780+0000 7f1e927fc640 1 -- 172.21.15.12:0/3826407331 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f1e94051790 con 0x7f1e9c153080 2023-10-16T23:28:39.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.932+0000 7f1ea3deb640 1 -- 172.21.15.12:0/3826407331 --> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1e9c070230 con 0x7f1e80065e90 2023-10-16T23:28:39.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.956+0000 7f1e927fc640 1 -- 172.21.15.12:0/3826407331 <== mgr.4108 v2:172.21.15.31:6832/37949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307660 (secure 0 0 0) 0x7f1e980a6040 con 0x7f1e80065e90 2023-10-16T23:28:39.963 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:28:39.965 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-16T23:28:39.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.960+0000 7f1ea3deb640 1 -- 172.21.15.12:0/3826407331 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1e80065e90 msgr2=0x7f1e80068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:39.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.960+0000 7f1ea3deb640 1 --2- 172.21.15.12:0/3826407331 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1e80065e90 0x7f1e80068350 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1e980af000 tx=0x7f1e98008040 comp rx=0 tx=0).stop 2023-10-16T23:28:39.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.960+0000 7f1ea3deb640 1 -- 172.21.15.12:0/3826407331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e9c153080 msgr2=0x7f1e9c1ef0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:28:39.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.960+0000 7f1ea3deb640 1 --2- 172.21.15.12:0/3826407331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e9c153080 0x7f1e9c1ef0c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1e94007e40 tx=0x7f1e9400e4b0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.960+0000 7f1ea3deb640 1 -- 172.21.15.12:0/3826407331 shutdown_connections 2023-10-16T23:28:39.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.960+0000 7f1ea3deb640 1 --2- 172.21.15.12:0/3826407331 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f1e80065e90 0x7f1e80068350 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.960+0000 7f1ea3deb640 1 --2- 172.21.15.12:0/3826407331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e9c153080 0x7f1e9c1ef0c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.960+0000 7f1ea3deb640 1 --2- 172.21.15.12:0/3826407331 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1e9c0bc930 0x7f1e9c1eeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.960+0000 7f1ea3deb640 1 --2- 172.21.15.12:0/3826407331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e9c06ef60 0x7f1e9c0ba230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:28:39.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.960+0000 7f1ea3deb640 1 -- 172.21.15.12:0/3826407331 >> 172.21.15.12:0/3826407331 conn(0x7f1e9c06ba20 msgr2=0x7f1e9c0c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:28:39.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.960+0000 7f1ea3deb640 1 -- 172.21.15.12:0/3826407331 shutdown_connections 2023-10-16T23:28:39.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:28:39.960+0000 7f1ea3deb640 1 -- 172.21.15.12:0/3826407331 wait complete. 2023-10-16T23:28:39.981 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-10-16T23:28:39.305515+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595638,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":217,"num_write_kb":2441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223048,"kb_used_data":3336,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751672,"statfs":{"total":773094113280,"available":772865712128,"internally_reserved":0,"allocated":3416064,"data_stored":2020140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004409"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.243979+0000","last_change":"2023-10-16T23:27:40.706600+0000","last_active":"2023-10-16T23:28:22.243979+0000","last_peered":"2023-10-16T23:28:22.243979+0000","last_clean":"2023-10-16T23:28:22.243979+0000","last_became_active":"2023-10-16T23:27:40.706320+0000","last_became_peered":"2023-10-16T23:27:40.706320+0000","last_unstale":"2023-10-16T23:28:22.243979+0000","last_undegraded":"2023-10-16T23:28:22.243979+0000","last_fullsized":"2023-10-16T23:28:22.243979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:48:20.356964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962517+0000","last_change":"2023-10-16T23:27:40.756555+0000","last_active":"2023-10-16T23:28:22.962517+0000","last_peered":"2023-10-16T23:28:22.962517+0000","last_clean":"2023-10-16T23:28:22.962517+0000","last_became_active":"2023-10-16T23:27:40.754736+0000","last_became_peered":"2023-10-16T23:27:40.754736+0000","last_unstale":"2023-10-16T23:28:22.962517+0000","last_undegraded":"2023-10-16T23:28:22.962517+0000","last_fullsized":"2023-10-16T23:28:22.962517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:26:45.642622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.434354+0000","last_change":"2023-10-16T23:27:40.726586+0000","last_active":"2023-10-16T23:28:23.434354+0000","last_peered":"2023-10-16T23:28:23.434354+0000","last_clean":"2023-10-16T23:28:23.434354+0000","last_became_active":"2023-10-16T23:27:40.725731+0000","last_became_peered":"2023-10-16T23:27:40.725731+0000","last_unstale":"2023-10-16T23:28:23.434354+0000","last_undegraded":"2023-10-16T23:28:23.434354+0000","last_fullsized":"2023-10-16T23:28:23.434354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247656+0000","last_change":"2023-10-16T23:27:40.715543+0000","last_active":"2023-10-16T23:28:22.247656+0000","last_peered":"2023-10-16T23:28:22.247656+0000","last_clean":"2023-10-16T23:28:22.247656+0000","last_became_active":"2023-10-16T23:27:40.714592+0000","last_became_peered":"2023-10-16T23:27:40.714592+0000","last_unstale":"2023-10-16T23:28:22.247656+0000","last_undegraded":"2023-10-16T23:28:22.247656+0000","last_fullsized":"2023-10-16T23:28:22.247656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:42:37.696897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.648949+0000","last_change":"2023-10-16T23:27:40.722734+0000","last_active":"2023-10-16T23:28:23.648949+0000","last_peered":"2023-10-16T23:28:23.648949+0000","last_clean":"2023-10-16T23:28:23.648949+0000","last_became_active":"2023-10-16T23:27:40.722399+0000","last_became_peered":"2023-10-16T23:27:40.722399+0000","last_unstale":"2023-10-16T23:28:23.648949+0000","last_undegraded":"2023-10-16T23:28:23.648949+0000","last_fullsized":"2023-10-16T23:28:23.648949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433340+0000","last_change":"2023-10-16T23:27:40.716139+0000","last_active":"2023-10-16T23:28:23.433340+0000","last_peered":"2023-10-16T23:28:23.433340+0000","last_clean":"2023-10-16T23:28:23.433340+0000","last_became_active":"2023-10-16T23:27:40.715294+0000","last_became_peered":"2023-10-16T23:27:40.715294+0000","last_unstale":"2023-10-16T23:28:23.433340+0000","last_undegraded":"2023-10-16T23:28:23.433340+0000","last_fullsized":"2023-10-16T23:28:23.433340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683398+0000","last_change":"2023-10-16T23:27:40.762253+0000","last_active":"2023-10-16T23:28:22.683398+0000","last_peered":"2023-10-16T23:28:22.683398+0000","last_clean":"2023-10-16T23:28:22.683398+0000","last_became_active":"2023-10-16T23:27:40.760726+0000","last_became_peered":"2023-10-16T23:27:40.760726+0000","last_unstale":"2023-10-16T23:28:22.683398+0000","last_undegraded":"2023-10-16T23:28:22.683398+0000","last_fullsized":"2023-10-16T23:28:22.683398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:50:08.569961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962326+0000","last_change":"2023-10-16T23:27:40.756184+0000","last_active":"2023-10-16T23:28:22.962326+0000","last_peered":"2023-10-16T23:28:22.962326+0000","last_clean":"2023-10-16T23:28:22.962326+0000","last_became_active":"2023-10-16T23:27:40.755276+0000","last_became_peered":"2023-10-16T23:27:40.755276+0000","last_unstale":"2023-10-16T23:28:22.962326+0000","last_undegraded":"2023-10-16T23:28:22.962326+0000","last_fullsized":"2023-10-16T23:28:22.962326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:14:55.995100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.649144+0000","last_change":"2023-10-16T23:27:40.724060+0000","last_active":"2023-10-16T23:28:23.649144+0000","last_peered":"2023-10-16T23:28:23.649144+0000","last_clean":"2023-10-16T23:28:23.649144+0000","last_became_active":"2023-10-16T23:27:40.723701+0000","last_became_peered":"2023-10-16T23:27:40.723701+0000","last_unstale":"2023-10-16T23:28:23.649144+0000","last_undegraded":"2023-10-16T23:28:23.649144+0000","last_fullsized":"2023-10-16T23:28:23.649144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962762+0000","last_change":"2023-10-16T23:27:40.756783+0000","last_active":"2023-10-16T23:28:22.962762+0000","last_peered":"2023-10-16T23:28:22.962762+0000","last_clean":"2023-10-16T23:28:22.962762+0000","last_became_active":"2023-10-16T23:27:40.755772+0000","last_became_peered":"2023-10-16T23:27:40.755772+0000","last_unstale":"2023-10-16T23:28:22.962762+0000","last_undegraded":"2023-10-16T23:28:22.962762+0000","last_fullsized":"2023-10-16T23:28:22.962762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:29:29.966138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.434576+0000","last_change":"2023-10-16T23:27:40.724754+0000","last_active":"2023-10-16T23:28:23.434576+0000","last_peered":"2023-10-16T23:28:23.434576+0000","last_clean":"2023-10-16T23:28:23.434576+0000","last_became_active":"2023-10-16T23:27:40.724031+0000","last_became_peered":"2023-10-16T23:27:40.724031+0000","last_unstale":"2023-10-16T23:28:23.434576+0000","last_undegraded":"2023-10-16T23:28:23.434576+0000","last_fullsized":"2023-10-16T23:28:23.434576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.243519+0000","last_change":"2023-10-16T23:27:40.724453+0000","last_active":"2023-10-16T23:28:22.243519+0000","last_peered":"2023-10-16T23:28:22.243519+0000","last_clean":"2023-10-16T23:28:22.243519+0000","last_became_active":"2023-10-16T23:27:40.724099+0000","last_became_peered":"2023-10-16T23:27:40.724099+0000","last_unstale":"2023-10-16T23:28:22.243519+0000","last_undegraded":"2023-10-16T23:28:22.243519+0000","last_fullsized":"2023-10-16T23:28:22.243519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:01:05.350517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.243081+0000","last_change":"2023-10-16T23:27:40.704484+0000","last_active":"2023-10-16T23:28:22.243081+0000","last_peered":"2023-10-16T23:28:22.243081+0000","last_clean":"2023-10-16T23:28:22.243081+0000","last_became_active":"2023-10-16T23:27:40.704162+0000","last_became_peered":"2023-10-16T23:27:40.704162+0000","last_unstale":"2023-10-16T23:28:22.243081+0000","last_undegraded":"2023-10-16T23:28:22.243081+0000","last_fullsized":"2023-10-16T23:28:22.243081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:15:16.646850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962528+0000","last_change":"2023-10-16T23:27:40.738913+0000","last_active":"2023-10-16T23:28:22.962528+0000","last_peered":"2023-10-16T23:28:22.962528+0000","last_clean":"2023-10-16T23:28:22.962528+0000","last_became_active":"2023-10-16T23:27:40.738070+0000","last_became_peered":"2023-10-16T23:27:40.738070+0000","last_unstale":"2023-10-16T23:28:22.962528+0000","last_undegraded":"2023-10-16T23:28:22.962528+0000","last_fullsized":"2023-10-16T23:28:22.962528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:56:41.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683534+0000","last_change":"2023-10-16T23:27:40.762529+0000","last_active":"2023-10-16T23:28:22.683534+0000","last_peered":"2023-10-16T23:28:22.683534+0000","last_clean":"2023-10-16T23:28:22.683534+0000","last_became_active":"2023-10-16T23:27:40.761570+0000","last_became_peered":"2023-10-16T23:27:40.761570+0000","last_unstale":"2023-10-16T23:28:22.683534+0000","last_undegraded":"2023-10-16T23:28:22.683534+0000","last_fullsized":"2023-10-16T23:28:22.683534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:06:46.449264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433430+0000","last_change":"2023-10-16T23:27:40.719227+0000","last_active":"2023-10-16T23:28:23.433430+0000","last_peered":"2023-10-16T23:28:23.433430+0000","last_clean":"2023-10-16T23:28:23.433430+0000","last_became_active":"2023-10-16T23:27:40.718276+0000","last_became_peered":"2023-10-16T23:27:40.718276+0000","last_unstale":"2023-10-16T23:28:23.433430+0000","last_undegraded":"2023-10-16T23:28:23.433430+0000","last_fullsized":"2023-10-16T23:28:23.433430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.649322+0000","last_change":"2023-10-16T23:27:40.719723+0000","last_active":"2023-10-16T23:28:23.649322+0000","last_peered":"2023-10-16T23:28:23.649322+0000","last_clean":"2023-10-16T23:28:23.649322+0000","last_became_active":"2023-10-16T23:27:40.719402+0000","last_became_peered":"2023-10-16T23:27:40.719402+0000","last_unstale":"2023-10-16T23:28:23.649322+0000","last_undegraded":"2023-10-16T23:28:23.649322+0000","last_fullsized":"2023-10-16T23:28:23.649322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.434805+0000","last_change":"2023-10-16T23:27:40.732931+0000","last_active":"2023-10-16T23:28:23.434805+0000","last_peered":"2023-10-16T23:28:23.434805+0000","last_clean":"2023-10-16T23:28:23.434805+0000","last_became_active":"2023-10-16T23:27:40.732102+0000","last_became_peered":"2023-10-16T23:27:40.732102+0000","last_unstale":"2023-10-16T23:28:23.434805+0000","last_undegraded":"2023-10-16T23:28:23.434805+0000","last_fullsized":"2023-10-16T23:28:23.434805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.244017+0000","last_change":"2023-10-16T23:27:40.728920+0000","last_active":"2023-10-16T23:28:22.244017+0000","last_peered":"2023-10-16T23:28:22.244017+0000","last_clean":"2023-10-16T23:28:22.244017+0000","last_became_active":"2023-10-16T23:27:40.728298+0000","last_became_peered":"2023-10-16T23:27:40.728298+0000","last_unstale":"2023-10-16T23:28:22.244017+0000","last_undegraded":"2023-10-16T23:28:22.244017+0000","last_fullsized":"2023-10-16T23:28:22.244017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:28:33.509782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.434637+0000","last_change":"2023-10-16T23:27:40.745270+0000","last_active":"2023-10-16T23:28:23.434637+0000","last_peered":"2023-10-16T23:28:23.434637+0000","last_clean":"2023-10-16T23:28:23.434637+0000","last_became_active":"2023-10-16T23:27:40.744483+0000","last_became_peered":"2023-10-16T23:27:40.744483+0000","last_unstale":"2023-10-16T23:28:23.434637+0000","last_undegraded":"2023-10-16T23:28:23.434637+0000","last_fullsized":"2023-10-16T23:28:23.434637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683429+0000","last_change":"2023-10-16T23:27:40.761480+0000","last_active":"2023-10-16T23:28:22.683429+0000","last_peered":"2023-10-16T23:28:22.683429+0000","last_clean":"2023-10-16T23:28:22.683429+0000","last_became_active":"2023-10-16T23:27:40.760882+0000","last_became_peered":"2023-10-16T23:27:40.760882+0000","last_unstale":"2023-10-16T23:28:22.683429+0000","last_undegraded":"2023-10-16T23:28:22.683429+0000","last_fullsized":"2023-10-16T23:28:22.683429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:37:38.843931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.648151+0000","last_change":"2023-10-16T23:27:40.722620+0000","last_active":"2023-10-16T23:28:23.648151+0000","last_peered":"2023-10-16T23:28:23.648151+0000","last_clean":"2023-10-16T23:28:23.648151+0000","last_became_active":"2023-10-16T23:27:40.722302+0000","last_became_peered":"2023-10-16T23:27:40.722302+0000","last_unstale":"2023-10-16T23:28:23.648151+0000","last_undegraded":"2023-10-16T23:28:23.648151+0000","last_fullsized":"2023-10-16T23:28:23.648151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.432837+0000","last_change":"2023-10-16T23:27:40.716578+0000","last_active":"2023-10-16T23:28:23.432837+0000","last_peered":"2023-10-16T23:28:23.432837+0000","last_clean":"2023-10-16T23:28:23.432837+0000","last_became_active":"2023-10-16T23:27:40.716228+0000","last_became_peered":"2023-10-16T23:27:40.716228+0000","last_unstale":"2023-10-16T23:28:23.432837+0000","last_undegraded":"2023-10-16T23:28:23.432837+0000","last_fullsized":"2023-10-16T23:28:23.432837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683349+0000","last_change":"2023-10-16T23:27:40.761323+0000","last_active":"2023-10-16T23:28:22.683349+0000","last_peered":"2023-10-16T23:28:22.683349+0000","last_clean":"2023-10-16T23:28:22.683349+0000","last_became_active":"2023-10-16T23:27:40.760659+0000","last_became_peered":"2023-10-16T23:27:40.760659+0000","last_unstale":"2023-10-16T23:28:22.683349+0000","last_undegraded":"2023-10-16T23:28:22.683349+0000","last_fullsized":"2023-10-16T23:28:22.683349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:09:55.835429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.650162+0000","last_change":"2023-10-16T23:27:40.727629+0000","last_active":"2023-10-16T23:28:23.650162+0000","last_peered":"2023-10-16T23:28:23.650162+0000","last_clean":"2023-10-16T23:28:23.650162+0000","last_became_active":"2023-10-16T23:27:40.727334+0000","last_became_peered":"2023-10-16T23:27:40.727334+0000","last_unstale":"2023-10-16T23:28:23.650162+0000","last_undegraded":"2023-10-16T23:28:23.650162+0000","last_fullsized":"2023-10-16T23:28:23.650162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.650009+0000","last_change":"2023-10-16T23:27:40.704775+0000","last_active":"2023-10-16T23:28:23.650009+0000","last_peered":"2023-10-16T23:28:23.650009+0000","last_clean":"2023-10-16T23:28:23.650009+0000","last_became_active":"2023-10-16T23:27:40.704536+0000","last_became_peered":"2023-10-16T23:27:40.704536+0000","last_unstale":"2023-10-16T23:28:23.650009+0000","last_undegraded":"2023-10-16T23:28:23.650009+0000","last_fullsized":"2023-10-16T23:28:23.650009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962992+0000","last_change":"2023-10-16T23:27:40.764351+0000","last_active":"2023-10-16T23:28:22.962992+0000","last_peered":"2023-10-16T23:28:22.962992+0000","last_clean":"2023-10-16T23:28:22.962992+0000","last_became_active":"2023-10-16T23:27:40.763592+0000","last_became_peered":"2023-10-16T23:27:40.763592+0000","last_unstale":"2023-10-16T23:28:22.962992+0000","last_undegraded":"2023-10-16T23:28:22.962992+0000","last_fullsized":"2023-10-16T23:28:22.962992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:48:07.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.649043+0000","last_change":"2023-10-16T23:27:40.760989+0000","last_active":"2023-10-16T23:28:23.649043+0000","last_peered":"2023-10-16T23:28:23.649043+0000","last_clean":"2023-10-16T23:28:23.649043+0000","last_became_active":"2023-10-16T23:27:40.760615+0000","last_became_peered":"2023-10-16T23:27:40.760615+0000","last_unstale":"2023-10-16T23:28:23.649043+0000","last_undegraded":"2023-10-16T23:28:23.649043+0000","last_fullsized":"2023-10-16T23:28:23.649043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433256+0000","last_change":"2023-10-16T23:27:40.760762+0000","last_active":"2023-10-16T23:28:23.433256+0000","last_peered":"2023-10-16T23:28:23.433256+0000","last_clean":"2023-10-16T23:28:23.433256+0000","last_became_active":"2023-10-16T23:27:40.760437+0000","last_became_peered":"2023-10-16T23:27:40.760437+0000","last_unstale":"2023-10-16T23:28:23.433256+0000","last_undegraded":"2023-10-16T23:28:23.433256+0000","last_fullsized":"2023-10-16T23:28:23.433256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433965+0000","last_change":"2023-10-16T23:27:40.745197+0000","last_active":"2023-10-16T23:28:23.433965+0000","last_peered":"2023-10-16T23:28:23.433965+0000","last_clean":"2023-10-16T23:28:23.433965+0000","last_became_active":"2023-10-16T23:27:40.744458+0000","last_became_peered":"2023-10-16T23:27:40.744458+0000","last_unstale":"2023-10-16T23:28:23.433965+0000","last_undegraded":"2023-10-16T23:28:23.433965+0000","last_fullsized":"2023-10-16T23:28:23.433965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.432942+0000","last_change":"2023-10-16T23:27:40.711795+0000","last_active":"2023-10-16T23:28:23.432942+0000","last_peered":"2023-10-16T23:28:23.432942+0000","last_clean":"2023-10-16T23:28:23.432942+0000","last_became_active":"2023-10-16T23:27:40.711492+0000","last_became_peered":"2023-10-16T23:27:40.711492+0000","last_unstale":"2023-10-16T23:28:23.432942+0000","last_undegraded":"2023-10-16T23:28:23.432942+0000","last_fullsized":"2023-10-16T23:28:23.432942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.245860+0000","last_change":"2023-10-16T23:27:40.710149+0000","last_active":"2023-10-16T23:28:22.245860+0000","last_peered":"2023-10-16T23:28:22.245860+0000","last_clean":"2023-10-16T23:28:22.245860+0000","last_became_active":"2023-10-16T23:27:40.709286+0000","last_became_peered":"2023-10-16T23:27:40.709286+0000","last_unstale":"2023-10-16T23:28:22.245860+0000","last_undegraded":"2023-10-16T23:28:22.245860+0000","last_fullsized":"2023-10-16T23:28:22.245860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:22:41.708468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433514+0000","last_change":"2023-10-16T23:27:40.707271+0000","last_active":"2023-10-16T23:28:23.433514+0000","last_peered":"2023-10-16T23:28:23.433514+0000","last_clean":"2023-10-16T23:28:23.433514+0000","last_became_active":"2023-10-16T23:27:40.706864+0000","last_became_peered":"2023-10-16T23:27:40.706864+0000","last_unstale":"2023-10-16T23:28:23.433514+0000","last_undegraded":"2023-10-16T23:28:23.433514+0000","last_fullsized":"2023-10-16T23:28:23.433514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683702+0000","last_change":"2023-10-16T23:27:40.353567+0000","last_active":"2023-10-16T23:28:22.683702+0000","last_peered":"2023-10-16T23:28:22.683702+0000","last_clean":"2023-10-16T23:28:22.683702+0000","last_became_active":"2023-10-16T23:27:40.352775+0000","last_became_peered":"2023-10-16T23:27:40.352775+0000","last_unstale":"2023-10-16T23:28:22.683702+0000","last_undegraded":"2023-10-16T23:28:22.683702+0000","last_fullsized":"2023-10-16T23:28:22.683702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:52:58.351406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.963098+0000","last_change":"2023-10-16T23:27:40.765398+0000","last_active":"2023-10-16T23:28:22.963098+0000","last_peered":"2023-10-16T23:28:22.963098+0000","last_clean":"2023-10-16T23:28:22.963098+0000","last_became_active":"2023-10-16T23:27:40.764517+0000","last_became_peered":"2023-10-16T23:27:40.764517+0000","last_unstale":"2023-10-16T23:28:22.963098+0000","last_undegraded":"2023-10-16T23:28:22.963098+0000","last_fullsized":"2023-10-16T23:28:22.963098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:31.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.648303+0000","last_change":"2023-10-16T23:27:40.335221+0000","last_active":"2023-10-16T23:28:23.648303+0000","last_peered":"2023-10-16T23:28:23.648303+0000","last_clean":"2023-10-16T23:28:23.648303+0000","last_became_active":"2023-10-16T23:27:40.334885+0000","last_became_peered":"2023-10-16T23:27:40.334885+0000","last_unstale":"2023-10-16T23:28:23.648303+0000","last_undegraded":"2023-10-16T23:28:23.648303+0000","last_fullsized":"2023-10-16T23:28:23.648303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.649328+0000","last_change":"2023-10-16T23:27:40.719997+0000","last_active":"2023-10-16T23:28:23.649328+0000","last_peered":"2023-10-16T23:28:23.649328+0000","last_clean":"2023-10-16T23:28:23.649328+0000","last_became_active":"2023-10-16T23:27:40.719811+0000","last_became_peered":"2023-10-16T23:27:40.719811+0000","last_unstale":"2023-10-16T23:28:23.649328+0000","last_undegraded":"2023-10-16T23:28:23.649328+0000","last_fullsized":"2023-10-16T23:28:23.649328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683767+0000","last_change":"2023-10-16T23:27:40.357620+0000","last_active":"2023-10-16T23:28:22.683767+0000","last_peered":"2023-10-16T23:28:22.683767+0000","last_clean":"2023-10-16T23:28:22.683767+0000","last_became_active":"2023-10-16T23:27:40.357009+0000","last_became_peered":"2023-10-16T23:27:40.357009+0000","last_unstale":"2023-10-16T23:28:22.683767+0000","last_undegraded":"2023-10-16T23:28:22.683767+0000","last_fullsized":"2023-10-16T23:28:22.683767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:07:50.847519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433839+0000","last_change":"2023-10-16T23:27:40.760925+0000","last_active":"2023-10-16T23:28:23.433839+0000","last_peered":"2023-10-16T23:28:23.433839+0000","last_clean":"2023-10-16T23:28:23.433839+0000","last_became_active":"2023-10-16T23:27:40.760365+0000","last_became_peered":"2023-10-16T23:27:40.760365+0000","last_unstale":"2023-10-16T23:28:23.433839+0000","last_undegraded":"2023-10-16T23:28:23.433839+0000","last_fullsized":"2023-10-16T23:28:23.433839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246026+0000","last_change":"2023-10-16T23:27:40.331826+0000","last_active":"2023-10-16T23:28:22.246026+0000","last_peered":"2023-10-16T23:28:22.246026+0000","last_clean":"2023-10-16T23:28:22.246026+0000","last_became_active":"2023-10-16T23:27:40.330857+0000","last_became_peered":"2023-10-16T23:27:40.330857+0000","last_unstale":"2023-10-16T23:28:22.246026+0000","last_undegraded":"2023-10-16T23:28:22.246026+0000","last_fullsized":"2023-10-16T23:28:22.246026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:42:46.614672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.684412+0000","last_change":"2023-10-16T23:27:40.357691+0000","last_active":"2023-10-16T23:28:22.684412+0000","last_peered":"2023-10-16T23:28:22.684412+0000","last_clean":"2023-10-16T23:28:22.684412+0000","last_became_active":"2023-10-16T23:27:40.357047+0000","last_became_peered":"2023-10-16T23:27:40.357047+0000","last_unstale":"2023-10-16T23:28:22.684412+0000","last_undegraded":"2023-10-16T23:28:22.684412+0000","last_fullsized":"2023-10-16T23:28:22.684412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:00:00.805564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962388+0000","last_change":"2023-10-16T23:27:40.763848+0000","last_active":"2023-10-16T23:28:22.962388+0000","last_peered":"2023-10-16T23:28:22.962388+0000","last_clean":"2023-10-16T23:28:22.962388+0000","last_became_active":"2023-10-16T23:27:40.763116+0000","last_became_peered":"2023-10-16T23:27:40.763116+0000","last_unstale":"2023-10-16T23:28:22.962388+0000","last_undegraded":"2023-10-16T23:28:22.962388+0000","last_fullsized":"2023-10-16T23:28:22.962388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:57.203640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.684383+0000","last_change":"2023-10-16T23:27:40.347016+0000","last_active":"2023-10-16T23:28:22.684383+0000","last_peered":"2023-10-16T23:28:22.684383+0000","last_clean":"2023-10-16T23:28:22.684383+0000","last_became_active":"2023-10-16T23:27:40.346439+0000","last_became_peered":"2023-10-16T23:27:40.346439+0000","last_unstale":"2023-10-16T23:28:22.684383+0000","last_undegraded":"2023-10-16T23:28:22.684383+0000","last_fullsized":"2023-10-16T23:28:22.684383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:08:40.047699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433848+0000","last_change":"2023-10-16T23:27:40.714905+0000","last_active":"2023-10-16T23:28:23.433848+0000","last_peered":"2023-10-16T23:28:23.433848+0000","last_clean":"2023-10-16T23:28:23.433848+0000","last_became_active":"2023-10-16T23:27:40.714098+0000","last_became_peered":"2023-10-16T23:27:40.714098+0000","last_unstale":"2023-10-16T23:28:23.433848+0000","last_undegraded":"2023-10-16T23:28:23.433848+0000","last_fullsized":"2023-10-16T23:28:23.433848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.684232+0000","last_change":"2023-10-16T23:27:40.340462+0000","last_active":"2023-10-16T23:28:22.684232+0000","last_peered":"2023-10-16T23:28:22.684232+0000","last_clean":"2023-10-16T23:28:22.684232+0000","last_became_active":"2023-10-16T23:27:40.339531+0000","last_became_peered":"2023-10-16T23:27:40.339531+0000","last_unstale":"2023-10-16T23:28:22.684232+0000","last_undegraded":"2023-10-16T23:28:22.684232+0000","last_fullsized":"2023-10-16T23:28:22.684232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:33:50.768168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246296+0000","last_change":"2023-10-16T23:27:40.713930+0000","last_active":"2023-10-16T23:28:22.246296+0000","last_peered":"2023-10-16T23:28:22.246296+0000","last_clean":"2023-10-16T23:28:22.246296+0000","last_became_active":"2023-10-16T23:27:40.713087+0000","last_became_peered":"2023-10-16T23:27:40.713087+0000","last_unstale":"2023-10-16T23:28:22.246296+0000","last_undegraded":"2023-10-16T23:28:22.246296+0000","last_fullsized":"2023-10-16T23:28:22.246296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:15:24.177529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962633+0000","last_change":"2023-10-16T23:27:40.320848+0000","last_active":"2023-10-16T23:28:22.962633+0000","last_peered":"2023-10-16T23:28:22.962633+0000","last_clean":"2023-10-16T23:28:22.962633+0000","last_became_active":"2023-10-16T23:27:40.319887+0000","last_became_peered":"2023-10-16T23:27:40.319887+0000","last_unstale":"2023-10-16T23:28:22.962633+0000","last_undegraded":"2023-10-16T23:28:22.962633+0000","last_fullsized":"2023-10-16T23:28:22.962633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:33:08.504661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.648467+0000","last_change":"2023-10-16T23:27:40.726405+0000","last_active":"2023-10-16T23:28:23.648467+0000","last_peered":"2023-10-16T23:28:23.648467+0000","last_clean":"2023-10-16T23:28:23.648467+0000","last_became_active":"2023-10-16T23:27:40.725724+0000","last_became_peered":"2023-10-16T23:27:40.725724+0000","last_unstale":"2023-10-16T23:28:23.648467+0000","last_undegraded":"2023-10-16T23:28:23.648467+0000","last_fullsized":"2023-10-16T23:28:23.648467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433444+0000","last_change":"2023-10-16T23:27:40.337756+0000","last_active":"2023-10-16T23:28:23.433444+0000","last_peered":"2023-10-16T23:28:23.433444+0000","last_clean":"2023-10-16T23:28:23.433444+0000","last_became_active":"2023-10-16T23:27:40.337405+0000","last_became_peered":"2023-10-16T23:27:40.337405+0000","last_unstale":"2023-10-16T23:28:23.433444+0000","last_undegraded":"2023-10-16T23:28:23.433444+0000","last_fullsized":"2023-10-16T23:28:23.433444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.434821+0000","last_change":"2023-10-16T23:27:40.722911+0000","last_active":"2023-10-16T23:28:23.434821+0000","last_peered":"2023-10-16T23:28:23.434821+0000","last_clean":"2023-10-16T23:28:23.434821+0000","last_became_active":"2023-10-16T23:27:40.722091+0000","last_became_peered":"2023-10-16T23:27:40.722091+0000","last_unstale":"2023-10-16T23:28:23.434821+0000","last_undegraded":"2023-10-16T23:28:23.434821+0000","last_fullsized":"2023-10-16T23:28:23.434821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.246704+0000","last_change":"2023-10-16T23:27:40.343242+0000","last_active":"2023-10-16T23:28:22.246704+0000","last_peered":"2023-10-16T23:28:22.246704+0000","last_clean":"2023-10-16T23:28:22.246704+0000","last_became_active":"2023-10-16T23:27:40.342213+0000","last_became_peered":"2023-10-16T23:27:40.342213+0000","last_unstale":"2023-10-16T23:28:22.246704+0000","last_undegraded":"2023-10-16T23:28:22.246704+0000","last_fullsized":"2023-10-16T23:28:22.246704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:48:04.095452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.434782+0000","last_change":"2023-10-16T23:27:40.733845+0000","last_active":"2023-10-16T23:28:23.434782+0000","last_peered":"2023-10-16T23:28:23.434782+0000","last_clean":"2023-10-16T23:28:23.434782+0000","last_became_active":"2023-10-16T23:27:40.732996+0000","last_became_peered":"2023-10-16T23:27:40.732996+0000","last_unstale":"2023-10-16T23:28:23.434782+0000","last_undegraded":"2023-10-16T23:28:23.434782+0000","last_fullsized":"2023-10-16T23:28:23.434782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.434542+0000","last_change":"2023-10-16T23:27:40.347984+0000","last_active":"2023-10-16T23:28:23.434542+0000","last_peered":"2023-10-16T23:28:23.434542+0000","last_clean":"2023-10-16T23:28:23.434542+0000","last_became_active":"2023-10-16T23:27:40.347253+0000","last_became_peered":"2023-10-16T23:27:40.347253+0000","last_unstale":"2023-10-16T23:28:23.434542+0000","last_undegraded":"2023-10-16T23:28:23.434542+0000","last_fullsized":"2023-10-16T23:28:23.434542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.435213+0000","last_change":"2023-10-16T23:27:40.745245+0000","last_active":"2023-10-16T23:28:23.435213+0000","last_peered":"2023-10-16T23:28:23.435213+0000","last_clean":"2023-10-16T23:28:23.435213+0000","last_became_active":"2023-10-16T23:27:40.744571+0000","last_became_peered":"2023-10-16T23:27:40.744571+0000","last_unstale":"2023-10-16T23:28:23.435213+0000","last_undegraded":"2023-10-16T23:28:23.435213+0000","last_fullsized":"2023-10-16T23:28:23.435213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433245+0000","last_change":"2023-10-16T23:27:40.314767+0000","last_active":"2023-10-16T23:28:23.433245+0000","last_peered":"2023-10-16T23:28:23.433245+0000","last_clean":"2023-10-16T23:28:23.433245+0000","last_became_active":"2023-10-16T23:27:40.314242+0000","last_became_peered":"2023-10-16T23:27:40.314242+0000","last_unstale":"2023-10-16T23:28:23.433245+0000","last_undegraded":"2023-10-16T23:28:23.433245+0000","last_fullsized":"2023-10-16T23:28:23.433245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.650310+0000","last_change":"2023-10-16T23:27:40.709591+0000","last_active":"2023-10-16T23:28:23.650310+0000","last_peered":"2023-10-16T23:28:23.650310+0000","last_clean":"2023-10-16T23:28:23.650310+0000","last_became_active":"2023-10-16T23:27:40.709174+0000","last_became_peered":"2023-10-16T23:27:40.709174+0000","last_unstale":"2023-10-16T23:28:23.650310+0000","last_undegraded":"2023-10-16T23:28:23.650310+0000","last_fullsized":"2023-10-16T23:28:23.650310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683820+0000","last_change":"2023-10-16T23:27:29.356842+0000","last_active":"2023-10-16T23:28:22.683820+0000","last_peered":"2023-10-16T23:28:22.683820+0000","last_clean":"2023-10-16T23:28:22.683820+0000","last_became_active":"2023-10-16T23:27:29.353846+0000","last_became_peered":"2023-10-16T23:27:29.353846+0000","last_unstale":"2023-10-16T23:28:22.683820+0000","last_undegraded":"2023-10-16T23:28:22.683820+0000","last_fullsized":"2023-10-16T23:28:22.683820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:28.136202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:28.136202+0000","last_clean_scrub_stamp":"2023-10-16T23:27:28.136202+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:34:30.590360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962513+0000","last_change":"2023-10-16T23:27:36.278001+0000","last_active":"2023-10-16T23:28:22.962513+0000","last_peered":"2023-10-16T23:28:22.962513+0000","last_clean":"2023-10-16T23:28:22.962513+0000","last_became_active":"2023-10-16T23:27:36.277096+0000","last_became_peered":"2023-10-16T23:27:36.277096+0000","last_unstale":"2023-10-16T23:28:22.962513+0000","last_undegraded":"2023-10-16T23:28:22.962513+0000","last_fullsized":"2023-10-16T23:28:22.962513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:38:00.468059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433052+0000","last_change":"2023-10-16T23:27:40.331268+0000","last_active":"2023-10-16T23:28:23.433052+0000","last_peered":"2023-10-16T23:28:23.433052+0000","last_clean":"2023-10-16T23:28:23.433052+0000","last_became_active":"2023-10-16T23:27:40.330989+0000","last_became_peered":"2023-10-16T23:27:40.330989+0000","last_unstale":"2023-10-16T23:28:23.433052+0000","last_undegraded":"2023-10-16T23:28:23.433052+0000","last_fullsized":"2023-10-16T23:28:23.433052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247248+0000","last_change":"2023-10-16T23:27:40.726429+0000","last_active":"2023-10-16T23:28:22.247248+0000","last_peered":"2023-10-16T23:28:22.247248+0000","last_clean":"2023-10-16T23:28:22.247248+0000","last_became_active":"2023-10-16T23:27:40.725490+0000","last_became_peered":"2023-10-16T23:27:40.725490+0000","last_unstale":"2023-10-16T23:28:22.247248+0000","last_undegraded":"2023-10-16T23:28:22.247248+0000","last_fullsized":"2023-10-16T23:28:22.247248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:52:41.884757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683589+0000","last_change":"2023-10-16T23:27:36.278865+0000","last_active":"2023-10-16T23:28:22.683589+0000","last_peered":"2023-10-16T23:28:22.683589+0000","last_clean":"2023-10-16T23:28:22.683589+0000","last_became_active":"2023-10-16T23:27:36.277974+0000","last_became_peered":"2023-10-16T23:27:36.277974+0000","last_unstale":"2023-10-16T23:28:22.683589+0000","last_undegraded":"2023-10-16T23:28:22.683589+0000","last_fullsized":"2023-10-16T23:28:22.683589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:31:09.411975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.647773+0000","last_change":"2023-10-16T23:27:40.340025+0000","last_active":"2023-10-16T23:28:23.647773+0000","last_peered":"2023-10-16T23:28:23.647773+0000","last_clean":"2023-10-16T23:28:23.647773+0000","last_became_active":"2023-10-16T23:27:40.339569+0000","last_became_peered":"2023-10-16T23:27:40.339569+0000","last_unstale":"2023-10-16T23:28:23.647773+0000","last_undegraded":"2023-10-16T23:28:23.647773+0000","last_fullsized":"2023-10-16T23:28:23.647773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.648765+0000","last_change":"2023-10-16T23:27:40.727415+0000","last_active":"2023-10-16T23:28:23.648765+0000","last_peered":"2023-10-16T23:28:23.648765+0000","last_clean":"2023-10-16T23:28:23.648765+0000","last_became_active":"2023-10-16T23:27:40.726813+0000","last_became_peered":"2023-10-16T23:27:40.726813+0000","last_unstale":"2023-10-16T23:28:23.648765+0000","last_undegraded":"2023-10-16T23:28:23.648765+0000","last_fullsized":"2023-10-16T23:28:23.648765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.243140+0000","last_change":"2023-10-16T23:27:36.294967+0000","last_active":"2023-10-16T23:28:22.243140+0000","last_peered":"2023-10-16T23:28:22.243140+0000","last_clean":"2023-10-16T23:28:22.243140+0000","last_became_active":"2023-10-16T23:27:36.294489+0000","last_became_peered":"2023-10-16T23:27:36.294489+0000","last_unstale":"2023-10-16T23:28:22.243140+0000","last_undegraded":"2023-10-16T23:28:22.243140+0000","last_fullsized":"2023-10-16T23:28:22.243140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:43:01.777197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.647641+0000","last_change":"2023-10-16T23:27:40.327194+0000","last_active":"2023-10-16T23:28:23.647641+0000","last_peered":"2023-10-16T23:28:23.647641+0000","last_clean":"2023-10-16T23:28:23.647641+0000","last_became_active":"2023-10-16T23:27:40.326396+0000","last_became_peered":"2023-10-16T23:27:40.326396+0000","last_unstale":"2023-10-16T23:28:23.647641+0000","last_undegraded":"2023-10-16T23:28:23.647641+0000","last_fullsized":"2023-10-16T23:28:23.647641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.650387+0000","last_change":"2023-10-16T23:27:40.755777+0000","last_active":"2023-10-16T23:28:23.650387+0000","last_peered":"2023-10-16T23:28:23.650387+0000","last_clean":"2023-10-16T23:28:23.650387+0000","last_became_active":"2023-10-16T23:27:40.755489+0000","last_became_peered":"2023-10-16T23:27:40.755489+0000","last_unstale":"2023-10-16T23:28:23.650387+0000","last_undegraded":"2023-10-16T23:28:23.650387+0000","last_fullsized":"2023-10-16T23:28:23.650387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962747+0000","last_change":"2023-10-16T23:27:36.279013+0000","last_active":"2023-10-16T23:28:22.962747+0000","last_peered":"2023-10-16T23:28:22.962747+0000","last_clean":"2023-10-16T23:28:22.962747+0000","last_became_active":"2023-10-16T23:27:36.278134+0000","last_became_peered":"2023-10-16T23:27:36.278134+0000","last_unstale":"2023-10-16T23:28:22.962747+0000","last_undegraded":"2023-10-16T23:28:22.962747+0000","last_fullsized":"2023-10-16T23:28:22.962747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:13:01.266310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.435658+0000","last_change":"2023-10-16T23:27:40.342715+0000","last_active":"2023-10-16T23:28:23.435658+0000","last_peered":"2023-10-16T23:28:23.435658+0000","last_clean":"2023-10-16T23:28:23.435658+0000","last_became_active":"2023-10-16T23:27:40.341951+0000","last_became_peered":"2023-10-16T23:27:40.341951+0000","last_unstale":"2023-10-16T23:28:23.435658+0000","last_undegraded":"2023-10-16T23:28:23.435658+0000","last_fullsized":"2023-10-16T23:28:23.435658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.648728+0000","last_change":"2023-10-16T23:27:40.731557+0000","last_active":"2023-10-16T23:28:23.648728+0000","last_peered":"2023-10-16T23:28:23.648728+0000","last_clean":"2023-10-16T23:28:23.648728+0000","last_became_active":"2023-10-16T23:27:40.731150+0000","last_became_peered":"2023-10-16T23:27:40.731150+0000","last_unstale":"2023-10-16T23:28:23.648728+0000","last_undegraded":"2023-10-16T23:28:23.648728+0000","last_fullsized":"2023-10-16T23:28:23.648728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.963319+0000","last_change":"2023-10-16T23:27:40.320403+0000","last_active":"2023-10-16T23:28:22.963319+0000","last_peered":"2023-10-16T23:28:22.963319+0000","last_clean":"2023-10-16T23:28:22.963319+0000","last_became_active":"2023-10-16T23:27:40.319571+0000","last_became_peered":"2023-10-16T23:27:40.319571+0000","last_unstale":"2023-10-16T23:28:22.963319+0000","last_undegraded":"2023-10-16T23:28:22.963319+0000","last_fullsized":"2023-10-16T23:28:22.963319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:53:59.252407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.649237+0000","last_change":"2023-10-16T23:27:36.434134+0000","last_active":"2023-10-16T23:28:23.649237+0000","last_peered":"2023-10-16T23:28:23.649237+0000","last_clean":"2023-10-16T23:28:23.649237+0000","last_became_active":"2023-10-16T23:27:36.433808+0000","last_became_peered":"2023-10-16T23:27:36.433808+0000","last_unstale":"2023-10-16T23:28:23.649237+0000","last_undegraded":"2023-10-16T23:28:23.649237+0000","last_fullsized":"2023-10-16T23:28:23.649237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.653934+0000","last_change":"2023-10-16T23:28:23.652508+0000","last_active":"2023-10-16T23:28:23.653934+0000","last_peered":"2023-10-16T23:28:23.653934+0000","last_clean":"2023-10-16T23:28:23.653934+0000","last_became_active":"2023-10-16T23:28:23.651881+0000","last_became_peered":"2023-10-16T23:28:23.651881+0000","last_unstale":"2023-10-16T23:28:23.653934+0000","last_undegraded":"2023-10-16T23:28:23.653934+0000","last_fullsized":"2023-10-16T23:28:23.653934+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:29:45.140655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.649869+0000","last_change":"2023-10-16T23:27:40.328161+0000","last_active":"2023-10-16T23:28:23.649869+0000","last_peered":"2023-10-16T23:28:23.649869+0000","last_clean":"2023-10-16T23:28:23.649869+0000","last_became_active":"2023-10-16T23:27:40.327804+0000","last_became_peered":"2023-10-16T23:27:40.327804+0000","last_unstale":"2023-10-16T23:28:23.649869+0000","last_undegraded":"2023-10-16T23:28:23.649869+0000","last_fullsized":"2023-10-16T23:28:23.649869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.684582+0000","last_change":"2023-10-16T23:27:36.434231+0000","last_active":"2023-10-16T23:28:22.684582+0000","last_peered":"2023-10-16T23:28:22.684582+0000","last_clean":"2023-10-16T23:28:22.684582+0000","last_became_active":"2023-10-16T23:27:36.433923+0000","last_became_peered":"2023-10-16T23:27:36.433923+0000","last_unstale":"2023-10-16T23:28:22.684582+0000","last_undegraded":"2023-10-16T23:28:22.684582+0000","last_fullsized":"2023-10-16T23:28:22.684582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:59.590093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.649621+0000","last_change":"2023-10-16T23:27:40.756257+0000","last_active":"2023-10-16T23:28:23.649621+0000","last_peered":"2023-10-16T23:28:23.649621+0000","last_clean":"2023-10-16T23:28:23.649621+0000","last_became_active":"2023-10-16T23:27:40.755822+0000","last_became_peered":"2023-10-16T23:27:40.755822+0000","last_unstale":"2023-10-16T23:28:23.649621+0000","last_undegraded":"2023-10-16T23:28:23.649621+0000","last_fullsized":"2023-10-16T23:28:23.649621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433765+0000","last_change":"2023-10-16T23:27:40.333672+0000","last_active":"2023-10-16T23:28:23.433765+0000","last_peered":"2023-10-16T23:28:23.433765+0000","last_clean":"2023-10-16T23:28:23.433765+0000","last_became_active":"2023-10-16T23:27:40.333290+0000","last_became_peered":"2023-10-16T23:27:40.333290+0000","last_unstale":"2023-10-16T23:28:23.433765+0000","last_undegraded":"2023-10-16T23:28:23.433765+0000","last_fullsized":"2023-10-16T23:28:23.433765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.650130+0000","last_change":"2023-10-16T23:27:36.278805+0000","last_active":"2023-10-16T23:28:23.650130+0000","last_peered":"2023-10-16T23:28:23.650130+0000","last_clean":"2023-10-16T23:28:23.650130+0000","last_became_active":"2023-10-16T23:27:36.278209+0000","last_became_peered":"2023-10-16T23:27:36.278209+0000","last_unstale":"2023-10-16T23:28:23.650130+0000","last_undegraded":"2023-10-16T23:28:23.650130+0000","last_fullsized":"2023-10-16T23:28:23.650130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.652371+0000","last_change":"2023-10-16T23:28:23.651145+0000","last_active":"2023-10-16T23:28:23.652371+0000","last_peered":"2023-10-16T23:28:23.652371+0000","last_clean":"2023-10-16T23:28:23.652371+0000","last_became_active":"2023-10-16T23:28:23.650570+0000","last_became_peered":"2023-10-16T23:28:23.650570+0000","last_unstale":"2023-10-16T23:28:23.652371+0000","last_undegraded":"2023-10-16T23:28:23.652371+0000","last_fullsized":"2023-10-16T23:28:23.652371+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:46:52.020400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"26'3","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:31.396486+0000","last_change":"2023-10-16T23:27:40.332668+0000","last_active":"2023-10-16T23:28:31.396486+0000","last_peered":"2023-10-16T23:28:31.396486+0000","last_clean":"2023-10-16T23:28:31.396486+0000","last_became_active":"2023-10-16T23:27:40.332084+0000","last_became_peered":"2023-10-16T23:27:40.332084+0000","last_unstale":"2023-10-16T23:28:31.396486+0000","last_undegraded":"2023-10-16T23:28:31.396486+0000","last_fullsized":"2023-10-16T23:28:31.396486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.248016+0000","last_change":"2023-10-16T23:27:36.281494+0000","last_active":"2023-10-16T23:28:22.248016+0000","last_peered":"2023-10-16T23:28:22.248016+0000","last_clean":"2023-10-16T23:28:22.248016+0000","last_became_active":"2023-10-16T23:27:36.280600+0000","last_became_peered":"2023-10-16T23:27:36.280600+0000","last_unstale":"2023-10-16T23:28:22.248016+0000","last_undegraded":"2023-10-16T23:28:22.248016+0000","last_fullsized":"2023-10-16T23:28:22.248016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:42:59.057101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.434193+0000","last_change":"2023-10-16T23:27:40.756574+0000","last_active":"2023-10-16T23:28:23.434193+0000","last_peered":"2023-10-16T23:28:23.434193+0000","last_clean":"2023-10-16T23:28:23.434193+0000","last_became_active":"2023-10-16T23:27:40.755830+0000","last_became_peered":"2023-10-16T23:27:40.755830+0000","last_unstale":"2023-10-16T23:28:23.434193+0000","last_undegraded":"2023-10-16T23:28:23.434193+0000","last_fullsized":"2023-10-16T23:28:23.434193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.435462+0000","last_change":"2023-10-16T23:27:40.745793+0000","last_active":"2023-10-16T23:28:23.435462+0000","last_peered":"2023-10-16T23:28:23.435462+0000","last_clean":"2023-10-16T23:28:23.435462+0000","last_became_active":"2023-10-16T23:27:40.745143+0000","last_became_peered":"2023-10-16T23:27:40.745143+0000","last_unstale":"2023-10-16T23:28:23.435462+0000","last_undegraded":"2023-10-16T23:28:23.435462+0000","last_fullsized":"2023-10-16T23:28:23.435462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"26'15","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:26.610062+0000","last_change":"2023-10-16T23:27:40.352546+0000","last_active":"2023-10-16T23:28:26.610062+0000","last_peered":"2023-10-16T23:28:26.610062+0000","last_clean":"2023-10-16T23:28:26.610062+0000","last_became_active":"2023-10-16T23:27:40.351687+0000","last_became_peered":"2023-10-16T23:27:40.351687+0000","last_unstale":"2023-10-16T23:28:26.610062+0000","last_undegraded":"2023-10-16T23:28:26.610062+0000","last_fullsized":"2023-10-16T23:28:26.610062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4472,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.650835+0000","last_change":"2023-10-16T23:27:40.727602+0000","last_active":"2023-10-16T23:28:23.650835+0000","last_peered":"2023-10-16T23:28:23.650835+0000","last_clean":"2023-10-16T23:28:23.650835+0000","last_became_active":"2023-10-16T23:27:40.727288+0000","last_became_peered":"2023-10-16T23:27:40.727288+0000","last_unstale":"2023-10-16T23:28:23.650835+0000","last_undegraded":"2023-10-16T23:28:23.650835+0000","last_fullsized":"2023-10-16T23:28:23.650835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.683974+0000","last_change":"2023-10-16T23:27:40.332379+0000","last_active":"2023-10-16T23:28:22.683974+0000","last_peered":"2023-10-16T23:28:22.683974+0000","last_clean":"2023-10-16T23:28:22.683974+0000","last_became_active":"2023-10-16T23:27:40.331517+0000","last_became_peered":"2023-10-16T23:27:40.331517+0000","last_unstale":"2023-10-16T23:28:22.683974+0000","last_undegraded":"2023-10-16T23:28:22.683974+0000","last_fullsized":"2023-10-16T23:28:22.683974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:07:55.534068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962827+0000","last_change":"2023-10-16T23:27:40.336300+0000","last_active":"2023-10-16T23:28:22.962827+0000","last_peered":"2023-10-16T23:28:22.962827+0000","last_clean":"2023-10-16T23:28:22.962827+0000","last_became_active":"2023-10-16T23:27:40.333012+0000","last_became_peered":"2023-10-16T23:27:40.333012+0000","last_unstale":"2023-10-16T23:28:22.962827+0000","last_undegraded":"2023-10-16T23:28:22.962827+0000","last_fullsized":"2023-10-16T23:28:22.962827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:26:38.439971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.432946+0000","last_change":"2023-10-16T23:27:40.760984+0000","last_active":"2023-10-16T23:28:23.432946+0000","last_peered":"2023-10-16T23:28:23.432946+0000","last_clean":"2023-10-16T23:28:23.432946+0000","last_became_active":"2023-10-16T23:27:40.760680+0000","last_became_peered":"2023-10-16T23:27:40.760680+0000","last_unstale":"2023-10-16T23:28:23.432946+0000","last_undegraded":"2023-10-16T23:28:23.432946+0000","last_fullsized":"2023-10-16T23:28:23.432946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.649603+0000","last_change":"2023-10-16T23:27:40.339159+0000","last_active":"2023-10-16T23:28:23.649603+0000","last_peered":"2023-10-16T23:28:23.649603+0000","last_clean":"2023-10-16T23:28:23.649603+0000","last_became_active":"2023-10-16T23:27:40.338706+0000","last_became_peered":"2023-10-16T23:27:40.338706+0000","last_unstale":"2023-10-16T23:28:23.649603+0000","last_undegraded":"2023-10-16T23:28:23.649603+0000","last_fullsized":"2023-10-16T23:28:23.649603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.432950+0000","last_change":"2023-10-16T23:27:40.713138+0000","last_active":"2023-10-16T23:28:23.432950+0000","last_peered":"2023-10-16T23:28:23.432950+0000","last_clean":"2023-10-16T23:28:23.432950+0000","last_became_active":"2023-10-16T23:27:40.712756+0000","last_became_peered":"2023-10-16T23:27:40.712756+0000","last_unstale":"2023-10-16T23:28:23.432950+0000","last_undegraded":"2023-10-16T23:28:23.432950+0000","last_fullsized":"2023-10-16T23:28:23.432950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.247821+0000","last_change":"2023-10-16T23:27:40.756418+0000","last_active":"2023-10-16T23:28:22.247821+0000","last_peered":"2023-10-16T23:28:22.247821+0000","last_clean":"2023-10-16T23:28:22.247821+0000","last_became_active":"2023-10-16T23:27:40.755714+0000","last_became_peered":"2023-10-16T23:27:40.755714+0000","last_unstale":"2023-10-16T23:28:22.247821+0000","last_undegraded":"2023-10-16T23:28:22.247821+0000","last_fullsized":"2023-10-16T23:28:22.247821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:56.634821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433196+0000","last_change":"2023-10-16T23:27:40.332275+0000","last_active":"2023-10-16T23:28:23.433196+0000","last_peered":"2023-10-16T23:28:23.433196+0000","last_clean":"2023-10-16T23:28:23.433196+0000","last_became_active":"2023-10-16T23:27:40.331428+0000","last_became_peered":"2023-10-16T23:27:40.331428+0000","last_unstale":"2023-10-16T23:28:23.433196+0000","last_undegraded":"2023-10-16T23:28:23.433196+0000","last_fullsized":"2023-10-16T23:28:23.433196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.648628+0000","last_change":"2023-10-16T23:27:40.761081+0000","last_active":"2023-10-16T23:28:23.648628+0000","last_peered":"2023-10-16T23:28:23.648628+0000","last_clean":"2023-10-16T23:28:23.648628+0000","last_became_active":"2023-10-16T23:27:40.760779+0000","last_became_peered":"2023-10-16T23:27:40.760779+0000","last_unstale":"2023-10-16T23:28:23.648628+0000","last_undegraded":"2023-10-16T23:28:23.648628+0000","last_fullsized":"2023-10-16T23:28:23.648628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.647957+0000","last_change":"2023-10-16T23:27:40.318419+0000","last_active":"2023-10-16T23:28:23.647957+0000","last_peered":"2023-10-16T23:28:23.647957+0000","last_clean":"2023-10-16T23:28:23.647957+0000","last_became_active":"2023-10-16T23:27:40.317622+0000","last_became_peered":"2023-10-16T23:27:40.317622+0000","last_unstale":"2023-10-16T23:28:23.647957+0000","last_undegraded":"2023-10-16T23:28:23.647957+0000","last_fullsized":"2023-10-16T23:28:23.647957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433498+0000","last_change":"2023-10-16T23:27:40.706263+0000","last_active":"2023-10-16T23:28:23.433498+0000","last_peered":"2023-10-16T23:28:23.433498+0000","last_clean":"2023-10-16T23:28:23.433498+0000","last_became_active":"2023-10-16T23:27:40.705956+0000","last_became_peered":"2023-10-16T23:27:40.705956+0000","last_unstale":"2023-10-16T23:28:23.433498+0000","last_undegraded":"2023-10-16T23:28:23.433498+0000","last_fullsized":"2023-10-16T23:28:23.433498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.434209+0000","last_change":"2023-10-16T23:27:40.344965+0000","last_active":"2023-10-16T23:28:23.434209+0000","last_peered":"2023-10-16T23:28:23.434209+0000","last_clean":"2023-10-16T23:28:23.434209+0000","last_became_active":"2023-10-16T23:27:40.344158+0000","last_became_peered":"2023-10-16T23:27:40.344158+0000","last_unstale":"2023-10-16T23:28:23.434209+0000","last_undegraded":"2023-10-16T23:28:23.434209+0000","last_fullsized":"2023-10-16T23:28:23.434209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.243569+0000","last_change":"2023-10-16T23:27:40.713594+0000","last_active":"2023-10-16T23:28:22.243569+0000","last_peered":"2023-10-16T23:28:22.243569+0000","last_clean":"2023-10-16T23:28:22.243569+0000","last_became_active":"2023-10-16T23:27:40.712632+0000","last_became_peered":"2023-10-16T23:27:40.712632+0000","last_unstale":"2023-10-16T23:28:22.243569+0000","last_undegraded":"2023-10-16T23:28:22.243569+0000","last_fullsized":"2023-10-16T23:28:22.243569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:31:52.368847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.649294+0000","last_change":"2023-10-16T23:27:40.357300+0000","last_active":"2023-10-16T23:28:23.649294+0000","last_peered":"2023-10-16T23:28:23.649294+0000","last_clean":"2023-10-16T23:28:23.649294+0000","last_became_active":"2023-10-16T23:27:40.356809+0000","last_became_peered":"2023-10-16T23:27:40.356809+0000","last_unstale":"2023-10-16T23:28:23.649294+0000","last_undegraded":"2023-10-16T23:28:23.649294+0000","last_fullsized":"2023-10-16T23:28:23.649294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.435247+0000","last_change":"2023-10-16T23:27:40.726018+0000","last_active":"2023-10-16T23:28:23.435247+0000","last_peered":"2023-10-16T23:28:23.435247+0000","last_clean":"2023-10-16T23:28:23.435247+0000","last_became_active":"2023-10-16T23:27:40.724910+0000","last_became_peered":"2023-10-16T23:27:40.724910+0000","last_unstale":"2023-10-16T23:28:23.435247+0000","last_undegraded":"2023-10-16T23:28:23.435247+0000","last_fullsized":"2023-10-16T23:28:23.435247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.962608+0000","last_change":"2023-10-16T23:27:40.345785+0000","last_active":"2023-10-16T23:28:22.962608+0000","last_peered":"2023-10-16T23:28:22.962608+0000","last_clean":"2023-10-16T23:28:22.962608+0000","last_became_active":"2023-10-16T23:27:40.344531+0000","last_became_peered":"2023-10-16T23:27:40.344531+0000","last_unstale":"2023-10-16T23:28:22.962608+0000","last_undegraded":"2023-10-16T23:28:22.962608+0000","last_fullsized":"2023-10-16T23:28:22.962608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:12:55.630817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433574+0000","last_change":"2023-10-16T23:27:40.720573+0000","last_active":"2023-10-16T23:28:23.433574+0000","last_peered":"2023-10-16T23:28:23.433574+0000","last_clean":"2023-10-16T23:28:23.433574+0000","last_became_active":"2023-10-16T23:27:40.719758+0000","last_became_peered":"2023-10-16T23:27:40.719758+0000","last_unstale":"2023-10-16T23:28:23.433574+0000","last_undegraded":"2023-10-16T23:28:23.433574+0000","last_fullsized":"2023-10-16T23:28:23.433574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T23:28:22.963212+0000","last_change":"2023-10-16T23:27:40.345400+0000","last_active":"2023-10-16T23:28:22.963212+0000","last_peered":"2023-10-16T23:28:22.963212+0000","last_clean":"2023-10-16T23:28:22.963212+0000","last_became_active":"2023-10-16T23:27:40.344589+0000","last_became_peered":"2023-10-16T23:27:40.344589+0000","last_unstale":"2023-10-16T23:28:22.963212+0000","last_undegraded":"2023-10-16T23:28:22.963212+0000","last_fullsized":"2023-10-16T23:28:22.963212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:15:23.173526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433159+0000","last_change":"2023-10-16T23:27:40.711211+0000","last_active":"2023-10-16T23:28:23.433159+0000","last_peered":"2023-10-16T23:28:23.433159+0000","last_clean":"2023-10-16T23:28:23.433159+0000","last_became_active":"2023-10-16T23:27:40.705936+0000","last_became_peered":"2023-10-16T23:27:40.705936+0000","last_unstale":"2023-10-16T23:28:23.433159+0000","last_undegraded":"2023-10-16T23:28:23.433159+0000","last_fullsized":"2023-10-16T23:28:23.433159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433714+0000","last_change":"2023-10-16T23:27:40.323626+0000","last_active":"2023-10-16T23:28:23.433714+0000","last_peered":"2023-10-16T23:28:23.433714+0000","last_clean":"2023-10-16T23:28:23.433714+0000","last_became_active":"2023-10-16T23:27:40.323352+0000","last_became_peered":"2023-10-16T23:27:40.323352+0000","last_unstale":"2023-10-16T23:28:23.433714+0000","last_undegraded":"2023-10-16T23:28:23.433714+0000","last_fullsized":"2023-10-16T23:28:23.433714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433633+0000","last_change":"2023-10-16T23:27:40.749109+0000","last_active":"2023-10-16T23:28:23.433633+0000","last_peered":"2023-10-16T23:28:23.433633+0000","last_clean":"2023-10-16T23:28:23.433633+0000","last_became_active":"2023-10-16T23:27:40.748525+0000","last_became_peered":"2023-10-16T23:27:40.748525+0000","last_unstale":"2023-10-16T23:28:23.433633+0000","last_undegraded":"2023-10-16T23:28:23.433633+0000","last_fullsized":"2023-10-16T23:28:23.433633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.649490+0000","last_change":"2023-10-16T23:27:40.338946+0000","last_active":"2023-10-16T23:28:23.649490+0000","last_peered":"2023-10-16T23:28:23.649490+0000","last_clean":"2023-10-16T23:28:23.649490+0000","last_became_active":"2023-10-16T23:27:40.338565+0000","last_became_peered":"2023-10-16T23:27:40.338565+0000","last_unstale":"2023-10-16T23:28:23.649490+0000","last_undegraded":"2023-10-16T23:28:23.649490+0000","last_fullsized":"2023-10-16T23:28:23.649490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5270,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":10540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":103608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.70199999999999996}]},{"osd":1,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.76000000000000001}]},{"osd":2,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.81499999999999995}]},{"osd":3,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":1.0329999999999999}]},{"osd":4,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.1220000000000001}]},{"osd":5,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.2650000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":1.079},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":1.0149999999999999}]},{"osd":7,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.1829999999999998,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.98199999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":278528,"data_stored":104260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.79900000000000004}]},{"osd":1,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.1789999999999998,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.179},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.97899999999999998}]},{"osd":2,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.23}]},{"osd":3,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":2.3690000000000002,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":0.626},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.5129999999999999,"5min":2.5129999999999999,"15min":2.5129999999999999},"last":0.88100000000000001}]},{"osd":4,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":3.0640000000000001,"5min":3.0640000000000001,"15min":3.0640000000000001},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":3.1669999999999998,"5min":3.1669999999999998,"15min":3.1669999999999998},"last":1.29}]},{"osd":6,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.6640000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":2.9119999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":1.3560000000000001}]},{"osd":7,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":2.9870000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":1.335},{"interface":"front","average":{"1min":1.345,"5min":1.345,"15min":1.345},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.8610000000000002,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":1.1419999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":108136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.55200000000000005}]},{"osd":1,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":1.02}]},{"osd":2,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.68799999999999994}]},{"osd":3,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.85799999999999998}]},{"osd":5,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":1.0620000000000001}]},{"osd":6,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":1.103},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":1.137}]},{"osd":7,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.95099999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":103698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.79500000000000004}]},{"osd":1,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.55100000000000005}]},{"osd":2,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.92400000000000004}]},{"osd":4,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":1.014}]},{"osd":5,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.085},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":0.995}]},{"osd":6,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.155}]},{"osd":7,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":1.042},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":1.0600000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":103608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.30199999999999999}]},{"osd":2,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.35399999999999998}]},{"osd":3,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.39900000000000002}]},{"osd":4,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.75},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.431,"5min":2.431,"15min":2.431},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.626}]},{"osd":6,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":0.76700000000000002}]},{"osd":7,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.82699999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":868352,"data_stored":694558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.34999999999999998}]},{"osd":2,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.38200000000000001}]},{"osd":3,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.39800000000000002}]},{"osd":4,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.75900000000000001}]},{"osd":5,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.57799999999999996}]},{"osd":6,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.628},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.53300000000000003}]},{"osd":7,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.54400000000000004}]}]},{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":698664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.135},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.73999999999999999}]},{"osd":1,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.01}]},{"osd":2,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.0489999999999999}]},{"osd":3,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.96499999999999997}]},{"osd":4,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.2450000000000001}]},{"osd":5,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":1.2829999999999999}]},{"osd":6,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.742,"5min":2.742,"15min":2.742},"last":1.3480000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":270336,"data_stored":103608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.55600000000000005}]},{"osd":1,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.93600000000000005}]},{"osd":3,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.442},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.38400000000000001}]},{"osd":4,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.63100000000000001}]},{"osd":5,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.76400000000000001}]},{"osd":6,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.84899999999999998}]},{"osd":7,"last update":"Mon Oct 16 23:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.87},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.88800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T23:28:39.991 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:39.991 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:39.992 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:39.992 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:39.993 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:39.993 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:39.994 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:39.994 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:39.994 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:39.995 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:39.995 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:39.995 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:39.996 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:39.996 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:39.997 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:39.997 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:39.998 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:39.998 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:39.998 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:39.999 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:39.999 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.000 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.000 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.000 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.001 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.001 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.002 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.002 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.003 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.003 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.003 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.004 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.004 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.004 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.005 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.005 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.006 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.006 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.006 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.007 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.007 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.008 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.008 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.008 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.009 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.009 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.009 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.010 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.010 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.011 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.011 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.011 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.012 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.012 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.013 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.013 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.013 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-16T23:27:28.136202+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=28, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.014 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-16T23:27:35.237327+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=35, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.014 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.015 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.015 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-16T23:27:35.237327+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=35, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.015 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.016 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.016 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-16T23:27:35.237327+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=35, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.017 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.017 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.017 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-16T23:27:35.237327+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=35, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.018 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.018 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.019 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.019 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-16T23:27:35.237327+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=35, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.020 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.020 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.020 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-16T23:27:35.237327+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=35, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.021 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.021 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.022 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-16T23:27:35.237327+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=35, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.022 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.023 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.023 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-16T23:27:35.237327+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=35, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.023 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.024 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.024 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.025 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.025 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.025 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.026 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.026 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.027 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.027 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.028 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.028 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.028 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.029 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.029 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.030 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.030 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.030 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.031 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.031 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.031 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.032 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.032 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.032 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.033 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:28:40.033 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-16T23:28:40.152 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:28:40.155 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:28:40.157 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:28:40.163 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:28:40.166 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:29:00.034 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T23:29:00.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.163+0000 7fad8d166640 1 Processor -- start 2023-10-16T23:29:00.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.163+0000 7fad8d166640 1 -- start start 2023-10-16T23:29:00.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.167+0000 7fad8d166640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fad880c1130 0x7fad880b8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:29:00.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.167+0000 7fad8d166640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fad8814c520 0x7fad8814c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:29:00.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.167+0000 7fad8d166640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad880b40c0 con 0x7fad8814cef0 2023-10-16T23:29:00.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.167+0000 7fad8d166640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad880b3ca0 con 0x7fad8814c520 2023-10-16T23:29:00.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.167+0000 7fad8d166640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad880b7ce0 con 0x7fad880c1130 2023-10-16T23:29:00.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.167+0000 7fad8659c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fad8814c520 0x7fad8814c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:29:00.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.167+0000 7fad8759e640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fad8814cef0 0x7fad880b9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55460/0 (socket says 172.21.15.12:55460) 2023-10-16T23:29:00.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.167+0000 7fad8759e640 1 -- 172.21.15.12:0/1359926059 learned_addr learned my addr 172.21.15.12:0/1359926059 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:29:00.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.167+0000 7fad86d9d640 1 --2- 172.21.15.12:0/1359926059 >> v2:172.21.15.31:3300/0 conn(0x7fad880c1130 0x7fad880b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:29:00.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.167+0000 7fad8659c640 1 -- 172.21.15.12:0/1359926059 >> v2:172.21.15.31:3300/0 conn(0x7fad880c1130 msgr2=0x7fad880b8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:29:00.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.167+0000 7fad8659c640 1 --2- 172.21.15.12:0/1359926059 >> v2:172.21.15.31:3300/0 conn(0x7fad880c1130 0x7fad880b8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:00.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.167+0000 7fad8659c640 1 -- 172.21.15.12:0/1359926059 >> v1:172.21.15.12:6789/0 conn(0x7fad8814cef0 legacy=0x7fad880b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:29:00.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.167+0000 7fad8659c640 1 -- 172.21.15.12:0/1359926059 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad880c1510 con 0x7fad8814c520 2023-10-16T23:29:00.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.167+0000 7fad8659c640 1 --2- 172.21.15.12:0/1359926059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad8814c520 0x7fad8814c9b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fad8806b470 tx=0x7fad7801c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=710e969825490c26 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:29:00.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.167+0000 7fad85d9b640 1 -- 172.21.15.12:0/1359926059 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad880bac70 con 0x7fad8814c520 2023-10-16T23:29:00.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.167+0000 7fad85d9b640 1 -- 172.21.15.12:0/1359926059 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad780a58d0 con 0x7fad8814c520 2023-10-16T23:29:00.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.167+0000 7fad85d9b640 1 -- 172.21.15.12:0/1359926059 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad780a5c60 con 0x7fad8814c520 2023-10-16T23:29:00.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad8d166640 1 -- 172.21.15.12:0/1359926059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad8814c520 msgr2=0x7fad8814c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:29:00.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad8d166640 1 --2- 172.21.15.12:0/1359926059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad8814c520 0x7fad8814c9b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fad8806b470 tx=0x7fad7801c7f0 comp rx=0 tx=0).stop 2023-10-16T23:29:00.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad8d166640 1 -- 172.21.15.12:0/1359926059 shutdown_connections 2023-10-16T23:29:00.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad8d166640 1 --2- 172.21.15.12:0/1359926059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad8814c520 0x7fad8814c9b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:00.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad8d166640 1 --2- 172.21.15.12:0/1359926059 >> v2:172.21.15.31:3300/0 conn(0x7fad880c1130 0x7fad880b8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:00.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad8d166640 1 -- 172.21.15.12:0/1359926059 >> 172.21.15.12:0/1359926059 conn(0x7fad8806ba20 msgr2=0x7fad880c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:29:00.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad8d166640 1 -- 172.21.15.12:0/1359926059 shutdown_connections 2023-10-16T23:29:00.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad8d166640 1 -- 172.21.15.12:0/1359926059 wait complete. 2023-10-16T23:29:00.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad8d166640 1 Processor -- start 2023-10-16T23:29:00.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad8d166640 1 -- start start 2023-10-16T23:29:00.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad8d166640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad880c1130 0x7fad880b6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:29:00.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad8d166640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad8814c520 0x7fad88144d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:29:00.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad8d166640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad8814cef0 0x7fad88140d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:29:00.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad8d166640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad88146b80 con 0x7fad880c1130 2023-10-16T23:29:00.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad8d166640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad881452c0 con 0x7fad8814c520 2023-10-16T23:29:00.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad8d166640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad880b48a0 con 0x7fad8814cef0 2023-10-16T23:29:00.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad86d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad880c1130 0x7fad880b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:29:00.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad86d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad880c1130 0x7fad880b6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48704/0 (socket says 172.21.15.12:48704) 2023-10-16T23:29:00.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad86d9d640 1 -- 172.21.15.12:0/3040973320 learned_addr learned my addr 172.21.15.12:0/3040973320 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:29:00.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad8759e640 1 --2- 172.21.15.12:0/3040973320 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad8814cef0 0x7fad88140d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:29:00.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad8659c640 1 --2- 172.21.15.12:0/3040973320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad8814c520 0x7fad88144d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:29:00.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad86d9d640 1 -- 172.21.15.12:0/3040973320 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad8814cef0 msgr2=0x7fad88140d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:29:00.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad86d9d640 1 --2- 172.21.15.12:0/3040973320 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad8814cef0 0x7fad88140d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:00.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad86d9d640 1 -- 172.21.15.12:0/3040973320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad8814c520 msgr2=0x7fad88144d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:29:00.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad86d9d640 1 --2- 172.21.15.12:0/3040973320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad8814c520 0x7fad88144d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:00.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad86d9d640 1 -- 172.21.15.12:0/3040973320 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad78009a70 con 0x7fad880c1130 2023-10-16T23:29:00.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad8659c640 1 --2- 172.21.15.12:0/3040973320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad8814c520 0x7fad88144d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:29:00.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad86d9d640 1 --2- 172.21.15.12:0/3040973320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad880c1130 0x7fad880b6420 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fad7000e930 tx=0x7fad7000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:29:00.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad7f7fe640 1 -- 172.21.15.12:0/3040973320 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70009690 con 0x7fad880c1130 2023-10-16T23:29:00.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad7f7fe640 1 -- 172.21.15.12:0/3040973320 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7000ca00 con 0x7fad880c1130 2023-10-16T23:29:00.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad8d166640 1 -- 172.21.15.12:0/3040973320 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad881420c0 con 0x7fad880c1130 2023-10-16T23:29:00.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad7f7fe640 1 -- 172.21.15.12:0/3040973320 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7000cd70 con 0x7fad880c1130 2023-10-16T23:29:00.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.171+0000 7fad8d166640 1 -- 172.21.15.12:0/3040973320 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad88141e70 con 0x7fad880c1130 2023-10-16T23:29:00.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.175+0000 7fad8d166640 1 -- 172.21.15.12:0/3040973320 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad880673a0 con 0x7fad880c1130 2023-10-16T23:29:00.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.175+0000 7fad7f7fe640 1 -- 172.21.15.12:0/3040973320 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fad70013470 con 0x7fad880c1130 2023-10-16T23:29:00.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.175+0000 7fad7f7fe640 1 --2- 172.21.15.12:0/3040973320 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fad68065e60 0x7fad68068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:29:00.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.175+0000 7fad7f7fe640 1 -- 172.21.15.12:0/3040973320 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fad70083a50 con 0x7fad880c1130 2023-10-16T23:29:00.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.175+0000 7fad8659c640 1 --2- 172.21.15.12:0/3040973320 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fad68065e60 0x7fad68068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:29:00.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.175+0000 7fad8659c640 1 --2- 172.21.15.12:0/3040973320 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fad68065e60 0x7fad68068320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fad780af000 tx=0x7fad780a7070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:29:00.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.179+0000 7fad7f7fe640 1 -- 172.21.15.12:0/3040973320 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fad700511b0 con 0x7fad880c1130 2023-10-16T23:29:00.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.335+0000 7fad8d166640 1 -- 172.21.15.12:0/3040973320 --> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fad8815a2c0 con 0x7fad68065e60 2023-10-16T23:29:00.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.363+0000 7fad7f7fe640 1 -- 172.21.15.12:0/3040973320 <== mgr.4108 v2:172.21.15.31:6832/37949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308286 (secure 0 0 0) 0x7fad780a5ca0 con 0x7fad68065e60 2023-10-16T23:29:00.370 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:29:00.373 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-16T23:29:00.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.367+0000 7fad8d166640 1 -- 172.21.15.12:0/3040973320 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fad68065e60 msgr2=0x7fad68068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:29:00.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.367+0000 7fad8d166640 1 --2- 172.21.15.12:0/3040973320 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fad68065e60 0x7fad68068320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fad780af000 tx=0x7fad780a7070 comp rx=0 tx=0).stop 2023-10-16T23:29:00.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.367+0000 7fad8d166640 1 -- 172.21.15.12:0/3040973320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad880c1130 msgr2=0x7fad880b6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:29:00.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.367+0000 7fad8d166640 1 --2- 172.21.15.12:0/3040973320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad880c1130 0x7fad880b6420 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fad7000e930 tx=0x7fad7000edf0 comp rx=0 tx=0).stop 2023-10-16T23:29:00.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.367+0000 7fad8d166640 1 -- 172.21.15.12:0/3040973320 shutdown_connections 2023-10-16T23:29:00.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.367+0000 7fad8d166640 1 --2- 172.21.15.12:0/3040973320 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fad68065e60 0x7fad68068320 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:00.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.367+0000 7fad8d166640 1 --2- 172.21.15.12:0/3040973320 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad8814cef0 0x7fad88140d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:00.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.367+0000 7fad8d166640 1 --2- 172.21.15.12:0/3040973320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad8814c520 0x7fad88144d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:00.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.367+0000 7fad8d166640 1 --2- 172.21.15.12:0/3040973320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad880c1130 0x7fad880b6420 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:00.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.367+0000 7fad8d166640 1 -- 172.21.15.12:0/3040973320 >> 172.21.15.12:0/3040973320 conn(0x7fad8806ba20 msgr2=0x7fad88145fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:29:00.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.367+0000 7fad8d166640 1 -- 172.21.15.12:0/3040973320 shutdown_connections 2023-10-16T23:29:00.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:00.367+0000 7fad8d166640 1 -- 172.21.15.12:0/3040973320 wait complete. 2023-10-16T23:29:00.393 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2023-10-16T23:28:59.313058+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595638,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":217,"num_write_kb":2441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":186,"ondisk_log_size":186,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223048,"kb_used_data":3336,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751672,"statfs":{"total":773094113280,"available":772865712128,"internally_reserved":0,"allocated":3416064,"data_stored":2020140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004376"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:46.347825+0000","last_change":"2023-10-16T23:28:46.348111+0000","last_active":"2023-10-16T23:28:46.347825+0000","last_peered":"2023-10-16T23:28:46.347825+0000","last_clean":"2023-10-16T23:28:46.347825+0000","last_became_active":"2023-10-16T23:27:40.706320+0000","last_became_peered":"2023-10-16T23:27:40.706320+0000","last_unstale":"2023-10-16T23:28:46.347825+0000","last_undegraded":"2023-10-16T23:28:46.347825+0000","last_fullsized":"2023-10-16T23:28:46.347825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:46.347775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:46.347775+0000","last_clean_scrub_stamp":"2023-10-16T23:28:46.347775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:47.920970+0000","scrub_duration":0.0035569769999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.648427+0000","last_change":"2023-10-16T23:27:40.756555+0000","last_active":"2023-10-16T23:28:23.648427+0000","last_peered":"2023-10-16T23:28:23.648427+0000","last_clean":"2023-10-16T23:28:23.648427+0000","last_became_active":"2023-10-16T23:27:40.754736+0000","last_became_peered":"2023-10-16T23:27:40.754736+0000","last_unstale":"2023-10-16T23:28:23.648427+0000","last_undegraded":"2023-10-16T23:28:23.648427+0000","last_fullsized":"2023-10-16T23:28:23.648427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.434354+0000","last_change":"2023-10-16T23:27:40.726586+0000","last_active":"2023-10-16T23:28:23.434354+0000","last_peered":"2023-10-16T23:28:23.434354+0000","last_clean":"2023-10-16T23:28:23.434354+0000","last_became_active":"2023-10-16T23:27:40.725731+0000","last_became_peered":"2023-10-16T23:27:40.725731+0000","last_unstale":"2023-10-16T23:28:23.434354+0000","last_undegraded":"2023-10-16T23:28:23.434354+0000","last_fullsized":"2023-10-16T23:28:23.434354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:50.441103+0000","last_change":"2023-10-16T23:28:50.441396+0000","last_active":"2023-10-16T23:28:50.441103+0000","last_peered":"2023-10-16T23:28:50.441103+0000","last_clean":"2023-10-16T23:28:50.441103+0000","last_became_active":"2023-10-16T23:27:40.714592+0000","last_became_peered":"2023-10-16T23:27:40.714592+0000","last_unstale":"2023-10-16T23:28:50.441103+0000","last_undegraded":"2023-10-16T23:28:50.441103+0000","last_fullsized":"2023-10-16T23:28:50.441103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:50.441050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:50.441050+0000","last_clean_scrub_stamp":"2023-10-16T23:28:50.441050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:12:05.680691+0000","scrub_duration":0.0035120030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.648949+0000","last_change":"2023-10-16T23:27:40.722734+0000","last_active":"2023-10-16T23:28:23.648949+0000","last_peered":"2023-10-16T23:28:23.648949+0000","last_clean":"2023-10-16T23:28:23.648949+0000","last_became_active":"2023-10-16T23:27:40.722399+0000","last_became_peered":"2023-10-16T23:27:40.722399+0000","last_unstale":"2023-10-16T23:28:23.648949+0000","last_undegraded":"2023-10-16T23:28:23.648949+0000","last_fullsized":"2023-10-16T23:28:23.648949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433340+0000","last_change":"2023-10-16T23:27:40.716139+0000","last_active":"2023-10-16T23:28:23.433340+0000","last_peered":"2023-10-16T23:28:23.433340+0000","last_clean":"2023-10-16T23:28:23.433340+0000","last_became_active":"2023-10-16T23:27:40.715294+0000","last_became_peered":"2023-10-16T23:27:40.715294+0000","last_unstale":"2023-10-16T23:28:23.433340+0000","last_undegraded":"2023-10-16T23:28:23.433340+0000","last_fullsized":"2023-10-16T23:28:23.433340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.649399+0000","last_change":"2023-10-16T23:27:40.762253+0000","last_active":"2023-10-16T23:28:23.649399+0000","last_peered":"2023-10-16T23:28:23.649399+0000","last_clean":"2023-10-16T23:28:23.649399+0000","last_became_active":"2023-10-16T23:27:40.760726+0000","last_became_peered":"2023-10-16T23:27:40.760726+0000","last_unstale":"2023-10-16T23:28:23.649399+0000","last_undegraded":"2023-10-16T23:28:23.649399+0000","last_fullsized":"2023-10-16T23:28:23.649399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.648066+0000","last_change":"2023-10-16T23:27:40.756184+0000","last_active":"2023-10-16T23:28:23.648066+0000","last_peered":"2023-10-16T23:28:23.648066+0000","last_clean":"2023-10-16T23:28:23.648066+0000","last_became_active":"2023-10-16T23:27:40.755276+0000","last_became_peered":"2023-10-16T23:27:40.755276+0000","last_unstale":"2023-10-16T23:28:23.648066+0000","last_undegraded":"2023-10-16T23:28:23.648066+0000","last_fullsized":"2023-10-16T23:28:23.648066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.649144+0000","last_change":"2023-10-16T23:27:40.724060+0000","last_active":"2023-10-16T23:28:23.649144+0000","last_peered":"2023-10-16T23:28:23.649144+0000","last_clean":"2023-10-16T23:28:23.649144+0000","last_became_active":"2023-10-16T23:27:40.723701+0000","last_became_peered":"2023-10-16T23:27:40.723701+0000","last_unstale":"2023-10-16T23:28:23.649144+0000","last_undegraded":"2023-10-16T23:28:23.649144+0000","last_fullsized":"2023-10-16T23:28:23.649144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.648654+0000","last_change":"2023-10-16T23:27:40.756783+0000","last_active":"2023-10-16T23:28:23.648654+0000","last_peered":"2023-10-16T23:28:23.648654+0000","last_clean":"2023-10-16T23:28:23.648654+0000","last_became_active":"2023-10-16T23:27:40.755772+0000","last_became_peered":"2023-10-16T23:27:40.755772+0000","last_unstale":"2023-10-16T23:28:23.648654+0000","last_undegraded":"2023-10-16T23:28:23.648654+0000","last_fullsized":"2023-10-16T23:28:23.648654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.434576+0000","last_change":"2023-10-16T23:27:40.724754+0000","last_active":"2023-10-16T23:28:23.434576+0000","last_peered":"2023-10-16T23:28:23.434576+0000","last_clean":"2023-10-16T23:28:23.434576+0000","last_became_active":"2023-10-16T23:27:40.724031+0000","last_became_peered":"2023-10-16T23:27:40.724031+0000","last_unstale":"2023-10-16T23:28:23.434576+0000","last_undegraded":"2023-10-16T23:28:23.434576+0000","last_fullsized":"2023-10-16T23:28:23.434576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:51.454135+0000","last_change":"2023-10-16T23:28:51.454416+0000","last_active":"2023-10-16T23:28:51.454135+0000","last_peered":"2023-10-16T23:28:51.454135+0000","last_clean":"2023-10-16T23:28:51.454135+0000","last_became_active":"2023-10-16T23:27:40.724099+0000","last_became_peered":"2023-10-16T23:27:40.724099+0000","last_unstale":"2023-10-16T23:28:51.454135+0000","last_undegraded":"2023-10-16T23:28:51.454135+0000","last_fullsized":"2023-10-16T23:28:51.454135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:51.454084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:51.454084+0000","last_clean_scrub_stamp":"2023-10-16T23:28:51.454084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:30:36.813149+0000","scrub_duration":0.0036983559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:44.412252+0000","last_change":"2023-10-16T23:28:44.412516+0000","last_active":"2023-10-16T23:28:44.412252+0000","last_peered":"2023-10-16T23:28:44.412252+0000","last_clean":"2023-10-16T23:28:44.412252+0000","last_became_active":"2023-10-16T23:27:40.704162+0000","last_became_peered":"2023-10-16T23:27:40.704162+0000","last_unstale":"2023-10-16T23:28:44.412252+0000","last_undegraded":"2023-10-16T23:28:44.412252+0000","last_fullsized":"2023-10-16T23:28:44.412252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:44.412201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:44.412201+0000","last_clean_scrub_stamp":"2023-10-16T23:28:44.412201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:26:44.683009+0000","scrub_duration":0.003351209,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.648928+0000","last_change":"2023-10-16T23:27:40.738913+0000","last_active":"2023-10-16T23:28:23.648928+0000","last_peered":"2023-10-16T23:28:23.648928+0000","last_clean":"2023-10-16T23:28:23.648928+0000","last_became_active":"2023-10-16T23:27:40.738070+0000","last_became_peered":"2023-10-16T23:27:40.738070+0000","last_unstale":"2023-10-16T23:28:23.648928+0000","last_undegraded":"2023-10-16T23:28:23.648928+0000","last_fullsized":"2023-10-16T23:28:23.648928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.649619+0000","last_change":"2023-10-16T23:27:40.762529+0000","last_active":"2023-10-16T23:28:23.649619+0000","last_peered":"2023-10-16T23:28:23.649619+0000","last_clean":"2023-10-16T23:28:23.649619+0000","last_became_active":"2023-10-16T23:27:40.761570+0000","last_became_peered":"2023-10-16T23:27:40.761570+0000","last_unstale":"2023-10-16T23:28:23.649619+0000","last_undegraded":"2023-10-16T23:28:23.649619+0000","last_fullsized":"2023-10-16T23:28:23.649619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433430+0000","last_change":"2023-10-16T23:27:40.719227+0000","last_active":"2023-10-16T23:28:23.433430+0000","last_peered":"2023-10-16T23:28:23.433430+0000","last_clean":"2023-10-16T23:28:23.433430+0000","last_became_active":"2023-10-16T23:27:40.718276+0000","last_became_peered":"2023-10-16T23:27:40.718276+0000","last_unstale":"2023-10-16T23:28:23.433430+0000","last_undegraded":"2023-10-16T23:28:23.433430+0000","last_fullsized":"2023-10-16T23:28:23.433430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.649322+0000","last_change":"2023-10-16T23:27:40.719723+0000","last_active":"2023-10-16T23:28:23.649322+0000","last_peered":"2023-10-16T23:28:23.649322+0000","last_clean":"2023-10-16T23:28:23.649322+0000","last_became_active":"2023-10-16T23:27:40.719402+0000","last_became_peered":"2023-10-16T23:27:40.719402+0000","last_unstale":"2023-10-16T23:28:23.649322+0000","last_undegraded":"2023-10-16T23:28:23.649322+0000","last_fullsized":"2023-10-16T23:28:23.649322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.434805+0000","last_change":"2023-10-16T23:27:40.732931+0000","last_active":"2023-10-16T23:28:23.434805+0000","last_peered":"2023-10-16T23:28:23.434805+0000","last_clean":"2023-10-16T23:28:23.434805+0000","last_became_active":"2023-10-16T23:27:40.732102+0000","last_became_peered":"2023-10-16T23:27:40.732102+0000","last_unstale":"2023-10-16T23:28:23.434805+0000","last_undegraded":"2023-10-16T23:28:23.434805+0000","last_fullsized":"2023-10-16T23:28:23.434805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:41.375368+0000","last_change":"2023-10-16T23:28:41.375625+0000","last_active":"2023-10-16T23:28:41.375368+0000","last_peered":"2023-10-16T23:28:41.375368+0000","last_clean":"2023-10-16T23:28:41.375368+0000","last_became_active":"2023-10-16T23:27:40.728298+0000","last_became_peered":"2023-10-16T23:27:40.728298+0000","last_unstale":"2023-10-16T23:28:41.375368+0000","last_undegraded":"2023-10-16T23:28:41.375368+0000","last_fullsized":"2023-10-16T23:28:41.375368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:41.375313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:41.375313+0000","last_clean_scrub_stamp":"2023-10-16T23:28:41.375313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:03:17.124670+0000","scrub_duration":0.003739582,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.434637+0000","last_change":"2023-10-16T23:27:40.745270+0000","last_active":"2023-10-16T23:28:23.434637+0000","last_peered":"2023-10-16T23:28:23.434637+0000","last_clean":"2023-10-16T23:28:23.434637+0000","last_became_active":"2023-10-16T23:27:40.744483+0000","last_became_peered":"2023-10-16T23:27:40.744483+0000","last_unstale":"2023-10-16T23:28:23.434637+0000","last_undegraded":"2023-10-16T23:28:23.434637+0000","last_fullsized":"2023-10-16T23:28:23.434637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.649188+0000","last_change":"2023-10-16T23:27:40.761480+0000","last_active":"2023-10-16T23:28:23.649188+0000","last_peered":"2023-10-16T23:28:23.649188+0000","last_clean":"2023-10-16T23:28:23.649188+0000","last_became_active":"2023-10-16T23:27:40.760882+0000","last_became_peered":"2023-10-16T23:27:40.760882+0000","last_unstale":"2023-10-16T23:28:23.649188+0000","last_undegraded":"2023-10-16T23:28:23.649188+0000","last_fullsized":"2023-10-16T23:28:23.649188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.648151+0000","last_change":"2023-10-16T23:27:40.722620+0000","last_active":"2023-10-16T23:28:23.648151+0000","last_peered":"2023-10-16T23:28:23.648151+0000","last_clean":"2023-10-16T23:28:23.648151+0000","last_became_active":"2023-10-16T23:27:40.722302+0000","last_became_peered":"2023-10-16T23:27:40.722302+0000","last_unstale":"2023-10-16T23:28:23.648151+0000","last_undegraded":"2023-10-16T23:28:23.648151+0000","last_fullsized":"2023-10-16T23:28:23.648151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.432837+0000","last_change":"2023-10-16T23:27:40.716578+0000","last_active":"2023-10-16T23:28:23.432837+0000","last_peered":"2023-10-16T23:28:23.432837+0000","last_clean":"2023-10-16T23:28:23.432837+0000","last_became_active":"2023-10-16T23:27:40.716228+0000","last_became_peered":"2023-10-16T23:27:40.716228+0000","last_unstale":"2023-10-16T23:28:23.432837+0000","last_undegraded":"2023-10-16T23:28:23.432837+0000","last_fullsized":"2023-10-16T23:28:23.432837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.648727+0000","last_change":"2023-10-16T23:27:40.761323+0000","last_active":"2023-10-16T23:28:23.648727+0000","last_peered":"2023-10-16T23:28:23.648727+0000","last_clean":"2023-10-16T23:28:23.648727+0000","last_became_active":"2023-10-16T23:27:40.760659+0000","last_became_peered":"2023-10-16T23:27:40.760659+0000","last_unstale":"2023-10-16T23:28:23.648727+0000","last_undegraded":"2023-10-16T23:28:23.648727+0000","last_fullsized":"2023-10-16T23:28:23.648727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.650162+0000","last_change":"2023-10-16T23:27:40.727629+0000","last_active":"2023-10-16T23:28:23.650162+0000","last_peered":"2023-10-16T23:28:23.650162+0000","last_clean":"2023-10-16T23:28:23.650162+0000","last_became_active":"2023-10-16T23:27:40.727334+0000","last_became_peered":"2023-10-16T23:27:40.727334+0000","last_unstale":"2023-10-16T23:28:23.650162+0000","last_undegraded":"2023-10-16T23:28:23.650162+0000","last_fullsized":"2023-10-16T23:28:23.650162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.650009+0000","last_change":"2023-10-16T23:27:40.704775+0000","last_active":"2023-10-16T23:28:23.650009+0000","last_peered":"2023-10-16T23:28:23.650009+0000","last_clean":"2023-10-16T23:28:23.650009+0000","last_became_active":"2023-10-16T23:27:40.704536+0000","last_became_peered":"2023-10-16T23:27:40.704536+0000","last_unstale":"2023-10-16T23:28:23.650009+0000","last_undegraded":"2023-10-16T23:28:23.650009+0000","last_fullsized":"2023-10-16T23:28:23.650009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.649582+0000","last_change":"2023-10-16T23:27:40.764351+0000","last_active":"2023-10-16T23:28:23.649582+0000","last_peered":"2023-10-16T23:28:23.649582+0000","last_clean":"2023-10-16T23:28:23.649582+0000","last_became_active":"2023-10-16T23:27:40.763592+0000","last_became_peered":"2023-10-16T23:27:40.763592+0000","last_unstale":"2023-10-16T23:28:23.649582+0000","last_undegraded":"2023-10-16T23:28:23.649582+0000","last_fullsized":"2023-10-16T23:28:23.649582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.649043+0000","last_change":"2023-10-16T23:27:40.760989+0000","last_active":"2023-10-16T23:28:23.649043+0000","last_peered":"2023-10-16T23:28:23.649043+0000","last_clean":"2023-10-16T23:28:23.649043+0000","last_became_active":"2023-10-16T23:27:40.760615+0000","last_became_peered":"2023-10-16T23:27:40.760615+0000","last_unstale":"2023-10-16T23:28:23.649043+0000","last_undegraded":"2023-10-16T23:28:23.649043+0000","last_fullsized":"2023-10-16T23:28:23.649043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433256+0000","last_change":"2023-10-16T23:27:40.760762+0000","last_active":"2023-10-16T23:28:23.433256+0000","last_peered":"2023-10-16T23:28:23.433256+0000","last_clean":"2023-10-16T23:28:23.433256+0000","last_became_active":"2023-10-16T23:27:40.760437+0000","last_became_peered":"2023-10-16T23:27:40.760437+0000","last_unstale":"2023-10-16T23:28:23.433256+0000","last_undegraded":"2023-10-16T23:28:23.433256+0000","last_fullsized":"2023-10-16T23:28:23.433256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433965+0000","last_change":"2023-10-16T23:27:40.745197+0000","last_active":"2023-10-16T23:28:23.433965+0000","last_peered":"2023-10-16T23:28:23.433965+0000","last_clean":"2023-10-16T23:28:23.433965+0000","last_became_active":"2023-10-16T23:27:40.744458+0000","last_became_peered":"2023-10-16T23:27:40.744458+0000","last_unstale":"2023-10-16T23:28:23.433965+0000","last_undegraded":"2023-10-16T23:28:23.433965+0000","last_fullsized":"2023-10-16T23:28:23.433965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.432942+0000","last_change":"2023-10-16T23:27:40.711795+0000","last_active":"2023-10-16T23:28:23.432942+0000","last_peered":"2023-10-16T23:28:23.432942+0000","last_clean":"2023-10-16T23:28:23.432942+0000","last_became_active":"2023-10-16T23:27:40.711492+0000","last_became_peered":"2023-10-16T23:27:40.711492+0000","last_unstale":"2023-10-16T23:28:23.432942+0000","last_undegraded":"2023-10-16T23:28:23.432942+0000","last_fullsized":"2023-10-16T23:28:23.432942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.432854+0000","last_change":"2023-10-16T23:27:40.710149+0000","last_active":"2023-10-16T23:28:23.432854+0000","last_peered":"2023-10-16T23:28:23.432854+0000","last_clean":"2023-10-16T23:28:23.432854+0000","last_became_active":"2023-10-16T23:27:40.709286+0000","last_became_peered":"2023-10-16T23:27:40.709286+0000","last_unstale":"2023-10-16T23:28:23.432854+0000","last_undegraded":"2023-10-16T23:28:23.432854+0000","last_fullsized":"2023-10-16T23:28:23.432854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433514+0000","last_change":"2023-10-16T23:27:40.707271+0000","last_active":"2023-10-16T23:28:23.433514+0000","last_peered":"2023-10-16T23:28:23.433514+0000","last_clean":"2023-10-16T23:28:23.433514+0000","last_became_active":"2023-10-16T23:27:40.706864+0000","last_became_peered":"2023-10-16T23:27:40.706864+0000","last_unstale":"2023-10-16T23:28:23.433514+0000","last_undegraded":"2023-10-16T23:28:23.433514+0000","last_fullsized":"2023-10-16T23:28:23.433514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'4","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:49.381697+0000","last_change":"2023-10-16T23:28:49.381955+0000","last_active":"2023-10-16T23:28:49.381697+0000","last_peered":"2023-10-16T23:28:49.381697+0000","last_clean":"2023-10-16T23:28:49.381697+0000","last_became_active":"2023-10-16T23:27:40.352775+0000","last_became_peered":"2023-10-16T23:27:40.352775+0000","last_unstale":"2023-10-16T23:28:49.381697+0000","last_undegraded":"2023-10-16T23:28:49.381697+0000","last_fullsized":"2023-10-16T23:28:49.381697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2023-10-16T23:28:49.381632+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2023-10-16T23:28:49.381632+0000","last_clean_scrub_stamp":"2023-10-16T23:28:49.381632+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:38:59.043081+0000","scrub_duration":0.008668594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.649789+0000","last_change":"2023-10-16T23:27:40.765398+0000","last_active":"2023-10-16T23:28:23.649789+0000","last_peered":"2023-10-16T23:28:23.649789+0000","last_clean":"2023-10-16T23:28:23.649789+0000","last_became_active":"2023-10-16T23:27:40.764517+0000","last_became_peered":"2023-10-16T23:27:40.764517+0000","last_unstale":"2023-10-16T23:28:23.649789+0000","last_undegraded":"2023-10-16T23:28:23.649789+0000","last_fullsized":"2023-10-16T23:28:23.649789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.648303+0000","last_change":"2023-10-16T23:27:40.335221+0000","last_active":"2023-10-16T23:28:23.648303+0000","last_peered":"2023-10-16T23:28:23.648303+0000","last_clean":"2023-10-16T23:28:23.648303+0000","last_became_active":"2023-10-16T23:27:40.334885+0000","last_became_peered":"2023-10-16T23:27:40.334885+0000","last_unstale":"2023-10-16T23:28:23.648303+0000","last_undegraded":"2023-10-16T23:28:23.648303+0000","last_fullsized":"2023-10-16T23:28:23.648303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.649328+0000","last_change":"2023-10-16T23:27:40.719997+0000","last_active":"2023-10-16T23:28:23.649328+0000","last_peered":"2023-10-16T23:28:23.649328+0000","last_clean":"2023-10-16T23:28:23.649328+0000","last_became_active":"2023-10-16T23:27:40.719811+0000","last_became_peered":"2023-10-16T23:27:40.719811+0000","last_unstale":"2023-10-16T23:28:23.649328+0000","last_undegraded":"2023-10-16T23:28:23.649328+0000","last_fullsized":"2023-10-16T23:28:23.649328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:45.316754+0000","last_change":"2023-10-16T23:28:45.317090+0000","last_active":"2023-10-16T23:28:45.316754+0000","last_peered":"2023-10-16T23:28:45.316754+0000","last_clean":"2023-10-16T23:28:45.316754+0000","last_became_active":"2023-10-16T23:27:40.357009+0000","last_became_peered":"2023-10-16T23:27:40.357009+0000","last_unstale":"2023-10-16T23:28:45.316754+0000","last_undegraded":"2023-10-16T23:28:45.316754+0000","last_fullsized":"2023-10-16T23:28:45.316754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:45.316698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:45.316698+0000","last_clean_scrub_stamp":"2023-10-16T23:28:45.316698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:46.889893+0000","scrub_duration":0.003457342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433839+0000","last_change":"2023-10-16T23:27:40.760925+0000","last_active":"2023-10-16T23:28:23.433839+0000","last_peered":"2023-10-16T23:28:23.433839+0000","last_clean":"2023-10-16T23:28:23.433839+0000","last_became_active":"2023-10-16T23:27:40.760365+0000","last_became_peered":"2023-10-16T23:27:40.760365+0000","last_unstale":"2023-10-16T23:28:23.433839+0000","last_undegraded":"2023-10-16T23:28:23.433839+0000","last_fullsized":"2023-10-16T23:28:23.433839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"26'12","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:48.460939+0000","last_change":"2023-10-16T23:28:48.461283+0000","last_active":"2023-10-16T23:28:48.460939+0000","last_peered":"2023-10-16T23:28:48.460939+0000","last_clean":"2023-10-16T23:28:48.460939+0000","last_became_active":"2023-10-16T23:27:40.330857+0000","last_became_peered":"2023-10-16T23:27:40.330857+0000","last_unstale":"2023-10-16T23:28:48.460939+0000","last_undegraded":"2023-10-16T23:28:48.460939+0000","last_fullsized":"2023-10-16T23:28:48.460939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12","last_scrub_stamp":"2023-10-16T23:28:48.460884+0000","last_deep_scrub":"26'12","last_deep_scrub_stamp":"2023-10-16T23:28:48.460884+0000","last_clean_scrub_stamp":"2023-10-16T23:28:48.460884+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:48.136384+0000","scrub_duration":0.010512126,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"26'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:48.333265+0000","last_change":"2023-10-16T23:28:48.333516+0000","last_active":"2023-10-16T23:28:48.333265+0000","last_peered":"2023-10-16T23:28:48.333265+0000","last_clean":"2023-10-16T23:28:48.333265+0000","last_became_active":"2023-10-16T23:27:40.357047+0000","last_became_peered":"2023-10-16T23:27:40.357047+0000","last_unstale":"2023-10-16T23:28:48.333265+0000","last_undegraded":"2023-10-16T23:28:48.333265+0000","last_fullsized":"2023-10-16T23:28:48.333265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2023-10-16T23:28:48.333206+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2023-10-16T23:28:48.333206+0000","last_clean_scrub_stamp":"2023-10-16T23:28:48.333206+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:30:33.692271+0000","scrub_duration":0.0077088319999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.648312+0000","last_change":"2023-10-16T23:27:40.763848+0000","last_active":"2023-10-16T23:28:23.648312+0000","last_peered":"2023-10-16T23:28:23.648312+0000","last_clean":"2023-10-16T23:28:23.648312+0000","last_became_active":"2023-10-16T23:27:40.763116+0000","last_became_peered":"2023-10-16T23:27:40.763116+0000","last_unstale":"2023-10-16T23:28:23.648312+0000","last_undegraded":"2023-10-16T23:28:23.648312+0000","last_fullsized":"2023-10-16T23:28:23.648312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:52.466822+0000","last_change":"2023-10-16T23:28:52.467072+0000","last_active":"2023-10-16T23:28:52.466822+0000","last_peered":"2023-10-16T23:28:52.466822+0000","last_clean":"2023-10-16T23:28:52.466822+0000","last_became_active":"2023-10-16T23:27:40.346439+0000","last_became_peered":"2023-10-16T23:27:40.346439+0000","last_unstale":"2023-10-16T23:28:52.466822+0000","last_undegraded":"2023-10-16T23:28:52.466822+0000","last_fullsized":"2023-10-16T23:28:52.466822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2023-10-16T23:28:52.466754+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2023-10-16T23:28:52.466754+0000","last_clean_scrub_stamp":"2023-10-16T23:28:52.466754+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:32.718215+0000","scrub_duration":0.0073781489999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:46.591562+0000","last_change":"2023-10-16T23:28:46.591816+0000","last_active":"2023-10-16T23:28:46.591562+0000","last_peered":"2023-10-16T23:28:46.591562+0000","last_clean":"2023-10-16T23:28:46.591562+0000","last_became_active":"2023-10-16T23:27:40.714098+0000","last_became_peered":"2023-10-16T23:27:40.714098+0000","last_unstale":"2023-10-16T23:28:46.591562+0000","last_undegraded":"2023-10-16T23:28:46.591562+0000","last_fullsized":"2023-10-16T23:28:46.591562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:46.591510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:46.591510+0000","last_clean_scrub_stamp":"2023-10-16T23:28:46.591510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:43.375635+0000","scrub_duration":0.0038871190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"26'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:47.356544+0000","last_change":"2023-10-16T23:28:47.356799+0000","last_active":"2023-10-16T23:28:47.356544+0000","last_peered":"2023-10-16T23:28:47.356544+0000","last_clean":"2023-10-16T23:28:47.356544+0000","last_became_active":"2023-10-16T23:27:40.339531+0000","last_became_peered":"2023-10-16T23:27:40.339531+0000","last_unstale":"2023-10-16T23:28:47.356544+0000","last_undegraded":"2023-10-16T23:28:47.356544+0000","last_fullsized":"2023-10-16T23:28:47.356544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2023-10-16T23:28:47.356483+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2023-10-16T23:28:47.356483+0000","last_clean_scrub_stamp":"2023-10-16T23:28:47.356483+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:10.570766+0000","scrub_duration":0.0069425870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433261+0000","last_change":"2023-10-16T23:27:40.713930+0000","last_active":"2023-10-16T23:28:23.433261+0000","last_peered":"2023-10-16T23:28:23.433261+0000","last_clean":"2023-10-16T23:28:23.433261+0000","last_became_active":"2023-10-16T23:27:40.713087+0000","last_became_peered":"2023-10-16T23:27:40.713087+0000","last_unstale":"2023-10-16T23:28:23.433261+0000","last_undegraded":"2023-10-16T23:28:23.433261+0000","last_fullsized":"2023-10-16T23:28:23.433261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:53.310895+0000","last_change":"2023-10-16T23:28:53.311195+0000","last_active":"2023-10-16T23:28:53.310895+0000","last_peered":"2023-10-16T23:28:53.310895+0000","last_clean":"2023-10-16T23:28:53.310895+0000","last_became_active":"2023-10-16T23:27:40.319887+0000","last_became_peered":"2023-10-16T23:27:40.319887+0000","last_unstale":"2023-10-16T23:28:53.310895+0000","last_undegraded":"2023-10-16T23:28:53.310895+0000","last_fullsized":"2023-10-16T23:28:53.310895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:53.310840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:53.310840+0000","last_clean_scrub_stamp":"2023-10-16T23:28:53.310840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:39:38.391533+0000","scrub_duration":0.0040007879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.648467+0000","last_change":"2023-10-16T23:27:40.726405+0000","last_active":"2023-10-16T23:28:23.648467+0000","last_peered":"2023-10-16T23:28:23.648467+0000","last_clean":"2023-10-16T23:28:23.648467+0000","last_became_active":"2023-10-16T23:27:40.725724+0000","last_became_peered":"2023-10-16T23:27:40.725724+0000","last_unstale":"2023-10-16T23:28:23.648467+0000","last_undegraded":"2023-10-16T23:28:23.648467+0000","last_fullsized":"2023-10-16T23:28:23.648467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:58.056830+0000","last_change":"2023-10-16T23:28:58.057082+0000","last_active":"2023-10-16T23:28:58.056830+0000","last_peered":"2023-10-16T23:28:58.056830+0000","last_clean":"2023-10-16T23:28:58.056830+0000","last_became_active":"2023-10-16T23:27:40.337405+0000","last_became_peered":"2023-10-16T23:27:40.337405+0000","last_unstale":"2023-10-16T23:28:58.056830+0000","last_undegraded":"2023-10-16T23:28:58.056830+0000","last_fullsized":"2023-10-16T23:28:58.056830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2023-10-16T23:28:58.056774+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2023-10-16T23:28:58.056774+0000","last_clean_scrub_stamp":"2023-10-16T23:28:58.056774+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:12.694345+0000","scrub_duration":0.0064973770000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:54.550987+0000","last_change":"2023-10-16T23:28:54.551267+0000","last_active":"2023-10-16T23:28:54.550987+0000","last_peered":"2023-10-16T23:28:54.550987+0000","last_clean":"2023-10-16T23:28:54.550987+0000","last_became_active":"2023-10-16T23:27:40.722091+0000","last_became_peered":"2023-10-16T23:27:40.722091+0000","last_unstale":"2023-10-16T23:28:54.550987+0000","last_undegraded":"2023-10-16T23:28:54.550987+0000","last_fullsized":"2023-10-16T23:28:54.550987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:54.550940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:54.550940+0000","last_clean_scrub_stamp":"2023-10-16T23:28:54.550940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:42.954644+0000","scrub_duration":0.0039030689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:43.363818+0000","last_change":"2023-10-16T23:28:43.364129+0000","last_active":"2023-10-16T23:28:43.363818+0000","last_peered":"2023-10-16T23:28:43.363818+0000","last_clean":"2023-10-16T23:28:43.363818+0000","last_became_active":"2023-10-16T23:27:40.342213+0000","last_became_peered":"2023-10-16T23:27:40.342213+0000","last_unstale":"2023-10-16T23:28:43.363818+0000","last_undegraded":"2023-10-16T23:28:43.363818+0000","last_fullsized":"2023-10-16T23:28:43.363818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:43.363769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:43.363769+0000","last_clean_scrub_stamp":"2023-10-16T23:28:43.363769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:58.725647+0000","scrub_duration":0.003734617,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:55.526798+0000","last_change":"2023-10-16T23:28:55.527078+0000","last_active":"2023-10-16T23:28:55.526798+0000","last_peered":"2023-10-16T23:28:55.526798+0000","last_clean":"2023-10-16T23:28:55.526798+0000","last_became_active":"2023-10-16T23:27:40.732996+0000","last_became_peered":"2023-10-16T23:27:40.732996+0000","last_unstale":"2023-10-16T23:28:55.526798+0000","last_undegraded":"2023-10-16T23:28:55.526798+0000","last_fullsized":"2023-10-16T23:28:55.526798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:55.526749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:55.526749+0000","last_clean_scrub_stamp":"2023-10-16T23:28:55.526749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:10.164320+0000","scrub_duration":0.0041469059999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.434542+0000","last_change":"2023-10-16T23:27:40.347984+0000","last_active":"2023-10-16T23:28:23.434542+0000","last_peered":"2023-10-16T23:28:23.434542+0000","last_clean":"2023-10-16T23:28:23.434542+0000","last_became_active":"2023-10-16T23:27:40.347253+0000","last_became_peered":"2023-10-16T23:27:40.347253+0000","last_unstale":"2023-10-16T23:28:23.434542+0000","last_undegraded":"2023-10-16T23:28:23.434542+0000","last_fullsized":"2023-10-16T23:28:23.434542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.435213+0000","last_change":"2023-10-16T23:27:40.745245+0000","last_active":"2023-10-16T23:28:23.435213+0000","last_peered":"2023-10-16T23:28:23.435213+0000","last_clean":"2023-10-16T23:28:23.435213+0000","last_became_active":"2023-10-16T23:27:40.744571+0000","last_became_peered":"2023-10-16T23:27:40.744571+0000","last_unstale":"2023-10-16T23:28:23.435213+0000","last_undegraded":"2023-10-16T23:28:23.435213+0000","last_fullsized":"2023-10-16T23:28:23.435213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:39.870190+0000","last_change":"2023-10-16T23:28:39.870424+0000","last_active":"2023-10-16T23:28:39.870190+0000","last_peered":"2023-10-16T23:28:39.870190+0000","last_clean":"2023-10-16T23:28:39.870190+0000","last_became_active":"2023-10-16T23:27:40.314242+0000","last_became_peered":"2023-10-16T23:27:40.314242+0000","last_unstale":"2023-10-16T23:28:39.870190+0000","last_undegraded":"2023-10-16T23:28:39.870190+0000","last_fullsized":"2023-10-16T23:28:39.870190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:39.870144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:39.870144+0000","last_clean_scrub_stamp":"2023-10-16T23:28:39.870144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:19:34.468123+0000","scrub_duration":0.002925712,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.650310+0000","last_change":"2023-10-16T23:27:40.709591+0000","last_active":"2023-10-16T23:28:23.650310+0000","last_peered":"2023-10-16T23:28:23.650310+0000","last_clean":"2023-10-16T23:28:23.650310+0000","last_became_active":"2023-10-16T23:27:40.709174+0000","last_became_peered":"2023-10-16T23:27:40.709174+0000","last_unstale":"2023-10-16T23:28:23.650310+0000","last_undegraded":"2023-10-16T23:28:23.650310+0000","last_fullsized":"2023-10-16T23:28:23.650310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":183,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:41.332779+0000","last_change":"2023-10-16T23:28:41.333104+0000","last_active":"2023-10-16T23:28:41.332779+0000","last_peered":"2023-10-16T23:28:41.332779+0000","last_clean":"2023-10-16T23:28:41.332779+0000","last_became_active":"2023-10-16T23:27:29.353846+0000","last_became_peered":"2023-10-16T23:27:29.353846+0000","last_unstale":"2023-10-16T23:28:41.332779+0000","last_undegraded":"2023-10-16T23:28:41.332779+0000","last_fullsized":"2023-10-16T23:28:41.332779+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2023-10-16T23:28:41.332715+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2023-10-16T23:28:41.332715+0000","last_clean_scrub_stamp":"2023-10-16T23:28:41.332715+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:34.312585+0000","scrub_duration":0.01599012,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:40.409329+0000","last_change":"2023-10-16T23:28:40.409634+0000","last_active":"2023-10-16T23:28:40.409329+0000","last_peered":"2023-10-16T23:28:40.409329+0000","last_clean":"2023-10-16T23:28:40.409329+0000","last_became_active":"2023-10-16T23:27:36.277096+0000","last_became_peered":"2023-10-16T23:27:36.277096+0000","last_unstale":"2023-10-16T23:28:40.409329+0000","last_undegraded":"2023-10-16T23:28:40.409329+0000","last_fullsized":"2023-10-16T23:28:40.409329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:40.409281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:40.409281+0000","last_clean_scrub_stamp":"2023-10-16T23:28:40.409281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:11:55.648922+0000","scrub_duration":0.003820922,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:51.048809+0000","last_change":"2023-10-16T23:28:51.049069+0000","last_active":"2023-10-16T23:28:51.048809+0000","last_peered":"2023-10-16T23:28:51.048809+0000","last_clean":"2023-10-16T23:28:51.048809+0000","last_became_active":"2023-10-16T23:27:40.330989+0000","last_became_peered":"2023-10-16T23:27:40.330989+0000","last_unstale":"2023-10-16T23:28:51.048809+0000","last_undegraded":"2023-10-16T23:28:51.048809+0000","last_fullsized":"2023-10-16T23:28:51.048809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:51.048757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:51.048757+0000","last_clean_scrub_stamp":"2023-10-16T23:28:51.048757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:39:36.129450+0000","scrub_duration":0.0042242089999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:52.485319+0000","last_change":"2023-10-16T23:28:52.485612+0000","last_active":"2023-10-16T23:28:52.485319+0000","last_peered":"2023-10-16T23:28:52.485319+0000","last_clean":"2023-10-16T23:28:52.485319+0000","last_became_active":"2023-10-16T23:27:40.725490+0000","last_became_peered":"2023-10-16T23:27:40.725490+0000","last_unstale":"2023-10-16T23:28:52.485319+0000","last_undegraded":"2023-10-16T23:28:52.485319+0000","last_fullsized":"2023-10-16T23:28:52.485319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:52.485272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:52.485272+0000","last_clean_scrub_stamp":"2023-10-16T23:28:52.485272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:45:18.719119+0000","scrub_duration":0.0033147099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:42.339210+0000","last_change":"2023-10-16T23:28:42.339474+0000","last_active":"2023-10-16T23:28:42.339210+0000","last_peered":"2023-10-16T23:28:42.339210+0000","last_clean":"2023-10-16T23:28:42.339210+0000","last_became_active":"2023-10-16T23:27:36.277974+0000","last_became_peered":"2023-10-16T23:27:36.277974+0000","last_unstale":"2023-10-16T23:28:42.339210+0000","last_undegraded":"2023-10-16T23:28:42.339210+0000","last_fullsized":"2023-10-16T23:28:42.339210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:42.339160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:42.339160+0000","last_clean_scrub_stamp":"2023-10-16T23:28:42.339160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:43:39.840764+0000","scrub_duration":0.0082552289999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:38.602009+0000","last_change":"2023-10-16T23:28:38.602280+0000","last_active":"2023-10-16T23:28:38.602009+0000","last_peered":"2023-10-16T23:28:38.602009+0000","last_clean":"2023-10-16T23:28:38.602009+0000","last_became_active":"2023-10-16T23:27:40.339569+0000","last_became_peered":"2023-10-16T23:27:40.339569+0000","last_unstale":"2023-10-16T23:28:38.602009+0000","last_undegraded":"2023-10-16T23:28:38.602009+0000","last_fullsized":"2023-10-16T23:28:38.602009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:38.601943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:38.601943+0000","last_clean_scrub_stamp":"2023-10-16T23:28:38.601943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:11:53.841584+0000","scrub_duration":0.0039239139999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.648765+0000","last_change":"2023-10-16T23:27:40.727415+0000","last_active":"2023-10-16T23:28:23.648765+0000","last_peered":"2023-10-16T23:28:23.648765+0000","last_clean":"2023-10-16T23:28:23.648765+0000","last_became_active":"2023-10-16T23:27:40.726813+0000","last_became_peered":"2023-10-16T23:27:40.726813+0000","last_unstale":"2023-10-16T23:28:23.648765+0000","last_undegraded":"2023-10-16T23:28:23.648765+0000","last_fullsized":"2023-10-16T23:28:23.648765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:38.315486+0000","last_change":"2023-10-16T23:28:38.315622+0000","last_active":"2023-10-16T23:28:38.315486+0000","last_peered":"2023-10-16T23:28:38.315486+0000","last_clean":"2023-10-16T23:28:38.315486+0000","last_became_active":"2023-10-16T23:27:36.294489+0000","last_became_peered":"2023-10-16T23:27:36.294489+0000","last_unstale":"2023-10-16T23:28:38.315486+0000","last_undegraded":"2023-10-16T23:28:38.315486+0000","last_fullsized":"2023-10-16T23:28:38.315486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:38.315459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:38.315459+0000","last_clean_scrub_stamp":"2023-10-16T23:28:38.315459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:37:02.617863+0000","scrub_duration":0.0020246650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:54.915320+0000","last_change":"2023-10-16T23:28:54.915581+0000","last_active":"2023-10-16T23:28:54.915320+0000","last_peered":"2023-10-16T23:28:54.915320+0000","last_clean":"2023-10-16T23:28:54.915320+0000","last_became_active":"2023-10-16T23:27:40.326396+0000","last_became_peered":"2023-10-16T23:27:40.326396+0000","last_unstale":"2023-10-16T23:28:54.915320+0000","last_undegraded":"2023-10-16T23:28:54.915320+0000","last_fullsized":"2023-10-16T23:28:54.915320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:54.915270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:54.915270+0000","last_clean_scrub_stamp":"2023-10-16T23:28:54.915270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:39:39.995963+0000","scrub_duration":0.0073983119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.650387+0000","last_change":"2023-10-16T23:27:40.755777+0000","last_active":"2023-10-16T23:28:23.650387+0000","last_peered":"2023-10-16T23:28:23.650387+0000","last_clean":"2023-10-16T23:28:23.650387+0000","last_became_active":"2023-10-16T23:27:40.755489+0000","last_became_peered":"2023-10-16T23:27:40.755489+0000","last_unstale":"2023-10-16T23:28:23.650387+0000","last_undegraded":"2023-10-16T23:28:23.650387+0000","last_fullsized":"2023-10-16T23:28:23.650387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-16T23:28:38.715127+0000","last_change":"2023-10-16T23:28:42.336100+0000","last_active":"2023-10-16T23:28:38.715127+0000","last_peered":"2023-10-16T23:28:38.715127+0000","last_clean":"2023-10-16T23:28:38.715127+0000","last_became_active":"2023-10-16T23:27:36.278134+0000","last_became_peered":"2023-10-16T23:27:36.278134+0000","last_unstale":"2023-10-16T23:28:38.715127+0000","last_undegraded":"2023-10-16T23:28:38.715127+0000","last_fullsized":"2023-10-16T23:28:38.715127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.435658+0000","last_change":"2023-10-16T23:27:40.342715+0000","last_active":"2023-10-16T23:28:23.435658+0000","last_peered":"2023-10-16T23:28:23.435658+0000","last_clean":"2023-10-16T23:28:23.435658+0000","last_became_active":"2023-10-16T23:27:40.341951+0000","last_became_peered":"2023-10-16T23:27:40.341951+0000","last_unstale":"2023-10-16T23:28:23.435658+0000","last_undegraded":"2023-10-16T23:28:23.435658+0000","last_fullsized":"2023-10-16T23:28:23.435658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.648728+0000","last_change":"2023-10-16T23:27:40.731557+0000","last_active":"2023-10-16T23:28:23.648728+0000","last_peered":"2023-10-16T23:28:23.648728+0000","last_clean":"2023-10-16T23:28:23.648728+0000","last_became_active":"2023-10-16T23:27:40.731150+0000","last_became_peered":"2023-10-16T23:27:40.731150+0000","last_unstale":"2023-10-16T23:28:23.648728+0000","last_undegraded":"2023-10-16T23:28:23.648728+0000","last_fullsized":"2023-10-16T23:28:23.648728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:51.375490+0000","last_change":"2023-10-16T23:28:51.375752+0000","last_active":"2023-10-16T23:28:51.375490+0000","last_peered":"2023-10-16T23:28:51.375490+0000","last_clean":"2023-10-16T23:28:51.375490+0000","last_became_active":"2023-10-16T23:27:40.319571+0000","last_became_peered":"2023-10-16T23:27:40.319571+0000","last_unstale":"2023-10-16T23:28:51.375490+0000","last_undegraded":"2023-10-16T23:28:51.375490+0000","last_fullsized":"2023-10-16T23:28:51.375490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:51.375443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:51.375443+0000","last_clean_scrub_stamp":"2023-10-16T23:28:51.375443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:48.159569+0000","scrub_duration":0.0039652410000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:44.785018+0000","last_change":"2023-10-16T23:28:44.785290+0000","last_active":"2023-10-16T23:28:44.785018+0000","last_peered":"2023-10-16T23:28:44.785018+0000","last_clean":"2023-10-16T23:28:44.785018+0000","last_became_active":"2023-10-16T23:27:36.433808+0000","last_became_peered":"2023-10-16T23:27:36.433808+0000","last_unstale":"2023-10-16T23:28:44.785018+0000","last_undegraded":"2023-10-16T23:28:44.785018+0000","last_fullsized":"2023-10-16T23:28:44.785018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:44.784970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:44.784970+0000","last_clean_scrub_stamp":"2023-10-16T23:28:44.784970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:45:11.018817+0000","scrub_duration":0.0037436349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:55.349739+0000","last_change":"2023-10-16T23:28:55.349998+0000","last_active":"2023-10-16T23:28:55.349739+0000","last_peered":"2023-10-16T23:28:55.349739+0000","last_clean":"2023-10-16T23:28:55.349739+0000","last_became_active":"2023-10-16T23:28:23.651881+0000","last_became_peered":"2023-10-16T23:28:23.651881+0000","last_unstale":"2023-10-16T23:28:55.349739+0000","last_undegraded":"2023-10-16T23:28:55.349739+0000","last_fullsized":"2023-10-16T23:28:55.349739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:55.349662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:55.349662+0000","last_clean_scrub_stamp":"2023-10-16T23:28:55.349662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:35.601123+0000","scrub_duration":0.003616677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:52.980589+0000","last_change":"2023-10-16T23:28:52.980865+0000","last_active":"2023-10-16T23:28:52.980589+0000","last_peered":"2023-10-16T23:28:52.980589+0000","last_clean":"2023-10-16T23:28:52.980589+0000","last_became_active":"2023-10-16T23:27:40.327804+0000","last_became_peered":"2023-10-16T23:27:40.327804+0000","last_unstale":"2023-10-16T23:28:52.980589+0000","last_undegraded":"2023-10-16T23:28:52.980589+0000","last_fullsized":"2023-10-16T23:28:52.980589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:52.980540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:52.980540+0000","last_clean_scrub_stamp":"2023-10-16T23:28:52.980540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:49.764666+0000","scrub_duration":0.0034145260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:44.279340+0000","last_change":"2023-10-16T23:28:44.279600+0000","last_active":"2023-10-16T23:28:44.279340+0000","last_peered":"2023-10-16T23:28:44.279340+0000","last_clean":"2023-10-16T23:28:44.279340+0000","last_became_active":"2023-10-16T23:27:36.433923+0000","last_became_peered":"2023-10-16T23:27:36.433923+0000","last_unstale":"2023-10-16T23:28:44.279340+0000","last_undegraded":"2023-10-16T23:28:44.279340+0000","last_fullsized":"2023-10-16T23:28:44.279340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:44.279284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:44.279284+0000","last_clean_scrub_stamp":"2023-10-16T23:28:44.279284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:32:40.077699+0000","scrub_duration":0.003868692,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.649621+0000","last_change":"2023-10-16T23:27:40.756257+0000","last_active":"2023-10-16T23:28:23.649621+0000","last_peered":"2023-10-16T23:28:23.649621+0000","last_clean":"2023-10-16T23:28:23.649621+0000","last_became_active":"2023-10-16T23:27:40.755822+0000","last_became_peered":"2023-10-16T23:27:40.755822+0000","last_unstale":"2023-10-16T23:28:23.649621+0000","last_undegraded":"2023-10-16T23:28:23.649621+0000","last_fullsized":"2023-10-16T23:28:23.649621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:49.004552+0000","last_change":"2023-10-16T23:28:49.004794+0000","last_active":"2023-10-16T23:28:49.004552+0000","last_peered":"2023-10-16T23:28:49.004552+0000","last_clean":"2023-10-16T23:28:49.004552+0000","last_became_active":"2023-10-16T23:27:40.333290+0000","last_became_peered":"2023-10-16T23:27:40.333290+0000","last_unstale":"2023-10-16T23:28:49.004552+0000","last_undegraded":"2023-10-16T23:28:49.004552+0000","last_fullsized":"2023-10-16T23:28:49.004552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2023-10-16T23:28:49.004498+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2023-10-16T23:28:49.004498+0000","last_clean_scrub_stamp":"2023-10-16T23:28:49.004498+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:45.788624+0000","scrub_duration":0.0068572590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:42.754243+0000","last_change":"2023-10-16T23:28:42.754504+0000","last_active":"2023-10-16T23:28:42.754243+0000","last_peered":"2023-10-16T23:28:42.754243+0000","last_clean":"2023-10-16T23:28:42.754243+0000","last_became_active":"2023-10-16T23:27:36.278209+0000","last_became_peered":"2023-10-16T23:27:36.278209+0000","last_unstale":"2023-10-16T23:28:42.754243+0000","last_undegraded":"2023-10-16T23:28:42.754243+0000","last_fullsized":"2023-10-16T23:28:42.754243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:42.754195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:42.754195+0000","last_clean_scrub_stamp":"2023-10-16T23:28:42.754195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:11:57.993836+0000","scrub_duration":0.003737359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:52.430757+0000","last_change":"2023-10-16T23:28:52.430982+0000","last_active":"2023-10-16T23:28:52.430757+0000","last_peered":"2023-10-16T23:28:52.430757+0000","last_clean":"2023-10-16T23:28:52.430757+0000","last_became_active":"2023-10-16T23:28:23.650570+0000","last_became_peered":"2023-10-16T23:28:23.650570+0000","last_unstale":"2023-10-16T23:28:52.430757+0000","last_undegraded":"2023-10-16T23:28:52.430757+0000","last_fullsized":"2023-10-16T23:28:52.430757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:52.430707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:52.430707+0000","last_clean_scrub_stamp":"2023-10-16T23:28:52.430707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:39:02.092156+0000","scrub_duration":0.0042398360000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:50.540560+0000","last_change":"2023-10-16T23:28:50.540697+0000","last_active":"2023-10-16T23:28:50.540560+0000","last_peered":"2023-10-16T23:28:50.540560+0000","last_clean":"2023-10-16T23:28:50.540560+0000","last_became_active":"2023-10-16T23:27:40.332084+0000","last_became_peered":"2023-10-16T23:27:40.332084+0000","last_unstale":"2023-10-16T23:28:50.540560+0000","last_undegraded":"2023-10-16T23:28:50.540560+0000","last_fullsized":"2023-10-16T23:28:50.540560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2023-10-16T23:28:50.540532+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2023-10-16T23:28:50.540532+0000","last_clean_scrub_stamp":"2023-10-16T23:28:50.540532+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:39:35.621225+0000","scrub_duration":0.0038185189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:42.321401+0000","last_change":"2023-10-16T23:28:42.321700+0000","last_active":"2023-10-16T23:28:42.321401+0000","last_peered":"2023-10-16T23:28:42.321401+0000","last_clean":"2023-10-16T23:28:42.321401+0000","last_became_active":"2023-10-16T23:27:36.280600+0000","last_became_peered":"2023-10-16T23:27:36.280600+0000","last_unstale":"2023-10-16T23:28:42.321401+0000","last_undegraded":"2023-10-16T23:28:42.321401+0000","last_fullsized":"2023-10-16T23:28:42.321401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:42.321354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:42.321354+0000","last_clean_scrub_stamp":"2023-10-16T23:28:42.321354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:38:37.718515+0000","scrub_duration":0.0039340479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.434193+0000","last_change":"2023-10-16T23:27:40.756574+0000","last_active":"2023-10-16T23:28:23.434193+0000","last_peered":"2023-10-16T23:28:23.434193+0000","last_clean":"2023-10-16T23:28:23.434193+0000","last_became_active":"2023-10-16T23:27:40.755830+0000","last_became_peered":"2023-10-16T23:27:40.755830+0000","last_unstale":"2023-10-16T23:28:23.434193+0000","last_undegraded":"2023-10-16T23:28:23.434193+0000","last_fullsized":"2023-10-16T23:28:23.434193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:48.589147+0000","last_change":"2023-10-16T23:28:48.589394+0000","last_active":"2023-10-16T23:28:48.589147+0000","last_peered":"2023-10-16T23:28:48.589147+0000","last_clean":"2023-10-16T23:28:48.589147+0000","last_became_active":"2023-10-16T23:27:40.745143+0000","last_became_peered":"2023-10-16T23:27:40.745143+0000","last_unstale":"2023-10-16T23:28:48.589147+0000","last_undegraded":"2023-10-16T23:28:48.589147+0000","last_fullsized":"2023-10-16T23:28:48.589147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:48.589096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:48.589096+0000","last_clean_scrub_stamp":"2023-10-16T23:28:48.589096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:39:33.669789+0000","scrub_duration":0.00331059,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"26'19","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:57.522277+0000","last_change":"2023-10-16T23:28:57.522537+0000","last_active":"2023-10-16T23:28:57.522277+0000","last_peered":"2023-10-16T23:28:57.522277+0000","last_clean":"2023-10-16T23:28:57.522277+0000","last_became_active":"2023-10-16T23:27:40.351687+0000","last_became_peered":"2023-10-16T23:27:40.351687+0000","last_unstale":"2023-10-16T23:28:57.522277+0000","last_undegraded":"2023-10-16T23:28:57.522277+0000","last_fullsized":"2023-10-16T23:28:57.522277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'19","last_scrub_stamp":"2023-10-16T23:28:57.522221+0000","last_deep_scrub":"26'19","last_deep_scrub_stamp":"2023-10-16T23:28:57.522221+0000","last_clean_scrub_stamp":"2023-10-16T23:28:57.522221+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:12:23.848118+0000","scrub_duration":0.014520379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4472,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.650835+0000","last_change":"2023-10-16T23:27:40.727602+0000","last_active":"2023-10-16T23:28:23.650835+0000","last_peered":"2023-10-16T23:28:23.650835+0000","last_clean":"2023-10-16T23:28:23.650835+0000","last_became_active":"2023-10-16T23:27:40.727288+0000","last_became_peered":"2023-10-16T23:27:40.727288+0000","last_unstale":"2023-10-16T23:28:23.650835+0000","last_undegraded":"2023-10-16T23:28:23.650835+0000","last_fullsized":"2023-10-16T23:28:23.650835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.650474+0000","last_change":"2023-10-16T23:27:40.332379+0000","last_active":"2023-10-16T23:28:23.650474+0000","last_peered":"2023-10-16T23:28:23.650474+0000","last_clean":"2023-10-16T23:28:23.650474+0000","last_became_active":"2023-10-16T23:27:40.331517+0000","last_became_peered":"2023-10-16T23:27:40.331517+0000","last_unstale":"2023-10-16T23:28:23.650474+0000","last_undegraded":"2023-10-16T23:28:23.650474+0000","last_fullsized":"2023-10-16T23:28:23.650474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.648898+0000","last_change":"2023-10-16T23:27:40.336300+0000","last_active":"2023-10-16T23:28:23.648898+0000","last_peered":"2023-10-16T23:28:23.648898+0000","last_clean":"2023-10-16T23:28:23.648898+0000","last_became_active":"2023-10-16T23:27:40.333012+0000","last_became_peered":"2023-10-16T23:27:40.333012+0000","last_unstale":"2023-10-16T23:28:23.648898+0000","last_undegraded":"2023-10-16T23:28:23.648898+0000","last_fullsized":"2023-10-16T23:28:23.648898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.432946+0000","last_change":"2023-10-16T23:27:40.760984+0000","last_active":"2023-10-16T23:28:23.432946+0000","last_peered":"2023-10-16T23:28:23.432946+0000","last_clean":"2023-10-16T23:28:23.432946+0000","last_became_active":"2023-10-16T23:27:40.760680+0000","last_became_peered":"2023-10-16T23:27:40.760680+0000","last_unstale":"2023-10-16T23:28:23.432946+0000","last_undegraded":"2023-10-16T23:28:23.432946+0000","last_fullsized":"2023-10-16T23:28:23.432946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:48.540009+0000","last_change":"2023-10-16T23:28:48.540264+0000","last_active":"2023-10-16T23:28:48.540009+0000","last_peered":"2023-10-16T23:28:48.540009+0000","last_clean":"2023-10-16T23:28:48.540009+0000","last_became_active":"2023-10-16T23:27:40.338706+0000","last_became_peered":"2023-10-16T23:27:40.338706+0000","last_unstale":"2023-10-16T23:28:48.540009+0000","last_undegraded":"2023-10-16T23:28:48.540009+0000","last_fullsized":"2023-10-16T23:28:48.540009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:48.539954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:48.539954+0000","last_clean_scrub_stamp":"2023-10-16T23:28:48.539954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:45.324079+0000","scrub_duration":0.0038093760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.432950+0000","last_change":"2023-10-16T23:27:40.713138+0000","last_active":"2023-10-16T23:28:23.432950+0000","last_peered":"2023-10-16T23:28:23.432950+0000","last_clean":"2023-10-16T23:28:23.432950+0000","last_became_active":"2023-10-16T23:27:40.712756+0000","last_became_peered":"2023-10-16T23:27:40.712756+0000","last_unstale":"2023-10-16T23:28:23.432950+0000","last_undegraded":"2023-10-16T23:28:23.432950+0000","last_fullsized":"2023-10-16T23:28:23.432950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433764+0000","last_change":"2023-10-16T23:27:40.756418+0000","last_active":"2023-10-16T23:28:23.433764+0000","last_peered":"2023-10-16T23:28:23.433764+0000","last_clean":"2023-10-16T23:28:23.433764+0000","last_became_active":"2023-10-16T23:27:40.755714+0000","last_became_peered":"2023-10-16T23:27:40.755714+0000","last_unstale":"2023-10-16T23:28:23.433764+0000","last_undegraded":"2023-10-16T23:28:23.433764+0000","last_fullsized":"2023-10-16T23:28:23.433764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:57.017486+0000","last_change":"2023-10-16T23:28:57.017752+0000","last_active":"2023-10-16T23:28:57.017486+0000","last_peered":"2023-10-16T23:28:57.017486+0000","last_clean":"2023-10-16T23:28:57.017486+0000","last_became_active":"2023-10-16T23:27:40.331428+0000","last_became_peered":"2023-10-16T23:27:40.331428+0000","last_unstale":"2023-10-16T23:28:57.017486+0000","last_undegraded":"2023-10-16T23:28:57.017486+0000","last_fullsized":"2023-10-16T23:28:57.017486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:57.017438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:57.017438+0000","last_clean_scrub_stamp":"2023-10-16T23:28:57.017438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:45.421142+0000","scrub_duration":0.0034634449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.648628+0000","last_change":"2023-10-16T23:27:40.761081+0000","last_active":"2023-10-16T23:28:23.648628+0000","last_peered":"2023-10-16T23:28:23.648628+0000","last_clean":"2023-10-16T23:28:23.648628+0000","last_became_active":"2023-10-16T23:27:40.760779+0000","last_became_peered":"2023-10-16T23:27:40.760779+0000","last_unstale":"2023-10-16T23:28:23.648628+0000","last_undegraded":"2023-10-16T23:28:23.648628+0000","last_fullsized":"2023-10-16T23:28:23.648628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.647957+0000","last_change":"2023-10-16T23:27:40.318419+0000","last_active":"2023-10-16T23:28:23.647957+0000","last_peered":"2023-10-16T23:28:23.647957+0000","last_clean":"2023-10-16T23:28:23.647957+0000","last_became_active":"2023-10-16T23:27:40.317622+0000","last_became_peered":"2023-10-16T23:27:40.317622+0000","last_unstale":"2023-10-16T23:28:23.647957+0000","last_undegraded":"2023-10-16T23:28:23.647957+0000","last_fullsized":"2023-10-16T23:28:23.647957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433498+0000","last_change":"2023-10-16T23:27:40.706263+0000","last_active":"2023-10-16T23:28:23.433498+0000","last_peered":"2023-10-16T23:28:23.433498+0000","last_clean":"2023-10-16T23:28:23.433498+0000","last_became_active":"2023-10-16T23:27:40.705956+0000","last_became_peered":"2023-10-16T23:27:40.705956+0000","last_unstale":"2023-10-16T23:28:23.433498+0000","last_undegraded":"2023-10-16T23:28:23.433498+0000","last_fullsized":"2023-10-16T23:28:23.433498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.434209+0000","last_change":"2023-10-16T23:27:40.344965+0000","last_active":"2023-10-16T23:28:23.434209+0000","last_peered":"2023-10-16T23:28:23.434209+0000","last_clean":"2023-10-16T23:28:23.434209+0000","last_became_active":"2023-10-16T23:27:40.344158+0000","last_became_peered":"2023-10-16T23:27:40.344158+0000","last_unstale":"2023-10-16T23:28:23.434209+0000","last_undegraded":"2023-10-16T23:28:23.434209+0000","last_fullsized":"2023-10-16T23:28:23.434209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:50.412806+0000","last_change":"2023-10-16T23:28:50.413057+0000","last_active":"2023-10-16T23:28:50.412806+0000","last_peered":"2023-10-16T23:28:50.412806+0000","last_clean":"2023-10-16T23:28:50.412806+0000","last_became_active":"2023-10-16T23:27:40.712632+0000","last_became_peered":"2023-10-16T23:27:40.712632+0000","last_unstale":"2023-10-16T23:28:50.412806+0000","last_undegraded":"2023-10-16T23:28:50.412806+0000","last_fullsized":"2023-10-16T23:28:50.412806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:50.412753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:50.412753+0000","last_clean_scrub_stamp":"2023-10-16T23:28:50.412753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:13.627037+0000","scrub_duration":0.003558257,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:40.596739+0000","last_change":"2023-10-16T23:28:40.596984+0000","last_active":"2023-10-16T23:28:40.596739+0000","last_peered":"2023-10-16T23:28:40.596739+0000","last_clean":"2023-10-16T23:28:40.596739+0000","last_became_active":"2023-10-16T23:27:40.356809+0000","last_became_peered":"2023-10-16T23:27:40.356809+0000","last_unstale":"2023-10-16T23:28:40.596739+0000","last_undegraded":"2023-10-16T23:28:40.596739+0000","last_fullsized":"2023-10-16T23:28:40.596739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-10-16T23:28:40.596681+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-10-16T23:28:40.596681+0000","last_clean_scrub_stamp":"2023-10-16T23:28:40.596681+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:45:06.830528+0000","scrub_duration":0.0040939920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.435247+0000","last_change":"2023-10-16T23:27:40.726018+0000","last_active":"2023-10-16T23:28:23.435247+0000","last_peered":"2023-10-16T23:28:23.435247+0000","last_clean":"2023-10-16T23:28:23.435247+0000","last_became_active":"2023-10-16T23:27:40.724910+0000","last_became_peered":"2023-10-16T23:27:40.724910+0000","last_unstale":"2023-10-16T23:28:23.435247+0000","last_undegraded":"2023-10-16T23:28:23.435247+0000","last_fullsized":"2023-10-16T23:28:23.435247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.648725+0000","last_change":"2023-10-16T23:27:40.345785+0000","last_active":"2023-10-16T23:28:23.648725+0000","last_peered":"2023-10-16T23:28:23.648725+0000","last_clean":"2023-10-16T23:28:23.648725+0000","last_became_active":"2023-10-16T23:27:40.344531+0000","last_became_peered":"2023-10-16T23:27:40.344531+0000","last_unstale":"2023-10-16T23:28:23.648725+0000","last_undegraded":"2023-10-16T23:28:23.648725+0000","last_fullsized":"2023-10-16T23:28:23.648725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433574+0000","last_change":"2023-10-16T23:27:40.720573+0000","last_active":"2023-10-16T23:28:23.433574+0000","last_peered":"2023-10-16T23:28:23.433574+0000","last_clean":"2023-10-16T23:28:23.433574+0000","last_became_active":"2023-10-16T23:27:40.719758+0000","last_became_peered":"2023-10-16T23:27:40.719758+0000","last_unstale":"2023-10-16T23:28:23.433574+0000","last_undegraded":"2023-10-16T23:28:23.433574+0000","last_fullsized":"2023-10-16T23:28:23.433574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.649944+0000","last_change":"2023-10-16T23:27:40.345400+0000","last_active":"2023-10-16T23:28:23.649944+0000","last_peered":"2023-10-16T23:28:23.649944+0000","last_clean":"2023-10-16T23:28:23.649944+0000","last_became_active":"2023-10-16T23:27:40.344589+0000","last_became_peered":"2023-10-16T23:27:40.344589+0000","last_unstale":"2023-10-16T23:28:23.649944+0000","last_undegraded":"2023-10-16T23:28:23.649944+0000","last_fullsized":"2023-10-16T23:28:23.649944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433159+0000","last_change":"2023-10-16T23:27:40.711211+0000","last_active":"2023-10-16T23:28:23.433159+0000","last_peered":"2023-10-16T23:28:23.433159+0000","last_clean":"2023-10-16T23:28:23.433159+0000","last_became_active":"2023-10-16T23:27:40.705936+0000","last_became_peered":"2023-10-16T23:27:40.705936+0000","last_unstale":"2023-10-16T23:28:23.433159+0000","last_undegraded":"2023-10-16T23:28:23.433159+0000","last_fullsized":"2023-10-16T23:28:23.433159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433714+0000","last_change":"2023-10-16T23:27:40.323626+0000","last_active":"2023-10-16T23:28:23.433714+0000","last_peered":"2023-10-16T23:28:23.433714+0000","last_clean":"2023-10-16T23:28:23.433714+0000","last_became_active":"2023-10-16T23:27:40.323352+0000","last_became_peered":"2023-10-16T23:27:40.323352+0000","last_unstale":"2023-10-16T23:28:23.433714+0000","last_undegraded":"2023-10-16T23:28:23.433714+0000","last_fullsized":"2023-10-16T23:28:23.433714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:39.283245+0000","last_clean_scrub_stamp":"2023-10-16T23:27:39.283245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433633+0000","last_change":"2023-10-16T23:27:40.749109+0000","last_active":"2023-10-16T23:28:23.433633+0000","last_peered":"2023-10-16T23:28:23.433633+0000","last_clean":"2023-10-16T23:28:23.433633+0000","last_became_active":"2023-10-16T23:27:40.748525+0000","last_became_peered":"2023-10-16T23:27:40.748525+0000","last_unstale":"2023-10-16T23:28:23.433633+0000","last_undegraded":"2023-10-16T23:28:23.433633+0000","last_fullsized":"2023-10-16T23:28:23.433633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"26'6","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:56.488704+0000","last_change":"2023-10-16T23:28:56.489024+0000","last_active":"2023-10-16T23:28:56.488704+0000","last_peered":"2023-10-16T23:28:56.488704+0000","last_clean":"2023-10-16T23:28:56.488704+0000","last_became_active":"2023-10-16T23:27:40.338565+0000","last_became_peered":"2023-10-16T23:27:40.338565+0000","last_unstale":"2023-10-16T23:28:56.488704+0000","last_undegraded":"2023-10-16T23:28:56.488704+0000","last_fullsized":"2023-10-16T23:28:56.488704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2023-10-16T23:28:56.488647+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2023-10-16T23:28:56.488647+0000","last_clean_scrub_stamp":"2023-10-16T23:28:56.488647+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:44.892351+0000","scrub_duration":0.008659211,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5270,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":10540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":67,"ondisk_log_size":67,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":103608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.80800000000000005}]},{"osd":1,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.266},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.88500000000000001}]},{"osd":2,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.129}]},{"osd":3,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":1.018},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":1.2150000000000001}]},{"osd":4,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.105},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.327}]},{"osd":5,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.2650000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":1.369},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":1.181}]},{"osd":7,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":1.073},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.1829999999999998,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":1.4410000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509461,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":278528,"data_stored":104260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.622}]},{"osd":1,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.1789999999999998,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.95799999999999996}]},{"osd":2,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.755},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.0669999999999999}]},{"osd":3,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":2.3690000000000002,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.5129999999999999,"5min":2.5129999999999999,"15min":2.5129999999999999},"last":0.84999999999999998}]},{"osd":4,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":3.0640000000000001,"5min":3.0640000000000001,"15min":3.0640000000000001},"last":1.202},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":3.1669999999999998,"5min":3.1669999999999998,"15min":3.1669999999999998},"last":1.155}]},{"osd":6,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.6640000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":2.9119999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":1.133}]},{"osd":7,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":2.9870000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.345,"15min":1.345},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.8610000000000002,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":1.1719999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":108136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.752},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.91700000000000004}]},{"osd":1,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":1.1779999999999999},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":1.083}]},{"osd":2,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.996}]},{"osd":3,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.046},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.026}]},{"osd":5,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.873},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.68300000000000005}]},{"osd":6,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":1.135}]},{"osd":7,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.1060000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":103698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.75}]},{"osd":1,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.80400000000000005}]},{"osd":2,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.70199999999999996}]},{"osd":4,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.1559999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":1.127}]},{"osd":5,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.014},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":0.88300000000000001}]},{"osd":6,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.069},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.206}]},{"osd":7,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.95199999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":103608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.77800000000000002}]},{"osd":2,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.95099999999999996}]},{"osd":3,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":1.212},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.89500000000000002}]},{"osd":4,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.996},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.85399999999999998}]},{"osd":5,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.431,"5min":2.431,"15min":2.431},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.0640000000000001}]},{"osd":6,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.04}]},{"osd":7,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":1.1599999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509463,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":868352,"data_stored":694558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.622}]},{"osd":2,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.752},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.90000000000000002}]},{"osd":3,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.96399999999999997}]},{"osd":4,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.83199999999999996}]},{"osd":5,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.2929999999999999}]},{"osd":6,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.999}]},{"osd":7,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.105},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.3520000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542166,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":698664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.0229999999999999}]},{"osd":1,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.0980000000000001}]},{"osd":2,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.87},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.1799999999999999}]},{"osd":3,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.82599999999999996}]},{"osd":4,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.68600000000000005}]},{"osd":5,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":1.131}]},{"osd":6,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.742,"5min":2.742,"15min":2.742},"last":1.226}]}]},{"osd":2,"up_from":14,"seq":60129542166,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":270336,"data_stored":103608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.56999999999999995}]},{"osd":1,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.63800000000000001}]},{"osd":3,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.878},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.96599999999999997}]},{"osd":4,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.998}]},{"osd":5,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.80500000000000005}]},{"osd":6,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.087},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.77300000000000002}]},{"osd":7,"last update":"Mon Oct 16 23:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.93400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T23:29:00.400 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.400 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.401 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.401 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.402 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.402 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.402 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.403 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.403 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.404 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.404 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.404 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.405 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.405 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.406 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.406 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.406 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.407 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.407 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.408 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.408 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.408 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.409 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.409 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.409 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.410 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.410 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.411 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.411 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.411 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.412 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.412 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.413 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.413 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.414 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.414 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.414 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.415 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.415 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.416 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.416 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-16T23:27:35.237327+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=35, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.417 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.417 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.417 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.418 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.418 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.419 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.419 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.419 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.420 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.420 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.421 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.421 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.421 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.422 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.422 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.423 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.423 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.423 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.424 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.424 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-10-16T23:27:39.283245+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=39, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.424 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:00.425 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-16T23:29:10.207 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:29:10.211 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:29:10.214 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:29:10.218 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:29:10.221 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:29:20.426 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T23:29:20.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.559+0000 7f2841c8f640 1 Processor -- start 2023-10-16T23:29:20.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.559+0000 7f2841c8f640 1 -- start start 2023-10-16T23:29:20.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.559+0000 7f2841c8f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f283c0b8630 0x7f283c14cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:29:20.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.559+0000 7f2841c8f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f283c0b9f40 0x7f283c0ba370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:29:20.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.559+0000 7f2841c8f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f283c0b40c0 con 0x7f283c0c1130 2023-10-16T23:29:20.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.559+0000 7f2841c8f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f283c0b3ca0 con 0x7f283c0b9f40 2023-10-16T23:29:20.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.559+0000 7f2841c8f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f283c14d170 con 0x7f283c0b8630 2023-10-16T23:29:20.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.559+0000 7f283bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f283c0b9f40 0x7f283c0ba370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:29:20.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.559+0000 7f283b7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f283c0c1130 0x7f283c14c520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53606/0 (socket says 172.21.15.12:53606) 2023-10-16T23:29:20.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.559+0000 7f283b7fe640 1 -- 172.21.15.12:0/882223397 learned_addr learned my addr 172.21.15.12:0/882223397 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:29:20.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.559+0000 7f283affd640 1 --2- 172.21.15.12:0/882223397 >> v2:172.21.15.31:3300/0 conn(0x7f283c0b8630 0x7f283c14cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:29:20.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.559+0000 7f283bfff640 1 -- 172.21.15.12:0/882223397 >> v2:172.21.15.31:3300/0 conn(0x7f283c0b8630 msgr2=0x7f283c14cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:29:20.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.559+0000 7f283bfff640 1 --2- 172.21.15.12:0/882223397 >> v2:172.21.15.31:3300/0 conn(0x7f283c0b8630 0x7f283c14cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:20.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.559+0000 7f283bfff640 1 -- 172.21.15.12:0/882223397 >> v1:172.21.15.12:6789/0 conn(0x7f283c0c1130 legacy=0x7f283c14c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:29:20.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.559+0000 7f283bfff640 1 -- 172.21.15.12:0/882223397 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283c0b7ce0 con 0x7f283c0b9f40 2023-10-16T23:29:20.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.559+0000 7f283a7fc640 1 -- 172.21.15.12:0/882223397 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936494896 0 0) 0x7f283c0b40c0 con 0x7f283c0c1130 2023-10-16T23:29:20.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f283bfff640 1 --2- 172.21.15.12:0/882223397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f283c0b9f40 0x7f283c0ba370 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f283c0be340 tx=0x7f283401c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0cf0246ca046433 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:29:20.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f283a7fc640 1 -- 172.21.15.12:0/882223397 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28340ab600 con 0x7f283c0b9f40 2023-10-16T23:29:20.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f283a7fc640 1 -- 172.21.15.12:0/882223397 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28340a7050 con 0x7f283c0b9f40 2023-10-16T23:29:20.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f283a7fc640 1 -- 172.21.15.12:0/882223397 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28340ab980 con 0x7f283c0b9f40 2023-10-16T23:29:20.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f2841c8f640 1 -- 172.21.15.12:0/882223397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f283c0b9f40 msgr2=0x7f283c0ba370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:29:20.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f2841c8f640 1 --2- 172.21.15.12:0/882223397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f283c0b9f40 0x7f283c0ba370 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f283c0be340 tx=0x7f283401c340 comp rx=0 tx=0).stop 2023-10-16T23:29:20.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f2841c8f640 1 -- 172.21.15.12:0/882223397 shutdown_connections 2023-10-16T23:29:20.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f2841c8f640 1 --2- 172.21.15.12:0/882223397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f283c0b9f40 0x7f283c0ba370 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:20.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f2841c8f640 1 --2- 172.21.15.12:0/882223397 >> v2:172.21.15.31:3300/0 conn(0x7f283c0b8630 0x7f283c14cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:20.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f2841c8f640 1 -- 172.21.15.12:0/882223397 >> 172.21.15.12:0/882223397 conn(0x7f283c06ba20 msgr2=0x7f283c0c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:29:20.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f2841c8f640 1 -- 172.21.15.12:0/882223397 shutdown_connections 2023-10-16T23:29:20.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f2841c8f640 1 -- 172.21.15.12:0/882223397 wait complete. 2023-10-16T23:29:20.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f2841c8f640 1 Processor -- start 2023-10-16T23:29:20.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f2841c8f640 1 -- start start 2023-10-16T23:29:20.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f2841c8f640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f283c0b8630 0x7f283c13f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:29:20.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f2841c8f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f283c0b9f40 0x7f283c13fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:29:20.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f2841c8f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f283c0c1130 0x7f283c1e8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:29:20.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f2841c8f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283c1488b0 con 0x7f283c0b9f40 2023-10-16T23:29:20.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f2841c8f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283c148260 con 0x7f283c0c1130 2023-10-16T23:29:20.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f2841c8f640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f283c148540 con 0x7f283c0b8630 2023-10-16T23:29:20.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f283affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f283c0b9f40 0x7f283c13fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:29:20.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f283affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f283c0b9f40 0x7f283c13fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59478/0 (socket says 172.21.15.12:59478) 2023-10-16T23:29:20.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f283affd640 1 -- 172.21.15.12:0/1201962068 learned_addr learned my addr 172.21.15.12:0/1201962068 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:29:20.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f283b7fe640 1 --2- 172.21.15.12:0/1201962068 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f283c0b8630 0x7f283c13f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:29:20.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f283bfff640 1 --2- 172.21.15.12:0/1201962068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f283c0c1130 0x7f283c1e8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:29:20.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f283affd640 1 -- 172.21.15.12:0/1201962068 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f283c0b8630 msgr2=0x7f283c13f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:29:20.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f283affd640 1 --2- 172.21.15.12:0/1201962068 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f283c0b8630 0x7f283c13f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:20.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f283affd640 1 -- 172.21.15.12:0/1201962068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f283c0c1130 msgr2=0x7f283c1e8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:29:20.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f283affd640 1 --2- 172.21.15.12:0/1201962068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f283c0c1130 0x7f283c1e8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:20.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f283affd640 1 -- 172.21.15.12:0/1201962068 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2834009420 con 0x7f283c0b9f40 2023-10-16T23:29:20.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f283affd640 1 --2- 172.21.15.12:0/1201962068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f283c0b9f40 0x7f283c13fce0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2830007ef0 tx=0x7f283000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:29:20.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f2823fff640 1 -- 172.21.15.12:0/1201962068 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2830014620 con 0x7f283c0b9f40 2023-10-16T23:29:20.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f2823fff640 1 -- 172.21.15.12:0/1201962068 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2830014780 con 0x7f283c0b9f40 2023-10-16T23:29:20.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f2841c8f640 1 -- 172.21.15.12:0/1201962068 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f283c0b8480 con 0x7f283c0b9f40 2023-10-16T23:29:20.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f2823fff640 1 -- 172.21.15.12:0/1201962068 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2830014b30 con 0x7f283c0b9f40 2023-10-16T23:29:20.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.563+0000 7f2841c8f640 1 -- 172.21.15.12:0/1201962068 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f283c142fb0 con 0x7f283c0b9f40 2023-10-16T23:29:20.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.567+0000 7f2841c8f640 1 -- 172.21.15.12:0/1201962068 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f283c148700 con 0x7f283c0b9f40 2023-10-16T23:29:20.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.567+0000 7f2823fff640 1 -- 172.21.15.12:0/1201962068 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f2830014c90 con 0x7f283c0b9f40 2023-10-16T23:29:20.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.567+0000 7f2823fff640 1 --2- 172.21.15.12:0/1201962068 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2828065e90 0x7f2828068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:29:20.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.567+0000 7f2823fff640 1 -- 172.21.15.12:0/1201962068 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2830084310 con 0x7f283c0b9f40 2023-10-16T23:29:20.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.567+0000 7f283b7fe640 1 --2- 172.21.15.12:0/1201962068 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2828065e90 0x7f2828068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:29:20.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.567+0000 7f283b7fe640 1 --2- 172.21.15.12:0/1201962068 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2828065e90 0x7f2828068350 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f282c000f70 tx=0x7f282c007c10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:29:20.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.571+0000 7f2823fff640 1 -- 172.21.15.12:0/1201962068 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f2830051880 con 0x7f283c0b9f40 2023-10-16T23:29:20.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.723+0000 7f2841c8f640 1 -- 172.21.15.12:0/1201962068 --> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f283c15a2c0 con 0x7f2828065e90 2023-10-16T23:29:20.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.751+0000 7f2823fff640 1 -- 172.21.15.12:0/1201962068 <== mgr.4108 v2:172.21.15.31:6832/37949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310873 (secure 0 0 0) 0x7f282c007270 con 0x7f2828065e90 2023-10-16T23:29:20.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:29:20.758 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-16T23:29:20.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.751+0000 7f2841c8f640 1 -- 172.21.15.12:0/1201962068 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2828065e90 msgr2=0x7f2828068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:29:20.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.751+0000 7f2841c8f640 1 --2- 172.21.15.12:0/1201962068 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2828065e90 0x7f2828068350 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f282c000f70 tx=0x7f282c007c10 comp rx=0 tx=0).stop 2023-10-16T23:29:20.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.751+0000 7f2841c8f640 1 -- 172.21.15.12:0/1201962068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f283c0b9f40 msgr2=0x7f283c13fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:29:20.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.751+0000 7f2841c8f640 1 --2- 172.21.15.12:0/1201962068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f283c0b9f40 0x7f283c13fce0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2830007ef0 tx=0x7f283000e4b0 comp rx=0 tx=0).stop 2023-10-16T23:29:20.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.751+0000 7f2841c8f640 1 -- 172.21.15.12:0/1201962068 shutdown_connections 2023-10-16T23:29:20.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.751+0000 7f2841c8f640 1 --2- 172.21.15.12:0/1201962068 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2828065e90 0x7f2828068350 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:20.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.755+0000 7f2841c8f640 1 --2- 172.21.15.12:0/1201962068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f283c0c1130 0x7f283c1e8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:20.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.755+0000 7f2841c8f640 1 --2- 172.21.15.12:0/1201962068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f283c0b9f40 0x7f283c13fce0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:20.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.755+0000 7f2841c8f640 1 --2- 172.21.15.12:0/1201962068 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f283c0b8630 0x7f283c13f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:20.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.755+0000 7f2841c8f640 1 -- 172.21.15.12:0/1201962068 >> 172.21.15.12:0/1201962068 conn(0x7f283c06ba20 msgr2=0x7f283c14ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:29:20.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.755+0000 7f2841c8f640 1 -- 172.21.15.12:0/1201962068 shutdown_connections 2023-10-16T23:29:20.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:20.755+0000 7f2841c8f640 1 -- 172.21.15.12:0/1201962068 wait complete. 2023-10-16T23:29:20.776 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2023-10-16T23:29:19.321469+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595638,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":217,"num_write_kb":2441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190,"ondisk_log_size":190,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223048,"kb_used_data":3336,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751672,"statfs":{"total":773094113280,"available":772865712128,"internally_reserved":0,"allocated":3416064,"data_stored":2020140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004822"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:46.347825+0000","last_change":"2023-10-16T23:28:46.348111+0000","last_active":"2023-10-16T23:28:46.347825+0000","last_peered":"2023-10-16T23:28:46.347825+0000","last_clean":"2023-10-16T23:28:46.347825+0000","last_became_active":"2023-10-16T23:27:40.706320+0000","last_became_peered":"2023-10-16T23:27:40.706320+0000","last_unstale":"2023-10-16T23:28:46.347825+0000","last_undegraded":"2023-10-16T23:28:46.347825+0000","last_fullsized":"2023-10-16T23:28:46.347825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:46.347775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:46.347775+0000","last_clean_scrub_stamp":"2023-10-16T23:28:46.347775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:47.920970+0000","scrub_duration":0.0035569769999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.648427+0000","last_change":"2023-10-16T23:27:40.756555+0000","last_active":"2023-10-16T23:28:23.648427+0000","last_peered":"2023-10-16T23:28:23.648427+0000","last_clean":"2023-10-16T23:28:23.648427+0000","last_became_active":"2023-10-16T23:27:40.754736+0000","last_became_peered":"2023-10-16T23:27:40.754736+0000","last_unstale":"2023-10-16T23:28:23.648427+0000","last_undegraded":"2023-10-16T23:28:23.648427+0000","last_fullsized":"2023-10-16T23:28:23.648427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.434354+0000","last_change":"2023-10-16T23:27:40.726586+0000","last_active":"2023-10-16T23:28:23.434354+0000","last_peered":"2023-10-16T23:28:23.434354+0000","last_clean":"2023-10-16T23:28:23.434354+0000","last_became_active":"2023-10-16T23:27:40.725731+0000","last_became_peered":"2023-10-16T23:27:40.725731+0000","last_unstale":"2023-10-16T23:28:23.434354+0000","last_undegraded":"2023-10-16T23:28:23.434354+0000","last_fullsized":"2023-10-16T23:28:23.434354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:50.441103+0000","last_change":"2023-10-16T23:28:50.441396+0000","last_active":"2023-10-16T23:28:50.441103+0000","last_peered":"2023-10-16T23:28:50.441103+0000","last_clean":"2023-10-16T23:28:50.441103+0000","last_became_active":"2023-10-16T23:27:40.714592+0000","last_became_peered":"2023-10-16T23:27:40.714592+0000","last_unstale":"2023-10-16T23:28:50.441103+0000","last_undegraded":"2023-10-16T23:28:50.441103+0000","last_fullsized":"2023-10-16T23:28:50.441103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:50.441050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:50.441050+0000","last_clean_scrub_stamp":"2023-10-16T23:28:50.441050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:12:05.680691+0000","scrub_duration":0.0035120030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:07.338753+0000","last_change":"2023-10-16T23:29:07.339049+0000","last_active":"2023-10-16T23:29:07.338753+0000","last_peered":"2023-10-16T23:29:07.338753+0000","last_clean":"2023-10-16T23:29:07.338753+0000","last_became_active":"2023-10-16T23:27:40.722399+0000","last_became_peered":"2023-10-16T23:27:40.722399+0000","last_unstale":"2023-10-16T23:29:07.338753+0000","last_undegraded":"2023-10-16T23:29:07.338753+0000","last_fullsized":"2023-10-16T23:29:07.338753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:07.338705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:07.338705+0000","last_clean_scrub_stamp":"2023-10-16T23:29:07.338705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:17:27.277608+0000","scrub_duration":0.0036007499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.433340+0000","last_change":"2023-10-16T23:27:40.716139+0000","last_active":"2023-10-16T23:28:23.433340+0000","last_peered":"2023-10-16T23:28:23.433340+0000","last_clean":"2023-10-16T23:28:23.433340+0000","last_became_active":"2023-10-16T23:27:40.715294+0000","last_became_peered":"2023-10-16T23:27:40.715294+0000","last_unstale":"2023-10-16T23:28:23.433340+0000","last_undegraded":"2023-10-16T23:28:23.433340+0000","last_fullsized":"2023-10-16T23:28:23.433340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:02.516317+0000","last_change":"2023-10-16T23:29:02.516594+0000","last_active":"2023-10-16T23:29:02.516317+0000","last_peered":"2023-10-16T23:29:02.516317+0000","last_clean":"2023-10-16T23:29:02.516317+0000","last_became_active":"2023-10-16T23:27:40.760726+0000","last_became_peered":"2023-10-16T23:27:40.760726+0000","last_unstale":"2023-10-16T23:29:02.516317+0000","last_undegraded":"2023-10-16T23:29:02.516317+0000","last_fullsized":"2023-10-16T23:29:02.516317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:02.516265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:02.516265+0000","last_clean_scrub_stamp":"2023-10-16T23:29:02.516265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:12:10.501158+0000","scrub_duration":0.0041045810000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.648066+0000","last_change":"2023-10-16T23:27:40.756184+0000","last_active":"2023-10-16T23:28:23.648066+0000","last_peered":"2023-10-16T23:28:23.648066+0000","last_clean":"2023-10-16T23:28:23.648066+0000","last_became_active":"2023-10-16T23:27:40.755276+0000","last_became_peered":"2023-10-16T23:27:40.755276+0000","last_unstale":"2023-10-16T23:28:23.648066+0000","last_undegraded":"2023-10-16T23:28:23.648066+0000","last_fullsized":"2023-10-16T23:28:23.648066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.649144+0000","last_change":"2023-10-16T23:27:40.724060+0000","last_active":"2023-10-16T23:28:23.649144+0000","last_peered":"2023-10-16T23:28:23.649144+0000","last_clean":"2023-10-16T23:28:23.649144+0000","last_became_active":"2023-10-16T23:27:40.723701+0000","last_became_peered":"2023-10-16T23:27:40.723701+0000","last_unstale":"2023-10-16T23:28:23.649144+0000","last_undegraded":"2023-10-16T23:28:23.649144+0000","last_fullsized":"2023-10-16T23:28:23.649144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:15.251336+0000","last_change":"2023-10-16T23:29:15.251708+0000","last_active":"2023-10-16T23:29:15.251336+0000","last_peered":"2023-10-16T23:29:15.251336+0000","last_clean":"2023-10-16T23:29:15.251336+0000","last_became_active":"2023-10-16T23:27:40.755772+0000","last_became_peered":"2023-10-16T23:27:40.755772+0000","last_unstale":"2023-10-16T23:29:15.251336+0000","last_undegraded":"2023-10-16T23:29:15.251336+0000","last_fullsized":"2023-10-16T23:29:15.251336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:15.251230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:15.251230+0000","last_clean_scrub_stamp":"2023-10-16T23:29:15.251230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:49:40.141118+0000","scrub_duration":0.0040644399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.434576+0000","last_change":"2023-10-16T23:27:40.724754+0000","last_active":"2023-10-16T23:28:23.434576+0000","last_peered":"2023-10-16T23:28:23.434576+0000","last_clean":"2023-10-16T23:28:23.434576+0000","last_became_active":"2023-10-16T23:27:40.724031+0000","last_became_peered":"2023-10-16T23:27:40.724031+0000","last_unstale":"2023-10-16T23:28:23.434576+0000","last_undegraded":"2023-10-16T23:28:23.434576+0000","last_fullsized":"2023-10-16T23:28:23.434576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:51.454135+0000","last_change":"2023-10-16T23:28:51.454416+0000","last_active":"2023-10-16T23:28:51.454135+0000","last_peered":"2023-10-16T23:28:51.454135+0000","last_clean":"2023-10-16T23:28:51.454135+0000","last_became_active":"2023-10-16T23:27:40.724099+0000","last_became_peered":"2023-10-16T23:27:40.724099+0000","last_unstale":"2023-10-16T23:28:51.454135+0000","last_undegraded":"2023-10-16T23:28:51.454135+0000","last_fullsized":"2023-10-16T23:28:51.454135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:51.454084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:51.454084+0000","last_clean_scrub_stamp":"2023-10-16T23:28:51.454084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:30:36.813149+0000","scrub_duration":0.0036983559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:44.412252+0000","last_change":"2023-10-16T23:28:44.412516+0000","last_active":"2023-10-16T23:28:44.412252+0000","last_peered":"2023-10-16T23:28:44.412252+0000","last_clean":"2023-10-16T23:28:44.412252+0000","last_became_active":"2023-10-16T23:27:40.704162+0000","last_became_peered":"2023-10-16T23:27:40.704162+0000","last_unstale":"2023-10-16T23:28:44.412252+0000","last_undegraded":"2023-10-16T23:28:44.412252+0000","last_fullsized":"2023-10-16T23:28:44.412252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:44.412201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:44.412201+0000","last_clean_scrub_stamp":"2023-10-16T23:28:44.412201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:26:44.683009+0000","scrub_duration":0.003351209,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:08.134208+0000","last_change":"2023-10-16T23:29:08.134486+0000","last_active":"2023-10-16T23:29:08.134208+0000","last_peered":"2023-10-16T23:29:08.134208+0000","last_clean":"2023-10-16T23:29:08.134208+0000","last_became_active":"2023-10-16T23:27:40.738070+0000","last_became_peered":"2023-10-16T23:27:40.738070+0000","last_unstale":"2023-10-16T23:29:08.134208+0000","last_undegraded":"2023-10-16T23:29:08.134208+0000","last_fullsized":"2023-10-16T23:29:08.134208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:08.134158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:08.134158+0000","last_clean_scrub_stamp":"2023-10-16T23:29:08.134158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:17:28.073062+0000","scrub_duration":0.0039984119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:59.521341+0000","last_change":"2023-10-16T23:28:59.521588+0000","last_active":"2023-10-16T23:28:59.521341+0000","last_peered":"2023-10-16T23:28:59.521341+0000","last_clean":"2023-10-16T23:28:59.521341+0000","last_became_active":"2023-10-16T23:27:40.761570+0000","last_became_peered":"2023-10-16T23:27:40.761570+0000","last_unstale":"2023-10-16T23:28:59.521341+0000","last_undegraded":"2023-10-16T23:28:59.521341+0000","last_fullsized":"2023-10-16T23:28:59.521341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:59.521278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:59.521278+0000","last_clean_scrub_stamp":"2023-10-16T23:28:59.521278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:31:38.322028+0000","scrub_duration":0.0038043040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:16.633881+0000","last_change":"2023-10-16T23:29:16.634132+0000","last_active":"2023-10-16T23:29:16.633881+0000","last_peered":"2023-10-16T23:29:16.633881+0000","last_clean":"2023-10-16T23:29:16.633881+0000","last_became_active":"2023-10-16T23:27:40.718276+0000","last_became_peered":"2023-10-16T23:27:40.718276+0000","last_unstale":"2023-10-16T23:29:16.633881+0000","last_undegraded":"2023-10-16T23:29:16.633881+0000","last_fullsized":"2023-10-16T23:29:16.633881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:16.633830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:16.633830+0000","last_clean_scrub_stamp":"2023-10-16T23:29:16.633830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:36:35.865114+0000","scrub_duration":0.0038590740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.649322+0000","last_change":"2023-10-16T23:27:40.719723+0000","last_active":"2023-10-16T23:28:23.649322+0000","last_peered":"2023-10-16T23:28:23.649322+0000","last_clean":"2023-10-16T23:28:23.649322+0000","last_became_active":"2023-10-16T23:27:40.719402+0000","last_became_peered":"2023-10-16T23:27:40.719402+0000","last_unstale":"2023-10-16T23:28:23.649322+0000","last_undegraded":"2023-10-16T23:28:23.649322+0000","last_fullsized":"2023-10-16T23:28:23.649322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.434805+0000","last_change":"2023-10-16T23:27:40.732931+0000","last_active":"2023-10-16T23:28:23.434805+0000","last_peered":"2023-10-16T23:28:23.434805+0000","last_clean":"2023-10-16T23:28:23.434805+0000","last_became_active":"2023-10-16T23:27:40.732102+0000","last_became_peered":"2023-10-16T23:27:40.732102+0000","last_unstale":"2023-10-16T23:28:23.434805+0000","last_undegraded":"2023-10-16T23:28:23.434805+0000","last_fullsized":"2023-10-16T23:28:23.434805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:41.375368+0000","last_change":"2023-10-16T23:28:41.375625+0000","last_active":"2023-10-16T23:28:41.375368+0000","last_peered":"2023-10-16T23:28:41.375368+0000","last_clean":"2023-10-16T23:28:41.375368+0000","last_became_active":"2023-10-16T23:27:40.728298+0000","last_became_peered":"2023-10-16T23:27:40.728298+0000","last_unstale":"2023-10-16T23:28:41.375368+0000","last_undegraded":"2023-10-16T23:28:41.375368+0000","last_fullsized":"2023-10-16T23:28:41.375368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:41.375313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:41.375313+0000","last_clean_scrub_stamp":"2023-10-16T23:28:41.375313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:03:17.124670+0000","scrub_duration":0.003739582,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.434637+0000","last_change":"2023-10-16T23:27:40.745270+0000","last_active":"2023-10-16T23:28:23.434637+0000","last_peered":"2023-10-16T23:28:23.434637+0000","last_clean":"2023-10-16T23:28:23.434637+0000","last_became_active":"2023-10-16T23:27:40.744483+0000","last_became_peered":"2023-10-16T23:27:40.744483+0000","last_unstale":"2023-10-16T23:28:23.434637+0000","last_undegraded":"2023-10-16T23:28:23.434637+0000","last_fullsized":"2023-10-16T23:28:23.434637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:00.514763+0000","last_change":"2023-10-16T23:29:00.514965+0000","last_active":"2023-10-16T23:29:00.514763+0000","last_peered":"2023-10-16T23:29:00.514763+0000","last_clean":"2023-10-16T23:29:00.514763+0000","last_became_active":"2023-10-16T23:27:40.760882+0000","last_became_peered":"2023-10-16T23:27:40.760882+0000","last_unstale":"2023-10-16T23:29:00.514763+0000","last_undegraded":"2023-10-16T23:29:00.514763+0000","last_fullsized":"2023-10-16T23:29:00.514763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:00.514740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:00.514740+0000","last_clean_scrub_stamp":"2023-10-16T23:29:00.514740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:05:49.777579+0000","scrub_duration":0.0031752130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:05.392879+0000","last_change":"2023-10-16T23:29:05.393170+0000","last_active":"2023-10-16T23:29:05.392879+0000","last_peered":"2023-10-16T23:29:05.392879+0000","last_clean":"2023-10-16T23:29:05.392879+0000","last_became_active":"2023-10-16T23:27:40.722302+0000","last_became_peered":"2023-10-16T23:27:40.722302+0000","last_unstale":"2023-10-16T23:29:05.392879+0000","last_undegraded":"2023-10-16T23:29:05.392879+0000","last_fullsized":"2023-10-16T23:29:05.392879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:05.392831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:05.392831+0000","last_clean_scrub_stamp":"2023-10-16T23:29:05.392831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:42:37.172781+0000","scrub_duration":0.0035357750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.432837+0000","last_change":"2023-10-16T23:27:40.716578+0000","last_active":"2023-10-16T23:28:23.432837+0000","last_peered":"2023-10-16T23:28:23.432837+0000","last_clean":"2023-10-16T23:28:23.432837+0000","last_became_active":"2023-10-16T23:27:40.716228+0000","last_became_peered":"2023-10-16T23:27:40.716228+0000","last_unstale":"2023-10-16T23:28:23.432837+0000","last_undegraded":"2023-10-16T23:28:23.432837+0000","last_fullsized":"2023-10-16T23:28:23.432837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:01.511671+0000","last_change":"2023-10-16T23:29:01.511926+0000","last_active":"2023-10-16T23:29:01.511671+0000","last_peered":"2023-10-16T23:29:01.511671+0000","last_clean":"2023-10-16T23:29:01.511671+0000","last_became_active":"2023-10-16T23:27:40.760659+0000","last_became_peered":"2023-10-16T23:27:40.760659+0000","last_unstale":"2023-10-16T23:29:01.511671+0000","last_undegraded":"2023-10-16T23:29:01.511671+0000","last_fullsized":"2023-10-16T23:29:01.511671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:01.511616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:01.511616+0000","last_clean_scrub_stamp":"2023-10-16T23:29:01.511616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:35:13.988738+0000","scrub_duration":0.003766648,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:16.885661+0000","last_change":"2023-10-16T23:29:16.885945+0000","last_active":"2023-10-16T23:29:16.885661+0000","last_peered":"2023-10-16T23:29:16.885661+0000","last_clean":"2023-10-16T23:29:16.885661+0000","last_became_active":"2023-10-16T23:27:40.727334+0000","last_became_peered":"2023-10-16T23:27:40.727334+0000","last_unstale":"2023-10-16T23:29:16.885661+0000","last_undegraded":"2023-10-16T23:29:16.885661+0000","last_fullsized":"2023-10-16T23:29:16.885661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:16.885612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:16.885612+0000","last_clean_scrub_stamp":"2023-10-16T23:29:16.885612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:36.575232+0000","scrub_duration":0.0037868989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:14.898409+0000","last_change":"2023-10-16T23:29:14.898671+0000","last_active":"2023-10-16T23:29:14.898409+0000","last_peered":"2023-10-16T23:29:14.898409+0000","last_clean":"2023-10-16T23:29:14.898409+0000","last_became_active":"2023-10-16T23:27:40.704536+0000","last_became_peered":"2023-10-16T23:27:40.704536+0000","last_unstale":"2023-10-16T23:29:14.898409+0000","last_undegraded":"2023-10-16T23:29:14.898409+0000","last_fullsized":"2023-10-16T23:29:14.898409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:14.898353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:14.898353+0000","last_clean_scrub_stamp":"2023-10-16T23:29:14.898353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:04.628284+0000","scrub_duration":0.003687811,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.649582+0000","last_change":"2023-10-16T23:27:40.764351+0000","last_active":"2023-10-16T23:28:23.649582+0000","last_peered":"2023-10-16T23:28:23.649582+0000","last_clean":"2023-10-16T23:28:23.649582+0000","last_became_active":"2023-10-16T23:27:40.763592+0000","last_became_peered":"2023-10-16T23:27:40.763592+0000","last_unstale":"2023-10-16T23:28:23.649582+0000","last_undegraded":"2023-10-16T23:28:23.649582+0000","last_fullsized":"2023-10-16T23:28:23.649582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.649043+0000","last_change":"2023-10-16T23:27:40.760989+0000","last_active":"2023-10-16T23:28:23.649043+0000","last_peered":"2023-10-16T23:28:23.649043+0000","last_clean":"2023-10-16T23:28:23.649043+0000","last_became_active":"2023-10-16T23:27:40.760615+0000","last_became_peered":"2023-10-16T23:27:40.760615+0000","last_unstale":"2023-10-16T23:28:23.649043+0000","last_undegraded":"2023-10-16T23:28:23.649043+0000","last_fullsized":"2023-10-16T23:28:23.649043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:08.300156+0000","last_change":"2023-10-16T23:29:08.300428+0000","last_active":"2023-10-16T23:29:08.300156+0000","last_peered":"2023-10-16T23:29:08.300156+0000","last_clean":"2023-10-16T23:29:08.300156+0000","last_became_active":"2023-10-16T23:27:40.760437+0000","last_became_peered":"2023-10-16T23:27:40.760437+0000","last_unstale":"2023-10-16T23:29:08.300156+0000","last_undegraded":"2023-10-16T23:29:08.300156+0000","last_fullsized":"2023-10-16T23:29:08.300156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:08.300103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:08.300103+0000","last_clean_scrub_stamp":"2023-10-16T23:29:08.300103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:17:28.239007+0000","scrub_duration":0.0035936340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:15.588249+0000","last_change":"2023-10-16T23:29:15.588518+0000","last_active":"2023-10-16T23:29:15.588249+0000","last_peered":"2023-10-16T23:29:15.588249+0000","last_clean":"2023-10-16T23:29:15.588249+0000","last_became_active":"2023-10-16T23:27:40.744458+0000","last_became_peered":"2023-10-16T23:27:40.744458+0000","last_unstale":"2023-10-16T23:29:15.588249+0000","last_undegraded":"2023-10-16T23:29:15.588249+0000","last_fullsized":"2023-10-16T23:29:15.588249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:15.588199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:15.588199+0000","last_clean_scrub_stamp":"2023-10-16T23:29:15.588199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:23:03.039514+0000","scrub_duration":0.0032820359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:17.225050+0000","last_change":"2023-10-16T23:29:17.225346+0000","last_active":"2023-10-16T23:29:17.225050+0000","last_peered":"2023-10-16T23:29:17.225050+0000","last_clean":"2023-10-16T23:29:17.225050+0000","last_became_active":"2023-10-16T23:27:40.711492+0000","last_became_peered":"2023-10-16T23:27:40.711492+0000","last_unstale":"2023-10-16T23:29:17.225050+0000","last_undegraded":"2023-10-16T23:29:17.225050+0000","last_fullsized":"2023-10-16T23:29:17.225050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:17.224999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:17.224999+0000","last_clean_scrub_stamp":"2023-10-16T23:29:17.224999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:23:04.676314+0000","scrub_duration":0.0033378930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:00.518211+0000","last_change":"2023-10-16T23:29:00.518352+0000","last_active":"2023-10-16T23:29:00.518211+0000","last_peered":"2023-10-16T23:29:00.518211+0000","last_clean":"2023-10-16T23:29:00.518211+0000","last_became_active":"2023-10-16T23:27:40.709286+0000","last_became_peered":"2023-10-16T23:27:40.709286+0000","last_unstale":"2023-10-16T23:29:00.518211+0000","last_undegraded":"2023-10-16T23:29:00.518211+0000","last_fullsized":"2023-10-16T23:29:00.518211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:00.518184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:00.518184+0000","last_clean_scrub_stamp":"2023-10-16T23:29:00.518184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:57.302309+0000","scrub_duration":0.002605067,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:05.176691+0000","last_change":"2023-10-16T23:29:05.176985+0000","last_active":"2023-10-16T23:29:05.176691+0000","last_peered":"2023-10-16T23:29:05.176691+0000","last_clean":"2023-10-16T23:29:05.176691+0000","last_became_active":"2023-10-16T23:27:40.706864+0000","last_became_peered":"2023-10-16T23:27:40.706864+0000","last_unstale":"2023-10-16T23:29:05.176691+0000","last_undegraded":"2023-10-16T23:29:05.176691+0000","last_fullsized":"2023-10-16T23:29:05.176691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:05.176639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:05.176639+0000","last_clean_scrub_stamp":"2023-10-16T23:29:05.176639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:42:36.956589+0000","scrub_duration":0.0035589369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'4","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:49.381697+0000","last_change":"2023-10-16T23:28:49.381955+0000","last_active":"2023-10-16T23:28:49.381697+0000","last_peered":"2023-10-16T23:28:49.381697+0000","last_clean":"2023-10-16T23:28:49.381697+0000","last_became_active":"2023-10-16T23:27:40.352775+0000","last_became_peered":"2023-10-16T23:27:40.352775+0000","last_unstale":"2023-10-16T23:28:49.381697+0000","last_undegraded":"2023-10-16T23:28:49.381697+0000","last_fullsized":"2023-10-16T23:28:49.381697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2023-10-16T23:28:49.381632+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2023-10-16T23:28:49.381632+0000","last_clean_scrub_stamp":"2023-10-16T23:28:49.381632+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:38:59.043081+0000","scrub_duration":0.008668594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:13.208673+0000","last_change":"2023-10-16T23:29:13.208965+0000","last_active":"2023-10-16T23:29:13.208673+0000","last_peered":"2023-10-16T23:29:13.208673+0000","last_clean":"2023-10-16T23:29:13.208673+0000","last_became_active":"2023-10-16T23:27:40.764517+0000","last_became_peered":"2023-10-16T23:27:40.764517+0000","last_unstale":"2023-10-16T23:29:13.208673+0000","last_undegraded":"2023-10-16T23:29:13.208673+0000","last_fullsized":"2023-10-16T23:29:13.208673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:13.208622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:13.208622+0000","last_clean_scrub_stamp":"2023-10-16T23:29:13.208622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:32.898242+0000","scrub_duration":0.0034766910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:00.442327+0000","last_change":"2023-10-16T23:29:00.442518+0000","last_active":"2023-10-16T23:29:00.442327+0000","last_peered":"2023-10-16T23:29:00.442327+0000","last_clean":"2023-10-16T23:29:00.442327+0000","last_became_active":"2023-10-16T23:27:40.334885+0000","last_became_peered":"2023-10-16T23:27:40.334885+0000","last_unstale":"2023-10-16T23:29:00.442327+0000","last_undegraded":"2023-10-16T23:29:00.442327+0000","last_fullsized":"2023-10-16T23:29:00.442327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:00.442297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:00.442297+0000","last_clean_scrub_stamp":"2023-10-16T23:29:00.442297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:51:37.914607+0000","scrub_duration":0.0034444219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:10.347471+0000","last_change":"2023-10-16T23:29:10.347729+0000","last_active":"2023-10-16T23:29:10.347471+0000","last_peered":"2023-10-16T23:29:10.347471+0000","last_clean":"2023-10-16T23:29:10.347471+0000","last_became_active":"2023-10-16T23:27:40.719811+0000","last_became_peered":"2023-10-16T23:27:40.719811+0000","last_unstale":"2023-10-16T23:29:10.347471+0000","last_undegraded":"2023-10-16T23:29:10.347471+0000","last_fullsized":"2023-10-16T23:29:10.347471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:10.347417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:10.347417+0000","last_clean_scrub_stamp":"2023-10-16T23:29:10.347417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:00.077348+0000","scrub_duration":0.0036543629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:45.316754+0000","last_change":"2023-10-16T23:28:45.317090+0000","last_active":"2023-10-16T23:28:45.316754+0000","last_peered":"2023-10-16T23:28:45.316754+0000","last_clean":"2023-10-16T23:28:45.316754+0000","last_became_active":"2023-10-16T23:27:40.357009+0000","last_became_peered":"2023-10-16T23:27:40.357009+0000","last_unstale":"2023-10-16T23:28:45.316754+0000","last_undegraded":"2023-10-16T23:28:45.316754+0000","last_fullsized":"2023-10-16T23:28:45.316754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:45.316698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:45.316698+0000","last_clean_scrub_stamp":"2023-10-16T23:28:45.316698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:46.889893+0000","scrub_duration":0.003457342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:11.264275+0000","last_change":"2023-10-16T23:29:11.264530+0000","last_active":"2023-10-16T23:29:11.264275+0000","last_peered":"2023-10-16T23:29:11.264275+0000","last_clean":"2023-10-16T23:29:11.264275+0000","last_became_active":"2023-10-16T23:27:40.760365+0000","last_became_peered":"2023-10-16T23:27:40.760365+0000","last_unstale":"2023-10-16T23:29:11.264275+0000","last_undegraded":"2023-10-16T23:29:11.264275+0000","last_fullsized":"2023-10-16T23:29:11.264275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:11.264225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:11.264225+0000","last_clean_scrub_stamp":"2023-10-16T23:29:11.264225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:00.994156+0000","scrub_duration":0.0036701329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"26'12","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:48.460939+0000","last_change":"2023-10-16T23:28:48.461283+0000","last_active":"2023-10-16T23:28:48.460939+0000","last_peered":"2023-10-16T23:28:48.460939+0000","last_clean":"2023-10-16T23:28:48.460939+0000","last_became_active":"2023-10-16T23:27:40.330857+0000","last_became_peered":"2023-10-16T23:27:40.330857+0000","last_unstale":"2023-10-16T23:28:48.460939+0000","last_undegraded":"2023-10-16T23:28:48.460939+0000","last_fullsized":"2023-10-16T23:28:48.460939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12","last_scrub_stamp":"2023-10-16T23:28:48.460884+0000","last_deep_scrub":"26'12","last_deep_scrub_stamp":"2023-10-16T23:28:48.460884+0000","last_clean_scrub_stamp":"2023-10-16T23:28:48.460884+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:48.136384+0000","scrub_duration":0.010512126,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"26'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:48.333265+0000","last_change":"2023-10-16T23:28:48.333516+0000","last_active":"2023-10-16T23:28:48.333265+0000","last_peered":"2023-10-16T23:28:48.333265+0000","last_clean":"2023-10-16T23:28:48.333265+0000","last_became_active":"2023-10-16T23:27:40.357047+0000","last_became_peered":"2023-10-16T23:27:40.357047+0000","last_unstale":"2023-10-16T23:28:48.333265+0000","last_undegraded":"2023-10-16T23:28:48.333265+0000","last_fullsized":"2023-10-16T23:28:48.333265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2023-10-16T23:28:48.333206+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2023-10-16T23:28:48.333206+0000","last_clean_scrub_stamp":"2023-10-16T23:28:48.333206+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:30:33.692271+0000","scrub_duration":0.0077088319999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:11.193915+0000","last_change":"2023-10-16T23:29:11.194180+0000","last_active":"2023-10-16T23:29:11.193915+0000","last_peered":"2023-10-16T23:29:11.193915+0000","last_clean":"2023-10-16T23:29:11.193915+0000","last_became_active":"2023-10-16T23:27:40.763116+0000","last_became_peered":"2023-10-16T23:27:40.763116+0000","last_unstale":"2023-10-16T23:29:11.193915+0000","last_undegraded":"2023-10-16T23:29:11.193915+0000","last_fullsized":"2023-10-16T23:29:11.193915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:11.193863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:11.193863+0000","last_clean_scrub_stamp":"2023-10-16T23:29:11.193863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:00.923794+0000","scrub_duration":0.0036105400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:52.466822+0000","last_change":"2023-10-16T23:28:52.467072+0000","last_active":"2023-10-16T23:28:52.466822+0000","last_peered":"2023-10-16T23:28:52.466822+0000","last_clean":"2023-10-16T23:28:52.466822+0000","last_became_active":"2023-10-16T23:27:40.346439+0000","last_became_peered":"2023-10-16T23:27:40.346439+0000","last_unstale":"2023-10-16T23:28:52.466822+0000","last_undegraded":"2023-10-16T23:28:52.466822+0000","last_fullsized":"2023-10-16T23:28:52.466822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2023-10-16T23:28:52.466754+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2023-10-16T23:28:52.466754+0000","last_clean_scrub_stamp":"2023-10-16T23:28:52.466754+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:32.718215+0000","scrub_duration":0.0073781489999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:46.591562+0000","last_change":"2023-10-16T23:28:46.591816+0000","last_active":"2023-10-16T23:28:46.591562+0000","last_peered":"2023-10-16T23:28:46.591562+0000","last_clean":"2023-10-16T23:28:46.591562+0000","last_became_active":"2023-10-16T23:27:40.714098+0000","last_became_peered":"2023-10-16T23:27:40.714098+0000","last_unstale":"2023-10-16T23:28:46.591562+0000","last_undegraded":"2023-10-16T23:28:46.591562+0000","last_fullsized":"2023-10-16T23:28:46.591562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:46.591510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:46.591510+0000","last_clean_scrub_stamp":"2023-10-16T23:28:46.591510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:43.375635+0000","scrub_duration":0.0038871190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"26'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:47.356544+0000","last_change":"2023-10-16T23:28:47.356799+0000","last_active":"2023-10-16T23:28:47.356544+0000","last_peered":"2023-10-16T23:28:47.356544+0000","last_clean":"2023-10-16T23:28:47.356544+0000","last_became_active":"2023-10-16T23:27:40.339531+0000","last_became_peered":"2023-10-16T23:27:40.339531+0000","last_unstale":"2023-10-16T23:28:47.356544+0000","last_undegraded":"2023-10-16T23:28:47.356544+0000","last_fullsized":"2023-10-16T23:28:47.356544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2023-10-16T23:28:47.356483+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2023-10-16T23:28:47.356483+0000","last_clean_scrub_stamp":"2023-10-16T23:28:47.356483+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:10.570766+0000","scrub_duration":0.0069425870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:09.544618+0000","last_change":"2023-10-16T23:29:09.544873+0000","last_active":"2023-10-16T23:29:09.544618+0000","last_peered":"2023-10-16T23:29:09.544618+0000","last_clean":"2023-10-16T23:29:09.544618+0000","last_became_active":"2023-10-16T23:27:40.713087+0000","last_became_peered":"2023-10-16T23:27:40.713087+0000","last_unstale":"2023-10-16T23:29:09.544618+0000","last_undegraded":"2023-10-16T23:29:09.544618+0000","last_fullsized":"2023-10-16T23:29:09.544618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:09.544568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:09.544568+0000","last_clean_scrub_stamp":"2023-10-16T23:29:09.544568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:24.182139+0000","scrub_duration":0.00371274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:53.310895+0000","last_change":"2023-10-16T23:28:53.311195+0000","last_active":"2023-10-16T23:28:53.310895+0000","last_peered":"2023-10-16T23:28:53.310895+0000","last_clean":"2023-10-16T23:28:53.310895+0000","last_became_active":"2023-10-16T23:27:40.319887+0000","last_became_peered":"2023-10-16T23:27:40.319887+0000","last_unstale":"2023-10-16T23:28:53.310895+0000","last_undegraded":"2023-10-16T23:28:53.310895+0000","last_fullsized":"2023-10-16T23:28:53.310895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:53.310840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:53.310840+0000","last_clean_scrub_stamp":"2023-10-16T23:28:53.310840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:39:38.391533+0000","scrub_duration":0.0040007879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.648467+0000","last_change":"2023-10-16T23:27:40.726405+0000","last_active":"2023-10-16T23:28:23.648467+0000","last_peered":"2023-10-16T23:28:23.648467+0000","last_clean":"2023-10-16T23:28:23.648467+0000","last_became_active":"2023-10-16T23:27:40.725724+0000","last_became_peered":"2023-10-16T23:27:40.725724+0000","last_unstale":"2023-10-16T23:28:23.648467+0000","last_undegraded":"2023-10-16T23:28:23.648467+0000","last_fullsized":"2023-10-16T23:28:23.648467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:58.056830+0000","last_change":"2023-10-16T23:28:58.057082+0000","last_active":"2023-10-16T23:28:58.056830+0000","last_peered":"2023-10-16T23:28:58.056830+0000","last_clean":"2023-10-16T23:28:58.056830+0000","last_became_active":"2023-10-16T23:27:40.337405+0000","last_became_peered":"2023-10-16T23:27:40.337405+0000","last_unstale":"2023-10-16T23:28:58.056830+0000","last_undegraded":"2023-10-16T23:28:58.056830+0000","last_fullsized":"2023-10-16T23:28:58.056830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2023-10-16T23:28:58.056774+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2023-10-16T23:28:58.056774+0000","last_clean_scrub_stamp":"2023-10-16T23:28:58.056774+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:12.694345+0000","scrub_duration":0.0064973770000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:54.550987+0000","last_change":"2023-10-16T23:28:54.551267+0000","last_active":"2023-10-16T23:28:54.550987+0000","last_peered":"2023-10-16T23:28:54.550987+0000","last_clean":"2023-10-16T23:28:54.550987+0000","last_became_active":"2023-10-16T23:27:40.722091+0000","last_became_peered":"2023-10-16T23:27:40.722091+0000","last_unstale":"2023-10-16T23:28:54.550987+0000","last_undegraded":"2023-10-16T23:28:54.550987+0000","last_fullsized":"2023-10-16T23:28:54.550987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:54.550940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:54.550940+0000","last_clean_scrub_stamp":"2023-10-16T23:28:54.550940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:42.954644+0000","scrub_duration":0.0039030689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:43.363818+0000","last_change":"2023-10-16T23:28:43.364129+0000","last_active":"2023-10-16T23:28:43.363818+0000","last_peered":"2023-10-16T23:28:43.363818+0000","last_clean":"2023-10-16T23:28:43.363818+0000","last_became_active":"2023-10-16T23:27:40.342213+0000","last_became_peered":"2023-10-16T23:27:40.342213+0000","last_unstale":"2023-10-16T23:28:43.363818+0000","last_undegraded":"2023-10-16T23:28:43.363818+0000","last_fullsized":"2023-10-16T23:28:43.363818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:43.363769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:43.363769+0000","last_clean_scrub_stamp":"2023-10-16T23:28:43.363769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:58.725647+0000","scrub_duration":0.003734617,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:55.526798+0000","last_change":"2023-10-16T23:28:55.527078+0000","last_active":"2023-10-16T23:28:55.526798+0000","last_peered":"2023-10-16T23:28:55.526798+0000","last_clean":"2023-10-16T23:28:55.526798+0000","last_became_active":"2023-10-16T23:27:40.732996+0000","last_became_peered":"2023-10-16T23:27:40.732996+0000","last_unstale":"2023-10-16T23:28:55.526798+0000","last_undegraded":"2023-10-16T23:28:55.526798+0000","last_fullsized":"2023-10-16T23:28:55.526798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:55.526749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:55.526749+0000","last_clean_scrub_stamp":"2023-10-16T23:28:55.526749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:10.164320+0000","scrub_duration":0.0041469059999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:04.485405+0000","last_change":"2023-10-16T23:29:04.485661+0000","last_active":"2023-10-16T23:29:04.485405+0000","last_peered":"2023-10-16T23:29:04.485405+0000","last_clean":"2023-10-16T23:29:04.485405+0000","last_became_active":"2023-10-16T23:27:40.347253+0000","last_became_peered":"2023-10-16T23:27:40.347253+0000","last_unstale":"2023-10-16T23:29:04.485405+0000","last_undegraded":"2023-10-16T23:29:04.485405+0000","last_fullsized":"2023-10-16T23:29:04.485405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:04.485343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:04.485343+0000","last_clean_scrub_stamp":"2023-10-16T23:29:04.485343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:17:24.424246+0000","scrub_duration":0.0040997250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.435213+0000","last_change":"2023-10-16T23:27:40.745245+0000","last_active":"2023-10-16T23:28:23.435213+0000","last_peered":"2023-10-16T23:28:23.435213+0000","last_clean":"2023-10-16T23:28:23.435213+0000","last_became_active":"2023-10-16T23:27:40.744571+0000","last_became_peered":"2023-10-16T23:27:40.744571+0000","last_unstale":"2023-10-16T23:28:23.435213+0000","last_undegraded":"2023-10-16T23:28:23.435213+0000","last_fullsized":"2023-10-16T23:28:23.435213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:39.870190+0000","last_change":"2023-10-16T23:28:39.870424+0000","last_active":"2023-10-16T23:28:39.870190+0000","last_peered":"2023-10-16T23:28:39.870190+0000","last_clean":"2023-10-16T23:28:39.870190+0000","last_became_active":"2023-10-16T23:27:40.314242+0000","last_became_peered":"2023-10-16T23:27:40.314242+0000","last_unstale":"2023-10-16T23:28:39.870190+0000","last_undegraded":"2023-10-16T23:28:39.870190+0000","last_fullsized":"2023-10-16T23:28:39.870190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:39.870144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:39.870144+0000","last_clean_scrub_stamp":"2023-10-16T23:28:39.870144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:19:34.468123+0000","scrub_duration":0.002925712,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:11.915806+0000","last_change":"2023-10-16T23:29:11.916050+0000","last_active":"2023-10-16T23:29:11.915806+0000","last_peered":"2023-10-16T23:29:11.915806+0000","last_clean":"2023-10-16T23:29:11.915806+0000","last_became_active":"2023-10-16T23:27:40.709174+0000","last_became_peered":"2023-10-16T23:27:40.709174+0000","last_unstale":"2023-10-16T23:29:11.915806+0000","last_undegraded":"2023-10-16T23:29:11.915806+0000","last_fullsized":"2023-10-16T23:29:11.915806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:11.915747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:11.915747+0000","last_clean_scrub_stamp":"2023-10-16T23:29:11.915747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:17:31.854651+0000","scrub_duration":0.0030805680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":183,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:41.332779+0000","last_change":"2023-10-16T23:28:41.333104+0000","last_active":"2023-10-16T23:28:41.332779+0000","last_peered":"2023-10-16T23:28:41.332779+0000","last_clean":"2023-10-16T23:28:41.332779+0000","last_became_active":"2023-10-16T23:27:29.353846+0000","last_became_peered":"2023-10-16T23:27:29.353846+0000","last_unstale":"2023-10-16T23:28:41.332779+0000","last_undegraded":"2023-10-16T23:28:41.332779+0000","last_fullsized":"2023-10-16T23:28:41.332779+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2023-10-16T23:28:41.332715+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2023-10-16T23:28:41.332715+0000","last_clean_scrub_stamp":"2023-10-16T23:28:41.332715+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:34.312585+0000","scrub_duration":0.01599012,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:40.409329+0000","last_change":"2023-10-16T23:28:40.409634+0000","last_active":"2023-10-16T23:28:40.409329+0000","last_peered":"2023-10-16T23:28:40.409329+0000","last_clean":"2023-10-16T23:28:40.409329+0000","last_became_active":"2023-10-16T23:27:36.277096+0000","last_became_peered":"2023-10-16T23:27:36.277096+0000","last_unstale":"2023-10-16T23:28:40.409329+0000","last_undegraded":"2023-10-16T23:28:40.409329+0000","last_fullsized":"2023-10-16T23:28:40.409329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:40.409281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:40.409281+0000","last_clean_scrub_stamp":"2023-10-16T23:28:40.409281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:11:55.648922+0000","scrub_duration":0.003820922,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:51.048809+0000","last_change":"2023-10-16T23:28:51.049069+0000","last_active":"2023-10-16T23:28:51.048809+0000","last_peered":"2023-10-16T23:28:51.048809+0000","last_clean":"2023-10-16T23:28:51.048809+0000","last_became_active":"2023-10-16T23:27:40.330989+0000","last_became_peered":"2023-10-16T23:27:40.330989+0000","last_unstale":"2023-10-16T23:28:51.048809+0000","last_undegraded":"2023-10-16T23:28:51.048809+0000","last_fullsized":"2023-10-16T23:28:51.048809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:51.048757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:51.048757+0000","last_clean_scrub_stamp":"2023-10-16T23:28:51.048757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:39:36.129450+0000","scrub_duration":0.0042242089999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:52.485319+0000","last_change":"2023-10-16T23:28:52.485612+0000","last_active":"2023-10-16T23:28:52.485319+0000","last_peered":"2023-10-16T23:28:52.485319+0000","last_clean":"2023-10-16T23:28:52.485319+0000","last_became_active":"2023-10-16T23:27:40.725490+0000","last_became_peered":"2023-10-16T23:27:40.725490+0000","last_unstale":"2023-10-16T23:28:52.485319+0000","last_undegraded":"2023-10-16T23:28:52.485319+0000","last_fullsized":"2023-10-16T23:28:52.485319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:52.485272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:52.485272+0000","last_clean_scrub_stamp":"2023-10-16T23:28:52.485272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:45:18.719119+0000","scrub_duration":0.0033147099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:42.339210+0000","last_change":"2023-10-16T23:28:42.339474+0000","last_active":"2023-10-16T23:28:42.339210+0000","last_peered":"2023-10-16T23:28:42.339210+0000","last_clean":"2023-10-16T23:28:42.339210+0000","last_became_active":"2023-10-16T23:27:36.277974+0000","last_became_peered":"2023-10-16T23:27:36.277974+0000","last_unstale":"2023-10-16T23:28:42.339210+0000","last_undegraded":"2023-10-16T23:28:42.339210+0000","last_fullsized":"2023-10-16T23:28:42.339210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:42.339160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:42.339160+0000","last_clean_scrub_stamp":"2023-10-16T23:28:42.339160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:43:39.840764+0000","scrub_duration":0.0082552289999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:38.602009+0000","last_change":"2023-10-16T23:28:38.602280+0000","last_active":"2023-10-16T23:28:38.602009+0000","last_peered":"2023-10-16T23:28:38.602009+0000","last_clean":"2023-10-16T23:28:38.602009+0000","last_became_active":"2023-10-16T23:27:40.339569+0000","last_became_peered":"2023-10-16T23:27:40.339569+0000","last_unstale":"2023-10-16T23:28:38.602009+0000","last_undegraded":"2023-10-16T23:28:38.602009+0000","last_fullsized":"2023-10-16T23:28:38.602009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:38.601943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:38.601943+0000","last_clean_scrub_stamp":"2023-10-16T23:28:38.601943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:11:53.841584+0000","scrub_duration":0.0039239139999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:11.361786+0000","last_change":"2023-10-16T23:29:11.362095+0000","last_active":"2023-10-16T23:29:11.361786+0000","last_peered":"2023-10-16T23:29:11.361786+0000","last_clean":"2023-10-16T23:29:11.361786+0000","last_became_active":"2023-10-16T23:27:40.726813+0000","last_became_peered":"2023-10-16T23:27:40.726813+0000","last_unstale":"2023-10-16T23:29:11.361786+0000","last_undegraded":"2023-10-16T23:29:11.361786+0000","last_fullsized":"2023-10-16T23:29:11.361786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:11.361731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:11.361731+0000","last_clean_scrub_stamp":"2023-10-16T23:29:11.361731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:51:49.495366+0000","scrub_duration":0.0034816449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:38.315486+0000","last_change":"2023-10-16T23:28:38.315622+0000","last_active":"2023-10-16T23:28:38.315486+0000","last_peered":"2023-10-16T23:28:38.315486+0000","last_clean":"2023-10-16T23:28:38.315486+0000","last_became_active":"2023-10-16T23:27:36.294489+0000","last_became_peered":"2023-10-16T23:27:36.294489+0000","last_unstale":"2023-10-16T23:28:38.315486+0000","last_undegraded":"2023-10-16T23:28:38.315486+0000","last_fullsized":"2023-10-16T23:28:38.315486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:38.315459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:38.315459+0000","last_clean_scrub_stamp":"2023-10-16T23:28:38.315459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:37:02.617863+0000","scrub_duration":0.0020246650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:54.915320+0000","last_change":"2023-10-16T23:28:54.915581+0000","last_active":"2023-10-16T23:28:54.915320+0000","last_peered":"2023-10-16T23:28:54.915320+0000","last_clean":"2023-10-16T23:28:54.915320+0000","last_became_active":"2023-10-16T23:27:40.326396+0000","last_became_peered":"2023-10-16T23:27:40.326396+0000","last_unstale":"2023-10-16T23:28:54.915320+0000","last_undegraded":"2023-10-16T23:28:54.915320+0000","last_fullsized":"2023-10-16T23:28:54.915320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:54.915270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:54.915270+0000","last_clean_scrub_stamp":"2023-10-16T23:28:54.915270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:39:39.995963+0000","scrub_duration":0.0073983119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:01.985002+0000","last_change":"2023-10-16T23:29:01.985257+0000","last_active":"2023-10-16T23:29:01.985002+0000","last_peered":"2023-10-16T23:29:01.985002+0000","last_clean":"2023-10-16T23:29:01.985002+0000","last_became_active":"2023-10-16T23:27:40.755489+0000","last_became_peered":"2023-10-16T23:27:40.755489+0000","last_unstale":"2023-10-16T23:29:01.985002+0000","last_undegraded":"2023-10-16T23:29:01.985002+0000","last_fullsized":"2023-10-16T23:29:01.985002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:01.984950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:01.984950+0000","last_clean_scrub_stamp":"2023-10-16T23:29:01.984950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:16.622521+0000","scrub_duration":0.0037752060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-16T23:28:38.715127+0000","last_change":"2023-10-16T23:28:42.336100+0000","last_active":"2023-10-16T23:28:38.715127+0000","last_peered":"2023-10-16T23:28:38.715127+0000","last_clean":"2023-10-16T23:28:38.715127+0000","last_became_active":"2023-10-16T23:27:36.278134+0000","last_became_peered":"2023-10-16T23:27:36.278134+0000","last_unstale":"2023-10-16T23:28:38.715127+0000","last_undegraded":"2023-10-16T23:28:38.715127+0000","last_fullsized":"2023-10-16T23:28:38.715127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:35.237327+0000","last_clean_scrub_stamp":"2023-10-16T23:27:35.237327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:07.464619+0000","last_change":"2023-10-16T23:29:07.464875+0000","last_active":"2023-10-16T23:29:07.464619+0000","last_peered":"2023-10-16T23:29:07.464619+0000","last_clean":"2023-10-16T23:29:07.464619+0000","last_became_active":"2023-10-16T23:27:40.341951+0000","last_became_peered":"2023-10-16T23:27:40.341951+0000","last_unstale":"2023-10-16T23:29:07.464619+0000","last_undegraded":"2023-10-16T23:29:07.464619+0000","last_fullsized":"2023-10-16T23:29:07.464619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:07.464569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:07.464569+0000","last_clean_scrub_stamp":"2023-10-16T23:29:07.464569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:44:57.194500+0000","scrub_duration":0.003795624,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:03.943355+0000","last_change":"2023-10-16T23:29:03.943599+0000","last_active":"2023-10-16T23:29:03.943355+0000","last_peered":"2023-10-16T23:29:03.943355+0000","last_clean":"2023-10-16T23:29:03.943355+0000","last_became_active":"2023-10-16T23:27:40.731150+0000","last_became_peered":"2023-10-16T23:27:40.731150+0000","last_unstale":"2023-10-16T23:29:03.943355+0000","last_undegraded":"2023-10-16T23:29:03.943355+0000","last_fullsized":"2023-10-16T23:29:03.943355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:03.943306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:03.943306+0000","last_clean_scrub_stamp":"2023-10-16T23:29:03.943306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:51:41.415616+0000","scrub_duration":0.003488578,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:51.375490+0000","last_change":"2023-10-16T23:28:51.375752+0000","last_active":"2023-10-16T23:28:51.375490+0000","last_peered":"2023-10-16T23:28:51.375490+0000","last_clean":"2023-10-16T23:28:51.375490+0000","last_became_active":"2023-10-16T23:27:40.319571+0000","last_became_peered":"2023-10-16T23:27:40.319571+0000","last_unstale":"2023-10-16T23:28:51.375490+0000","last_undegraded":"2023-10-16T23:28:51.375490+0000","last_fullsized":"2023-10-16T23:28:51.375490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:51.375443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:51.375443+0000","last_clean_scrub_stamp":"2023-10-16T23:28:51.375443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:48.159569+0000","scrub_duration":0.0039652410000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:44.785018+0000","last_change":"2023-10-16T23:28:44.785290+0000","last_active":"2023-10-16T23:28:44.785018+0000","last_peered":"2023-10-16T23:28:44.785018+0000","last_clean":"2023-10-16T23:28:44.785018+0000","last_became_active":"2023-10-16T23:27:36.433808+0000","last_became_peered":"2023-10-16T23:27:36.433808+0000","last_unstale":"2023-10-16T23:28:44.785018+0000","last_undegraded":"2023-10-16T23:28:44.785018+0000","last_fullsized":"2023-10-16T23:28:44.785018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:44.784970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:44.784970+0000","last_clean_scrub_stamp":"2023-10-16T23:28:44.784970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:45:11.018817+0000","scrub_duration":0.0037436349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:55.349739+0000","last_change":"2023-10-16T23:28:55.349998+0000","last_active":"2023-10-16T23:28:55.349739+0000","last_peered":"2023-10-16T23:28:55.349739+0000","last_clean":"2023-10-16T23:28:55.349739+0000","last_became_active":"2023-10-16T23:28:23.651881+0000","last_became_peered":"2023-10-16T23:28:23.651881+0000","last_unstale":"2023-10-16T23:28:55.349739+0000","last_undegraded":"2023-10-16T23:28:55.349739+0000","last_fullsized":"2023-10-16T23:28:55.349739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:55.349662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:55.349662+0000","last_clean_scrub_stamp":"2023-10-16T23:28:55.349662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:35.601123+0000","scrub_duration":0.003616677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:52.980589+0000","last_change":"2023-10-16T23:28:52.980865+0000","last_active":"2023-10-16T23:28:52.980589+0000","last_peered":"2023-10-16T23:28:52.980589+0000","last_clean":"2023-10-16T23:28:52.980589+0000","last_became_active":"2023-10-16T23:27:40.327804+0000","last_became_peered":"2023-10-16T23:27:40.327804+0000","last_unstale":"2023-10-16T23:28:52.980589+0000","last_undegraded":"2023-10-16T23:28:52.980589+0000","last_fullsized":"2023-10-16T23:28:52.980589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:52.980540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:52.980540+0000","last_clean_scrub_stamp":"2023-10-16T23:28:52.980540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:49.764666+0000","scrub_duration":0.0034145260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:44.279340+0000","last_change":"2023-10-16T23:28:44.279600+0000","last_active":"2023-10-16T23:28:44.279340+0000","last_peered":"2023-10-16T23:28:44.279340+0000","last_clean":"2023-10-16T23:28:44.279340+0000","last_became_active":"2023-10-16T23:27:36.433923+0000","last_became_peered":"2023-10-16T23:27:36.433923+0000","last_unstale":"2023-10-16T23:28:44.279340+0000","last_undegraded":"2023-10-16T23:28:44.279340+0000","last_fullsized":"2023-10-16T23:28:44.279340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:44.279284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:44.279284+0000","last_clean_scrub_stamp":"2023-10-16T23:28:44.279284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:32:40.077699+0000","scrub_duration":0.003868692,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.649621+0000","last_change":"2023-10-16T23:27:40.756257+0000","last_active":"2023-10-16T23:28:23.649621+0000","last_peered":"2023-10-16T23:28:23.649621+0000","last_clean":"2023-10-16T23:28:23.649621+0000","last_became_active":"2023-10-16T23:27:40.755822+0000","last_became_peered":"2023-10-16T23:27:40.755822+0000","last_unstale":"2023-10-16T23:28:23.649621+0000","last_undegraded":"2023-10-16T23:28:23.649621+0000","last_fullsized":"2023-10-16T23:28:23.649621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:49.004552+0000","last_change":"2023-10-16T23:28:49.004794+0000","last_active":"2023-10-16T23:28:49.004552+0000","last_peered":"2023-10-16T23:28:49.004552+0000","last_clean":"2023-10-16T23:28:49.004552+0000","last_became_active":"2023-10-16T23:27:40.333290+0000","last_became_peered":"2023-10-16T23:27:40.333290+0000","last_unstale":"2023-10-16T23:28:49.004552+0000","last_undegraded":"2023-10-16T23:28:49.004552+0000","last_fullsized":"2023-10-16T23:28:49.004552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2023-10-16T23:28:49.004498+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2023-10-16T23:28:49.004498+0000","last_clean_scrub_stamp":"2023-10-16T23:28:49.004498+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:45.788624+0000","scrub_duration":0.0068572590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:42.754243+0000","last_change":"2023-10-16T23:28:42.754504+0000","last_active":"2023-10-16T23:28:42.754243+0000","last_peered":"2023-10-16T23:28:42.754243+0000","last_clean":"2023-10-16T23:28:42.754243+0000","last_became_active":"2023-10-16T23:27:36.278209+0000","last_became_peered":"2023-10-16T23:27:36.278209+0000","last_unstale":"2023-10-16T23:28:42.754243+0000","last_undegraded":"2023-10-16T23:28:42.754243+0000","last_fullsized":"2023-10-16T23:28:42.754243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:42.754195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:42.754195+0000","last_clean_scrub_stamp":"2023-10-16T23:28:42.754195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:11:57.993836+0000","scrub_duration":0.003737359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:52.430757+0000","last_change":"2023-10-16T23:28:52.430982+0000","last_active":"2023-10-16T23:28:52.430757+0000","last_peered":"2023-10-16T23:28:52.430757+0000","last_clean":"2023-10-16T23:28:52.430757+0000","last_became_active":"2023-10-16T23:28:23.650570+0000","last_became_peered":"2023-10-16T23:28:23.650570+0000","last_unstale":"2023-10-16T23:28:52.430757+0000","last_undegraded":"2023-10-16T23:28:52.430757+0000","last_fullsized":"2023-10-16T23:28:52.430757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:52.430707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:52.430707+0000","last_clean_scrub_stamp":"2023-10-16T23:28:52.430707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:39:02.092156+0000","scrub_duration":0.0042398360000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:50.540560+0000","last_change":"2023-10-16T23:28:50.540697+0000","last_active":"2023-10-16T23:28:50.540560+0000","last_peered":"2023-10-16T23:28:50.540560+0000","last_clean":"2023-10-16T23:28:50.540560+0000","last_became_active":"2023-10-16T23:27:40.332084+0000","last_became_peered":"2023-10-16T23:27:40.332084+0000","last_unstale":"2023-10-16T23:28:50.540560+0000","last_undegraded":"2023-10-16T23:28:50.540560+0000","last_fullsized":"2023-10-16T23:28:50.540560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2023-10-16T23:28:50.540532+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2023-10-16T23:28:50.540532+0000","last_clean_scrub_stamp":"2023-10-16T23:28:50.540532+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:39:35.621225+0000","scrub_duration":0.0038185189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:42.321401+0000","last_change":"2023-10-16T23:28:42.321700+0000","last_active":"2023-10-16T23:28:42.321401+0000","last_peered":"2023-10-16T23:28:42.321401+0000","last_clean":"2023-10-16T23:28:42.321401+0000","last_became_active":"2023-10-16T23:27:36.280600+0000","last_became_peered":"2023-10-16T23:27:36.280600+0000","last_unstale":"2023-10-16T23:28:42.321401+0000","last_undegraded":"2023-10-16T23:28:42.321401+0000","last_fullsized":"2023-10-16T23:28:42.321401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:42.321354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:42.321354+0000","last_clean_scrub_stamp":"2023-10-16T23:28:42.321354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:38:37.718515+0000","scrub_duration":0.0039340479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:11.520288+0000","last_change":"2023-10-16T23:29:11.520558+0000","last_active":"2023-10-16T23:29:11.520288+0000","last_peered":"2023-10-16T23:29:11.520288+0000","last_clean":"2023-10-16T23:29:11.520288+0000","last_became_active":"2023-10-16T23:27:40.755830+0000","last_became_peered":"2023-10-16T23:27:40.755830+0000","last_unstale":"2023-10-16T23:29:11.520288+0000","last_undegraded":"2023-10-16T23:29:11.520288+0000","last_fullsized":"2023-10-16T23:29:11.520288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:11.520239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:11.520239+0000","last_clean_scrub_stamp":"2023-10-16T23:29:11.520239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:49:36.410127+0000","scrub_duration":0.0034573680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:48.589147+0000","last_change":"2023-10-16T23:28:48.589394+0000","last_active":"2023-10-16T23:28:48.589147+0000","last_peered":"2023-10-16T23:28:48.589147+0000","last_clean":"2023-10-16T23:28:48.589147+0000","last_became_active":"2023-10-16T23:27:40.745143+0000","last_became_peered":"2023-10-16T23:27:40.745143+0000","last_unstale":"2023-10-16T23:28:48.589147+0000","last_undegraded":"2023-10-16T23:28:48.589147+0000","last_fullsized":"2023-10-16T23:28:48.589147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:48.589096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:48.589096+0000","last_clean_scrub_stamp":"2023-10-16T23:28:48.589096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:39:33.669789+0000","scrub_duration":0.00331059,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"26'19","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:57.522277+0000","last_change":"2023-10-16T23:28:57.522537+0000","last_active":"2023-10-16T23:28:57.522277+0000","last_peered":"2023-10-16T23:28:57.522277+0000","last_clean":"2023-10-16T23:28:57.522277+0000","last_became_active":"2023-10-16T23:27:40.351687+0000","last_became_peered":"2023-10-16T23:27:40.351687+0000","last_unstale":"2023-10-16T23:28:57.522277+0000","last_undegraded":"2023-10-16T23:28:57.522277+0000","last_fullsized":"2023-10-16T23:28:57.522277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'19","last_scrub_stamp":"2023-10-16T23:28:57.522221+0000","last_deep_scrub":"26'19","last_deep_scrub_stamp":"2023-10-16T23:28:57.522221+0000","last_clean_scrub_stamp":"2023-10-16T23:28:57.522221+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:12:23.848118+0000","scrub_duration":0.014520379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4472,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:08.898043+0000","last_change":"2023-10-16T23:29:08.898342+0000","last_active":"2023-10-16T23:29:08.898043+0000","last_peered":"2023-10-16T23:29:08.898043+0000","last_clean":"2023-10-16T23:29:08.898043+0000","last_became_active":"2023-10-16T23:27:40.727288+0000","last_became_peered":"2023-10-16T23:27:40.727288+0000","last_unstale":"2023-10-16T23:29:08.898043+0000","last_undegraded":"2023-10-16T23:29:08.898043+0000","last_fullsized":"2023-10-16T23:29:08.898043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:08.897996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:08.897996+0000","last_clean_scrub_stamp":"2023-10-16T23:29:08.897996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:42:40.677946+0000","scrub_duration":0.0041386900000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"26'5","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:58.491424+0000","last_change":"2023-10-16T23:28:58.491742+0000","last_active":"2023-10-16T23:28:58.491424+0000","last_peered":"2023-10-16T23:28:58.491424+0000","last_clean":"2023-10-16T23:28:58.491424+0000","last_became_active":"2023-10-16T23:27:40.331517+0000","last_became_peered":"2023-10-16T23:27:40.331517+0000","last_unstale":"2023-10-16T23:28:58.491424+0000","last_undegraded":"2023-10-16T23:28:58.491424+0000","last_fullsized":"2023-10-16T23:28:58.491424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2023-10-16T23:28:58.491358+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2023-10-16T23:28:58.491358+0000","last_clean_scrub_stamp":"2023-10-16T23:28:58.491358+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:51:11.739497+0000","scrub_duration":0.010820824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:00.251873+0000","last_change":"2023-10-16T23:29:00.252151+0000","last_active":"2023-10-16T23:29:00.251873+0000","last_peered":"2023-10-16T23:29:00.251873+0000","last_clean":"2023-10-16T23:29:00.251873+0000","last_became_active":"2023-10-16T23:27:40.333012+0000","last_became_peered":"2023-10-16T23:27:40.333012+0000","last_unstale":"2023-10-16T23:29:00.251873+0000","last_undegraded":"2023-10-16T23:29:00.251873+0000","last_fullsized":"2023-10-16T23:29:00.251873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:00.251827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:00.251827+0000","last_clean_scrub_stamp":"2023-10-16T23:29:00.251827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:14.889398+0000","scrub_duration":0.0029792669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:15.178193+0000","last_change":"2023-10-16T23:29:15.178447+0000","last_active":"2023-10-16T23:29:15.178193+0000","last_peered":"2023-10-16T23:29:15.178193+0000","last_clean":"2023-10-16T23:29:15.178193+0000","last_became_active":"2023-10-16T23:27:40.760680+0000","last_became_peered":"2023-10-16T23:27:40.760680+0000","last_unstale":"2023-10-16T23:29:15.178193+0000","last_undegraded":"2023-10-16T23:29:15.178193+0000","last_fullsized":"2023-10-16T23:29:15.178193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:15.178139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:15.178139+0000","last_clean_scrub_stamp":"2023-10-16T23:29:15.178139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:10:40.347181+0000","scrub_duration":0.0036559560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:48.540009+0000","last_change":"2023-10-16T23:28:48.540264+0000","last_active":"2023-10-16T23:28:48.540009+0000","last_peered":"2023-10-16T23:28:48.540009+0000","last_clean":"2023-10-16T23:28:48.540009+0000","last_became_active":"2023-10-16T23:27:40.338706+0000","last_became_peered":"2023-10-16T23:27:40.338706+0000","last_unstale":"2023-10-16T23:28:48.540009+0000","last_undegraded":"2023-10-16T23:28:48.540009+0000","last_fullsized":"2023-10-16T23:28:48.540009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:48.539954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:48.539954+0000","last_clean_scrub_stamp":"2023-10-16T23:28:48.539954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:45.324079+0000","scrub_duration":0.0038093760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:18.207342+0000","last_change":"2023-10-16T23:29:18.207605+0000","last_active":"2023-10-16T23:29:18.207342+0000","last_peered":"2023-10-16T23:29:18.207342+0000","last_clean":"2023-10-16T23:29:18.207342+0000","last_became_active":"2023-10-16T23:27:40.712756+0000","last_became_peered":"2023-10-16T23:27:40.712756+0000","last_unstale":"2023-10-16T23:29:18.207342+0000","last_undegraded":"2023-10-16T23:29:18.207342+0000","last_fullsized":"2023-10-16T23:29:18.207342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:18.207292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:18.207292+0000","last_clean_scrub_stamp":"2023-10-16T23:29:18.207292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:36:37.438577+0000","scrub_duration":0.0033421290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:02.514985+0000","last_change":"2023-10-16T23:29:02.515267+0000","last_active":"2023-10-16T23:29:02.514985+0000","last_peered":"2023-10-16T23:29:02.514985+0000","last_clean":"2023-10-16T23:29:02.514985+0000","last_became_active":"2023-10-16T23:27:40.755714+0000","last_became_peered":"2023-10-16T23:27:40.755714+0000","last_unstale":"2023-10-16T23:29:02.514985+0000","last_undegraded":"2023-10-16T23:29:02.514985+0000","last_fullsized":"2023-10-16T23:29:02.514985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:02.514934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:02.514934+0000","last_clean_scrub_stamp":"2023-10-16T23:29:02.514934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:39:47.595627+0000","scrub_duration":0.003702679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:57.017486+0000","last_change":"2023-10-16T23:28:57.017752+0000","last_active":"2023-10-16T23:28:57.017486+0000","last_peered":"2023-10-16T23:28:57.017486+0000","last_clean":"2023-10-16T23:28:57.017486+0000","last_became_active":"2023-10-16T23:27:40.331428+0000","last_became_peered":"2023-10-16T23:27:40.331428+0000","last_unstale":"2023-10-16T23:28:57.017486+0000","last_undegraded":"2023-10-16T23:28:57.017486+0000","last_fullsized":"2023-10-16T23:28:57.017486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:57.017438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:57.017438+0000","last_clean_scrub_stamp":"2023-10-16T23:28:57.017438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:45.421142+0000","scrub_duration":0.0034634449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:13.350346+0000","last_change":"2023-10-16T23:29:13.350648+0000","last_active":"2023-10-16T23:29:13.350346+0000","last_peered":"2023-10-16T23:29:13.350346+0000","last_clean":"2023-10-16T23:29:13.350346+0000","last_became_active":"2023-10-16T23:27:40.760779+0000","last_became_peered":"2023-10-16T23:27:40.760779+0000","last_unstale":"2023-10-16T23:29:13.350346+0000","last_undegraded":"2023-10-16T23:29:13.350346+0000","last_fullsized":"2023-10-16T23:29:13.350346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:13.350294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:13.350294+0000","last_clean_scrub_stamp":"2023-10-16T23:29:13.350294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:04:56.833201+0000","scrub_duration":0.004336871,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:00.969242+0000","last_change":"2023-10-16T23:29:00.969511+0000","last_active":"2023-10-16T23:29:00.969242+0000","last_peered":"2023-10-16T23:29:00.969242+0000","last_clean":"2023-10-16T23:29:00.969242+0000","last_became_active":"2023-10-16T23:27:40.317622+0000","last_became_peered":"2023-10-16T23:27:40.317622+0000","last_unstale":"2023-10-16T23:29:00.969242+0000","last_undegraded":"2023-10-16T23:29:00.969242+0000","last_fullsized":"2023-10-16T23:29:00.969242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:00.969194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:00.969194+0000","last_clean_scrub_stamp":"2023-10-16T23:29:00.969194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:49.372898+0000","scrub_duration":0.0033320379999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:14.223546+0000","last_change":"2023-10-16T23:29:14.223876+0000","last_active":"2023-10-16T23:29:14.223546+0000","last_peered":"2023-10-16T23:29:14.223546+0000","last_clean":"2023-10-16T23:29:14.223546+0000","last_became_active":"2023-10-16T23:27:40.705956+0000","last_became_peered":"2023-10-16T23:27:40.705956+0000","last_unstale":"2023-10-16T23:29:14.223546+0000","last_undegraded":"2023-10-16T23:29:14.223546+0000","last_fullsized":"2023-10-16T23:29:14.223546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:14.223496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:14.223496+0000","last_clean_scrub_stamp":"2023-10-16T23:29:14.223496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:04:57.706402+0000","scrub_duration":0.0037136740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:02.432748+0000","last_change":"2023-10-16T23:29:02.433013+0000","last_active":"2023-10-16T23:29:02.432748+0000","last_peered":"2023-10-16T23:29:02.432748+0000","last_clean":"2023-10-16T23:29:02.432748+0000","last_became_active":"2023-10-16T23:27:40.344158+0000","last_became_peered":"2023-10-16T23:27:40.344158+0000","last_unstale":"2023-10-16T23:29:02.432748+0000","last_undegraded":"2023-10-16T23:29:02.432748+0000","last_fullsized":"2023-10-16T23:29:02.432748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-10-16T23:29:02.432697+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-10-16T23:29:02.432697+0000","last_clean_scrub_stamp":"2023-10-16T23:29:02.432697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:42:34.212647+0000","scrub_duration":0.0038963000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:50.412806+0000","last_change":"2023-10-16T23:28:50.413057+0000","last_active":"2023-10-16T23:28:50.412806+0000","last_peered":"2023-10-16T23:28:50.412806+0000","last_clean":"2023-10-16T23:28:50.412806+0000","last_became_active":"2023-10-16T23:27:40.712632+0000","last_became_peered":"2023-10-16T23:27:40.712632+0000","last_unstale":"2023-10-16T23:28:50.412806+0000","last_undegraded":"2023-10-16T23:28:50.412806+0000","last_fullsized":"2023-10-16T23:28:50.412806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:50.412753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:50.412753+0000","last_clean_scrub_stamp":"2023-10-16T23:28:50.412753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:13.627037+0000","scrub_duration":0.003558257,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:40.596739+0000","last_change":"2023-10-16T23:28:40.596984+0000","last_active":"2023-10-16T23:28:40.596739+0000","last_peered":"2023-10-16T23:28:40.596739+0000","last_clean":"2023-10-16T23:28:40.596739+0000","last_became_active":"2023-10-16T23:27:40.356809+0000","last_became_peered":"2023-10-16T23:27:40.356809+0000","last_unstale":"2023-10-16T23:28:40.596739+0000","last_undegraded":"2023-10-16T23:28:40.596739+0000","last_fullsized":"2023-10-16T23:28:40.596739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-10-16T23:28:40.596681+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-10-16T23:28:40.596681+0000","last_clean_scrub_stamp":"2023-10-16T23:28:40.596681+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:45:06.830528+0000","scrub_duration":0.0040939920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.435247+0000","last_change":"2023-10-16T23:27:40.726018+0000","last_active":"2023-10-16T23:28:23.435247+0000","last_peered":"2023-10-16T23:28:23.435247+0000","last_clean":"2023-10-16T23:28:23.435247+0000","last_became_active":"2023-10-16T23:27:40.724910+0000","last_became_peered":"2023-10-16T23:27:40.724910+0000","last_unstale":"2023-10-16T23:28:23.435247+0000","last_undegraded":"2023-10-16T23:28:23.435247+0000","last_fullsized":"2023-10-16T23:28:23.435247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:01.278714+0000","last_change":"2023-10-16T23:29:01.278983+0000","last_active":"2023-10-16T23:29:01.278714+0000","last_peered":"2023-10-16T23:29:01.278714+0000","last_clean":"2023-10-16T23:29:01.278714+0000","last_became_active":"2023-10-16T23:27:40.344531+0000","last_became_peered":"2023-10-16T23:27:40.344531+0000","last_unstale":"2023-10-16T23:29:01.278714+0000","last_undegraded":"2023-10-16T23:29:01.278714+0000","last_fullsized":"2023-10-16T23:29:01.278714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2023-10-16T23:29:01.278657+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2023-10-16T23:29:01.278657+0000","last_clean_scrub_stamp":"2023-10-16T23:29:01.278657+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:51:38.750967+0000","scrub_duration":0.0085448030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:17.659966+0000","last_change":"2023-10-16T23:29:17.660277+0000","last_active":"2023-10-16T23:29:17.659966+0000","last_peered":"2023-10-16T23:29:17.659966+0000","last_clean":"2023-10-16T23:29:17.659966+0000","last_became_active":"2023-10-16T23:27:40.719758+0000","last_became_peered":"2023-10-16T23:27:40.719758+0000","last_unstale":"2023-10-16T23:29:17.659966+0000","last_undegraded":"2023-10-16T23:29:17.659966+0000","last_fullsized":"2023-10-16T23:29:17.659966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:17.659916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:17.659916+0000","last_clean_scrub_stamp":"2023-10-16T23:29:17.659916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:11:05.041471+0000","scrub_duration":0.0041757160000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:06.198247+0000","last_change":"2023-10-16T23:29:06.198508+0000","last_active":"2023-10-16T23:29:06.198247+0000","last_peered":"2023-10-16T23:29:06.198247+0000","last_clean":"2023-10-16T23:29:06.198247+0000","last_became_active":"2023-10-16T23:27:40.344589+0000","last_became_peered":"2023-10-16T23:27:40.344589+0000","last_unstale":"2023-10-16T23:29:06.198247+0000","last_undegraded":"2023-10-16T23:29:06.198247+0000","last_fullsized":"2023-10-16T23:29:06.198247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2023-10-16T23:29:06.198193+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2023-10-16T23:29:06.198193+0000","last_clean_scrub_stamp":"2023-10-16T23:29:06.198193+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:42:37.978143+0000","scrub_duration":0.0065836169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:12.277801+0000","last_change":"2023-10-16T23:29:12.278045+0000","last_active":"2023-10-16T23:29:12.277801+0000","last_peered":"2023-10-16T23:29:12.277801+0000","last_clean":"2023-10-16T23:29:12.277801+0000","last_became_active":"2023-10-16T23:27:40.705936+0000","last_became_peered":"2023-10-16T23:27:40.705936+0000","last_unstale":"2023-10-16T23:29:12.277801+0000","last_undegraded":"2023-10-16T23:29:12.277801+0000","last_fullsized":"2023-10-16T23:29:12.277801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:12.277747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:12.277747+0000","last_clean_scrub_stamp":"2023-10-16T23:29:12.277747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:51:50.411382+0000","scrub_duration":0.0031714410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:00.139419+0000","last_change":"2023-10-16T23:29:00.139719+0000","last_active":"2023-10-16T23:29:00.139419+0000","last_peered":"2023-10-16T23:29:00.139419+0000","last_clean":"2023-10-16T23:29:00.139419+0000","last_became_active":"2023-10-16T23:27:40.323352+0000","last_became_peered":"2023-10-16T23:27:40.323352+0000","last_unstale":"2023-10-16T23:29:00.139419+0000","last_undegraded":"2023-10-16T23:29:00.139419+0000","last_fullsized":"2023-10-16T23:29:00.139419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-10-16T23:29:00.139362+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-10-16T23:29:00.139362+0000","last_clean_scrub_stamp":"2023-10-16T23:29:00.139362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:12:26.465259+0000","scrub_duration":0.0029808759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:09.490698+0000","last_change":"2023-10-16T23:29:09.490994+0000","last_active":"2023-10-16T23:29:09.490698+0000","last_peered":"2023-10-16T23:29:09.490698+0000","last_clean":"2023-10-16T23:29:09.490698+0000","last_became_active":"2023-10-16T23:27:40.748525+0000","last_became_peered":"2023-10-16T23:27:40.748525+0000","last_unstale":"2023-10-16T23:29:09.490698+0000","last_undegraded":"2023-10-16T23:29:09.490698+0000","last_fullsized":"2023-10-16T23:29:09.490698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:09.490647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:09.490647+0000","last_clean_scrub_stamp":"2023-10-16T23:29:09.490647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:29.180267+0000","scrub_duration":0.0033377290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"26'6","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:56.488704+0000","last_change":"2023-10-16T23:28:56.489024+0000","last_active":"2023-10-16T23:28:56.488704+0000","last_peered":"2023-10-16T23:28:56.488704+0000","last_clean":"2023-10-16T23:28:56.488704+0000","last_became_active":"2023-10-16T23:27:40.338565+0000","last_became_peered":"2023-10-16T23:27:40.338565+0000","last_unstale":"2023-10-16T23:28:56.488704+0000","last_undegraded":"2023-10-16T23:28:56.488704+0000","last_fullsized":"2023-10-16T23:28:56.488704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2023-10-16T23:28:56.488647+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2023-10-16T23:28:56.488647+0000","last_clean_scrub_stamp":"2023-10-16T23:28:56.488647+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:44.892351+0000","scrub_duration":0.008659211,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5270,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":10540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71,"ondisk_log_size":71,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":103608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.83799999999999997}]},{"osd":1,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.90800000000000003}]},{"osd":2,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.97799999999999998}]},{"osd":3,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":1.073}]},{"osd":4,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.032}]},{"osd":5,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.2650000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.999}]},{"osd":7,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.1829999999999998,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.878}]}]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":278528,"data_stored":104260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.0680000000000001}]},{"osd":1,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.1789999999999998,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.66700000000000004}]},{"osd":2,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.002}]},{"osd":3,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":2.3690000000000002,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.5129999999999999,"5min":2.5129999999999999,"15min":2.5129999999999999},"last":0.85499999999999998}]},{"osd":4,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":3.0640000000000001,"5min":3.0640000000000001,"15min":3.0640000000000001},"last":1.05},{"interface":"front","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":3.1669999999999998,"5min":3.1669999999999998,"15min":3.1669999999999998},"last":1.1180000000000001}]},{"osd":6,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.6640000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":2.9119999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.81899999999999995}]},{"osd":7,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":2.9870000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.345,"5min":1.345,"15min":1.345},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.8610000000000002,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":1.0229999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509467,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":108136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.67900000000000005}]},{"osd":1,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.72699999999999998}]},{"osd":2,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.752},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.86599999999999999}]},{"osd":3,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.171}]},{"osd":5,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":1.206}]},{"osd":6,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":1.048},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":1.133}]},{"osd":7,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.276},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.2350000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":103698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.84699999999999998}]},{"osd":1,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.0600000000000001}]},{"osd":2,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.749},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.94899999999999995}]},{"osd":4,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.98599999999999999}]},{"osd":5,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.044},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.1519999999999999}]},{"osd":6,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.206},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.085}]},{"osd":7,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":1.242},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":1.286}]}]},{"osd":1,"up_from":15,"seq":64424509465,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":103608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.97299999999999998}]},{"osd":2,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.70099999999999996}]},{"osd":3,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.80400000000000005}]},{"osd":4,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":1.2270000000000001},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.069}]},{"osd":5,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.431,"5min":2.431,"15min":2.431},"last":1.181},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.0469999999999999}]},{"osd":6,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.1619999999999999},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.3129999999999999}]},{"osd":7,"last update":"Mon Oct 16 23:28:28 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.109},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":1.2849999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509467,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":868352,"data_stored":694558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.56200000000000006}]},{"osd":2,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.82099999999999995}]},{"osd":3,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.635,"5min":1.635,"15min":1.635},"last":0.90000000000000002}]},{"osd":4,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.93999999999999995}]},{"osd":5,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.0640000000000001}]},{"osd":6,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.212},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.1060000000000001}]},{"osd":7,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.119}]}]},{"osd":7,"up_from":14,"seq":60129542170,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":698664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.76600000000000001}]},{"osd":1,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.87}]},{"osd":2,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.96199999999999997}]},{"osd":3,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.165},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.90300000000000002}]},{"osd":4,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.0840000000000001}]},{"osd":5,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.82099999999999995}]},{"osd":6,"last update":"Mon Oct 16 23:28:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.004},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.742,"5min":2.742,"15min":2.742},"last":1.133}]}]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":270336,"data_stored":103608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.63700000000000001}]},{"osd":1,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.69299999999999995}]},{"osd":3,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":1.016},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.93999999999999995}]},{"osd":4,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.97699999999999998}]},{"osd":5,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.135},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.0580000000000001}]},{"osd":6,"last update":"Mon Oct 16 23:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.21}]},{"osd":7,"last update":"Mon Oct 16 23:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.254}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T23:29:20.785 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:20.785 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:20.786 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:20.786 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:20.787 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:20.787 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:20.787 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:20.788 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:20.788 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:20.789 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:20.789 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:20.790 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:20.790 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:20.791 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:20.791 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-16T23:27:35.237327+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=35, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:20.792 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:20.793 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:20.793 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-16T23:29:40.264 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:29:40.272 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:29:40.274 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:29:40.277 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:29:40.280 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:29:40.794 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T23:29:40.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feacc0b2640 1 Processor -- start 2023-10-16T23:29:40.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feacc0b2640 1 -- start start 2023-10-16T23:29:40.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feacc0b2640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feac414cc30 0x7feac40ba650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:29:40.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feacc0b2640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feac40b40c0 con 0x7feac40b8630 2023-10-16T23:29:40.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feacc0b2640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feac40b7ce0 con 0x7feac40c1130 2023-10-16T23:29:40.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feacc0b2640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feac40b3ca0 con 0x7feac414cc30 2023-10-16T23:29:40.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feac964d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7feac40b8630 0x7feac40b9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60498/0 (socket says 172.21.15.12:60498) 2023-10-16T23:29:40.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feac964d640 1 -- 172.21.15.12:0/2739315734 learned_addr learned my addr 172.21.15.12:0/2739315734 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:29:40.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feaca64f640 1 --2- 172.21.15.12:0/2739315734 >> v2:172.21.15.31:3300/0 conn(0x7feac414cc30 0x7feac40ba650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:29:40.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feac8e4c640 1 -- 172.21.15.12:0/2739315734 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 808796682 0 0) 0x7feac40b40c0 con 0x7feac40b8630 2023-10-16T23:29:40.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feac8e4c640 1 -- 172.21.15.12:0/2739315734 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaac003530 con 0x7feac40b8630 2023-10-16T23:29:40.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feac8e4c640 1 -- 172.21.15.12:0/2739315734 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3886255328 0 0) 0x7feaac003530 con 0x7feac40b8630 2023-10-16T23:29:40.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feac8e4c640 1 -- 172.21.15.12:0/2739315734 >> v2:172.21.15.31:3300/0 conn(0x7feac414cc30 msgr2=0x7feac40ba650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:29:40.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feac8e4c640 1 --2- 172.21.15.12:0/2739315734 >> v2:172.21.15.31:3300/0 conn(0x7feac414cc30 0x7feac40ba650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:40.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feac8e4c640 1 -- 172.21.15.12:0/2739315734 >> v1:172.21.15.31:6789/0 conn(0x7feac40c1130 legacy=0x7feac414c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:29:40.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feac8e4c640 1 -- 172.21.15.12:0/2739315734 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac40bab90 con 0x7feac40b8630 2023-10-16T23:29:40.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feac8e4c640 1 -- 172.21.15.12:0/2739315734 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7feab8001a00 con 0x7feac40b8630 2023-10-16T23:29:40.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feac8e4c640 1 -- 172.21.15.12:0/2739315734 >> v1:172.21.15.12:6789/0 conn(0x7feac40b8630 legacy=0x7feac40b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:29:40.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feac8e4c640 1 --2- 172.21.15.12:0/2739315734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaac003980 0x7feaac003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:29:40.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feac8e4c640 1 --2- 172.21.15.12:0/2739315734 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feaac0047d0 0x7feaac004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:29:40.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feac8e4c640 1 --2- 172.21.15.12:0/2739315734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaac0052b0 0x7feaac00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:29:40.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feac8e4c640 1 -- 172.21.15.12:0/2739315734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac40b3ca0 con 0x7feaac0052b0 2023-10-16T23:29:40.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feac8e4c640 1 -- 172.21.15.12:0/2739315734 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac00c180 con 0x7feaac003980 2023-10-16T23:29:40.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feac8e4c640 1 -- 172.21.15.12:0/2739315734 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaac00c340 con 0x7feaac0047d0 2023-10-16T23:29:40.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feaca64f640 1 --2- 172.21.15.12:0/2739315734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaac0052b0 0x7feaac00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:29:40.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feac9e4e640 1 --2- 172.21.15.12:0/2739315734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaac003980 0x7feaac003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:29:40.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feac964d640 1 --2- 172.21.15.12:0/2739315734 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feaac0047d0 0x7feaac004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:29:40.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feaca64f640 1 -- 172.21.15.12:0/2739315734 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feaac0047d0 msgr2=0x7feaac004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:29:40.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feaca64f640 1 --2- 172.21.15.12:0/2739315734 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feaac0047d0 0x7feaac004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:40.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feaca64f640 1 -- 172.21.15.12:0/2739315734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaac003980 msgr2=0x7feaac003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:29:40.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feaca64f640 1 --2- 172.21.15.12:0/2739315734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaac003980 0x7feaac003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:40.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.923+0000 7feaca64f640 1 -- 172.21.15.12:0/2739315734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac003530 con 0x7feaac0052b0 2023-10-16T23:29:40.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.927+0000 7feaca64f640 1 -- 172.21.15.12:0/2739315734 reap_dead start 2023-10-16T23:29:40.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.927+0000 7feaca64f640 1 --2- 172.21.15.12:0/2739315734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaac0052b0 0x7feaac00b990 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7feabc009ab0 tx=0x7feabc01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb14cb753822bd8e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:29:40.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.927+0000 7feac8e4c640 1 -- 172.21.15.12:0/2739315734 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc004020 con 0x7feaac0052b0 2023-10-16T23:29:40.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.927+0000 7feac8e4c640 1 -- 172.21.15.12:0/2739315734 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feabc004180 con 0x7feaac0052b0 2023-10-16T23:29:40.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.927+0000 7feac8e4c640 1 -- 172.21.15.12:0/2739315734 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc0a5660 con 0x7feaac0052b0 2023-10-16T23:29:40.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.927+0000 7feacc0b2640 1 -- 172.21.15.12:0/2739315734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaac0052b0 msgr2=0x7feaac00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:29:40.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.927+0000 7feacc0b2640 1 --2- 172.21.15.12:0/2739315734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaac0052b0 0x7feaac00b990 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7feabc009ab0 tx=0x7feabc01ca70 comp rx=0 tx=0).stop 2023-10-16T23:29:40.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.927+0000 7feacc0b2640 1 -- 172.21.15.12:0/2739315734 shutdown_connections 2023-10-16T23:29:40.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.927+0000 7feacc0b2640 1 --2- 172.21.15.12:0/2739315734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaac0052b0 0x7feaac00b990 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:40.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.927+0000 7feacc0b2640 1 -- 172.21.15.12:0/2739315734 >> 172.21.15.12:0/2739315734 conn(0x7feac406ba20 msgr2=0x7feac40c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:29:40.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.927+0000 7feacc0b2640 1 -- 172.21.15.12:0/2739315734 shutdown_connections 2023-10-16T23:29:40.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.927+0000 7feacc0b2640 1 -- 172.21.15.12:0/2739315734 wait complete. 2023-10-16T23:29:40.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.927+0000 7feacc0b2640 1 Processor -- start 2023-10-16T23:29:40.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.927+0000 7feacc0b2640 1 -- start start 2023-10-16T23:29:40.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feacc0b2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaac0052b0 0x7feac41eac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:29:40.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feacc0b2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feac414b360 0x7feac4148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:29:40.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feacc0b2640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feac41492b0 0x7feac41e6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:29:40.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feacc0b2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac41eb1b0 con 0x7feac414b360 2023-10-16T23:29:40.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feacc0b2640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac4141570 con 0x7feaac0052b0 2023-10-16T23:29:40.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feacc0b2640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac406fde0 con 0x7feac41492b0 2023-10-16T23:29:40.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feac964d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feac414b360 0x7feac4148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:29:40.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feac964d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feac414b360 0x7feac4148d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50074/0 (socket says 172.21.15.12:50074) 2023-10-16T23:29:40.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feac964d640 1 -- 172.21.15.12:0/964035701 learned_addr learned my addr 172.21.15.12:0/964035701 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:29:40.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feac9e4e640 1 --2- 172.21.15.12:0/964035701 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaac0052b0 0x7feac41eac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:29:40.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feaca64f640 1 --2- 172.21.15.12:0/964035701 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feac41492b0 0x7feac41e6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:29:40.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feac964d640 1 -- 172.21.15.12:0/964035701 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feac41492b0 msgr2=0x7feac41e6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:29:40.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feac964d640 1 --2- 172.21.15.12:0/964035701 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feac41492b0 0x7feac41e6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:40.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feac964d640 1 -- 172.21.15.12:0/964035701 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaac0052b0 msgr2=0x7feac41eac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:29:40.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feac964d640 1 --2- 172.21.15.12:0/964035701 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaac0052b0 0x7feac41eac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:40.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feac964d640 1 -- 172.21.15.12:0/964035701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac40700c0 con 0x7feac414b360 2023-10-16T23:29:40.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feac964d640 1 --2- 172.21.15.12:0/964035701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feac414b360 0x7feac4148d70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7feab8001590 tx=0x7feab800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:29:40.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feac27fc640 1 -- 172.21.15.12:0/964035701 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab800ee20 con 0x7feac414b360 2023-10-16T23:29:40.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feac27fc640 1 -- 172.21.15.12:0/964035701 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab8013420 con 0x7feac414b360 2023-10-16T23:29:40.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feacc0b2640 1 -- 172.21.15.12:0/964035701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac40703a0 con 0x7feac414b360 2023-10-16T23:29:40.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feac27fc640 1 -- 172.21.15.12:0/964035701 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab80137d0 con 0x7feac414b360 2023-10-16T23:29:40.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feacc0b2640 1 -- 172.21.15.12:0/964035701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac413a730 con 0x7feac414b360 2023-10-16T23:29:40.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feacc0b2640 1 -- 172.21.15.12:0/964035701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feac40b7870 con 0x7feac414b360 2023-10-16T23:29:40.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feac27fc640 1 -- 172.21.15.12:0/964035701 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7feab8013930 con 0x7feac414b360 2023-10-16T23:29:40.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feac27fc640 1 --2- 172.21.15.12:0/964035701 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7feab0065e60 0x7feab0068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:29:40.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feac27fc640 1 -- 172.21.15.12:0/964035701 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7feab8083ef0 con 0x7feac414b360 2023-10-16T23:29:40.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.931+0000 7feac9e4e640 1 --2- 172.21.15.12:0/964035701 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7feab0065e60 0x7feab0068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:29:40.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.935+0000 7feac9e4e640 1 --2- 172.21.15.12:0/964035701 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7feab0065e60 0x7feab0068320 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7feab4005490 tx=0x7feab4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:29:40.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:40.935+0000 7feac27fc640 1 -- 172.21.15.12:0/964035701 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7feac40b7870 con 0x7feac414b360 2023-10-16T23:29:41.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:41.091+0000 7feacc0b2640 1 -- 172.21.15.12:0/964035701 --> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feac40b7870 con 0x7feab0065e60 2023-10-16T23:29:41.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:41.119+0000 7feac27fc640 1 -- 172.21.15.12:0/964035701 <== mgr.4108 v2:172.21.15.31:6832/37949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311511 (secure 0 0 0) 0x7feac40b7870 con 0x7feab0065e60 2023-10-16T23:29:41.123 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:29:41.125 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-16T23:29:41.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:41.119+0000 7feacc0b2640 1 -- 172.21.15.12:0/964035701 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7feab0065e60 msgr2=0x7feab0068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:29:41.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:41.119+0000 7feacc0b2640 1 --2- 172.21.15.12:0/964035701 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7feab0065e60 0x7feab0068320 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7feab4005490 tx=0x7feab4009040 comp rx=0 tx=0).stop 2023-10-16T23:29:41.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:41.119+0000 7feacc0b2640 1 -- 172.21.15.12:0/964035701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feac414b360 msgr2=0x7feac4148d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:29:41.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:41.119+0000 7feacc0b2640 1 --2- 172.21.15.12:0/964035701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feac414b360 0x7feac4148d70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7feab8001590 tx=0x7feab800e530 comp rx=0 tx=0).stop 2023-10-16T23:29:41.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:41.119+0000 7feacc0b2640 1 -- 172.21.15.12:0/964035701 shutdown_connections 2023-10-16T23:29:41.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:41.119+0000 7feacc0b2640 1 --2- 172.21.15.12:0/964035701 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7feab0065e60 0x7feab0068320 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:41.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:41.119+0000 7feacc0b2640 1 --2- 172.21.15.12:0/964035701 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feac41492b0 0x7feac41e6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:41.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:41.119+0000 7feacc0b2640 1 --2- 172.21.15.12:0/964035701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feac414b360 0x7feac4148d70 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:41.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:41.119+0000 7feacc0b2640 1 --2- 172.21.15.12:0/964035701 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaac0052b0 0x7feac41eac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:29:41.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:41.119+0000 7feacc0b2640 1 -- 172.21.15.12:0/964035701 >> 172.21.15.12:0/964035701 conn(0x7feac406ba20 msgr2=0x7feac40bca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:29:41.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:41.119+0000 7feacc0b2640 1 -- 172.21.15.12:0/964035701 shutdown_connections 2023-10-16T23:29:41.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:29:41.119+0000 7feacc0b2640 1 -- 172.21.15.12:0/964035701 wait complete. 2023-10-16T23:29:41.142 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2023-10-16T23:29:39.329175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595638,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":217,"num_write_kb":2441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190,"ondisk_log_size":190,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223048,"kb_used_data":3336,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751672,"statfs":{"total":773094113280,"available":772865712128,"internally_reserved":0,"allocated":3416064,"data_stored":2020140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004557"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:46.347825+0000","last_change":"2023-10-16T23:28:46.348111+0000","last_active":"2023-10-16T23:28:46.347825+0000","last_peered":"2023-10-16T23:28:46.347825+0000","last_clean":"2023-10-16T23:28:46.347825+0000","last_became_active":"2023-10-16T23:27:40.706320+0000","last_became_peered":"2023-10-16T23:27:40.706320+0000","last_unstale":"2023-10-16T23:28:46.347825+0000","last_undegraded":"2023-10-16T23:28:46.347825+0000","last_fullsized":"2023-10-16T23:28:46.347825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:46.347775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:46.347775+0000","last_clean_scrub_stamp":"2023-10-16T23:28:46.347775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:47.920970+0000","scrub_duration":0.0035569769999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:19.350223+0000","last_change":"2023-10-16T23:29:19.350538+0000","last_active":"2023-10-16T23:29:19.350223+0000","last_peered":"2023-10-16T23:29:19.350223+0000","last_clean":"2023-10-16T23:29:19.350223+0000","last_became_active":"2023-10-16T23:27:40.754736+0000","last_became_peered":"2023-10-16T23:27:40.754736+0000","last_unstale":"2023-10-16T23:29:19.350223+0000","last_undegraded":"2023-10-16T23:29:19.350223+0000","last_fullsized":"2023-10-16T23:29:19.350223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:19.350174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:19.350174+0000","last_clean_scrub_stamp":"2023-10-16T23:29:19.350174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:23:06.801488+0000","scrub_duration":0.0041567469999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:34.645486+0000","last_change":"2023-10-16T23:29:34.645738+0000","last_active":"2023-10-16T23:29:34.645486+0000","last_peered":"2023-10-16T23:29:34.645486+0000","last_clean":"2023-10-16T23:29:34.645486+0000","last_became_active":"2023-10-16T23:27:40.725731+0000","last_became_peered":"2023-10-16T23:27:40.725731+0000","last_unstale":"2023-10-16T23:29:34.645486+0000","last_undegraded":"2023-10-16T23:29:34.645486+0000","last_fullsized":"2023-10-16T23:29:34.645486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:34.645439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:34.645439+0000","last_clean_scrub_stamp":"2023-10-16T23:29:34.645439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:29:20.119576+0000","scrub_duration":0.0039052679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:50.441103+0000","last_change":"2023-10-16T23:28:50.441396+0000","last_active":"2023-10-16T23:28:50.441103+0000","last_peered":"2023-10-16T23:28:50.441103+0000","last_clean":"2023-10-16T23:28:50.441103+0000","last_became_active":"2023-10-16T23:27:40.714592+0000","last_became_peered":"2023-10-16T23:27:40.714592+0000","last_unstale":"2023-10-16T23:28:50.441103+0000","last_undegraded":"2023-10-16T23:28:50.441103+0000","last_fullsized":"2023-10-16T23:28:50.441103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:50.441050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:50.441050+0000","last_clean_scrub_stamp":"2023-10-16T23:28:50.441050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:12:05.680691+0000","scrub_duration":0.0035120030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:07.338753+0000","last_change":"2023-10-16T23:29:07.339049+0000","last_active":"2023-10-16T23:29:07.338753+0000","last_peered":"2023-10-16T23:29:07.338753+0000","last_clean":"2023-10-16T23:29:07.338753+0000","last_became_active":"2023-10-16T23:27:40.722399+0000","last_became_peered":"2023-10-16T23:27:40.722399+0000","last_unstale":"2023-10-16T23:29:07.338753+0000","last_undegraded":"2023-10-16T23:29:07.338753+0000","last_fullsized":"2023-10-16T23:29:07.338753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:07.338705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:07.338705+0000","last_clean_scrub_stamp":"2023-10-16T23:29:07.338705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:17:27.277608+0000","scrub_duration":0.0036007499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:26.546739+0000","last_change":"2023-10-16T23:29:26.547009+0000","last_active":"2023-10-16T23:29:26.546739+0000","last_peered":"2023-10-16T23:29:26.546739+0000","last_clean":"2023-10-16T23:29:26.546739+0000","last_became_active":"2023-10-16T23:27:40.715294+0000","last_became_peered":"2023-10-16T23:27:40.715294+0000","last_unstale":"2023-10-16T23:29:26.546739+0000","last_undegraded":"2023-10-16T23:29:26.546739+0000","last_fullsized":"2023-10-16T23:29:26.546739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:26.546688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:26.546688+0000","last_clean_scrub_stamp":"2023-10-16T23:29:26.546688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:33:05.904856+0000","scrub_duration":0.0040575799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:02.516317+0000","last_change":"2023-10-16T23:29:02.516594+0000","last_active":"2023-10-16T23:29:02.516317+0000","last_peered":"2023-10-16T23:29:02.516317+0000","last_clean":"2023-10-16T23:29:02.516317+0000","last_became_active":"2023-10-16T23:27:40.760726+0000","last_became_peered":"2023-10-16T23:27:40.760726+0000","last_unstale":"2023-10-16T23:29:02.516317+0000","last_undegraded":"2023-10-16T23:29:02.516317+0000","last_fullsized":"2023-10-16T23:29:02.516317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:02.516265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:02.516265+0000","last_clean_scrub_stamp":"2023-10-16T23:29:02.516265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:12:10.501158+0000","scrub_duration":0.0041045810000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:20.399769+0000","last_change":"2023-10-16T23:29:20.400065+0000","last_active":"2023-10-16T23:29:20.399769+0000","last_peered":"2023-10-16T23:29:20.399769+0000","last_clean":"2023-10-16T23:29:20.399769+0000","last_became_active":"2023-10-16T23:27:40.755276+0000","last_became_peered":"2023-10-16T23:27:40.755276+0000","last_unstale":"2023-10-16T23:29:20.399769+0000","last_undegraded":"2023-10-16T23:29:20.399769+0000","last_fullsized":"2023-10-16T23:29:20.399769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:20.399716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:20.399716+0000","last_clean_scrub_stamp":"2023-10-16T23:29:20.399716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:36:39.631000+0000","scrub_duration":0.0034242270000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:20.436488+0000","last_change":"2023-10-16T23:29:20.436754+0000","last_active":"2023-10-16T23:29:20.436488+0000","last_peered":"2023-10-16T23:29:20.436488+0000","last_clean":"2023-10-16T23:29:20.436488+0000","last_became_active":"2023-10-16T23:27:40.723701+0000","last_became_peered":"2023-10-16T23:27:40.723701+0000","last_unstale":"2023-10-16T23:29:20.436488+0000","last_undegraded":"2023-10-16T23:29:20.436488+0000","last_fullsized":"2023-10-16T23:29:20.436488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:20.436433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:20.436433+0000","last_clean_scrub_stamp":"2023-10-16T23:29:20.436433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:11:07.817988+0000","scrub_duration":0.003479822,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:15.251336+0000","last_change":"2023-10-16T23:29:15.251708+0000","last_active":"2023-10-16T23:29:15.251336+0000","last_peered":"2023-10-16T23:29:15.251336+0000","last_clean":"2023-10-16T23:29:15.251336+0000","last_became_active":"2023-10-16T23:27:40.755772+0000","last_became_peered":"2023-10-16T23:27:40.755772+0000","last_unstale":"2023-10-16T23:29:15.251336+0000","last_undegraded":"2023-10-16T23:29:15.251336+0000","last_fullsized":"2023-10-16T23:29:15.251336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:15.251230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:15.251230+0000","last_clean_scrub_stamp":"2023-10-16T23:29:15.251230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:49:40.141118+0000","scrub_duration":0.0040644399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:31.644998+0000","last_change":"2023-10-16T23:29:31.645269+0000","last_active":"2023-10-16T23:29:31.644998+0000","last_peered":"2023-10-16T23:29:31.644998+0000","last_clean":"2023-10-16T23:29:31.644998+0000","last_became_active":"2023-10-16T23:27:40.724031+0000","last_became_peered":"2023-10-16T23:27:40.724031+0000","last_unstale":"2023-10-16T23:29:31.644998+0000","last_undegraded":"2023-10-16T23:29:31.644998+0000","last_fullsized":"2023-10-16T23:29:31.644998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:31.644942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:31.644942+0000","last_clean_scrub_stamp":"2023-10-16T23:29:31.644942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:59.916620+0000","scrub_duration":0.0037764489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:51.454135+0000","last_change":"2023-10-16T23:28:51.454416+0000","last_active":"2023-10-16T23:28:51.454135+0000","last_peered":"2023-10-16T23:28:51.454135+0000","last_clean":"2023-10-16T23:28:51.454135+0000","last_became_active":"2023-10-16T23:27:40.724099+0000","last_became_peered":"2023-10-16T23:27:40.724099+0000","last_unstale":"2023-10-16T23:28:51.454135+0000","last_undegraded":"2023-10-16T23:28:51.454135+0000","last_fullsized":"2023-10-16T23:28:51.454135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:51.454084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:51.454084+0000","last_clean_scrub_stamp":"2023-10-16T23:28:51.454084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:30:36.813149+0000","scrub_duration":0.0036983559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:44.412252+0000","last_change":"2023-10-16T23:28:44.412516+0000","last_active":"2023-10-16T23:28:44.412252+0000","last_peered":"2023-10-16T23:28:44.412252+0000","last_clean":"2023-10-16T23:28:44.412252+0000","last_became_active":"2023-10-16T23:27:40.704162+0000","last_became_peered":"2023-10-16T23:27:40.704162+0000","last_unstale":"2023-10-16T23:28:44.412252+0000","last_undegraded":"2023-10-16T23:28:44.412252+0000","last_fullsized":"2023-10-16T23:28:44.412252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:44.412201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:44.412201+0000","last_clean_scrub_stamp":"2023-10-16T23:28:44.412201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:26:44.683009+0000","scrub_duration":0.003351209,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:08.134208+0000","last_change":"2023-10-16T23:29:08.134486+0000","last_active":"2023-10-16T23:29:08.134208+0000","last_peered":"2023-10-16T23:29:08.134208+0000","last_clean":"2023-10-16T23:29:08.134208+0000","last_became_active":"2023-10-16T23:27:40.738070+0000","last_became_peered":"2023-10-16T23:27:40.738070+0000","last_unstale":"2023-10-16T23:29:08.134208+0000","last_undegraded":"2023-10-16T23:29:08.134208+0000","last_fullsized":"2023-10-16T23:29:08.134208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:08.134158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:08.134158+0000","last_clean_scrub_stamp":"2023-10-16T23:29:08.134158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:17:28.073062+0000","scrub_duration":0.0039984119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:59.521341+0000","last_change":"2023-10-16T23:28:59.521588+0000","last_active":"2023-10-16T23:28:59.521341+0000","last_peered":"2023-10-16T23:28:59.521341+0000","last_clean":"2023-10-16T23:28:59.521341+0000","last_became_active":"2023-10-16T23:27:40.761570+0000","last_became_peered":"2023-10-16T23:27:40.761570+0000","last_unstale":"2023-10-16T23:28:59.521341+0000","last_undegraded":"2023-10-16T23:28:59.521341+0000","last_fullsized":"2023-10-16T23:28:59.521341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:59.521278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:59.521278+0000","last_clean_scrub_stamp":"2023-10-16T23:28:59.521278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:31:38.322028+0000","scrub_duration":0.0038043040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:16.633881+0000","last_change":"2023-10-16T23:29:16.634132+0000","last_active":"2023-10-16T23:29:16.633881+0000","last_peered":"2023-10-16T23:29:16.633881+0000","last_clean":"2023-10-16T23:29:16.633881+0000","last_became_active":"2023-10-16T23:27:40.718276+0000","last_became_peered":"2023-10-16T23:27:40.718276+0000","last_unstale":"2023-10-16T23:29:16.633881+0000","last_undegraded":"2023-10-16T23:29:16.633881+0000","last_fullsized":"2023-10-16T23:29:16.633881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:16.633830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:16.633830+0000","last_clean_scrub_stamp":"2023-10-16T23:29:16.633830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:36:35.865114+0000","scrub_duration":0.0038590740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:18.417002+0000","last_change":"2023-10-16T23:29:18.417263+0000","last_active":"2023-10-16T23:29:18.417002+0000","last_peered":"2023-10-16T23:29:18.417002+0000","last_clean":"2023-10-16T23:29:18.417002+0000","last_became_active":"2023-10-16T23:27:40.719402+0000","last_became_peered":"2023-10-16T23:27:40.719402+0000","last_unstale":"2023-10-16T23:29:18.417002+0000","last_undegraded":"2023-10-16T23:29:18.417002+0000","last_fullsized":"2023-10-16T23:29:18.417002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:18.416953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:18.416953+0000","last_clean_scrub_stamp":"2023-10-16T23:29:18.416953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:23:05.868268+0000","scrub_duration":0.0033107929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:30.626338+0000","last_change":"2023-10-16T23:29:30.626609+0000","last_active":"2023-10-16T23:29:30.626338+0000","last_peered":"2023-10-16T23:29:30.626338+0000","last_clean":"2023-10-16T23:29:30.626338+0000","last_became_active":"2023-10-16T23:27:40.732102+0000","last_became_peered":"2023-10-16T23:27:40.732102+0000","last_unstale":"2023-10-16T23:29:30.626338+0000","last_undegraded":"2023-10-16T23:29:30.626338+0000","last_fullsized":"2023-10-16T23:29:30.626338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:30.626282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:30.626282+0000","last_clean_scrub_stamp":"2023-10-16T23:29:30.626282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:04:32.094589+0000","scrub_duration":0.0039223979999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:41.375368+0000","last_change":"2023-10-16T23:28:41.375625+0000","last_active":"2023-10-16T23:28:41.375368+0000","last_peered":"2023-10-16T23:28:41.375368+0000","last_clean":"2023-10-16T23:28:41.375368+0000","last_became_active":"2023-10-16T23:27:40.728298+0000","last_became_peered":"2023-10-16T23:27:40.728298+0000","last_unstale":"2023-10-16T23:28:41.375368+0000","last_undegraded":"2023-10-16T23:28:41.375368+0000","last_fullsized":"2023-10-16T23:28:41.375368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:41.375313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:41.375313+0000","last_clean_scrub_stamp":"2023-10-16T23:28:41.375313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:03:17.124670+0000","scrub_duration":0.003739582,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.434637+0000","last_change":"2023-10-16T23:27:40.745270+0000","last_active":"2023-10-16T23:28:23.434637+0000","last_peered":"2023-10-16T23:28:23.434637+0000","last_clean":"2023-10-16T23:28:23.434637+0000","last_became_active":"2023-10-16T23:27:40.744483+0000","last_became_peered":"2023-10-16T23:27:40.744483+0000","last_unstale":"2023-10-16T23:28:23.434637+0000","last_undegraded":"2023-10-16T23:28:23.434637+0000","last_fullsized":"2023-10-16T23:28:23.434637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:00.514763+0000","last_change":"2023-10-16T23:29:00.514965+0000","last_active":"2023-10-16T23:29:00.514763+0000","last_peered":"2023-10-16T23:29:00.514763+0000","last_clean":"2023-10-16T23:29:00.514763+0000","last_became_active":"2023-10-16T23:27:40.760882+0000","last_became_peered":"2023-10-16T23:27:40.760882+0000","last_unstale":"2023-10-16T23:29:00.514763+0000","last_undegraded":"2023-10-16T23:29:00.514763+0000","last_fullsized":"2023-10-16T23:29:00.514763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:00.514740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:00.514740+0000","last_clean_scrub_stamp":"2023-10-16T23:29:00.514740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:05:49.777579+0000","scrub_duration":0.0031752130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:05.392879+0000","last_change":"2023-10-16T23:29:05.393170+0000","last_active":"2023-10-16T23:29:05.392879+0000","last_peered":"2023-10-16T23:29:05.392879+0000","last_clean":"2023-10-16T23:29:05.392879+0000","last_became_active":"2023-10-16T23:27:40.722302+0000","last_became_peered":"2023-10-16T23:27:40.722302+0000","last_unstale":"2023-10-16T23:29:05.392879+0000","last_undegraded":"2023-10-16T23:29:05.392879+0000","last_fullsized":"2023-10-16T23:29:05.392879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:05.392831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:05.392831+0000","last_clean_scrub_stamp":"2023-10-16T23:29:05.392831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:42:37.172781+0000","scrub_duration":0.0035357750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:21.300356+0000","last_change":"2023-10-16T23:29:21.300611+0000","last_active":"2023-10-16T23:29:21.300356+0000","last_peered":"2023-10-16T23:29:21.300356+0000","last_clean":"2023-10-16T23:29:21.300356+0000","last_became_active":"2023-10-16T23:27:40.716228+0000","last_became_peered":"2023-10-16T23:27:40.716228+0000","last_unstale":"2023-10-16T23:29:21.300356+0000","last_undegraded":"2023-10-16T23:29:21.300356+0000","last_fullsized":"2023-10-16T23:29:21.300356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:21.300307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:21.300307+0000","last_clean_scrub_stamp":"2023-10-16T23:29:21.300307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:59:28.620745+0000","scrub_duration":0.003465639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:01.511671+0000","last_change":"2023-10-16T23:29:01.511926+0000","last_active":"2023-10-16T23:29:01.511671+0000","last_peered":"2023-10-16T23:29:01.511671+0000","last_clean":"2023-10-16T23:29:01.511671+0000","last_became_active":"2023-10-16T23:27:40.760659+0000","last_became_peered":"2023-10-16T23:27:40.760659+0000","last_unstale":"2023-10-16T23:29:01.511671+0000","last_undegraded":"2023-10-16T23:29:01.511671+0000","last_fullsized":"2023-10-16T23:29:01.511671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:01.511616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:01.511616+0000","last_clean_scrub_stamp":"2023-10-16T23:29:01.511616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:35:13.988738+0000","scrub_duration":0.003766648,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:16.885661+0000","last_change":"2023-10-16T23:29:16.885945+0000","last_active":"2023-10-16T23:29:16.885661+0000","last_peered":"2023-10-16T23:29:16.885661+0000","last_clean":"2023-10-16T23:29:16.885661+0000","last_became_active":"2023-10-16T23:27:40.727334+0000","last_became_peered":"2023-10-16T23:27:40.727334+0000","last_unstale":"2023-10-16T23:29:16.885661+0000","last_undegraded":"2023-10-16T23:29:16.885661+0000","last_fullsized":"2023-10-16T23:29:16.885661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:16.885612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:16.885612+0000","last_clean_scrub_stamp":"2023-10-16T23:29:16.885612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:36.575232+0000","scrub_duration":0.0037868989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:14.898409+0000","last_change":"2023-10-16T23:29:14.898671+0000","last_active":"2023-10-16T23:29:14.898409+0000","last_peered":"2023-10-16T23:29:14.898409+0000","last_clean":"2023-10-16T23:29:14.898409+0000","last_became_active":"2023-10-16T23:27:40.704536+0000","last_became_peered":"2023-10-16T23:27:40.704536+0000","last_unstale":"2023-10-16T23:29:14.898409+0000","last_undegraded":"2023-10-16T23:29:14.898409+0000","last_fullsized":"2023-10-16T23:29:14.898409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:14.898353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:14.898353+0000","last_clean_scrub_stamp":"2023-10-16T23:29:14.898353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:04.628284+0000","scrub_duration":0.003687811,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:21.400280+0000","last_change":"2023-10-16T23:29:21.400550+0000","last_active":"2023-10-16T23:29:21.400280+0000","last_peered":"2023-10-16T23:29:21.400280+0000","last_clean":"2023-10-16T23:29:21.400280+0000","last_became_active":"2023-10-16T23:27:40.763592+0000","last_became_peered":"2023-10-16T23:27:40.763592+0000","last_unstale":"2023-10-16T23:29:21.400280+0000","last_undegraded":"2023-10-16T23:29:21.400280+0000","last_fullsized":"2023-10-16T23:29:21.400280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:21.400228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:21.400228+0000","last_clean_scrub_stamp":"2023-10-16T23:29:21.400228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:11:08.781782+0000","scrub_duration":0.0035353440000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:18.832481+0000","last_change":"2023-10-16T23:29:18.832772+0000","last_active":"2023-10-16T23:29:18.832481+0000","last_peered":"2023-10-16T23:29:18.832481+0000","last_clean":"2023-10-16T23:29:18.832481+0000","last_became_active":"2023-10-16T23:27:40.760615+0000","last_became_peered":"2023-10-16T23:27:40.760615+0000","last_unstale":"2023-10-16T23:29:18.832481+0000","last_undegraded":"2023-10-16T23:29:18.832481+0000","last_fullsized":"2023-10-16T23:29:18.832481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:18.832431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:18.832431+0000","last_clean_scrub_stamp":"2023-10-16T23:29:18.832431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:49:43.722320+0000","scrub_duration":0.003603453,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:08.300156+0000","last_change":"2023-10-16T23:29:08.300428+0000","last_active":"2023-10-16T23:29:08.300156+0000","last_peered":"2023-10-16T23:29:08.300156+0000","last_clean":"2023-10-16T23:29:08.300156+0000","last_became_active":"2023-10-16T23:27:40.760437+0000","last_became_peered":"2023-10-16T23:27:40.760437+0000","last_unstale":"2023-10-16T23:29:08.300156+0000","last_undegraded":"2023-10-16T23:29:08.300156+0000","last_fullsized":"2023-10-16T23:29:08.300156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:08.300103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:08.300103+0000","last_clean_scrub_stamp":"2023-10-16T23:29:08.300103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:17:28.239007+0000","scrub_duration":0.0035936340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:15.588249+0000","last_change":"2023-10-16T23:29:15.588518+0000","last_active":"2023-10-16T23:29:15.588249+0000","last_peered":"2023-10-16T23:29:15.588249+0000","last_clean":"2023-10-16T23:29:15.588249+0000","last_became_active":"2023-10-16T23:27:40.744458+0000","last_became_peered":"2023-10-16T23:27:40.744458+0000","last_unstale":"2023-10-16T23:29:15.588249+0000","last_undegraded":"2023-10-16T23:29:15.588249+0000","last_fullsized":"2023-10-16T23:29:15.588249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:15.588199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:15.588199+0000","last_clean_scrub_stamp":"2023-10-16T23:29:15.588199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:23:03.039514+0000","scrub_duration":0.0032820359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:17.225050+0000","last_change":"2023-10-16T23:29:17.225346+0000","last_active":"2023-10-16T23:29:17.225050+0000","last_peered":"2023-10-16T23:29:17.225050+0000","last_clean":"2023-10-16T23:29:17.225050+0000","last_became_active":"2023-10-16T23:27:40.711492+0000","last_became_peered":"2023-10-16T23:27:40.711492+0000","last_unstale":"2023-10-16T23:29:17.225050+0000","last_undegraded":"2023-10-16T23:29:17.225050+0000","last_fullsized":"2023-10-16T23:29:17.225050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:17.224999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:17.224999+0000","last_clean_scrub_stamp":"2023-10-16T23:29:17.224999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:23:04.676314+0000","scrub_duration":0.0033378930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:00.518211+0000","last_change":"2023-10-16T23:29:00.518352+0000","last_active":"2023-10-16T23:29:00.518211+0000","last_peered":"2023-10-16T23:29:00.518211+0000","last_clean":"2023-10-16T23:29:00.518211+0000","last_became_active":"2023-10-16T23:27:40.709286+0000","last_became_peered":"2023-10-16T23:27:40.709286+0000","last_unstale":"2023-10-16T23:29:00.518211+0000","last_undegraded":"2023-10-16T23:29:00.518211+0000","last_fullsized":"2023-10-16T23:29:00.518211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:00.518184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:00.518184+0000","last_clean_scrub_stamp":"2023-10-16T23:29:00.518184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:57.302309+0000","scrub_duration":0.002605067,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:05.176691+0000","last_change":"2023-10-16T23:29:05.176985+0000","last_active":"2023-10-16T23:29:05.176691+0000","last_peered":"2023-10-16T23:29:05.176691+0000","last_clean":"2023-10-16T23:29:05.176691+0000","last_became_active":"2023-10-16T23:27:40.706864+0000","last_became_peered":"2023-10-16T23:27:40.706864+0000","last_unstale":"2023-10-16T23:29:05.176691+0000","last_undegraded":"2023-10-16T23:29:05.176691+0000","last_fullsized":"2023-10-16T23:29:05.176691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:05.176639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:05.176639+0000","last_clean_scrub_stamp":"2023-10-16T23:29:05.176639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:42:36.956589+0000","scrub_duration":0.0035589369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'4","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:49.381697+0000","last_change":"2023-10-16T23:28:49.381955+0000","last_active":"2023-10-16T23:28:49.381697+0000","last_peered":"2023-10-16T23:28:49.381697+0000","last_clean":"2023-10-16T23:28:49.381697+0000","last_became_active":"2023-10-16T23:27:40.352775+0000","last_became_peered":"2023-10-16T23:27:40.352775+0000","last_unstale":"2023-10-16T23:28:49.381697+0000","last_undegraded":"2023-10-16T23:28:49.381697+0000","last_fullsized":"2023-10-16T23:28:49.381697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2023-10-16T23:28:49.381632+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2023-10-16T23:28:49.381632+0000","last_clean_scrub_stamp":"2023-10-16T23:28:49.381632+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:38:59.043081+0000","scrub_duration":0.008668594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:13.208673+0000","last_change":"2023-10-16T23:29:13.208965+0000","last_active":"2023-10-16T23:29:13.208673+0000","last_peered":"2023-10-16T23:29:13.208673+0000","last_clean":"2023-10-16T23:29:13.208673+0000","last_became_active":"2023-10-16T23:27:40.764517+0000","last_became_peered":"2023-10-16T23:27:40.764517+0000","last_unstale":"2023-10-16T23:29:13.208673+0000","last_undegraded":"2023-10-16T23:29:13.208673+0000","last_fullsized":"2023-10-16T23:29:13.208673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:13.208622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:13.208622+0000","last_clean_scrub_stamp":"2023-10-16T23:29:13.208622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:32.898242+0000","scrub_duration":0.0034766910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:00.442327+0000","last_change":"2023-10-16T23:29:00.442518+0000","last_active":"2023-10-16T23:29:00.442327+0000","last_peered":"2023-10-16T23:29:00.442327+0000","last_clean":"2023-10-16T23:29:00.442327+0000","last_became_active":"2023-10-16T23:27:40.334885+0000","last_became_peered":"2023-10-16T23:27:40.334885+0000","last_unstale":"2023-10-16T23:29:00.442327+0000","last_undegraded":"2023-10-16T23:29:00.442327+0000","last_fullsized":"2023-10-16T23:29:00.442327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:00.442297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:00.442297+0000","last_clean_scrub_stamp":"2023-10-16T23:29:00.442297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:51:37.914607+0000","scrub_duration":0.0034444219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:10.347471+0000","last_change":"2023-10-16T23:29:10.347729+0000","last_active":"2023-10-16T23:29:10.347471+0000","last_peered":"2023-10-16T23:29:10.347471+0000","last_clean":"2023-10-16T23:29:10.347471+0000","last_became_active":"2023-10-16T23:27:40.719811+0000","last_became_peered":"2023-10-16T23:27:40.719811+0000","last_unstale":"2023-10-16T23:29:10.347471+0000","last_undegraded":"2023-10-16T23:29:10.347471+0000","last_fullsized":"2023-10-16T23:29:10.347471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:10.347417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:10.347417+0000","last_clean_scrub_stamp":"2023-10-16T23:29:10.347417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:00.077348+0000","scrub_duration":0.0036543629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:45.316754+0000","last_change":"2023-10-16T23:28:45.317090+0000","last_active":"2023-10-16T23:28:45.316754+0000","last_peered":"2023-10-16T23:28:45.316754+0000","last_clean":"2023-10-16T23:28:45.316754+0000","last_became_active":"2023-10-16T23:27:40.357009+0000","last_became_peered":"2023-10-16T23:27:40.357009+0000","last_unstale":"2023-10-16T23:28:45.316754+0000","last_undegraded":"2023-10-16T23:28:45.316754+0000","last_fullsized":"2023-10-16T23:28:45.316754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:45.316698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:45.316698+0000","last_clean_scrub_stamp":"2023-10-16T23:28:45.316698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:46.889893+0000","scrub_duration":0.003457342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:11.264275+0000","last_change":"2023-10-16T23:29:11.264530+0000","last_active":"2023-10-16T23:29:11.264275+0000","last_peered":"2023-10-16T23:29:11.264275+0000","last_clean":"2023-10-16T23:29:11.264275+0000","last_became_active":"2023-10-16T23:27:40.760365+0000","last_became_peered":"2023-10-16T23:27:40.760365+0000","last_unstale":"2023-10-16T23:29:11.264275+0000","last_undegraded":"2023-10-16T23:29:11.264275+0000","last_fullsized":"2023-10-16T23:29:11.264275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:11.264225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:11.264225+0000","last_clean_scrub_stamp":"2023-10-16T23:29:11.264225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:00.994156+0000","scrub_duration":0.0036701329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"26'12","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:48.460939+0000","last_change":"2023-10-16T23:28:48.461283+0000","last_active":"2023-10-16T23:28:48.460939+0000","last_peered":"2023-10-16T23:28:48.460939+0000","last_clean":"2023-10-16T23:28:48.460939+0000","last_became_active":"2023-10-16T23:27:40.330857+0000","last_became_peered":"2023-10-16T23:27:40.330857+0000","last_unstale":"2023-10-16T23:28:48.460939+0000","last_undegraded":"2023-10-16T23:28:48.460939+0000","last_fullsized":"2023-10-16T23:28:48.460939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12","last_scrub_stamp":"2023-10-16T23:28:48.460884+0000","last_deep_scrub":"26'12","last_deep_scrub_stamp":"2023-10-16T23:28:48.460884+0000","last_clean_scrub_stamp":"2023-10-16T23:28:48.460884+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:48.136384+0000","scrub_duration":0.010512126,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"26'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:48.333265+0000","last_change":"2023-10-16T23:28:48.333516+0000","last_active":"2023-10-16T23:28:48.333265+0000","last_peered":"2023-10-16T23:28:48.333265+0000","last_clean":"2023-10-16T23:28:48.333265+0000","last_became_active":"2023-10-16T23:27:40.357047+0000","last_became_peered":"2023-10-16T23:27:40.357047+0000","last_unstale":"2023-10-16T23:28:48.333265+0000","last_undegraded":"2023-10-16T23:28:48.333265+0000","last_fullsized":"2023-10-16T23:28:48.333265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2023-10-16T23:28:48.333206+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2023-10-16T23:28:48.333206+0000","last_clean_scrub_stamp":"2023-10-16T23:28:48.333206+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:30:33.692271+0000","scrub_duration":0.0077088319999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:11.193915+0000","last_change":"2023-10-16T23:29:11.194180+0000","last_active":"2023-10-16T23:29:11.193915+0000","last_peered":"2023-10-16T23:29:11.193915+0000","last_clean":"2023-10-16T23:29:11.193915+0000","last_became_active":"2023-10-16T23:27:40.763116+0000","last_became_peered":"2023-10-16T23:27:40.763116+0000","last_unstale":"2023-10-16T23:29:11.193915+0000","last_undegraded":"2023-10-16T23:29:11.193915+0000","last_fullsized":"2023-10-16T23:29:11.193915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:11.193863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:11.193863+0000","last_clean_scrub_stamp":"2023-10-16T23:29:11.193863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:00.923794+0000","scrub_duration":0.0036105400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:52.466822+0000","last_change":"2023-10-16T23:28:52.467072+0000","last_active":"2023-10-16T23:28:52.466822+0000","last_peered":"2023-10-16T23:28:52.466822+0000","last_clean":"2023-10-16T23:28:52.466822+0000","last_became_active":"2023-10-16T23:27:40.346439+0000","last_became_peered":"2023-10-16T23:27:40.346439+0000","last_unstale":"2023-10-16T23:28:52.466822+0000","last_undegraded":"2023-10-16T23:28:52.466822+0000","last_fullsized":"2023-10-16T23:28:52.466822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2023-10-16T23:28:52.466754+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2023-10-16T23:28:52.466754+0000","last_clean_scrub_stamp":"2023-10-16T23:28:52.466754+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:32.718215+0000","scrub_duration":0.0073781489999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:46.591562+0000","last_change":"2023-10-16T23:28:46.591816+0000","last_active":"2023-10-16T23:28:46.591562+0000","last_peered":"2023-10-16T23:28:46.591562+0000","last_clean":"2023-10-16T23:28:46.591562+0000","last_became_active":"2023-10-16T23:27:40.714098+0000","last_became_peered":"2023-10-16T23:27:40.714098+0000","last_unstale":"2023-10-16T23:28:46.591562+0000","last_undegraded":"2023-10-16T23:28:46.591562+0000","last_fullsized":"2023-10-16T23:28:46.591562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:46.591510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:46.591510+0000","last_clean_scrub_stamp":"2023-10-16T23:28:46.591510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:43.375635+0000","scrub_duration":0.0038871190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"26'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:47.356544+0000","last_change":"2023-10-16T23:28:47.356799+0000","last_active":"2023-10-16T23:28:47.356544+0000","last_peered":"2023-10-16T23:28:47.356544+0000","last_clean":"2023-10-16T23:28:47.356544+0000","last_became_active":"2023-10-16T23:27:40.339531+0000","last_became_peered":"2023-10-16T23:27:40.339531+0000","last_unstale":"2023-10-16T23:28:47.356544+0000","last_undegraded":"2023-10-16T23:28:47.356544+0000","last_fullsized":"2023-10-16T23:28:47.356544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2023-10-16T23:28:47.356483+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2023-10-16T23:28:47.356483+0000","last_clean_scrub_stamp":"2023-10-16T23:28:47.356483+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:10.570766+0000","scrub_duration":0.0069425870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:09.544618+0000","last_change":"2023-10-16T23:29:09.544873+0000","last_active":"2023-10-16T23:29:09.544618+0000","last_peered":"2023-10-16T23:29:09.544618+0000","last_clean":"2023-10-16T23:29:09.544618+0000","last_became_active":"2023-10-16T23:27:40.713087+0000","last_became_peered":"2023-10-16T23:27:40.713087+0000","last_unstale":"2023-10-16T23:29:09.544618+0000","last_undegraded":"2023-10-16T23:29:09.544618+0000","last_fullsized":"2023-10-16T23:29:09.544618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:09.544568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:09.544568+0000","last_clean_scrub_stamp":"2023-10-16T23:29:09.544568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:24.182139+0000","scrub_duration":0.00371274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:53.310895+0000","last_change":"2023-10-16T23:28:53.311195+0000","last_active":"2023-10-16T23:28:53.310895+0000","last_peered":"2023-10-16T23:28:53.310895+0000","last_clean":"2023-10-16T23:28:53.310895+0000","last_became_active":"2023-10-16T23:27:40.319887+0000","last_became_peered":"2023-10-16T23:27:40.319887+0000","last_unstale":"2023-10-16T23:28:53.310895+0000","last_undegraded":"2023-10-16T23:28:53.310895+0000","last_fullsized":"2023-10-16T23:28:53.310895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:53.310840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:53.310840+0000","last_clean_scrub_stamp":"2023-10-16T23:28:53.310840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:39:38.391533+0000","scrub_duration":0.0040007879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:21.459710+0000","last_change":"2023-10-16T23:29:21.459961+0000","last_active":"2023-10-16T23:29:21.459710+0000","last_peered":"2023-10-16T23:29:21.459710+0000","last_clean":"2023-10-16T23:29:21.459710+0000","last_became_active":"2023-10-16T23:27:40.725724+0000","last_became_peered":"2023-10-16T23:27:40.725724+0000","last_unstale":"2023-10-16T23:29:21.459710+0000","last_undegraded":"2023-10-16T23:29:21.459710+0000","last_fullsized":"2023-10-16T23:29:21.459710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:21.459656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:21.459656+0000","last_clean_scrub_stamp":"2023-10-16T23:29:21.459656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:59:28.780094+0000","scrub_duration":0.003283593,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:58.056830+0000","last_change":"2023-10-16T23:28:58.057082+0000","last_active":"2023-10-16T23:28:58.056830+0000","last_peered":"2023-10-16T23:28:58.056830+0000","last_clean":"2023-10-16T23:28:58.056830+0000","last_became_active":"2023-10-16T23:27:40.337405+0000","last_became_peered":"2023-10-16T23:27:40.337405+0000","last_unstale":"2023-10-16T23:28:58.056830+0000","last_undegraded":"2023-10-16T23:28:58.056830+0000","last_fullsized":"2023-10-16T23:28:58.056830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2023-10-16T23:28:58.056774+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2023-10-16T23:28:58.056774+0000","last_clean_scrub_stamp":"2023-10-16T23:28:58.056774+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:12.694345+0000","scrub_duration":0.0064973770000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:54.550987+0000","last_change":"2023-10-16T23:28:54.551267+0000","last_active":"2023-10-16T23:28:54.550987+0000","last_peered":"2023-10-16T23:28:54.550987+0000","last_clean":"2023-10-16T23:28:54.550987+0000","last_became_active":"2023-10-16T23:27:40.722091+0000","last_became_peered":"2023-10-16T23:27:40.722091+0000","last_unstale":"2023-10-16T23:28:54.550987+0000","last_undegraded":"2023-10-16T23:28:54.550987+0000","last_fullsized":"2023-10-16T23:28:54.550987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:54.550940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:54.550940+0000","last_clean_scrub_stamp":"2023-10-16T23:28:54.550940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:42.954644+0000","scrub_duration":0.0039030689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:43.363818+0000","last_change":"2023-10-16T23:28:43.364129+0000","last_active":"2023-10-16T23:28:43.363818+0000","last_peered":"2023-10-16T23:28:43.363818+0000","last_clean":"2023-10-16T23:28:43.363818+0000","last_became_active":"2023-10-16T23:27:40.342213+0000","last_became_peered":"2023-10-16T23:27:40.342213+0000","last_unstale":"2023-10-16T23:28:43.363818+0000","last_undegraded":"2023-10-16T23:28:43.363818+0000","last_fullsized":"2023-10-16T23:28:43.363818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:43.363769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:43.363769+0000","last_clean_scrub_stamp":"2023-10-16T23:28:43.363769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:58.725647+0000","scrub_duration":0.003734617,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:55.526798+0000","last_change":"2023-10-16T23:28:55.527078+0000","last_active":"2023-10-16T23:28:55.526798+0000","last_peered":"2023-10-16T23:28:55.526798+0000","last_clean":"2023-10-16T23:28:55.526798+0000","last_became_active":"2023-10-16T23:27:40.732996+0000","last_became_peered":"2023-10-16T23:27:40.732996+0000","last_unstale":"2023-10-16T23:28:55.526798+0000","last_undegraded":"2023-10-16T23:28:55.526798+0000","last_fullsized":"2023-10-16T23:28:55.526798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:55.526749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:55.526749+0000","last_clean_scrub_stamp":"2023-10-16T23:28:55.526749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:10.164320+0000","scrub_duration":0.0041469059999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:04.485405+0000","last_change":"2023-10-16T23:29:04.485661+0000","last_active":"2023-10-16T23:29:04.485405+0000","last_peered":"2023-10-16T23:29:04.485405+0000","last_clean":"2023-10-16T23:29:04.485405+0000","last_became_active":"2023-10-16T23:27:40.347253+0000","last_became_peered":"2023-10-16T23:27:40.347253+0000","last_unstale":"2023-10-16T23:29:04.485405+0000","last_undegraded":"2023-10-16T23:29:04.485405+0000","last_fullsized":"2023-10-16T23:29:04.485405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:04.485343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:04.485343+0000","last_clean_scrub_stamp":"2023-10-16T23:29:04.485343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:17:24.424246+0000","scrub_duration":0.0040997250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:18.642233+0000","last_change":"2023-10-16T23:29:18.642538+0000","last_active":"2023-10-16T23:29:18.642233+0000","last_peered":"2023-10-16T23:29:18.642233+0000","last_clean":"2023-10-16T23:29:18.642233+0000","last_became_active":"2023-10-16T23:27:40.744571+0000","last_became_peered":"2023-10-16T23:27:40.744571+0000","last_unstale":"2023-10-16T23:29:18.642233+0000","last_undegraded":"2023-10-16T23:29:18.642233+0000","last_fullsized":"2023-10-16T23:29:18.642233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:18.642179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:18.642179+0000","last_clean_scrub_stamp":"2023-10-16T23:29:18.642179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:55.970808+0000","scrub_duration":0.003845958,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:39.870190+0000","last_change":"2023-10-16T23:28:39.870424+0000","last_active":"2023-10-16T23:28:39.870190+0000","last_peered":"2023-10-16T23:28:39.870190+0000","last_clean":"2023-10-16T23:28:39.870190+0000","last_became_active":"2023-10-16T23:27:40.314242+0000","last_became_peered":"2023-10-16T23:27:40.314242+0000","last_unstale":"2023-10-16T23:28:39.870190+0000","last_undegraded":"2023-10-16T23:28:39.870190+0000","last_fullsized":"2023-10-16T23:28:39.870190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:39.870144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:39.870144+0000","last_clean_scrub_stamp":"2023-10-16T23:28:39.870144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:19:34.468123+0000","scrub_duration":0.002925712,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:11.915806+0000","last_change":"2023-10-16T23:29:11.916050+0000","last_active":"2023-10-16T23:29:11.915806+0000","last_peered":"2023-10-16T23:29:11.915806+0000","last_clean":"2023-10-16T23:29:11.915806+0000","last_became_active":"2023-10-16T23:27:40.709174+0000","last_became_peered":"2023-10-16T23:27:40.709174+0000","last_unstale":"2023-10-16T23:29:11.915806+0000","last_undegraded":"2023-10-16T23:29:11.915806+0000","last_fullsized":"2023-10-16T23:29:11.915806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:11.915747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:11.915747+0000","last_clean_scrub_stamp":"2023-10-16T23:29:11.915747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:17:31.854651+0000","scrub_duration":0.0030805680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":184,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:41.333104+0000","last_change":"2023-10-16T23:28:41.333104+0000","last_active":"2023-10-16T23:28:41.333104+0000","last_peered":"2023-10-16T23:28:41.333104+0000","last_clean":"2023-10-16T23:28:41.333104+0000","last_became_active":"2023-10-16T23:27:29.353846+0000","last_became_peered":"2023-10-16T23:27:29.353846+0000","last_unstale":"2023-10-16T23:28:41.333104+0000","last_undegraded":"2023-10-16T23:28:41.333104+0000","last_fullsized":"2023-10-16T23:28:41.333104+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2023-10-16T23:28:41.332715+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2023-10-16T23:28:41.332715+0000","last_clean_scrub_stamp":"2023-10-16T23:28:41.332715+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:34.312585+0000","scrub_duration":0.01599012,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:40.409329+0000","last_change":"2023-10-16T23:28:40.409634+0000","last_active":"2023-10-16T23:28:40.409329+0000","last_peered":"2023-10-16T23:28:40.409329+0000","last_clean":"2023-10-16T23:28:40.409329+0000","last_became_active":"2023-10-16T23:27:36.277096+0000","last_became_peered":"2023-10-16T23:27:36.277096+0000","last_unstale":"2023-10-16T23:28:40.409329+0000","last_undegraded":"2023-10-16T23:28:40.409329+0000","last_fullsized":"2023-10-16T23:28:40.409329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:40.409281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:40.409281+0000","last_clean_scrub_stamp":"2023-10-16T23:28:40.409281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:11:55.648922+0000","scrub_duration":0.003820922,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:51.048809+0000","last_change":"2023-10-16T23:28:51.049069+0000","last_active":"2023-10-16T23:28:51.048809+0000","last_peered":"2023-10-16T23:28:51.048809+0000","last_clean":"2023-10-16T23:28:51.048809+0000","last_became_active":"2023-10-16T23:27:40.330989+0000","last_became_peered":"2023-10-16T23:27:40.330989+0000","last_unstale":"2023-10-16T23:28:51.048809+0000","last_undegraded":"2023-10-16T23:28:51.048809+0000","last_fullsized":"2023-10-16T23:28:51.048809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:51.048757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:51.048757+0000","last_clean_scrub_stamp":"2023-10-16T23:28:51.048757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:39:36.129450+0000","scrub_duration":0.0042242089999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:52.485319+0000","last_change":"2023-10-16T23:28:52.485612+0000","last_active":"2023-10-16T23:28:52.485319+0000","last_peered":"2023-10-16T23:28:52.485319+0000","last_clean":"2023-10-16T23:28:52.485319+0000","last_became_active":"2023-10-16T23:27:40.725490+0000","last_became_peered":"2023-10-16T23:27:40.725490+0000","last_unstale":"2023-10-16T23:28:52.485319+0000","last_undegraded":"2023-10-16T23:28:52.485319+0000","last_fullsized":"2023-10-16T23:28:52.485319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:52.485272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:52.485272+0000","last_clean_scrub_stamp":"2023-10-16T23:28:52.485272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:45:18.719119+0000","scrub_duration":0.0033147099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:42.339474+0000","last_change":"2023-10-16T23:28:42.339474+0000","last_active":"2023-10-16T23:28:42.339474+0000","last_peered":"2023-10-16T23:28:42.339474+0000","last_clean":"2023-10-16T23:28:42.339474+0000","last_became_active":"2023-10-16T23:27:36.277974+0000","last_became_peered":"2023-10-16T23:27:36.277974+0000","last_unstale":"2023-10-16T23:28:42.339474+0000","last_undegraded":"2023-10-16T23:28:42.339474+0000","last_fullsized":"2023-10-16T23:28:42.339474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:42.339160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:42.339160+0000","last_clean_scrub_stamp":"2023-10-16T23:28:42.339160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:43:39.840764+0000","scrub_duration":0.0082552289999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:38.602009+0000","last_change":"2023-10-16T23:28:38.602280+0000","last_active":"2023-10-16T23:28:38.602009+0000","last_peered":"2023-10-16T23:28:38.602009+0000","last_clean":"2023-10-16T23:28:38.602009+0000","last_became_active":"2023-10-16T23:27:40.339569+0000","last_became_peered":"2023-10-16T23:27:40.339569+0000","last_unstale":"2023-10-16T23:28:38.602009+0000","last_undegraded":"2023-10-16T23:28:38.602009+0000","last_fullsized":"2023-10-16T23:28:38.602009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:38.601943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:38.601943+0000","last_clean_scrub_stamp":"2023-10-16T23:28:38.601943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:11:53.841584+0000","scrub_duration":0.0039239139999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:11.361786+0000","last_change":"2023-10-16T23:29:11.362095+0000","last_active":"2023-10-16T23:29:11.361786+0000","last_peered":"2023-10-16T23:29:11.361786+0000","last_clean":"2023-10-16T23:29:11.361786+0000","last_became_active":"2023-10-16T23:27:40.726813+0000","last_became_peered":"2023-10-16T23:27:40.726813+0000","last_unstale":"2023-10-16T23:29:11.361786+0000","last_undegraded":"2023-10-16T23:29:11.361786+0000","last_fullsized":"2023-10-16T23:29:11.361786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:11.361731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:11.361731+0000","last_clean_scrub_stamp":"2023-10-16T23:29:11.361731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:51:49.495366+0000","scrub_duration":0.0034816449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:38.315486+0000","last_change":"2023-10-16T23:28:38.315622+0000","last_active":"2023-10-16T23:28:38.315486+0000","last_peered":"2023-10-16T23:28:38.315486+0000","last_clean":"2023-10-16T23:28:38.315486+0000","last_became_active":"2023-10-16T23:27:36.294489+0000","last_became_peered":"2023-10-16T23:27:36.294489+0000","last_unstale":"2023-10-16T23:28:38.315486+0000","last_undegraded":"2023-10-16T23:28:38.315486+0000","last_fullsized":"2023-10-16T23:28:38.315486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:38.315459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:38.315459+0000","last_clean_scrub_stamp":"2023-10-16T23:28:38.315459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:37:02.617863+0000","scrub_duration":0.0020246650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:54.915320+0000","last_change":"2023-10-16T23:28:54.915581+0000","last_active":"2023-10-16T23:28:54.915320+0000","last_peered":"2023-10-16T23:28:54.915320+0000","last_clean":"2023-10-16T23:28:54.915320+0000","last_became_active":"2023-10-16T23:27:40.326396+0000","last_became_peered":"2023-10-16T23:27:40.326396+0000","last_unstale":"2023-10-16T23:28:54.915320+0000","last_undegraded":"2023-10-16T23:28:54.915320+0000","last_fullsized":"2023-10-16T23:28:54.915320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:54.915270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:54.915270+0000","last_clean_scrub_stamp":"2023-10-16T23:28:54.915270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:39:39.995963+0000","scrub_duration":0.0073983119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:01.985002+0000","last_change":"2023-10-16T23:29:01.985257+0000","last_active":"2023-10-16T23:29:01.985002+0000","last_peered":"2023-10-16T23:29:01.985002+0000","last_clean":"2023-10-16T23:29:01.985002+0000","last_became_active":"2023-10-16T23:27:40.755489+0000","last_became_peered":"2023-10-16T23:27:40.755489+0000","last_unstale":"2023-10-16T23:29:01.985002+0000","last_undegraded":"2023-10-16T23:29:01.985002+0000","last_fullsized":"2023-10-16T23:29:01.985002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:01.984950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:01.984950+0000","last_clean_scrub_stamp":"2023-10-16T23:29:01.984950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:16.622521+0000","scrub_duration":0.0037752060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:22.392176+0000","last_change":"2023-10-16T23:29:22.392424+0000","last_active":"2023-10-16T23:29:22.392176+0000","last_peered":"2023-10-16T23:29:22.392176+0000","last_clean":"2023-10-16T23:29:22.392176+0000","last_became_active":"2023-10-16T23:27:36.278134+0000","last_became_peered":"2023-10-16T23:27:36.278134+0000","last_unstale":"2023-10-16T23:29:22.392176+0000","last_undegraded":"2023-10-16T23:29:22.392176+0000","last_fullsized":"2023-10-16T23:29:22.392176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:22.392126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:22.392126+0000","last_clean_scrub_stamp":"2023-10-16T23:29:22.392126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:59.720754+0000","scrub_duration":0.0038224819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:07.464619+0000","last_change":"2023-10-16T23:29:07.464875+0000","last_active":"2023-10-16T23:29:07.464619+0000","last_peered":"2023-10-16T23:29:07.464619+0000","last_clean":"2023-10-16T23:29:07.464619+0000","last_became_active":"2023-10-16T23:27:40.341951+0000","last_became_peered":"2023-10-16T23:27:40.341951+0000","last_unstale":"2023-10-16T23:29:07.464619+0000","last_undegraded":"2023-10-16T23:29:07.464619+0000","last_fullsized":"2023-10-16T23:29:07.464619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:07.464569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:07.464569+0000","last_clean_scrub_stamp":"2023-10-16T23:29:07.464569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:44:57.194500+0000","scrub_duration":0.003795624,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:03.943355+0000","last_change":"2023-10-16T23:29:03.943599+0000","last_active":"2023-10-16T23:29:03.943355+0000","last_peered":"2023-10-16T23:29:03.943355+0000","last_clean":"2023-10-16T23:29:03.943355+0000","last_became_active":"2023-10-16T23:27:40.731150+0000","last_became_peered":"2023-10-16T23:27:40.731150+0000","last_unstale":"2023-10-16T23:29:03.943355+0000","last_undegraded":"2023-10-16T23:29:03.943355+0000","last_fullsized":"2023-10-16T23:29:03.943355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:03.943306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:03.943306+0000","last_clean_scrub_stamp":"2023-10-16T23:29:03.943306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:51:41.415616+0000","scrub_duration":0.003488578,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:51.375490+0000","last_change":"2023-10-16T23:28:51.375752+0000","last_active":"2023-10-16T23:28:51.375490+0000","last_peered":"2023-10-16T23:28:51.375490+0000","last_clean":"2023-10-16T23:28:51.375490+0000","last_became_active":"2023-10-16T23:27:40.319571+0000","last_became_peered":"2023-10-16T23:27:40.319571+0000","last_unstale":"2023-10-16T23:28:51.375490+0000","last_undegraded":"2023-10-16T23:28:51.375490+0000","last_fullsized":"2023-10-16T23:28:51.375490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:51.375443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:51.375443+0000","last_clean_scrub_stamp":"2023-10-16T23:28:51.375443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:48.159569+0000","scrub_duration":0.0039652410000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:44.785018+0000","last_change":"2023-10-16T23:28:44.785290+0000","last_active":"2023-10-16T23:28:44.785018+0000","last_peered":"2023-10-16T23:28:44.785018+0000","last_clean":"2023-10-16T23:28:44.785018+0000","last_became_active":"2023-10-16T23:27:36.433808+0000","last_became_peered":"2023-10-16T23:27:36.433808+0000","last_unstale":"2023-10-16T23:28:44.785018+0000","last_undegraded":"2023-10-16T23:28:44.785018+0000","last_fullsized":"2023-10-16T23:28:44.785018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:44.784970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:44.784970+0000","last_clean_scrub_stamp":"2023-10-16T23:28:44.784970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:45:11.018817+0000","scrub_duration":0.0037436349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:55.349739+0000","last_change":"2023-10-16T23:28:55.349998+0000","last_active":"2023-10-16T23:28:55.349739+0000","last_peered":"2023-10-16T23:28:55.349739+0000","last_clean":"2023-10-16T23:28:55.349739+0000","last_became_active":"2023-10-16T23:28:23.651881+0000","last_became_peered":"2023-10-16T23:28:23.651881+0000","last_unstale":"2023-10-16T23:28:55.349739+0000","last_undegraded":"2023-10-16T23:28:55.349739+0000","last_fullsized":"2023-10-16T23:28:55.349739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:55.349662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:55.349662+0000","last_clean_scrub_stamp":"2023-10-16T23:28:55.349662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:35.601123+0000","scrub_duration":0.003616677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:52.980589+0000","last_change":"2023-10-16T23:28:52.980865+0000","last_active":"2023-10-16T23:28:52.980589+0000","last_peered":"2023-10-16T23:28:52.980589+0000","last_clean":"2023-10-16T23:28:52.980589+0000","last_became_active":"2023-10-16T23:27:40.327804+0000","last_became_peered":"2023-10-16T23:27:40.327804+0000","last_unstale":"2023-10-16T23:28:52.980589+0000","last_undegraded":"2023-10-16T23:28:52.980589+0000","last_fullsized":"2023-10-16T23:28:52.980589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:52.980540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:52.980540+0000","last_clean_scrub_stamp":"2023-10-16T23:28:52.980540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:49.764666+0000","scrub_duration":0.0034145260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:44.279340+0000","last_change":"2023-10-16T23:28:44.279600+0000","last_active":"2023-10-16T23:28:44.279340+0000","last_peered":"2023-10-16T23:28:44.279340+0000","last_clean":"2023-10-16T23:28:44.279340+0000","last_became_active":"2023-10-16T23:27:36.433923+0000","last_became_peered":"2023-10-16T23:27:36.433923+0000","last_unstale":"2023-10-16T23:28:44.279340+0000","last_undegraded":"2023-10-16T23:28:44.279340+0000","last_fullsized":"2023-10-16T23:28:44.279340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:44.279284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:44.279284+0000","last_clean_scrub_stamp":"2023-10-16T23:28:44.279284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:32:40.077699+0000","scrub_duration":0.003868692,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:19.465145+0000","last_change":"2023-10-16T23:29:19.465397+0000","last_active":"2023-10-16T23:29:19.465145+0000","last_peered":"2023-10-16T23:29:19.465145+0000","last_clean":"2023-10-16T23:29:19.465145+0000","last_became_active":"2023-10-16T23:27:40.755822+0000","last_became_peered":"2023-10-16T23:27:40.755822+0000","last_unstale":"2023-10-16T23:29:19.465145+0000","last_undegraded":"2023-10-16T23:29:19.465145+0000","last_fullsized":"2023-10-16T23:29:19.465145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:19.465088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:19.465088+0000","last_clean_scrub_stamp":"2023-10-16T23:29:19.465088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:36:38.696373+0000","scrub_duration":0.0036413130000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:49.004552+0000","last_change":"2023-10-16T23:28:49.004794+0000","last_active":"2023-10-16T23:28:49.004552+0000","last_peered":"2023-10-16T23:28:49.004552+0000","last_clean":"2023-10-16T23:28:49.004552+0000","last_became_active":"2023-10-16T23:27:40.333290+0000","last_became_peered":"2023-10-16T23:27:40.333290+0000","last_unstale":"2023-10-16T23:28:49.004552+0000","last_undegraded":"2023-10-16T23:28:49.004552+0000","last_fullsized":"2023-10-16T23:28:49.004552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2023-10-16T23:28:49.004498+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2023-10-16T23:28:49.004498+0000","last_clean_scrub_stamp":"2023-10-16T23:28:49.004498+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:45.788624+0000","scrub_duration":0.0068572590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:42.754243+0000","last_change":"2023-10-16T23:28:42.754504+0000","last_active":"2023-10-16T23:28:42.754243+0000","last_peered":"2023-10-16T23:28:42.754243+0000","last_clean":"2023-10-16T23:28:42.754243+0000","last_became_active":"2023-10-16T23:27:36.278209+0000","last_became_peered":"2023-10-16T23:27:36.278209+0000","last_unstale":"2023-10-16T23:28:42.754243+0000","last_undegraded":"2023-10-16T23:28:42.754243+0000","last_fullsized":"2023-10-16T23:28:42.754243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:42.754195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:42.754195+0000","last_clean_scrub_stamp":"2023-10-16T23:28:42.754195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:11:57.993836+0000","scrub_duration":0.003737359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:52.430757+0000","last_change":"2023-10-16T23:28:52.430982+0000","last_active":"2023-10-16T23:28:52.430757+0000","last_peered":"2023-10-16T23:28:52.430757+0000","last_clean":"2023-10-16T23:28:52.430757+0000","last_became_active":"2023-10-16T23:28:23.650570+0000","last_became_peered":"2023-10-16T23:28:23.650570+0000","last_unstale":"2023-10-16T23:28:52.430757+0000","last_undegraded":"2023-10-16T23:28:52.430757+0000","last_fullsized":"2023-10-16T23:28:52.430757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:52.430707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:52.430707+0000","last_clean_scrub_stamp":"2023-10-16T23:28:52.430707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:39:02.092156+0000","scrub_duration":0.0042398360000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:50.540560+0000","last_change":"2023-10-16T23:28:50.540697+0000","last_active":"2023-10-16T23:28:50.540560+0000","last_peered":"2023-10-16T23:28:50.540560+0000","last_clean":"2023-10-16T23:28:50.540560+0000","last_became_active":"2023-10-16T23:27:40.332084+0000","last_became_peered":"2023-10-16T23:27:40.332084+0000","last_unstale":"2023-10-16T23:28:50.540560+0000","last_undegraded":"2023-10-16T23:28:50.540560+0000","last_fullsized":"2023-10-16T23:28:50.540560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2023-10-16T23:28:50.540532+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2023-10-16T23:28:50.540532+0000","last_clean_scrub_stamp":"2023-10-16T23:28:50.540532+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:39:35.621225+0000","scrub_duration":0.0038185189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:42.321401+0000","last_change":"2023-10-16T23:28:42.321700+0000","last_active":"2023-10-16T23:28:42.321401+0000","last_peered":"2023-10-16T23:28:42.321401+0000","last_clean":"2023-10-16T23:28:42.321401+0000","last_became_active":"2023-10-16T23:27:36.280600+0000","last_became_peered":"2023-10-16T23:27:36.280600+0000","last_unstale":"2023-10-16T23:28:42.321401+0000","last_undegraded":"2023-10-16T23:28:42.321401+0000","last_fullsized":"2023-10-16T23:28:42.321401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:42.321354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:42.321354+0000","last_clean_scrub_stamp":"2023-10-16T23:28:42.321354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:38:37.718515+0000","scrub_duration":0.0039340479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:11.520288+0000","last_change":"2023-10-16T23:29:11.520558+0000","last_active":"2023-10-16T23:29:11.520288+0000","last_peered":"2023-10-16T23:29:11.520288+0000","last_clean":"2023-10-16T23:29:11.520288+0000","last_became_active":"2023-10-16T23:27:40.755830+0000","last_became_peered":"2023-10-16T23:27:40.755830+0000","last_unstale":"2023-10-16T23:29:11.520288+0000","last_undegraded":"2023-10-16T23:29:11.520288+0000","last_fullsized":"2023-10-16T23:29:11.520288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:11.520239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:11.520239+0000","last_clean_scrub_stamp":"2023-10-16T23:29:11.520239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:49:36.410127+0000","scrub_duration":0.0034573680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:48.589147+0000","last_change":"2023-10-16T23:28:48.589394+0000","last_active":"2023-10-16T23:28:48.589147+0000","last_peered":"2023-10-16T23:28:48.589147+0000","last_clean":"2023-10-16T23:28:48.589147+0000","last_became_active":"2023-10-16T23:27:40.745143+0000","last_became_peered":"2023-10-16T23:27:40.745143+0000","last_unstale":"2023-10-16T23:28:48.589147+0000","last_undegraded":"2023-10-16T23:28:48.589147+0000","last_fullsized":"2023-10-16T23:28:48.589147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:48.589096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:48.589096+0000","last_clean_scrub_stamp":"2023-10-16T23:28:48.589096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:39:33.669789+0000","scrub_duration":0.00331059,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"26'19","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:57.522277+0000","last_change":"2023-10-16T23:28:57.522537+0000","last_active":"2023-10-16T23:28:57.522277+0000","last_peered":"2023-10-16T23:28:57.522277+0000","last_clean":"2023-10-16T23:28:57.522277+0000","last_became_active":"2023-10-16T23:27:40.351687+0000","last_became_peered":"2023-10-16T23:27:40.351687+0000","last_unstale":"2023-10-16T23:28:57.522277+0000","last_undegraded":"2023-10-16T23:28:57.522277+0000","last_fullsized":"2023-10-16T23:28:57.522277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'19","last_scrub_stamp":"2023-10-16T23:28:57.522221+0000","last_deep_scrub":"26'19","last_deep_scrub_stamp":"2023-10-16T23:28:57.522221+0000","last_clean_scrub_stamp":"2023-10-16T23:28:57.522221+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:12:23.848118+0000","scrub_duration":0.014520379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4472,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:08.898043+0000","last_change":"2023-10-16T23:29:08.898342+0000","last_active":"2023-10-16T23:29:08.898043+0000","last_peered":"2023-10-16T23:29:08.898043+0000","last_clean":"2023-10-16T23:29:08.898043+0000","last_became_active":"2023-10-16T23:27:40.727288+0000","last_became_peered":"2023-10-16T23:27:40.727288+0000","last_unstale":"2023-10-16T23:29:08.898043+0000","last_undegraded":"2023-10-16T23:29:08.898043+0000","last_fullsized":"2023-10-16T23:29:08.898043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:08.897996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:08.897996+0000","last_clean_scrub_stamp":"2023-10-16T23:29:08.897996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:42:40.677946+0000","scrub_duration":0.0041386900000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"26'5","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:58.491424+0000","last_change":"2023-10-16T23:28:58.491742+0000","last_active":"2023-10-16T23:28:58.491424+0000","last_peered":"2023-10-16T23:28:58.491424+0000","last_clean":"2023-10-16T23:28:58.491424+0000","last_became_active":"2023-10-16T23:27:40.331517+0000","last_became_peered":"2023-10-16T23:27:40.331517+0000","last_unstale":"2023-10-16T23:28:58.491424+0000","last_undegraded":"2023-10-16T23:28:58.491424+0000","last_fullsized":"2023-10-16T23:28:58.491424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2023-10-16T23:28:58.491358+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2023-10-16T23:28:58.491358+0000","last_clean_scrub_stamp":"2023-10-16T23:28:58.491358+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:51:11.739497+0000","scrub_duration":0.010820824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:00.251873+0000","last_change":"2023-10-16T23:29:00.252151+0000","last_active":"2023-10-16T23:29:00.251873+0000","last_peered":"2023-10-16T23:29:00.251873+0000","last_clean":"2023-10-16T23:29:00.251873+0000","last_became_active":"2023-10-16T23:27:40.333012+0000","last_became_peered":"2023-10-16T23:27:40.333012+0000","last_unstale":"2023-10-16T23:29:00.251873+0000","last_undegraded":"2023-10-16T23:29:00.251873+0000","last_fullsized":"2023-10-16T23:29:00.251873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:00.251827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:00.251827+0000","last_clean_scrub_stamp":"2023-10-16T23:29:00.251827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:14.889398+0000","scrub_duration":0.0029792669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:15.178193+0000","last_change":"2023-10-16T23:29:15.178447+0000","last_active":"2023-10-16T23:29:15.178193+0000","last_peered":"2023-10-16T23:29:15.178193+0000","last_clean":"2023-10-16T23:29:15.178193+0000","last_became_active":"2023-10-16T23:27:40.760680+0000","last_became_peered":"2023-10-16T23:27:40.760680+0000","last_unstale":"2023-10-16T23:29:15.178193+0000","last_undegraded":"2023-10-16T23:29:15.178193+0000","last_fullsized":"2023-10-16T23:29:15.178193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:15.178139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:15.178139+0000","last_clean_scrub_stamp":"2023-10-16T23:29:15.178139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:10:40.347181+0000","scrub_duration":0.0036559560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:48.540009+0000","last_change":"2023-10-16T23:28:48.540264+0000","last_active":"2023-10-16T23:28:48.540009+0000","last_peered":"2023-10-16T23:28:48.540009+0000","last_clean":"2023-10-16T23:28:48.540009+0000","last_became_active":"2023-10-16T23:27:40.338706+0000","last_became_peered":"2023-10-16T23:27:40.338706+0000","last_unstale":"2023-10-16T23:28:48.540009+0000","last_undegraded":"2023-10-16T23:28:48.540009+0000","last_fullsized":"2023-10-16T23:28:48.540009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:48.539954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:48.539954+0000","last_clean_scrub_stamp":"2023-10-16T23:28:48.539954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:45.324079+0000","scrub_duration":0.0038093760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:18.207342+0000","last_change":"2023-10-16T23:29:18.207605+0000","last_active":"2023-10-16T23:29:18.207342+0000","last_peered":"2023-10-16T23:29:18.207342+0000","last_clean":"2023-10-16T23:29:18.207342+0000","last_became_active":"2023-10-16T23:27:40.712756+0000","last_became_peered":"2023-10-16T23:27:40.712756+0000","last_unstale":"2023-10-16T23:29:18.207342+0000","last_undegraded":"2023-10-16T23:29:18.207342+0000","last_fullsized":"2023-10-16T23:29:18.207342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:18.207292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:18.207292+0000","last_clean_scrub_stamp":"2023-10-16T23:29:18.207292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:36:37.438577+0000","scrub_duration":0.0033421290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:02.514985+0000","last_change":"2023-10-16T23:29:02.515267+0000","last_active":"2023-10-16T23:29:02.514985+0000","last_peered":"2023-10-16T23:29:02.514985+0000","last_clean":"2023-10-16T23:29:02.514985+0000","last_became_active":"2023-10-16T23:27:40.755714+0000","last_became_peered":"2023-10-16T23:27:40.755714+0000","last_unstale":"2023-10-16T23:29:02.514985+0000","last_undegraded":"2023-10-16T23:29:02.514985+0000","last_fullsized":"2023-10-16T23:29:02.514985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:02.514934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:02.514934+0000","last_clean_scrub_stamp":"2023-10-16T23:29:02.514934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:39:47.595627+0000","scrub_duration":0.003702679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:57.017486+0000","last_change":"2023-10-16T23:28:57.017752+0000","last_active":"2023-10-16T23:28:57.017486+0000","last_peered":"2023-10-16T23:28:57.017486+0000","last_clean":"2023-10-16T23:28:57.017486+0000","last_became_active":"2023-10-16T23:27:40.331428+0000","last_became_peered":"2023-10-16T23:27:40.331428+0000","last_unstale":"2023-10-16T23:28:57.017486+0000","last_undegraded":"2023-10-16T23:28:57.017486+0000","last_fullsized":"2023-10-16T23:28:57.017486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:57.017438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:57.017438+0000","last_clean_scrub_stamp":"2023-10-16T23:28:57.017438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:45.421142+0000","scrub_duration":0.0034634449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:13.350346+0000","last_change":"2023-10-16T23:29:13.350648+0000","last_active":"2023-10-16T23:29:13.350346+0000","last_peered":"2023-10-16T23:29:13.350346+0000","last_clean":"2023-10-16T23:29:13.350346+0000","last_became_active":"2023-10-16T23:27:40.760779+0000","last_became_peered":"2023-10-16T23:27:40.760779+0000","last_unstale":"2023-10-16T23:29:13.350346+0000","last_undegraded":"2023-10-16T23:29:13.350346+0000","last_fullsized":"2023-10-16T23:29:13.350346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:13.350294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:13.350294+0000","last_clean_scrub_stamp":"2023-10-16T23:29:13.350294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:04:56.833201+0000","scrub_duration":0.004336871,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:00.969242+0000","last_change":"2023-10-16T23:29:00.969511+0000","last_active":"2023-10-16T23:29:00.969242+0000","last_peered":"2023-10-16T23:29:00.969242+0000","last_clean":"2023-10-16T23:29:00.969242+0000","last_became_active":"2023-10-16T23:27:40.317622+0000","last_became_peered":"2023-10-16T23:27:40.317622+0000","last_unstale":"2023-10-16T23:29:00.969242+0000","last_undegraded":"2023-10-16T23:29:00.969242+0000","last_fullsized":"2023-10-16T23:29:00.969242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:00.969194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:00.969194+0000","last_clean_scrub_stamp":"2023-10-16T23:29:00.969194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:49.372898+0000","scrub_duration":0.0033320379999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:14.223546+0000","last_change":"2023-10-16T23:29:14.223876+0000","last_active":"2023-10-16T23:29:14.223546+0000","last_peered":"2023-10-16T23:29:14.223546+0000","last_clean":"2023-10-16T23:29:14.223546+0000","last_became_active":"2023-10-16T23:27:40.705956+0000","last_became_peered":"2023-10-16T23:27:40.705956+0000","last_unstale":"2023-10-16T23:29:14.223546+0000","last_undegraded":"2023-10-16T23:29:14.223546+0000","last_fullsized":"2023-10-16T23:29:14.223546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:14.223496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:14.223496+0000","last_clean_scrub_stamp":"2023-10-16T23:29:14.223496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:04:57.706402+0000","scrub_duration":0.0037136740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:02.432748+0000","last_change":"2023-10-16T23:29:02.433013+0000","last_active":"2023-10-16T23:29:02.432748+0000","last_peered":"2023-10-16T23:29:02.432748+0000","last_clean":"2023-10-16T23:29:02.432748+0000","last_became_active":"2023-10-16T23:27:40.344158+0000","last_became_peered":"2023-10-16T23:27:40.344158+0000","last_unstale":"2023-10-16T23:29:02.432748+0000","last_undegraded":"2023-10-16T23:29:02.432748+0000","last_fullsized":"2023-10-16T23:29:02.432748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-10-16T23:29:02.432697+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-10-16T23:29:02.432697+0000","last_clean_scrub_stamp":"2023-10-16T23:29:02.432697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:42:34.212647+0000","scrub_duration":0.0038963000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:50.412806+0000","last_change":"2023-10-16T23:28:50.413057+0000","last_active":"2023-10-16T23:28:50.412806+0000","last_peered":"2023-10-16T23:28:50.412806+0000","last_clean":"2023-10-16T23:28:50.412806+0000","last_became_active":"2023-10-16T23:27:40.712632+0000","last_became_peered":"2023-10-16T23:27:40.712632+0000","last_unstale":"2023-10-16T23:28:50.412806+0000","last_undegraded":"2023-10-16T23:28:50.412806+0000","last_fullsized":"2023-10-16T23:28:50.412806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:50.412753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:50.412753+0000","last_clean_scrub_stamp":"2023-10-16T23:28:50.412753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:13.627037+0000","scrub_duration":0.003558257,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:40.596739+0000","last_change":"2023-10-16T23:28:40.596984+0000","last_active":"2023-10-16T23:28:40.596739+0000","last_peered":"2023-10-16T23:28:40.596739+0000","last_clean":"2023-10-16T23:28:40.596739+0000","last_became_active":"2023-10-16T23:27:40.356809+0000","last_became_peered":"2023-10-16T23:27:40.356809+0000","last_unstale":"2023-10-16T23:28:40.596739+0000","last_undegraded":"2023-10-16T23:28:40.596739+0000","last_fullsized":"2023-10-16T23:28:40.596739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-10-16T23:28:40.596681+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-10-16T23:28:40.596681+0000","last_clean_scrub_stamp":"2023-10-16T23:28:40.596681+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:45:06.830528+0000","scrub_duration":0.0040939920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:23.435247+0000","last_change":"2023-10-16T23:27:40.726018+0000","last_active":"2023-10-16T23:28:23.435247+0000","last_peered":"2023-10-16T23:28:23.435247+0000","last_clean":"2023-10-16T23:28:23.435247+0000","last_became_active":"2023-10-16T23:27:40.724910+0000","last_became_peered":"2023-10-16T23:27:40.724910+0000","last_unstale":"2023-10-16T23:28:23.435247+0000","last_undegraded":"2023-10-16T23:28:23.435247+0000","last_fullsized":"2023-10-16T23:28:23.435247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:27:40.287248+0000","last_clean_scrub_stamp":"2023-10-16T23:27:40.287248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:01.278714+0000","last_change":"2023-10-16T23:29:01.278983+0000","last_active":"2023-10-16T23:29:01.278714+0000","last_peered":"2023-10-16T23:29:01.278714+0000","last_clean":"2023-10-16T23:29:01.278714+0000","last_became_active":"2023-10-16T23:27:40.344531+0000","last_became_peered":"2023-10-16T23:27:40.344531+0000","last_unstale":"2023-10-16T23:29:01.278714+0000","last_undegraded":"2023-10-16T23:29:01.278714+0000","last_fullsized":"2023-10-16T23:29:01.278714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2023-10-16T23:29:01.278657+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2023-10-16T23:29:01.278657+0000","last_clean_scrub_stamp":"2023-10-16T23:29:01.278657+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:51:38.750967+0000","scrub_duration":0.0085448030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:17.659966+0000","last_change":"2023-10-16T23:29:17.660277+0000","last_active":"2023-10-16T23:29:17.659966+0000","last_peered":"2023-10-16T23:29:17.659966+0000","last_clean":"2023-10-16T23:29:17.659966+0000","last_became_active":"2023-10-16T23:27:40.719758+0000","last_became_peered":"2023-10-16T23:27:40.719758+0000","last_unstale":"2023-10-16T23:29:17.659966+0000","last_undegraded":"2023-10-16T23:29:17.659966+0000","last_fullsized":"2023-10-16T23:29:17.659966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:17.659916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:17.659916+0000","last_clean_scrub_stamp":"2023-10-16T23:29:17.659916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:11:05.041471+0000","scrub_duration":0.0041757160000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:06.198247+0000","last_change":"2023-10-16T23:29:06.198508+0000","last_active":"2023-10-16T23:29:06.198247+0000","last_peered":"2023-10-16T23:29:06.198247+0000","last_clean":"2023-10-16T23:29:06.198247+0000","last_became_active":"2023-10-16T23:27:40.344589+0000","last_became_peered":"2023-10-16T23:27:40.344589+0000","last_unstale":"2023-10-16T23:29:06.198247+0000","last_undegraded":"2023-10-16T23:29:06.198247+0000","last_fullsized":"2023-10-16T23:29:06.198247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2023-10-16T23:29:06.198193+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2023-10-16T23:29:06.198193+0000","last_clean_scrub_stamp":"2023-10-16T23:29:06.198193+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:42:37.978143+0000","scrub_duration":0.0065836169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:12.277801+0000","last_change":"2023-10-16T23:29:12.278045+0000","last_active":"2023-10-16T23:29:12.277801+0000","last_peered":"2023-10-16T23:29:12.277801+0000","last_clean":"2023-10-16T23:29:12.277801+0000","last_became_active":"2023-10-16T23:27:40.705936+0000","last_became_peered":"2023-10-16T23:27:40.705936+0000","last_unstale":"2023-10-16T23:29:12.277801+0000","last_undegraded":"2023-10-16T23:29:12.277801+0000","last_fullsized":"2023-10-16T23:29:12.277801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:12.277747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:12.277747+0000","last_clean_scrub_stamp":"2023-10-16T23:29:12.277747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:51:50.411382+0000","scrub_duration":0.0031714410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:00.139419+0000","last_change":"2023-10-16T23:29:00.139719+0000","last_active":"2023-10-16T23:29:00.139419+0000","last_peered":"2023-10-16T23:29:00.139419+0000","last_clean":"2023-10-16T23:29:00.139419+0000","last_became_active":"2023-10-16T23:27:40.323352+0000","last_became_peered":"2023-10-16T23:27:40.323352+0000","last_unstale":"2023-10-16T23:29:00.139419+0000","last_undegraded":"2023-10-16T23:29:00.139419+0000","last_fullsized":"2023-10-16T23:29:00.139419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-10-16T23:29:00.139362+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-10-16T23:29:00.139362+0000","last_clean_scrub_stamp":"2023-10-16T23:29:00.139362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:12:26.465259+0000","scrub_duration":0.0029808759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:09.490698+0000","last_change":"2023-10-16T23:29:09.490994+0000","last_active":"2023-10-16T23:29:09.490698+0000","last_peered":"2023-10-16T23:29:09.490698+0000","last_clean":"2023-10-16T23:29:09.490698+0000","last_became_active":"2023-10-16T23:27:40.748525+0000","last_became_peered":"2023-10-16T23:27:40.748525+0000","last_unstale":"2023-10-16T23:29:09.490698+0000","last_undegraded":"2023-10-16T23:29:09.490698+0000","last_fullsized":"2023-10-16T23:29:09.490698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:09.490647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:09.490647+0000","last_clean_scrub_stamp":"2023-10-16T23:29:09.490647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:29.180267+0000","scrub_duration":0.0033377290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"26'6","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:56.488704+0000","last_change":"2023-10-16T23:28:56.489024+0000","last_active":"2023-10-16T23:28:56.488704+0000","last_peered":"2023-10-16T23:28:56.488704+0000","last_clean":"2023-10-16T23:28:56.488704+0000","last_became_active":"2023-10-16T23:27:40.338565+0000","last_became_peered":"2023-10-16T23:27:40.338565+0000","last_unstale":"2023-10-16T23:28:56.488704+0000","last_undegraded":"2023-10-16T23:28:56.488704+0000","last_fullsized":"2023-10-16T23:28:56.488704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2023-10-16T23:28:56.488647+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2023-10-16T23:28:56.488647+0000","last_clean_scrub_stamp":"2023-10-16T23:28:56.488647+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:44.892351+0000","scrub_duration":0.008659211,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5270,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":10540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71,"ondisk_log_size":71,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509469,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":103608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:29:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78600000000000003,"15min":0.78700000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1060000000000001,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.85699999999999998,"15min":0.84699999999999998},"min":{"1min":0.70199999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.087,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.90700000000000003}]},{"osd":1,"last update":"Mon Oct 16 23:29:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.876,"15min":0.873},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":1.032},{"interface":"front","average":{"1min":1.014,"5min":1.02,"15min":1.0209999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.246,"5min":1.456,"15min":1.456},"last":0.69799999999999995}]},{"osd":2,"last update":"Mon Oct 16 23:29:28 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.94299999999999995,"15min":0.94899999999999995},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.012,"15min":1.0149999999999999},"min":{"1min":0.68899999999999995,"5min":0.63,"15min":0.63},"max":{"1min":1.21,"5min":2.056,"15min":2.056},"last":1.159}]},{"osd":3,"last update":"Mon Oct 16 23:29:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.99199999999999999,"15min":0.99399999999999999},"min":{"1min":0.78400000000000003,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.875},{"interface":"front","average":{"1min":1.054,"5min":1.0820000000000001,"15min":1.087},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.83399999999999996}]},{"osd":4,"last update":"Mon Oct 16 23:29:28 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":1.0649999999999999,"15min":1.091},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2569999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.1970000000000001,"15min":1.22},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.327,"5min":1.516,"15min":1.516},"last":1.004}]},{"osd":5,"last update":"Mon Oct 16 23:29:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":1.163,"15min":1.1930000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.369,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":1.224},{"interface":"front","average":{"1min":1.095,"5min":1.22,"15min":1.2410000000000001},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.3169999999999999,"5min":1.659,"15min":1.659},"last":1.083}]},{"osd":7,"last update":"Mon Oct 16 23:29:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.2509999999999999,"15min":1.2689999999999999},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.377,"5min":1.544,"15min":1.544},"last":1.123},{"interface":"front","average":{"1min":1.105,"5min":1.2569999999999999,"15min":1.2829999999999999},"min":{"1min":0.878,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.5269999999999999,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":1.272}]}]},{"osd":5,"up_from":15,"seq":64424509469,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":278528,"data_stored":104260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83199999999999996,"15min":0.83099999999999996},"min":{"1min":0.64000000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.109,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.91300000000000003,"15min":0.90900000000000003},"min":{"1min":0.62,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3180000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.85999999999999999}]},{"osd":1,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.97299999999999998,"15min":0.97899999999999998},"min":{"1min":0.64700000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.2190000000000001,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.23},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.92200000000000004,"15min":0.92000000000000004},"min":{"1min":0.66700000000000004,"5min":0.622,"15min":0.622},"max":{"1min":1.1890000000000001,"5min":1.649,"15min":1.649},"last":0.71799999999999997}]},{"osd":2,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.97499999999999998,"15min":0.97699999999999998},"min":{"1min":0.65600000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2470000000000001,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1.012,"15min":1.024},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.23,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.1439999999999999}]},{"osd":3,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.004,"15min":1.0109999999999999},"min":{"1min":0.626,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.3440000000000001,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.004},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.111,"15min":1.123},"min":{"1min":0.83099999999999996,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.3200000000000001,"5min":2.5129999999999999,"15min":2.5129999999999999},"last":0.91100000000000003}]},{"osd":4,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":1.0980000000000001,"15min":1.1259999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.3140000000000001,"5min":3.0640000000000001,"15min":3.0640000000000001},"last":1.048},{"interface":"front","average":{"1min":1.006,"5min":1.1559999999999999,"15min":1.181},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.385,"5min":3.1669999999999998,"15min":3.1669999999999998},"last":1.1120000000000001}]},{"osd":6,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.1919999999999999,"15min":1.2190000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.4199999999999999,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.1819999999999999,"15min":1.208},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.3560000000000001,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":1.256}]},{"osd":7,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.2470000000000001,"15min":1.2709999999999999},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.3959999999999999,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.157,"5min":1.3069999999999999,"15min":1.3320000000000001},"min":{"1min":0.78000000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.363,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":1.1910000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509471,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":108136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.56599999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1839999999999999,"5min":1.319,"15min":1.319},"last":1.038},{"interface":"front","average":{"1min":0.877,"5min":0.85299999999999998,"15min":0.84899999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.80000000000000004}]},{"osd":1,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.90200000000000002,"15min":0.90000000000000002},"min":{"1min":0.68899999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.872},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.877,"15min":0.86799999999999999},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.91600000000000004}]},{"osd":2,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.89000000000000001,"15min":0.88100000000000001},"min":{"1min":0.65300000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.228,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.96099999999999997,"15min":0.96399999999999997},"min":{"1min":0.68799999999999994,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":1.121}]},{"osd":3,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.95799999999999996,"15min":0.96299999999999997},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.1950000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.014,"15min":1.012},"min":{"1min":0.67400000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3240000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.76800000000000002}]},{"osd":5,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.98499999999999999,"15min":0.98099999999999998},"min":{"1min":0.67100000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":1.2090000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.052,"15min":1.0620000000000001},"min":{"1min":0.64600000000000002,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4059999999999999,"5min":1.421,"15min":1.421},"last":1.0660000000000001}]},{"osd":6,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.097,"15min":1.105},"min":{"1min":0.69199999999999995,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.248,"5min":1.556,"15min":1.556},"last":1},{"interface":"front","average":{"1min":1.179,"5min":1.1930000000000001,"15min":1.1950000000000001},"min":{"1min":1.018,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":1.3520000000000001,"5min":1.399,"15min":1.399},"last":1.276}]},{"osd":7,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.175,"15min":1.1930000000000001},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.3100000000000001,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.139},{"interface":"front","average":{"1min":1.171,"5min":1.1970000000000001,"15min":1.2010000000000001},"min":{"1min":0.91300000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.393,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.2390000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509470,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":103698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:29:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.59299999999999997,"15min":0.57699999999999996},"min":{"1min":0.41799999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.64300000000000002,"15min":0.628},"min":{"1min":0.46899999999999997,"5min":0.315,"15min":0.315},"max":{"1min":1.0569999999999999,"5min":1.081,"15min":1.081},"last":0.90100000000000002}]},{"osd":1,"last update":"Mon Oct 16 23:29:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.624,"15min":0.61899999999999999},"min":{"1min":0.432,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.86599999999999999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":1.2709999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.72299999999999998,"15min":0.70799999999999996},"min":{"1min":0.45200000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0600000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.72999999999999998}]},{"osd":2,"last update":"Mon Oct 16 23:29:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.746,"15min":0.74099999999999999},"min":{"1min":0.46100000000000002,"5min":0.371,"15min":0.371},"max":{"1min":1.0760000000000001,"5min":1.131,"15min":1.131},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83299999999999996,"15min":0.83199999999999996},"min":{"1min":0.48399999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.147,"5min":1.859,"15min":1.859},"last":1.107}]},{"osd":4,"last update":"Mon Oct 16 23:29:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.91800000000000004,"15min":0.90800000000000003},"min":{"1min":0.66200000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2450000000000001,"5min":1.53,"15min":1.53},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.028,"5min":0.99199999999999999,"15min":0.98599999999999999},"min":{"1min":0.627,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.385,"5min":1.514,"15min":1.514},"last":1.0469999999999999}]},{"osd":5,"last update":"Mon Oct 16 23:29:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0069999999999999,"15min":1.008},"min":{"1min":0.81499999999999995,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3280000000000001,"5min":1.571,"15min":1.571},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.069,"15min":1.0740000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.323,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":0.999}]},{"osd":6,"last update":"Mon Oct 16 23:29:30 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0009999999999999,"15min":0.98299999999999998},"min":{"1min":0.85099999999999998,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.306,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.083},{"interface":"front","average":{"1min":1.101,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.71199999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.4350000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.163}]},{"osd":7,"last update":"Mon Oct 16 23:29:30 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.101,"15min":1.1020000000000001},"min":{"1min":0.82599999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.377,"5min":2.379,"15min":2.379},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.0589999999999999,"15min":1.052},"min":{"1min":0.73399999999999999,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3280000000000001,"5min":1.349,"15min":1.349},"last":1.23}]}]},{"osd":1,"up_from":15,"seq":64424509469,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":103608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.59199999999999997,"15min":0.58499999999999996},"min":{"1min":0.39400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.98899999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.63200000000000001,"15min":0.61799999999999999},"min":{"1min":0.30199999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":1.0049999999999999}]},{"osd":2,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.56899999999999995,"15min":0.55500000000000005},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81899999999999995,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.66700000000000004,"15min":0.65700000000000003},"min":{"1min":0.35399999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.95099999999999996,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.78400000000000003}]},{"osd":3,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.749,"15min":0.72699999999999998},"min":{"1min":0.39000000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.36499999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.72199999999999998}]},{"osd":4,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.92600000000000005,"15min":0.91800000000000004},"min":{"1min":0.75,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.264,"5min":1.371,"15min":1.371},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.89600000000000002,"15min":0.89400000000000002},"min":{"1min":0.60499999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.2809999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.91300000000000003}]},{"osd":5,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.97099999999999997,"15min":0.96799999999999997},"min":{"1min":0.79900000000000004,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3640000000000001,"5min":2.431,"15min":2.431},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0389999999999999,"15min":1.0349999999999999},"min":{"1min":0.626,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.4510000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.4510000000000001}]},{"osd":6,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":0.96699999999999997,"15min":0.95299999999999996},"min":{"1min":0.64700000000000002,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1930000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.008,"15min":1.0009999999999999},"min":{"1min":0.76700000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4139999999999999,"5min":2.222,"15min":2.222},"last":0.98299999999999998}]},{"osd":7,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.0580000000000001,"15min":1.0409999999999999},"min":{"1min":0.66900000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3939999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.034,"15min":1.0209999999999999},"min":{"1min":0.752,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.3440000000000001,"5min":1.716,"15min":1.716},"last":1.1379999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509471,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":868352,"data_stored":694558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 23:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46400000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.119,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0109999999999999,"5min":1.528,"15min":1.528},"last":0.59399999999999997}]},{"osd":2,"last update":"Mon Oct 16 23:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.89100000000000001,"5min":1.603,"15min":1.603},"last":0.747},{"interface":"front","average":{"1min":0.745,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0820000000000001,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.69799999999999995}]},{"osd":3,"last update":"Mon Oct 16 23:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.745,"15min":0.73499999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.94799999999999995,"15min":0.95199999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1930000000000001,"5min":1.635,"15min":1.635},"last":0.99099999999999999}]},{"osd":4,"last update":"Mon Oct 16 23:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.93700000000000006,"15min":0.94099999999999995},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.121,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.046,"15min":1.0669999999999999},"min":{"1min":0.67300000000000004,"5min":0.626,"15min":0.626},"max":{"1min":1.1850000000000001,"5min":1.694,"15min":1.694},"last":0.90900000000000003}]},{"osd":5,"last update":"Mon Oct 16 23:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0229999999999999,"15min":1.026},"min":{"1min":0.755,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.25,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.879},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97899999999999998,"15min":0.97999999999999998},"min":{"1min":0.57799999999999996,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2929999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.149}]},{"osd":6,"last update":"Mon Oct 16 23:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.109,"15min":1.1240000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.228,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0940000000000001,"15min":1.1040000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2929999999999999,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.109}]},{"osd":7,"last update":"Mon Oct 16 23:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.107,"15min":1.113},"min":{"1min":0.81200000000000006,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.26,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.026},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.046,"15min":1.046},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3520000000000001,"5min":1.881,"15min":1.881},"last":1.05}]}]},{"osd":7,"up_from":14,"seq":60129542174,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":698664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.88300000000000001,"15min":0.88900000000000001},"min":{"1min":0.60499999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2030000000000001,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.89600000000000002,"15min":0.90100000000000002},"min":{"1min":0.60499999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.0409999999999999,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.85999999999999999}]},{"osd":1,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.95699999999999996,"15min":0.95499999999999996},"min":{"1min":0.67900000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.21,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":0.88},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.96199999999999997,"15min":0.95799999999999996},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.329,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.77500000000000002}]},{"osd":2,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.95499999999999996,"15min":0.95799999999999996},"min":{"1min":0.746,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.165,"5min":1.333,"15min":1.333},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.01,"5min":0.98099999999999998,"15min":0.97599999999999998},"min":{"1min":0.76300000000000001,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.1799999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.75}]},{"osd":3,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.028,"15min":1.0389999999999999},"min":{"1min":0.80300000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.165,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.014,"15min":1.022},"min":{"1min":0.71199999999999997,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.238,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.94399999999999995}]},{"osd":4,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":1.0600000000000001,"15min":1.0800000000000001},"min":{"1min":0.69399999999999995,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.242,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.169,"15min":1.1890000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.427,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.1319999999999999}]},{"osd":5,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.052,"15min":1.0660000000000001},"min":{"1min":0.63500000000000001,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.216,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.2050000000000001,"15min":1.2230000000000001},"min":{"1min":0.72699999999999998,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.3720000000000001,"5min":2.165,"15min":2.165},"last":0.82299999999999995}]},{"osd":6,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.1819999999999999,"15min":1.204},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.29,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.2909999999999999,"15min":1.3100000000000001},"min":{"1min":0.83999999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.5289999999999999,"5min":2.742,"15min":2.742},"last":0.93200000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542174,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":270336,"data_stored":103608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.48599999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.84999999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.53000000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.86599999999999999}]},{"osd":1,"last update":"Mon Oct 16 23:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.75600000000000001,"15min":0.73699999999999999},"min":{"1min":0.68300000000000005,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.70099999999999996,"15min":0.69199999999999995},"min":{"1min":0.55800000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93600000000000005,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.82499999999999996}]},{"osd":3,"last update":"Mon Oct 16 23:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.77500000000000002,"15min":0.76100000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.139,"5min":1.145,"15min":1.145},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.69699999999999995,"15min":0.67700000000000005},"min":{"1min":0.38400000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.95899999999999996}]},{"osd":4,"last update":"Mon Oct 16 23:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.84799999999999998,"15min":0.83199999999999996},"min":{"1min":0.75,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1399999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.90200000000000002,"15min":0.88900000000000001},"min":{"1min":0.63100000000000001,"5min":0.621,"15min":0.621},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.90300000000000002}]},{"osd":5,"last update":"Mon Oct 16 23:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.95799999999999996,"15min":0.93999999999999995},"min":{"1min":0.75600000000000001,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.92300000000000004,"15min":0.91300000000000003},"min":{"1min":0.76400000000000001,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2070000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.1859999999999999}]},{"osd":6,"last update":"Mon Oct 16 23:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":0.98399999999999999,"15min":0.97599999999999998},"min":{"1min":0.74299999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.04,"15min":1.024},"min":{"1min":0.77300000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":1.288}]},{"osd":7,"last update":"Mon Oct 16 23:29:28 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.01,"15min":0.996},"min":{"1min":0.85199999999999998,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.0660000000000001,"15min":1.0509999999999999},"min":{"1min":0.88800000000000001,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3400000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.2210000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T23:29:41.197 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:41.198 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-10-16T23:27:40.287248+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=27, tm_sec=40, tm_wday=0, tm_yday=289, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=16, tm_hour=23, tm_min=28, tm_sec=34, tm_wday=0, tm_yday=289, tm_isdst=0) 2023-10-16T23:29:41.199 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-16T23:30:01.200 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T23:30:01.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.331+0000 7f2ca075e640 1 Processor -- start 2023-10-16T23:30:01.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.331+0000 7f2ca075e640 1 -- start start 2023-10-16T23:30:01.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.331+0000 7f2ca075e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2c9806e770 0x7f2c980c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:01.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.331+0000 7f2ca075e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2c980bfc30 0x7f2c98153150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:01.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.331+0000 7f2ca075e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c980c01e0 con 0x7f2c980c1950 2023-10-16T23:30:01.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.331+0000 7f2ca075e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c980b85b0 con 0x7f2c9806e770 2023-10-16T23:30:01.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.331+0000 7f2ca075e640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c980b8120 con 0x7f2c980bfc30 2023-10-16T23:30:01.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.331+0000 7f2c9e4fa640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2c980c1950 0x7f2c98152a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45370/0 (socket says 172.21.15.12:45370) 2023-10-16T23:30:01.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.331+0000 7f2c9e4fa640 1 -- 172.21.15.12:0/3874124932 learned_addr learned my addr 172.21.15.12:0/3874124932 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:30:01.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.331+0000 7f2c9dcf9640 1 --2- 172.21.15.12:0/3874124932 >> v2:172.21.15.12:3300/0 conn(0x7f2c9806e770 0x7f2c980c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:01.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.331+0000 7f2c9ecfb640 1 --2- 172.21.15.12:0/3874124932 >> v2:172.21.15.31:3300/0 conn(0x7f2c980bfc30 0x7f2c98153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:01.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.331+0000 7f2c9dcf9640 1 -- 172.21.15.12:0/3874124932 >> v2:172.21.15.31:3300/0 conn(0x7f2c980bfc30 msgr2=0x7f2c98153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:30:01.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.331+0000 7f2c9dcf9640 1 --2- 172.21.15.12:0/3874124932 >> v2:172.21.15.31:3300/0 conn(0x7f2c980bfc30 0x7f2c98153150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:01.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.331+0000 7f2c9dcf9640 1 -- 172.21.15.12:0/3874124932 >> v1:172.21.15.12:6789/0 conn(0x7f2c980c1950 legacy=0x7f2c98152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:01.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.331+0000 7f2c9dcf9640 1 -- 172.21.15.12:0/3874124932 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c980b7db0 con 0x7f2c9806e770 2023-10-16T23:30:01.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.331+0000 7f2c9d4f8640 1 -- 172.21.15.12:0/3874124932 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3714680505 0 0) 0x7f2c980c01e0 con 0x7f2c980c1950 2023-10-16T23:30:01.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.335+0000 7f2c9dcf9640 1 --2- 172.21.15.12:0/3874124932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c9806e770 0x7f2c980c1d30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2c980c2480 tx=0x7f2c8801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47201b897d60a1cd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:01.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.335+0000 7f2c9d4f8640 1 -- 172.21.15.12:0/3874124932 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c880ab5f0 con 0x7f2c9806e770 2023-10-16T23:30:01.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.335+0000 7f2c9d4f8640 1 -- 172.21.15.12:0/3874124932 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c880ab750 con 0x7f2c9806e770 2023-10-16T23:30:01.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.335+0000 7f2c9d4f8640 1 -- 172.21.15.12:0/3874124932 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c880abae0 con 0x7f2c9806e770 2023-10-16T23:30:01.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.335+0000 7f2ca075e640 1 -- 172.21.15.12:0/3874124932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c9806e770 msgr2=0x7f2c980c1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:01.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.335+0000 7f2ca075e640 1 --2- 172.21.15.12:0/3874124932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c9806e770 0x7f2c980c1d30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2c980c2480 tx=0x7f2c8801c3d0 comp rx=0 tx=0).stop 2023-10-16T23:30:01.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.335+0000 7f2ca075e640 1 -- 172.21.15.12:0/3874124932 shutdown_connections 2023-10-16T23:30:01.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.335+0000 7f2ca075e640 1 --2- 172.21.15.12:0/3874124932 >> v2:172.21.15.31:3300/0 conn(0x7f2c980bfc30 0x7f2c98153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:01.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.335+0000 7f2ca075e640 1 --2- 172.21.15.12:0/3874124932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c9806e770 0x7f2c980c1d30 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:01.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.335+0000 7f2ca075e640 1 -- 172.21.15.12:0/3874124932 >> 172.21.15.12:0/3874124932 conn(0x7f2c9806b5d0 msgr2=0x7f2c9806b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:30:01.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.335+0000 7f2ca075e640 1 -- 172.21.15.12:0/3874124932 shutdown_connections 2023-10-16T23:30:01.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.335+0000 7f2ca075e640 1 -- 172.21.15.12:0/3874124932 wait complete. 2023-10-16T23:30:01.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.335+0000 7f2ca075e640 1 Processor -- start 2023-10-16T23:30:01.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.335+0000 7f2ca075e640 1 -- start start 2023-10-16T23:30:01.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.335+0000 7f2ca075e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c9806e770 0x7f2c98145300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:01.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.335+0000 7f2ca075e640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c980bfc30 0x7f2c98138d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:01.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.335+0000 7f2ca075e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c980c1950 0x7f2c981486b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:01.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.335+0000 7f2ca075e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c98139880 con 0x7f2c980c1950 2023-10-16T23:30:01.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.335+0000 7f2ca075e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c98142680 con 0x7f2c9806e770 2023-10-16T23:30:01.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.335+0000 7f2ca075e640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c981eb1b0 con 0x7f2c980bfc30 2023-10-16T23:30:01.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.335+0000 7f2c9ecfb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c980c1950 0x7f2c981486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:01.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.335+0000 7f2c9ecfb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c980c1950 0x7f2c981486b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42932/0 (socket says 172.21.15.12:42932) 2023-10-16T23:30:01.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.335+0000 7f2c9ecfb640 1 -- 172.21.15.12:0/811718835 learned_addr learned my addr 172.21.15.12:0/811718835 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:30:01.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.339+0000 7f2c9dcf9640 1 --2- 172.21.15.12:0/811718835 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c980bfc30 0x7f2c98138d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:01.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.339+0000 7f2c9e4fa640 1 --2- 172.21.15.12:0/811718835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c9806e770 0x7f2c98145300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:01.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.339+0000 7f2c9ecfb640 1 -- 172.21.15.12:0/811718835 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c980bfc30 msgr2=0x7f2c98138d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:01.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.339+0000 7f2c9ecfb640 1 --2- 172.21.15.12:0/811718835 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c980bfc30 0x7f2c98138d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:01.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.339+0000 7f2c9ecfb640 1 -- 172.21.15.12:0/811718835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c9806e770 msgr2=0x7f2c98145300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:01.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.339+0000 7f2c9ecfb640 1 --2- 172.21.15.12:0/811718835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c9806e770 0x7f2c98145300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:01.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.339+0000 7f2c9ecfb640 1 -- 172.21.15.12:0/811718835 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c88009420 con 0x7f2c980c1950 2023-10-16T23:30:01.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.339+0000 7f2c9e4fa640 1 --2- 172.21.15.12:0/811718835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c9806e770 0x7f2c98145300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:30:01.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.339+0000 7f2c9ecfb640 1 --2- 172.21.15.12:0/811718835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c980c1950 0x7f2c981486b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2c90007e40 tx=0x7f2c9000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:01.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.339+0000 7f2c8effd640 1 -- 172.21.15.12:0/811718835 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c90014620 con 0x7f2c980c1950 2023-10-16T23:30:01.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.339+0000 7f2c8effd640 1 -- 172.21.15.12:0/811718835 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9000ee90 con 0x7f2c980c1950 2023-10-16T23:30:01.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.339+0000 7f2ca075e640 1 -- 172.21.15.12:0/811718835 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c981395a0 con 0x7f2c980c1950 2023-10-16T23:30:01.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.339+0000 7f2c8effd640 1 -- 172.21.15.12:0/811718835 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c900149e0 con 0x7f2c980c1950 2023-10-16T23:30:01.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.339+0000 7f2ca075e640 1 -- 172.21.15.12:0/811718835 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c981511b0 con 0x7f2c980c1950 2023-10-16T23:30:01.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.339+0000 7f2ca075e640 1 -- 172.21.15.12:0/811718835 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c981eb360 con 0x7f2c980c1950 2023-10-16T23:30:01.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.339+0000 7f2c8effd640 1 -- 172.21.15.12:0/811718835 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f2c90014b40 con 0x7f2c980c1950 2023-10-16T23:30:01.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.339+0000 7f2c8effd640 1 --2- 172.21.15.12:0/811718835 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2c7c065e90 0x7f2c7c068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:01.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.339+0000 7f2c8effd640 1 -- 172.21.15.12:0/811718835 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2c90084250 con 0x7f2c980c1950 2023-10-16T23:30:01.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.339+0000 7f2c9e4fa640 1 --2- 172.21.15.12:0/811718835 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2c7c065e90 0x7f2c7c068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:01.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.339+0000 7f2c9e4fa640 1 --2- 172.21.15.12:0/811718835 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2c7c065e90 0x7f2c7c068350 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2c94000f70 tx=0x7f2c94009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:01.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.343+0000 7f2c8effd640 1 -- 172.21.15.12:0/811718835 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f2c981eb360 con 0x7f2c980c1950 2023-10-16T23:30:01.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.495+0000 7f2ca075e640 1 -- 172.21.15.12:0/811718835 --> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2c981eb360 con 0x7f2c7c065e90 2023-10-16T23:30:01.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.519+0000 7f2c8effd640 1 -- 172.21.15.12:0/811718835 <== mgr.4108 v2:172.21.15.31:6832/37949 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311675 (secure 0 0 0) 0x7f2c981eb360 con 0x7f2c7c065e90 2023-10-16T23:30:01.528 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:30:01.530 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-16T23:30:01.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.523+0000 7f2ca075e640 1 -- 172.21.15.12:0/811718835 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2c7c065e90 msgr2=0x7f2c7c068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:01.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.523+0000 7f2ca075e640 1 --2- 172.21.15.12:0/811718835 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2c7c065e90 0x7f2c7c068350 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2c94000f70 tx=0x7f2c94009040 comp rx=0 tx=0).stop 2023-10-16T23:30:01.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.523+0000 7f2ca075e640 1 -- 172.21.15.12:0/811718835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c980c1950 msgr2=0x7f2c981486b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:01.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.523+0000 7f2ca075e640 1 --2- 172.21.15.12:0/811718835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c980c1950 0x7f2c981486b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2c90007e40 tx=0x7f2c9000e4b0 comp rx=0 tx=0).stop 2023-10-16T23:30:01.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.523+0000 7f2ca075e640 1 -- 172.21.15.12:0/811718835 shutdown_connections 2023-10-16T23:30:01.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.523+0000 7f2ca075e640 1 --2- 172.21.15.12:0/811718835 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2c7c065e90 0x7f2c7c068350 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:01.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.523+0000 7f2ca075e640 1 --2- 172.21.15.12:0/811718835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c980c1950 0x7f2c981486b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:01.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.523+0000 7f2ca075e640 1 --2- 172.21.15.12:0/811718835 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2c980bfc30 0x7f2c98138d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:01.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.523+0000 7f2ca075e640 1 --2- 172.21.15.12:0/811718835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c9806e770 0x7f2c98145300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:01.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.523+0000 7f2ca075e640 1 -- 172.21.15.12:0/811718835 >> 172.21.15.12:0/811718835 conn(0x7f2c9806b5d0 msgr2=0x7f2c98150940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:30:01.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.523+0000 7f2ca075e640 1 -- 172.21.15.12:0/811718835 shutdown_connections 2023-10-16T23:30:01.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.523+0000 7f2ca075e640 1 -- 172.21.15.12:0/811718835 wait complete. 2023-10-16T23:30:01.546 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2023-10-16T23:30:01.337463+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595638,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":217,"num_write_kb":2441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190,"ondisk_log_size":190,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223048,"kb_used_data":3336,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751672,"statfs":{"total":773094113280,"available":772865712128,"internally_reserved":0,"allocated":3416064,"data_stored":2020140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004461"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:46.348111+0000","last_change":"2023-10-16T23:28:46.348111+0000","last_active":"2023-10-16T23:28:46.348111+0000","last_peered":"2023-10-16T23:28:46.348111+0000","last_clean":"2023-10-16T23:28:46.348111+0000","last_became_active":"2023-10-16T23:27:40.706320+0000","last_became_peered":"2023-10-16T23:27:40.706320+0000","last_unstale":"2023-10-16T23:28:46.348111+0000","last_undegraded":"2023-10-16T23:28:46.348111+0000","last_fullsized":"2023-10-16T23:28:46.348111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:46.347775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:46.347775+0000","last_clean_scrub_stamp":"2023-10-16T23:28:46.347775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:47.920970+0000","scrub_duration":0.0035569769999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:19.350538+0000","last_change":"2023-10-16T23:29:19.350538+0000","last_active":"2023-10-16T23:29:19.350538+0000","last_peered":"2023-10-16T23:29:19.350538+0000","last_clean":"2023-10-16T23:29:19.350538+0000","last_became_active":"2023-10-16T23:27:40.754736+0000","last_became_peered":"2023-10-16T23:27:40.754736+0000","last_unstale":"2023-10-16T23:29:19.350538+0000","last_undegraded":"2023-10-16T23:29:19.350538+0000","last_fullsized":"2023-10-16T23:29:19.350538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:19.350174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:19.350174+0000","last_clean_scrub_stamp":"2023-10-16T23:29:19.350174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:23:06.801488+0000","scrub_duration":0.0041567469999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:34.645738+0000","last_change":"2023-10-16T23:29:34.645738+0000","last_active":"2023-10-16T23:29:34.645738+0000","last_peered":"2023-10-16T23:29:34.645738+0000","last_clean":"2023-10-16T23:29:34.645738+0000","last_became_active":"2023-10-16T23:27:40.725731+0000","last_became_peered":"2023-10-16T23:27:40.725731+0000","last_unstale":"2023-10-16T23:29:34.645738+0000","last_undegraded":"2023-10-16T23:29:34.645738+0000","last_fullsized":"2023-10-16T23:29:34.645738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:34.645439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:34.645439+0000","last_clean_scrub_stamp":"2023-10-16T23:29:34.645439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:29:20.119576+0000","scrub_duration":0.0039052679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:50.441396+0000","last_change":"2023-10-16T23:28:50.441396+0000","last_active":"2023-10-16T23:28:50.441396+0000","last_peered":"2023-10-16T23:28:50.441396+0000","last_clean":"2023-10-16T23:28:50.441396+0000","last_became_active":"2023-10-16T23:27:40.714592+0000","last_became_peered":"2023-10-16T23:27:40.714592+0000","last_unstale":"2023-10-16T23:28:50.441396+0000","last_undegraded":"2023-10-16T23:28:50.441396+0000","last_fullsized":"2023-10-16T23:28:50.441396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:50.441050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:50.441050+0000","last_clean_scrub_stamp":"2023-10-16T23:28:50.441050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:12:05.680691+0000","scrub_duration":0.0035120030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:07.338753+0000","last_change":"2023-10-16T23:29:07.339049+0000","last_active":"2023-10-16T23:29:07.338753+0000","last_peered":"2023-10-16T23:29:07.338753+0000","last_clean":"2023-10-16T23:29:07.338753+0000","last_became_active":"2023-10-16T23:27:40.722399+0000","last_became_peered":"2023-10-16T23:27:40.722399+0000","last_unstale":"2023-10-16T23:29:07.338753+0000","last_undegraded":"2023-10-16T23:29:07.338753+0000","last_fullsized":"2023-10-16T23:29:07.338753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:07.338705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:07.338705+0000","last_clean_scrub_stamp":"2023-10-16T23:29:07.338705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:17:27.277608+0000","scrub_duration":0.0036007499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:26.546739+0000","last_change":"2023-10-16T23:29:26.547009+0000","last_active":"2023-10-16T23:29:26.546739+0000","last_peered":"2023-10-16T23:29:26.546739+0000","last_clean":"2023-10-16T23:29:26.546739+0000","last_became_active":"2023-10-16T23:27:40.715294+0000","last_became_peered":"2023-10-16T23:27:40.715294+0000","last_unstale":"2023-10-16T23:29:26.546739+0000","last_undegraded":"2023-10-16T23:29:26.546739+0000","last_fullsized":"2023-10-16T23:29:26.546739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:26.546688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:26.546688+0000","last_clean_scrub_stamp":"2023-10-16T23:29:26.546688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:33:05.904856+0000","scrub_duration":0.0040575799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:02.516317+0000","last_change":"2023-10-16T23:29:02.516594+0000","last_active":"2023-10-16T23:29:02.516317+0000","last_peered":"2023-10-16T23:29:02.516317+0000","last_clean":"2023-10-16T23:29:02.516317+0000","last_became_active":"2023-10-16T23:27:40.760726+0000","last_became_peered":"2023-10-16T23:27:40.760726+0000","last_unstale":"2023-10-16T23:29:02.516317+0000","last_undegraded":"2023-10-16T23:29:02.516317+0000","last_fullsized":"2023-10-16T23:29:02.516317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:02.516265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:02.516265+0000","last_clean_scrub_stamp":"2023-10-16T23:29:02.516265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:12:10.501158+0000","scrub_duration":0.0041045810000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:20.399769+0000","last_change":"2023-10-16T23:29:20.400065+0000","last_active":"2023-10-16T23:29:20.399769+0000","last_peered":"2023-10-16T23:29:20.399769+0000","last_clean":"2023-10-16T23:29:20.399769+0000","last_became_active":"2023-10-16T23:27:40.755276+0000","last_became_peered":"2023-10-16T23:27:40.755276+0000","last_unstale":"2023-10-16T23:29:20.399769+0000","last_undegraded":"2023-10-16T23:29:20.399769+0000","last_fullsized":"2023-10-16T23:29:20.399769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:20.399716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:20.399716+0000","last_clean_scrub_stamp":"2023-10-16T23:29:20.399716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:36:39.631000+0000","scrub_duration":0.0034242270000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:20.436488+0000","last_change":"2023-10-16T23:29:20.436754+0000","last_active":"2023-10-16T23:29:20.436488+0000","last_peered":"2023-10-16T23:29:20.436488+0000","last_clean":"2023-10-16T23:29:20.436488+0000","last_became_active":"2023-10-16T23:27:40.723701+0000","last_became_peered":"2023-10-16T23:27:40.723701+0000","last_unstale":"2023-10-16T23:29:20.436488+0000","last_undegraded":"2023-10-16T23:29:20.436488+0000","last_fullsized":"2023-10-16T23:29:20.436488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:20.436433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:20.436433+0000","last_clean_scrub_stamp":"2023-10-16T23:29:20.436433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:11:07.817988+0000","scrub_duration":0.003479822,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:15.251336+0000","last_change":"2023-10-16T23:29:15.251708+0000","last_active":"2023-10-16T23:29:15.251336+0000","last_peered":"2023-10-16T23:29:15.251336+0000","last_clean":"2023-10-16T23:29:15.251336+0000","last_became_active":"2023-10-16T23:27:40.755772+0000","last_became_peered":"2023-10-16T23:27:40.755772+0000","last_unstale":"2023-10-16T23:29:15.251336+0000","last_undegraded":"2023-10-16T23:29:15.251336+0000","last_fullsized":"2023-10-16T23:29:15.251336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:15.251230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:15.251230+0000","last_clean_scrub_stamp":"2023-10-16T23:29:15.251230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:49:40.141118+0000","scrub_duration":0.0040644399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:31.644998+0000","last_change":"2023-10-16T23:29:31.645269+0000","last_active":"2023-10-16T23:29:31.644998+0000","last_peered":"2023-10-16T23:29:31.644998+0000","last_clean":"2023-10-16T23:29:31.644998+0000","last_became_active":"2023-10-16T23:27:40.724031+0000","last_became_peered":"2023-10-16T23:27:40.724031+0000","last_unstale":"2023-10-16T23:29:31.644998+0000","last_undegraded":"2023-10-16T23:29:31.644998+0000","last_fullsized":"2023-10-16T23:29:31.644998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:31.644942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:31.644942+0000","last_clean_scrub_stamp":"2023-10-16T23:29:31.644942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:40:59.916620+0000","scrub_duration":0.0037764489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:51.454135+0000","last_change":"2023-10-16T23:28:51.454416+0000","last_active":"2023-10-16T23:28:51.454135+0000","last_peered":"2023-10-16T23:28:51.454135+0000","last_clean":"2023-10-16T23:28:51.454135+0000","last_became_active":"2023-10-16T23:27:40.724099+0000","last_became_peered":"2023-10-16T23:27:40.724099+0000","last_unstale":"2023-10-16T23:28:51.454135+0000","last_undegraded":"2023-10-16T23:28:51.454135+0000","last_fullsized":"2023-10-16T23:28:51.454135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:51.454084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:51.454084+0000","last_clean_scrub_stamp":"2023-10-16T23:28:51.454084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:30:36.813149+0000","scrub_duration":0.0036983559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:44.412252+0000","last_change":"2023-10-16T23:28:44.412516+0000","last_active":"2023-10-16T23:28:44.412252+0000","last_peered":"2023-10-16T23:28:44.412252+0000","last_clean":"2023-10-16T23:28:44.412252+0000","last_became_active":"2023-10-16T23:27:40.704162+0000","last_became_peered":"2023-10-16T23:27:40.704162+0000","last_unstale":"2023-10-16T23:28:44.412252+0000","last_undegraded":"2023-10-16T23:28:44.412252+0000","last_fullsized":"2023-10-16T23:28:44.412252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:44.412201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:44.412201+0000","last_clean_scrub_stamp":"2023-10-16T23:28:44.412201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:26:44.683009+0000","scrub_duration":0.003351209,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:08.134208+0000","last_change":"2023-10-16T23:29:08.134486+0000","last_active":"2023-10-16T23:29:08.134208+0000","last_peered":"2023-10-16T23:29:08.134208+0000","last_clean":"2023-10-16T23:29:08.134208+0000","last_became_active":"2023-10-16T23:27:40.738070+0000","last_became_peered":"2023-10-16T23:27:40.738070+0000","last_unstale":"2023-10-16T23:29:08.134208+0000","last_undegraded":"2023-10-16T23:29:08.134208+0000","last_fullsized":"2023-10-16T23:29:08.134208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:08.134158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:08.134158+0000","last_clean_scrub_stamp":"2023-10-16T23:29:08.134158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:17:28.073062+0000","scrub_duration":0.0039984119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:59.521341+0000","last_change":"2023-10-16T23:28:59.521588+0000","last_active":"2023-10-16T23:28:59.521341+0000","last_peered":"2023-10-16T23:28:59.521341+0000","last_clean":"2023-10-16T23:28:59.521341+0000","last_became_active":"2023-10-16T23:27:40.761570+0000","last_became_peered":"2023-10-16T23:27:40.761570+0000","last_unstale":"2023-10-16T23:28:59.521341+0000","last_undegraded":"2023-10-16T23:28:59.521341+0000","last_fullsized":"2023-10-16T23:28:59.521341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:59.521278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:59.521278+0000","last_clean_scrub_stamp":"2023-10-16T23:28:59.521278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:31:38.322028+0000","scrub_duration":0.0038043040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:16.633881+0000","last_change":"2023-10-16T23:29:16.634132+0000","last_active":"2023-10-16T23:29:16.633881+0000","last_peered":"2023-10-16T23:29:16.633881+0000","last_clean":"2023-10-16T23:29:16.633881+0000","last_became_active":"2023-10-16T23:27:40.718276+0000","last_became_peered":"2023-10-16T23:27:40.718276+0000","last_unstale":"2023-10-16T23:29:16.633881+0000","last_undegraded":"2023-10-16T23:29:16.633881+0000","last_fullsized":"2023-10-16T23:29:16.633881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:16.633830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:16.633830+0000","last_clean_scrub_stamp":"2023-10-16T23:29:16.633830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:36:35.865114+0000","scrub_duration":0.0038590740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:18.417002+0000","last_change":"2023-10-16T23:29:18.417263+0000","last_active":"2023-10-16T23:29:18.417002+0000","last_peered":"2023-10-16T23:29:18.417002+0000","last_clean":"2023-10-16T23:29:18.417002+0000","last_became_active":"2023-10-16T23:27:40.719402+0000","last_became_peered":"2023-10-16T23:27:40.719402+0000","last_unstale":"2023-10-16T23:29:18.417002+0000","last_undegraded":"2023-10-16T23:29:18.417002+0000","last_fullsized":"2023-10-16T23:29:18.417002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:18.416953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:18.416953+0000","last_clean_scrub_stamp":"2023-10-16T23:29:18.416953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:23:05.868268+0000","scrub_duration":0.0033107929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:30.626338+0000","last_change":"2023-10-16T23:29:30.626609+0000","last_active":"2023-10-16T23:29:30.626338+0000","last_peered":"2023-10-16T23:29:30.626338+0000","last_clean":"2023-10-16T23:29:30.626338+0000","last_became_active":"2023-10-16T23:27:40.732102+0000","last_became_peered":"2023-10-16T23:27:40.732102+0000","last_unstale":"2023-10-16T23:29:30.626338+0000","last_undegraded":"2023-10-16T23:29:30.626338+0000","last_fullsized":"2023-10-16T23:29:30.626338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:30.626282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:30.626282+0000","last_clean_scrub_stamp":"2023-10-16T23:29:30.626282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:04:32.094589+0000","scrub_duration":0.0039223979999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:41.375625+0000","last_change":"2023-10-16T23:28:41.375625+0000","last_active":"2023-10-16T23:28:41.375625+0000","last_peered":"2023-10-16T23:28:41.375625+0000","last_clean":"2023-10-16T23:28:41.375625+0000","last_became_active":"2023-10-16T23:27:40.728298+0000","last_became_peered":"2023-10-16T23:27:40.728298+0000","last_unstale":"2023-10-16T23:28:41.375625+0000","last_undegraded":"2023-10-16T23:28:41.375625+0000","last_fullsized":"2023-10-16T23:28:41.375625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:41.375313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:41.375313+0000","last_clean_scrub_stamp":"2023-10-16T23:28:41.375313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:03:17.124670+0000","scrub_duration":0.003739582,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:45.580772+0000","last_change":"2023-10-16T23:29:45.580772+0000","last_active":"2023-10-16T23:29:45.580772+0000","last_peered":"2023-10-16T23:29:45.580772+0000","last_clean":"2023-10-16T23:29:45.580772+0000","last_became_active":"2023-10-16T23:27:40.744483+0000","last_became_peered":"2023-10-16T23:27:40.744483+0000","last_unstale":"2023-10-16T23:29:45.580772+0000","last_undegraded":"2023-10-16T23:29:45.580772+0000","last_fullsized":"2023-10-16T23:29:45.580772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:45.580474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:45.580474+0000","last_clean_scrub_stamp":"2023-10-16T23:29:45.580474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:37:45.803340+0000","scrub_duration":0.003411917,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:00.514965+0000","last_change":"2023-10-16T23:29:00.514965+0000","last_active":"2023-10-16T23:29:00.514965+0000","last_peered":"2023-10-16T23:29:00.514965+0000","last_clean":"2023-10-16T23:29:00.514965+0000","last_became_active":"2023-10-16T23:27:40.760882+0000","last_became_peered":"2023-10-16T23:27:40.760882+0000","last_unstale":"2023-10-16T23:29:00.514965+0000","last_undegraded":"2023-10-16T23:29:00.514965+0000","last_fullsized":"2023-10-16T23:29:00.514965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:00.514740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:00.514740+0000","last_clean_scrub_stamp":"2023-10-16T23:29:00.514740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:05:49.777579+0000","scrub_duration":0.0031752130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:05.393170+0000","last_change":"2023-10-16T23:29:05.393170+0000","last_active":"2023-10-16T23:29:05.393170+0000","last_peered":"2023-10-16T23:29:05.393170+0000","last_clean":"2023-10-16T23:29:05.393170+0000","last_became_active":"2023-10-16T23:27:40.722302+0000","last_became_peered":"2023-10-16T23:27:40.722302+0000","last_unstale":"2023-10-16T23:29:05.393170+0000","last_undegraded":"2023-10-16T23:29:05.393170+0000","last_fullsized":"2023-10-16T23:29:05.393170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:05.392831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:05.392831+0000","last_clean_scrub_stamp":"2023-10-16T23:29:05.392831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:42:37.172781+0000","scrub_duration":0.0035357750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:21.300611+0000","last_change":"2023-10-16T23:29:21.300611+0000","last_active":"2023-10-16T23:29:21.300611+0000","last_peered":"2023-10-16T23:29:21.300611+0000","last_clean":"2023-10-16T23:29:21.300611+0000","last_became_active":"2023-10-16T23:27:40.716228+0000","last_became_peered":"2023-10-16T23:27:40.716228+0000","last_unstale":"2023-10-16T23:29:21.300611+0000","last_undegraded":"2023-10-16T23:29:21.300611+0000","last_fullsized":"2023-10-16T23:29:21.300611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:21.300307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:21.300307+0000","last_clean_scrub_stamp":"2023-10-16T23:29:21.300307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:59:28.620745+0000","scrub_duration":0.003465639,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:01.511926+0000","last_change":"2023-10-16T23:29:01.511926+0000","last_active":"2023-10-16T23:29:01.511926+0000","last_peered":"2023-10-16T23:29:01.511926+0000","last_clean":"2023-10-16T23:29:01.511926+0000","last_became_active":"2023-10-16T23:27:40.760659+0000","last_became_peered":"2023-10-16T23:27:40.760659+0000","last_unstale":"2023-10-16T23:29:01.511926+0000","last_undegraded":"2023-10-16T23:29:01.511926+0000","last_fullsized":"2023-10-16T23:29:01.511926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:01.511616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:01.511616+0000","last_clean_scrub_stamp":"2023-10-16T23:29:01.511616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:35:13.988738+0000","scrub_duration":0.003766648,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:16.885945+0000","last_change":"2023-10-16T23:29:16.885945+0000","last_active":"2023-10-16T23:29:16.885945+0000","last_peered":"2023-10-16T23:29:16.885945+0000","last_clean":"2023-10-16T23:29:16.885945+0000","last_became_active":"2023-10-16T23:27:40.727334+0000","last_became_peered":"2023-10-16T23:27:40.727334+0000","last_unstale":"2023-10-16T23:29:16.885945+0000","last_undegraded":"2023-10-16T23:29:16.885945+0000","last_fullsized":"2023-10-16T23:29:16.885945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:16.885612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:16.885612+0000","last_clean_scrub_stamp":"2023-10-16T23:29:16.885612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:36.575232+0000","scrub_duration":0.0037868989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:14.898671+0000","last_change":"2023-10-16T23:29:14.898671+0000","last_active":"2023-10-16T23:29:14.898671+0000","last_peered":"2023-10-16T23:29:14.898671+0000","last_clean":"2023-10-16T23:29:14.898671+0000","last_became_active":"2023-10-16T23:27:40.704536+0000","last_became_peered":"2023-10-16T23:27:40.704536+0000","last_unstale":"2023-10-16T23:29:14.898671+0000","last_undegraded":"2023-10-16T23:29:14.898671+0000","last_fullsized":"2023-10-16T23:29:14.898671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:14.898353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:14.898353+0000","last_clean_scrub_stamp":"2023-10-16T23:29:14.898353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:04.628284+0000","scrub_duration":0.003687811,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:21.400550+0000","last_change":"2023-10-16T23:29:21.400550+0000","last_active":"2023-10-16T23:29:21.400550+0000","last_peered":"2023-10-16T23:29:21.400550+0000","last_clean":"2023-10-16T23:29:21.400550+0000","last_became_active":"2023-10-16T23:27:40.763592+0000","last_became_peered":"2023-10-16T23:27:40.763592+0000","last_unstale":"2023-10-16T23:29:21.400550+0000","last_undegraded":"2023-10-16T23:29:21.400550+0000","last_fullsized":"2023-10-16T23:29:21.400550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:21.400228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:21.400228+0000","last_clean_scrub_stamp":"2023-10-16T23:29:21.400228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:11:08.781782+0000","scrub_duration":0.0035353440000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:18.832772+0000","last_change":"2023-10-16T23:29:18.832772+0000","last_active":"2023-10-16T23:29:18.832772+0000","last_peered":"2023-10-16T23:29:18.832772+0000","last_clean":"2023-10-16T23:29:18.832772+0000","last_became_active":"2023-10-16T23:27:40.760615+0000","last_became_peered":"2023-10-16T23:27:40.760615+0000","last_unstale":"2023-10-16T23:29:18.832772+0000","last_undegraded":"2023-10-16T23:29:18.832772+0000","last_fullsized":"2023-10-16T23:29:18.832772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:18.832431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:18.832431+0000","last_clean_scrub_stamp":"2023-10-16T23:29:18.832431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:49:43.722320+0000","scrub_duration":0.003603453,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:08.300428+0000","last_change":"2023-10-16T23:29:08.300428+0000","last_active":"2023-10-16T23:29:08.300428+0000","last_peered":"2023-10-16T23:29:08.300428+0000","last_clean":"2023-10-16T23:29:08.300428+0000","last_became_active":"2023-10-16T23:27:40.760437+0000","last_became_peered":"2023-10-16T23:27:40.760437+0000","last_unstale":"2023-10-16T23:29:08.300428+0000","last_undegraded":"2023-10-16T23:29:08.300428+0000","last_fullsized":"2023-10-16T23:29:08.300428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:08.300103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:08.300103+0000","last_clean_scrub_stamp":"2023-10-16T23:29:08.300103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:17:28.239007+0000","scrub_duration":0.0035936340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:15.588518+0000","last_change":"2023-10-16T23:29:15.588518+0000","last_active":"2023-10-16T23:29:15.588518+0000","last_peered":"2023-10-16T23:29:15.588518+0000","last_clean":"2023-10-16T23:29:15.588518+0000","last_became_active":"2023-10-16T23:27:40.744458+0000","last_became_peered":"2023-10-16T23:27:40.744458+0000","last_unstale":"2023-10-16T23:29:15.588518+0000","last_undegraded":"2023-10-16T23:29:15.588518+0000","last_fullsized":"2023-10-16T23:29:15.588518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:15.588199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:15.588199+0000","last_clean_scrub_stamp":"2023-10-16T23:29:15.588199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:23:03.039514+0000","scrub_duration":0.0032820359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:17.225346+0000","last_change":"2023-10-16T23:29:17.225346+0000","last_active":"2023-10-16T23:29:17.225346+0000","last_peered":"2023-10-16T23:29:17.225346+0000","last_clean":"2023-10-16T23:29:17.225346+0000","last_became_active":"2023-10-16T23:27:40.711492+0000","last_became_peered":"2023-10-16T23:27:40.711492+0000","last_unstale":"2023-10-16T23:29:17.225346+0000","last_undegraded":"2023-10-16T23:29:17.225346+0000","last_fullsized":"2023-10-16T23:29:17.225346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:17.224999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:17.224999+0000","last_clean_scrub_stamp":"2023-10-16T23:29:17.224999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:23:04.676314+0000","scrub_duration":0.0033378930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:00.518352+0000","last_change":"2023-10-16T23:29:00.518352+0000","last_active":"2023-10-16T23:29:00.518352+0000","last_peered":"2023-10-16T23:29:00.518352+0000","last_clean":"2023-10-16T23:29:00.518352+0000","last_became_active":"2023-10-16T23:27:40.709286+0000","last_became_peered":"2023-10-16T23:27:40.709286+0000","last_unstale":"2023-10-16T23:29:00.518352+0000","last_undegraded":"2023-10-16T23:29:00.518352+0000","last_fullsized":"2023-10-16T23:29:00.518352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:00.518184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:00.518184+0000","last_clean_scrub_stamp":"2023-10-16T23:29:00.518184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:57.302309+0000","scrub_duration":0.002605067,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:05.176691+0000","last_change":"2023-10-16T23:29:05.176985+0000","last_active":"2023-10-16T23:29:05.176691+0000","last_peered":"2023-10-16T23:29:05.176691+0000","last_clean":"2023-10-16T23:29:05.176691+0000","last_became_active":"2023-10-16T23:27:40.706864+0000","last_became_peered":"2023-10-16T23:27:40.706864+0000","last_unstale":"2023-10-16T23:29:05.176691+0000","last_undegraded":"2023-10-16T23:29:05.176691+0000","last_fullsized":"2023-10-16T23:29:05.176691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:05.176639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:05.176639+0000","last_clean_scrub_stamp":"2023-10-16T23:29:05.176639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:42:36.956589+0000","scrub_duration":0.0035589369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'4","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:49.381697+0000","last_change":"2023-10-16T23:28:49.381955+0000","last_active":"2023-10-16T23:28:49.381697+0000","last_peered":"2023-10-16T23:28:49.381697+0000","last_clean":"2023-10-16T23:28:49.381697+0000","last_became_active":"2023-10-16T23:27:40.352775+0000","last_became_peered":"2023-10-16T23:27:40.352775+0000","last_unstale":"2023-10-16T23:28:49.381697+0000","last_undegraded":"2023-10-16T23:28:49.381697+0000","last_fullsized":"2023-10-16T23:28:49.381697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2023-10-16T23:28:49.381632+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2023-10-16T23:28:49.381632+0000","last_clean_scrub_stamp":"2023-10-16T23:28:49.381632+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:38:59.043081+0000","scrub_duration":0.008668594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:13.208673+0000","last_change":"2023-10-16T23:29:13.208965+0000","last_active":"2023-10-16T23:29:13.208673+0000","last_peered":"2023-10-16T23:29:13.208673+0000","last_clean":"2023-10-16T23:29:13.208673+0000","last_became_active":"2023-10-16T23:27:40.764517+0000","last_became_peered":"2023-10-16T23:27:40.764517+0000","last_unstale":"2023-10-16T23:29:13.208673+0000","last_undegraded":"2023-10-16T23:29:13.208673+0000","last_fullsized":"2023-10-16T23:29:13.208673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:13.208622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:13.208622+0000","last_clean_scrub_stamp":"2023-10-16T23:29:13.208622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:32.898242+0000","scrub_duration":0.0034766910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:00.442327+0000","last_change":"2023-10-16T23:29:00.442518+0000","last_active":"2023-10-16T23:29:00.442327+0000","last_peered":"2023-10-16T23:29:00.442327+0000","last_clean":"2023-10-16T23:29:00.442327+0000","last_became_active":"2023-10-16T23:27:40.334885+0000","last_became_peered":"2023-10-16T23:27:40.334885+0000","last_unstale":"2023-10-16T23:29:00.442327+0000","last_undegraded":"2023-10-16T23:29:00.442327+0000","last_fullsized":"2023-10-16T23:29:00.442327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:00.442297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:00.442297+0000","last_clean_scrub_stamp":"2023-10-16T23:29:00.442297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:51:37.914607+0000","scrub_duration":0.0034444219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:10.347471+0000","last_change":"2023-10-16T23:29:10.347729+0000","last_active":"2023-10-16T23:29:10.347471+0000","last_peered":"2023-10-16T23:29:10.347471+0000","last_clean":"2023-10-16T23:29:10.347471+0000","last_became_active":"2023-10-16T23:27:40.719811+0000","last_became_peered":"2023-10-16T23:27:40.719811+0000","last_unstale":"2023-10-16T23:29:10.347471+0000","last_undegraded":"2023-10-16T23:29:10.347471+0000","last_fullsized":"2023-10-16T23:29:10.347471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:10.347417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:10.347417+0000","last_clean_scrub_stamp":"2023-10-16T23:29:10.347417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:00.077348+0000","scrub_duration":0.0036543629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:45.316754+0000","last_change":"2023-10-16T23:28:45.317090+0000","last_active":"2023-10-16T23:28:45.316754+0000","last_peered":"2023-10-16T23:28:45.316754+0000","last_clean":"2023-10-16T23:28:45.316754+0000","last_became_active":"2023-10-16T23:27:40.357009+0000","last_became_peered":"2023-10-16T23:27:40.357009+0000","last_unstale":"2023-10-16T23:28:45.316754+0000","last_undegraded":"2023-10-16T23:28:45.316754+0000","last_fullsized":"2023-10-16T23:28:45.316754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:45.316698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:45.316698+0000","last_clean_scrub_stamp":"2023-10-16T23:28:45.316698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:46.889893+0000","scrub_duration":0.003457342,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:11.264275+0000","last_change":"2023-10-16T23:29:11.264530+0000","last_active":"2023-10-16T23:29:11.264275+0000","last_peered":"2023-10-16T23:29:11.264275+0000","last_clean":"2023-10-16T23:29:11.264275+0000","last_became_active":"2023-10-16T23:27:40.760365+0000","last_became_peered":"2023-10-16T23:27:40.760365+0000","last_unstale":"2023-10-16T23:29:11.264275+0000","last_undegraded":"2023-10-16T23:29:11.264275+0000","last_fullsized":"2023-10-16T23:29:11.264275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:11.264225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:11.264225+0000","last_clean_scrub_stamp":"2023-10-16T23:29:11.264225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:00.994156+0000","scrub_duration":0.0036701329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"26'12","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:48.460939+0000","last_change":"2023-10-16T23:28:48.461283+0000","last_active":"2023-10-16T23:28:48.460939+0000","last_peered":"2023-10-16T23:28:48.460939+0000","last_clean":"2023-10-16T23:28:48.460939+0000","last_became_active":"2023-10-16T23:27:40.330857+0000","last_became_peered":"2023-10-16T23:27:40.330857+0000","last_unstale":"2023-10-16T23:28:48.460939+0000","last_undegraded":"2023-10-16T23:28:48.460939+0000","last_fullsized":"2023-10-16T23:28:48.460939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12","last_scrub_stamp":"2023-10-16T23:28:48.460884+0000","last_deep_scrub":"26'12","last_deep_scrub_stamp":"2023-10-16T23:28:48.460884+0000","last_clean_scrub_stamp":"2023-10-16T23:28:48.460884+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:48.136384+0000","scrub_duration":0.010512126,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"26'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:48.333516+0000","last_change":"2023-10-16T23:28:48.333516+0000","last_active":"2023-10-16T23:28:48.333516+0000","last_peered":"2023-10-16T23:28:48.333516+0000","last_clean":"2023-10-16T23:28:48.333516+0000","last_became_active":"2023-10-16T23:27:40.357047+0000","last_became_peered":"2023-10-16T23:27:40.357047+0000","last_unstale":"2023-10-16T23:28:48.333516+0000","last_undegraded":"2023-10-16T23:28:48.333516+0000","last_fullsized":"2023-10-16T23:28:48.333516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2023-10-16T23:28:48.333206+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2023-10-16T23:28:48.333206+0000","last_clean_scrub_stamp":"2023-10-16T23:28:48.333206+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:30:33.692271+0000","scrub_duration":0.0077088319999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:11.194180+0000","last_change":"2023-10-16T23:29:11.194180+0000","last_active":"2023-10-16T23:29:11.194180+0000","last_peered":"2023-10-16T23:29:11.194180+0000","last_clean":"2023-10-16T23:29:11.194180+0000","last_became_active":"2023-10-16T23:27:40.763116+0000","last_became_peered":"2023-10-16T23:27:40.763116+0000","last_unstale":"2023-10-16T23:29:11.194180+0000","last_undegraded":"2023-10-16T23:29:11.194180+0000","last_fullsized":"2023-10-16T23:29:11.194180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:11.193863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:11.193863+0000","last_clean_scrub_stamp":"2023-10-16T23:29:11.193863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:45:00.923794+0000","scrub_duration":0.0036105400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:52.467072+0000","last_change":"2023-10-16T23:28:52.467072+0000","last_active":"2023-10-16T23:28:52.467072+0000","last_peered":"2023-10-16T23:28:52.467072+0000","last_clean":"2023-10-16T23:28:52.467072+0000","last_became_active":"2023-10-16T23:27:40.346439+0000","last_became_peered":"2023-10-16T23:27:40.346439+0000","last_unstale":"2023-10-16T23:28:52.467072+0000","last_undegraded":"2023-10-16T23:28:52.467072+0000","last_fullsized":"2023-10-16T23:28:52.467072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2023-10-16T23:28:52.466754+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2023-10-16T23:28:52.466754+0000","last_clean_scrub_stamp":"2023-10-16T23:28:52.466754+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:32.718215+0000","scrub_duration":0.0073781489999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:46.591816+0000","last_change":"2023-10-16T23:28:46.591816+0000","last_active":"2023-10-16T23:28:46.591816+0000","last_peered":"2023-10-16T23:28:46.591816+0000","last_clean":"2023-10-16T23:28:46.591816+0000","last_became_active":"2023-10-16T23:27:40.714098+0000","last_became_peered":"2023-10-16T23:27:40.714098+0000","last_unstale":"2023-10-16T23:28:46.591816+0000","last_undegraded":"2023-10-16T23:28:46.591816+0000","last_fullsized":"2023-10-16T23:28:46.591816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:46.591510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:46.591510+0000","last_clean_scrub_stamp":"2023-10-16T23:28:46.591510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:43.375635+0000","scrub_duration":0.0038871190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"26'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:47.356799+0000","last_change":"2023-10-16T23:28:47.356799+0000","last_active":"2023-10-16T23:28:47.356799+0000","last_peered":"2023-10-16T23:28:47.356799+0000","last_clean":"2023-10-16T23:28:47.356799+0000","last_became_active":"2023-10-16T23:27:40.339531+0000","last_became_peered":"2023-10-16T23:27:40.339531+0000","last_unstale":"2023-10-16T23:28:47.356799+0000","last_undegraded":"2023-10-16T23:28:47.356799+0000","last_fullsized":"2023-10-16T23:28:47.356799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2023-10-16T23:28:47.356483+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2023-10-16T23:28:47.356483+0000","last_clean_scrub_stamp":"2023-10-16T23:28:47.356483+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:10.570766+0000","scrub_duration":0.0069425870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:09.544873+0000","last_change":"2023-10-16T23:29:09.544873+0000","last_active":"2023-10-16T23:29:09.544873+0000","last_peered":"2023-10-16T23:29:09.544873+0000","last_clean":"2023-10-16T23:29:09.544873+0000","last_became_active":"2023-10-16T23:27:40.713087+0000","last_became_peered":"2023-10-16T23:27:40.713087+0000","last_unstale":"2023-10-16T23:29:09.544873+0000","last_undegraded":"2023-10-16T23:29:09.544873+0000","last_fullsized":"2023-10-16T23:29:09.544873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:09.544568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:09.544568+0000","last_clean_scrub_stamp":"2023-10-16T23:29:09.544568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:24.182139+0000","scrub_duration":0.00371274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:53.311195+0000","last_change":"2023-10-16T23:28:53.311195+0000","last_active":"2023-10-16T23:28:53.311195+0000","last_peered":"2023-10-16T23:28:53.311195+0000","last_clean":"2023-10-16T23:28:53.311195+0000","last_became_active":"2023-10-16T23:27:40.319887+0000","last_became_peered":"2023-10-16T23:27:40.319887+0000","last_unstale":"2023-10-16T23:28:53.311195+0000","last_undegraded":"2023-10-16T23:28:53.311195+0000","last_fullsized":"2023-10-16T23:28:53.311195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:53.310840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:53.310840+0000","last_clean_scrub_stamp":"2023-10-16T23:28:53.310840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:39:38.391533+0000","scrub_duration":0.0040007879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:21.459961+0000","last_change":"2023-10-16T23:29:21.459961+0000","last_active":"2023-10-16T23:29:21.459961+0000","last_peered":"2023-10-16T23:29:21.459961+0000","last_clean":"2023-10-16T23:29:21.459961+0000","last_became_active":"2023-10-16T23:27:40.725724+0000","last_became_peered":"2023-10-16T23:27:40.725724+0000","last_unstale":"2023-10-16T23:29:21.459961+0000","last_undegraded":"2023-10-16T23:29:21.459961+0000","last_fullsized":"2023-10-16T23:29:21.459961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:21.459656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:21.459656+0000","last_clean_scrub_stamp":"2023-10-16T23:29:21.459656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:59:28.780094+0000","scrub_duration":0.003283593,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:58.057082+0000","last_change":"2023-10-16T23:28:58.057082+0000","last_active":"2023-10-16T23:28:58.057082+0000","last_peered":"2023-10-16T23:28:58.057082+0000","last_clean":"2023-10-16T23:28:58.057082+0000","last_became_active":"2023-10-16T23:27:40.337405+0000","last_became_peered":"2023-10-16T23:27:40.337405+0000","last_unstale":"2023-10-16T23:28:58.057082+0000","last_undegraded":"2023-10-16T23:28:58.057082+0000","last_fullsized":"2023-10-16T23:28:58.057082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2023-10-16T23:28:58.056774+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2023-10-16T23:28:58.056774+0000","last_clean_scrub_stamp":"2023-10-16T23:28:58.056774+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:12.694345+0000","scrub_duration":0.0064973770000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:54.551267+0000","last_change":"2023-10-16T23:28:54.551267+0000","last_active":"2023-10-16T23:28:54.551267+0000","last_peered":"2023-10-16T23:28:54.551267+0000","last_clean":"2023-10-16T23:28:54.551267+0000","last_became_active":"2023-10-16T23:27:40.722091+0000","last_became_peered":"2023-10-16T23:27:40.722091+0000","last_unstale":"2023-10-16T23:28:54.551267+0000","last_undegraded":"2023-10-16T23:28:54.551267+0000","last_fullsized":"2023-10-16T23:28:54.551267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:54.550940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:54.550940+0000","last_clean_scrub_stamp":"2023-10-16T23:28:54.550940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:42.954644+0000","scrub_duration":0.0039030689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:43.364129+0000","last_change":"2023-10-16T23:28:43.364129+0000","last_active":"2023-10-16T23:28:43.364129+0000","last_peered":"2023-10-16T23:28:43.364129+0000","last_clean":"2023-10-16T23:28:43.364129+0000","last_became_active":"2023-10-16T23:27:40.342213+0000","last_became_peered":"2023-10-16T23:27:40.342213+0000","last_unstale":"2023-10-16T23:28:43.364129+0000","last_undegraded":"2023-10-16T23:28:43.364129+0000","last_fullsized":"2023-10-16T23:28:43.364129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:43.363769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:43.363769+0000","last_clean_scrub_stamp":"2023-10-16T23:28:43.363769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:01:58.725647+0000","scrub_duration":0.003734617,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:55.527078+0000","last_change":"2023-10-16T23:28:55.527078+0000","last_active":"2023-10-16T23:28:55.527078+0000","last_peered":"2023-10-16T23:28:55.527078+0000","last_clean":"2023-10-16T23:28:55.527078+0000","last_became_active":"2023-10-16T23:27:40.732996+0000","last_became_peered":"2023-10-16T23:27:40.732996+0000","last_unstale":"2023-10-16T23:28:55.527078+0000","last_undegraded":"2023-10-16T23:28:55.527078+0000","last_fullsized":"2023-10-16T23:28:55.527078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:55.526749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:55.526749+0000","last_clean_scrub_stamp":"2023-10-16T23:28:55.526749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:10.164320+0000","scrub_duration":0.0041469059999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:04.485661+0000","last_change":"2023-10-16T23:29:04.485661+0000","last_active":"2023-10-16T23:29:04.485661+0000","last_peered":"2023-10-16T23:29:04.485661+0000","last_clean":"2023-10-16T23:29:04.485661+0000","last_became_active":"2023-10-16T23:27:40.347253+0000","last_became_peered":"2023-10-16T23:27:40.347253+0000","last_unstale":"2023-10-16T23:29:04.485661+0000","last_undegraded":"2023-10-16T23:29:04.485661+0000","last_fullsized":"2023-10-16T23:29:04.485661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:04.485343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:04.485343+0000","last_clean_scrub_stamp":"2023-10-16T23:29:04.485343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:17:24.424246+0000","scrub_duration":0.0040997250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:18.642538+0000","last_change":"2023-10-16T23:29:18.642538+0000","last_active":"2023-10-16T23:29:18.642538+0000","last_peered":"2023-10-16T23:29:18.642538+0000","last_clean":"2023-10-16T23:29:18.642538+0000","last_became_active":"2023-10-16T23:27:40.744571+0000","last_became_peered":"2023-10-16T23:27:40.744571+0000","last_unstale":"2023-10-16T23:29:18.642538+0000","last_undegraded":"2023-10-16T23:29:18.642538+0000","last_fullsized":"2023-10-16T23:29:18.642538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:18.642179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:18.642179+0000","last_clean_scrub_stamp":"2023-10-16T23:29:18.642179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:55.970808+0000","scrub_duration":0.003845958,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:39.870424+0000","last_change":"2023-10-16T23:28:39.870424+0000","last_active":"2023-10-16T23:28:39.870424+0000","last_peered":"2023-10-16T23:28:39.870424+0000","last_clean":"2023-10-16T23:28:39.870424+0000","last_became_active":"2023-10-16T23:27:40.314242+0000","last_became_peered":"2023-10-16T23:27:40.314242+0000","last_unstale":"2023-10-16T23:28:39.870424+0000","last_undegraded":"2023-10-16T23:28:39.870424+0000","last_fullsized":"2023-10-16T23:28:39.870424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:39.870144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:39.870144+0000","last_clean_scrub_stamp":"2023-10-16T23:28:39.870144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:19:34.468123+0000","scrub_duration":0.002925712,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:11.916050+0000","last_change":"2023-10-16T23:29:11.916050+0000","last_active":"2023-10-16T23:29:11.916050+0000","last_peered":"2023-10-16T23:29:11.916050+0000","last_clean":"2023-10-16T23:29:11.916050+0000","last_became_active":"2023-10-16T23:27:40.709174+0000","last_became_peered":"2023-10-16T23:27:40.709174+0000","last_unstale":"2023-10-16T23:29:11.916050+0000","last_undegraded":"2023-10-16T23:29:11.916050+0000","last_fullsized":"2023-10-16T23:29:11.916050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:11.915747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:11.915747+0000","last_clean_scrub_stamp":"2023-10-16T23:29:11.915747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:17:31.854651+0000","scrub_duration":0.0030805680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":184,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:41.333104+0000","last_change":"2023-10-16T23:28:41.333104+0000","last_active":"2023-10-16T23:28:41.333104+0000","last_peered":"2023-10-16T23:28:41.333104+0000","last_clean":"2023-10-16T23:28:41.333104+0000","last_became_active":"2023-10-16T23:27:29.353846+0000","last_became_peered":"2023-10-16T23:27:29.353846+0000","last_unstale":"2023-10-16T23:28:41.333104+0000","last_undegraded":"2023-10-16T23:28:41.333104+0000","last_fullsized":"2023-10-16T23:28:41.333104+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2023-10-16T23:28:41.332715+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2023-10-16T23:28:41.332715+0000","last_clean_scrub_stamp":"2023-10-16T23:28:41.332715+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:26:34.312585+0000","scrub_duration":0.01599012,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:40.409634+0000","last_change":"2023-10-16T23:28:40.409634+0000","last_active":"2023-10-16T23:28:40.409634+0000","last_peered":"2023-10-16T23:28:40.409634+0000","last_clean":"2023-10-16T23:28:40.409634+0000","last_became_active":"2023-10-16T23:27:36.277096+0000","last_became_peered":"2023-10-16T23:27:36.277096+0000","last_unstale":"2023-10-16T23:28:40.409634+0000","last_undegraded":"2023-10-16T23:28:40.409634+0000","last_fullsized":"2023-10-16T23:28:40.409634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:40.409281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:40.409281+0000","last_clean_scrub_stamp":"2023-10-16T23:28:40.409281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:11:55.648922+0000","scrub_duration":0.003820922,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:51.049069+0000","last_change":"2023-10-16T23:28:51.049069+0000","last_active":"2023-10-16T23:28:51.049069+0000","last_peered":"2023-10-16T23:28:51.049069+0000","last_clean":"2023-10-16T23:28:51.049069+0000","last_became_active":"2023-10-16T23:27:40.330989+0000","last_became_peered":"2023-10-16T23:27:40.330989+0000","last_unstale":"2023-10-16T23:28:51.049069+0000","last_undegraded":"2023-10-16T23:28:51.049069+0000","last_fullsized":"2023-10-16T23:28:51.049069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:51.048757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:51.048757+0000","last_clean_scrub_stamp":"2023-10-16T23:28:51.048757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:39:36.129450+0000","scrub_duration":0.0042242089999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:52.485612+0000","last_change":"2023-10-16T23:28:52.485612+0000","last_active":"2023-10-16T23:28:52.485612+0000","last_peered":"2023-10-16T23:28:52.485612+0000","last_clean":"2023-10-16T23:28:52.485612+0000","last_became_active":"2023-10-16T23:27:40.725490+0000","last_became_peered":"2023-10-16T23:27:40.725490+0000","last_unstale":"2023-10-16T23:28:52.485612+0000","last_undegraded":"2023-10-16T23:28:52.485612+0000","last_fullsized":"2023-10-16T23:28:52.485612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:52.485272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:52.485272+0000","last_clean_scrub_stamp":"2023-10-16T23:28:52.485272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:45:18.719119+0000","scrub_duration":0.0033147099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:42.339474+0000","last_change":"2023-10-16T23:28:42.339474+0000","last_active":"2023-10-16T23:28:42.339474+0000","last_peered":"2023-10-16T23:28:42.339474+0000","last_clean":"2023-10-16T23:28:42.339474+0000","last_became_active":"2023-10-16T23:27:36.277974+0000","last_became_peered":"2023-10-16T23:27:36.277974+0000","last_unstale":"2023-10-16T23:28:42.339474+0000","last_undegraded":"2023-10-16T23:28:42.339474+0000","last_fullsized":"2023-10-16T23:28:42.339474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:42.339160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:42.339160+0000","last_clean_scrub_stamp":"2023-10-16T23:28:42.339160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:43:39.840764+0000","scrub_duration":0.0082552289999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:38.602280+0000","last_change":"2023-10-16T23:28:38.602280+0000","last_active":"2023-10-16T23:28:38.602280+0000","last_peered":"2023-10-16T23:28:38.602280+0000","last_clean":"2023-10-16T23:28:38.602280+0000","last_became_active":"2023-10-16T23:27:40.339569+0000","last_became_peered":"2023-10-16T23:27:40.339569+0000","last_unstale":"2023-10-16T23:28:38.602280+0000","last_undegraded":"2023-10-16T23:28:38.602280+0000","last_fullsized":"2023-10-16T23:28:38.602280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:38.601943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:38.601943+0000","last_clean_scrub_stamp":"2023-10-16T23:28:38.601943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:11:53.841584+0000","scrub_duration":0.0039239139999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:11.362095+0000","last_change":"2023-10-16T23:29:11.362095+0000","last_active":"2023-10-16T23:29:11.362095+0000","last_peered":"2023-10-16T23:29:11.362095+0000","last_clean":"2023-10-16T23:29:11.362095+0000","last_became_active":"2023-10-16T23:27:40.726813+0000","last_became_peered":"2023-10-16T23:27:40.726813+0000","last_unstale":"2023-10-16T23:29:11.362095+0000","last_undegraded":"2023-10-16T23:29:11.362095+0000","last_fullsized":"2023-10-16T23:29:11.362095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:11.361731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:11.361731+0000","last_clean_scrub_stamp":"2023-10-16T23:29:11.361731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:51:49.495366+0000","scrub_duration":0.0034816449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:38.315622+0000","last_change":"2023-10-16T23:28:38.315622+0000","last_active":"2023-10-16T23:28:38.315622+0000","last_peered":"2023-10-16T23:28:38.315622+0000","last_clean":"2023-10-16T23:28:38.315622+0000","last_became_active":"2023-10-16T23:27:36.294489+0000","last_became_peered":"2023-10-16T23:27:36.294489+0000","last_unstale":"2023-10-16T23:28:38.315622+0000","last_undegraded":"2023-10-16T23:28:38.315622+0000","last_fullsized":"2023-10-16T23:28:38.315622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:38.315459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:38.315459+0000","last_clean_scrub_stamp":"2023-10-16T23:28:38.315459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:37:02.617863+0000","scrub_duration":0.0020246650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:54.915581+0000","last_change":"2023-10-16T23:28:54.915581+0000","last_active":"2023-10-16T23:28:54.915581+0000","last_peered":"2023-10-16T23:28:54.915581+0000","last_clean":"2023-10-16T23:28:54.915581+0000","last_became_active":"2023-10-16T23:27:40.326396+0000","last_became_peered":"2023-10-16T23:27:40.326396+0000","last_unstale":"2023-10-16T23:28:54.915581+0000","last_undegraded":"2023-10-16T23:28:54.915581+0000","last_fullsized":"2023-10-16T23:28:54.915581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:54.915270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:54.915270+0000","last_clean_scrub_stamp":"2023-10-16T23:28:54.915270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:39:39.995963+0000","scrub_duration":0.0073983119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:01.985257+0000","last_change":"2023-10-16T23:29:01.985257+0000","last_active":"2023-10-16T23:29:01.985257+0000","last_peered":"2023-10-16T23:29:01.985257+0000","last_clean":"2023-10-16T23:29:01.985257+0000","last_became_active":"2023-10-16T23:27:40.755489+0000","last_became_peered":"2023-10-16T23:27:40.755489+0000","last_unstale":"2023-10-16T23:29:01.985257+0000","last_undegraded":"2023-10-16T23:29:01.985257+0000","last_fullsized":"2023-10-16T23:29:01.985257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:01.984950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:01.984950+0000","last_clean_scrub_stamp":"2023-10-16T23:29:01.984950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:16.622521+0000","scrub_duration":0.0037752060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:22.392424+0000","last_change":"2023-10-16T23:29:22.392424+0000","last_active":"2023-10-16T23:29:22.392424+0000","last_peered":"2023-10-16T23:29:22.392424+0000","last_clean":"2023-10-16T23:29:22.392424+0000","last_became_active":"2023-10-16T23:27:36.278134+0000","last_became_peered":"2023-10-16T23:27:36.278134+0000","last_unstale":"2023-10-16T23:29:22.392424+0000","last_undegraded":"2023-10-16T23:29:22.392424+0000","last_fullsized":"2023-10-16T23:29:22.392424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:22.392126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:22.392126+0000","last_clean_scrub_stamp":"2023-10-16T23:29:22.392126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:59.720754+0000","scrub_duration":0.0038224819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:07.464875+0000","last_change":"2023-10-16T23:29:07.464875+0000","last_active":"2023-10-16T23:29:07.464875+0000","last_peered":"2023-10-16T23:29:07.464875+0000","last_clean":"2023-10-16T23:29:07.464875+0000","last_became_active":"2023-10-16T23:27:40.341951+0000","last_became_peered":"2023-10-16T23:27:40.341951+0000","last_unstale":"2023-10-16T23:29:07.464875+0000","last_undegraded":"2023-10-16T23:29:07.464875+0000","last_fullsized":"2023-10-16T23:29:07.464875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:07.464569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:07.464569+0000","last_clean_scrub_stamp":"2023-10-16T23:29:07.464569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:44:57.194500+0000","scrub_duration":0.003795624,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:03.943599+0000","last_change":"2023-10-16T23:29:03.943599+0000","last_active":"2023-10-16T23:29:03.943599+0000","last_peered":"2023-10-16T23:29:03.943599+0000","last_clean":"2023-10-16T23:29:03.943599+0000","last_became_active":"2023-10-16T23:27:40.731150+0000","last_became_peered":"2023-10-16T23:27:40.731150+0000","last_unstale":"2023-10-16T23:29:03.943599+0000","last_undegraded":"2023-10-16T23:29:03.943599+0000","last_fullsized":"2023-10-16T23:29:03.943599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:03.943306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:03.943306+0000","last_clean_scrub_stamp":"2023-10-16T23:29:03.943306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:51:41.415616+0000","scrub_duration":0.003488578,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:51.375752+0000","last_change":"2023-10-16T23:28:51.375752+0000","last_active":"2023-10-16T23:28:51.375752+0000","last_peered":"2023-10-16T23:28:51.375752+0000","last_clean":"2023-10-16T23:28:51.375752+0000","last_became_active":"2023-10-16T23:27:40.319571+0000","last_became_peered":"2023-10-16T23:27:40.319571+0000","last_unstale":"2023-10-16T23:28:51.375752+0000","last_undegraded":"2023-10-16T23:28:51.375752+0000","last_fullsized":"2023-10-16T23:28:51.375752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:51.375443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:51.375443+0000","last_clean_scrub_stamp":"2023-10-16T23:28:51.375443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:48.159569+0000","scrub_duration":0.0039652410000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:44.785290+0000","last_change":"2023-10-16T23:28:44.785290+0000","last_active":"2023-10-16T23:28:44.785290+0000","last_peered":"2023-10-16T23:28:44.785290+0000","last_clean":"2023-10-16T23:28:44.785290+0000","last_became_active":"2023-10-16T23:27:36.433808+0000","last_became_peered":"2023-10-16T23:27:36.433808+0000","last_unstale":"2023-10-16T23:28:44.785290+0000","last_undegraded":"2023-10-16T23:28:44.785290+0000","last_fullsized":"2023-10-16T23:28:44.785290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:44.784970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:44.784970+0000","last_clean_scrub_stamp":"2023-10-16T23:28:44.784970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:45:11.018817+0000","scrub_duration":0.0037436349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:55.349739+0000","last_change":"2023-10-16T23:28:55.349998+0000","last_active":"2023-10-16T23:28:55.349739+0000","last_peered":"2023-10-16T23:28:55.349739+0000","last_clean":"2023-10-16T23:28:55.349739+0000","last_became_active":"2023-10-16T23:28:23.651881+0000","last_became_peered":"2023-10-16T23:28:23.651881+0000","last_unstale":"2023-10-16T23:28:55.349739+0000","last_undegraded":"2023-10-16T23:28:55.349739+0000","last_fullsized":"2023-10-16T23:28:55.349739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:55.349662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:55.349662+0000","last_clean_scrub_stamp":"2023-10-16T23:28:55.349662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T04:07:35.601123+0000","scrub_duration":0.003616677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:52.980865+0000","last_change":"2023-10-16T23:28:52.980865+0000","last_active":"2023-10-16T23:28:52.980865+0000","last_peered":"2023-10-16T23:28:52.980865+0000","last_clean":"2023-10-16T23:28:52.980865+0000","last_became_active":"2023-10-16T23:27:40.327804+0000","last_became_peered":"2023-10-16T23:27:40.327804+0000","last_unstale":"2023-10-16T23:28:52.980865+0000","last_undegraded":"2023-10-16T23:28:52.980865+0000","last_fullsized":"2023-10-16T23:28:52.980865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:52.980540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:52.980540+0000","last_clean_scrub_stamp":"2023-10-16T23:28:52.980540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:49.764666+0000","scrub_duration":0.0034145260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:44.279600+0000","last_change":"2023-10-16T23:28:44.279600+0000","last_active":"2023-10-16T23:28:44.279600+0000","last_peered":"2023-10-16T23:28:44.279600+0000","last_clean":"2023-10-16T23:28:44.279600+0000","last_became_active":"2023-10-16T23:27:36.433923+0000","last_became_peered":"2023-10-16T23:27:36.433923+0000","last_unstale":"2023-10-16T23:28:44.279600+0000","last_undegraded":"2023-10-16T23:28:44.279600+0000","last_fullsized":"2023-10-16T23:28:44.279600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:44.279284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:44.279284+0000","last_clean_scrub_stamp":"2023-10-16T23:28:44.279284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:32:40.077699+0000","scrub_duration":0.003868692,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:19.465397+0000","last_change":"2023-10-16T23:29:19.465397+0000","last_active":"2023-10-16T23:29:19.465397+0000","last_peered":"2023-10-16T23:29:19.465397+0000","last_clean":"2023-10-16T23:29:19.465397+0000","last_became_active":"2023-10-16T23:27:40.755822+0000","last_became_peered":"2023-10-16T23:27:40.755822+0000","last_unstale":"2023-10-16T23:29:19.465397+0000","last_undegraded":"2023-10-16T23:29:19.465397+0000","last_fullsized":"2023-10-16T23:29:19.465397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:19.465088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:19.465088+0000","last_clean_scrub_stamp":"2023-10-16T23:29:19.465088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:36:38.696373+0000","scrub_duration":0.0036413130000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:49.004794+0000","last_change":"2023-10-16T23:28:49.004794+0000","last_active":"2023-10-16T23:28:49.004794+0000","last_peered":"2023-10-16T23:28:49.004794+0000","last_clean":"2023-10-16T23:28:49.004794+0000","last_became_active":"2023-10-16T23:27:40.333290+0000","last_became_peered":"2023-10-16T23:27:40.333290+0000","last_unstale":"2023-10-16T23:28:49.004794+0000","last_undegraded":"2023-10-16T23:28:49.004794+0000","last_fullsized":"2023-10-16T23:28:49.004794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2023-10-16T23:28:49.004498+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2023-10-16T23:28:49.004498+0000","last_clean_scrub_stamp":"2023-10-16T23:28:49.004498+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:45.788624+0000","scrub_duration":0.0068572590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:42.754504+0000","last_change":"2023-10-16T23:28:42.754504+0000","last_active":"2023-10-16T23:28:42.754504+0000","last_peered":"2023-10-16T23:28:42.754504+0000","last_clean":"2023-10-16T23:28:42.754504+0000","last_became_active":"2023-10-16T23:27:36.278209+0000","last_became_peered":"2023-10-16T23:27:36.278209+0000","last_unstale":"2023-10-16T23:28:42.754504+0000","last_undegraded":"2023-10-16T23:28:42.754504+0000","last_fullsized":"2023-10-16T23:28:42.754504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:42.754195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:42.754195+0000","last_clean_scrub_stamp":"2023-10-16T23:28:42.754195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:11:57.993836+0000","scrub_duration":0.003737359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:52.430757+0000","last_change":"2023-10-16T23:28:52.430982+0000","last_active":"2023-10-16T23:28:52.430757+0000","last_peered":"2023-10-16T23:28:52.430757+0000","last_clean":"2023-10-16T23:28:52.430757+0000","last_became_active":"2023-10-16T23:28:23.650570+0000","last_became_peered":"2023-10-16T23:28:23.650570+0000","last_unstale":"2023-10-16T23:28:52.430757+0000","last_undegraded":"2023-10-16T23:28:52.430757+0000","last_fullsized":"2023-10-16T23:28:52.430757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:52.430707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:52.430707+0000","last_clean_scrub_stamp":"2023-10-16T23:28:52.430707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:39:02.092156+0000","scrub_duration":0.0042398360000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:50.540697+0000","last_change":"2023-10-16T23:28:50.540697+0000","last_active":"2023-10-16T23:28:50.540697+0000","last_peered":"2023-10-16T23:28:50.540697+0000","last_clean":"2023-10-16T23:28:50.540697+0000","last_became_active":"2023-10-16T23:27:40.332084+0000","last_became_peered":"2023-10-16T23:27:40.332084+0000","last_unstale":"2023-10-16T23:28:50.540697+0000","last_undegraded":"2023-10-16T23:28:50.540697+0000","last_fullsized":"2023-10-16T23:28:50.540697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2023-10-16T23:28:50.540532+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2023-10-16T23:28:50.540532+0000","last_clean_scrub_stamp":"2023-10-16T23:28:50.540532+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:39:35.621225+0000","scrub_duration":0.0038185189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:42.321700+0000","last_change":"2023-10-16T23:28:42.321700+0000","last_active":"2023-10-16T23:28:42.321700+0000","last_peered":"2023-10-16T23:28:42.321700+0000","last_clean":"2023-10-16T23:28:42.321700+0000","last_became_active":"2023-10-16T23:27:36.280600+0000","last_became_peered":"2023-10-16T23:27:36.280600+0000","last_unstale":"2023-10-16T23:28:42.321700+0000","last_undegraded":"2023-10-16T23:28:42.321700+0000","last_fullsized":"2023-10-16T23:28:42.321700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:42.321354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:42.321354+0000","last_clean_scrub_stamp":"2023-10-16T23:28:42.321354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:38:37.718515+0000","scrub_duration":0.0039340479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:11.520558+0000","last_change":"2023-10-16T23:29:11.520558+0000","last_active":"2023-10-16T23:29:11.520558+0000","last_peered":"2023-10-16T23:29:11.520558+0000","last_clean":"2023-10-16T23:29:11.520558+0000","last_became_active":"2023-10-16T23:27:40.755830+0000","last_became_peered":"2023-10-16T23:27:40.755830+0000","last_unstale":"2023-10-16T23:29:11.520558+0000","last_undegraded":"2023-10-16T23:29:11.520558+0000","last_fullsized":"2023-10-16T23:29:11.520558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:11.520239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:11.520239+0000","last_clean_scrub_stamp":"2023-10-16T23:29:11.520239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:49:36.410127+0000","scrub_duration":0.0034573680000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:48.589147+0000","last_change":"2023-10-16T23:28:48.589394+0000","last_active":"2023-10-16T23:28:48.589147+0000","last_peered":"2023-10-16T23:28:48.589147+0000","last_clean":"2023-10-16T23:28:48.589147+0000","last_became_active":"2023-10-16T23:27:40.745143+0000","last_became_peered":"2023-10-16T23:27:40.745143+0000","last_unstale":"2023-10-16T23:28:48.589147+0000","last_undegraded":"2023-10-16T23:28:48.589147+0000","last_fullsized":"2023-10-16T23:28:48.589147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:48.589096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:48.589096+0000","last_clean_scrub_stamp":"2023-10-16T23:28:48.589096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:39:33.669789+0000","scrub_duration":0.00331059,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"26'19","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:57.522277+0000","last_change":"2023-10-16T23:28:57.522537+0000","last_active":"2023-10-16T23:28:57.522277+0000","last_peered":"2023-10-16T23:28:57.522277+0000","last_clean":"2023-10-16T23:28:57.522277+0000","last_became_active":"2023-10-16T23:27:40.351687+0000","last_became_peered":"2023-10-16T23:27:40.351687+0000","last_unstale":"2023-10-16T23:28:57.522277+0000","last_undegraded":"2023-10-16T23:28:57.522277+0000","last_fullsized":"2023-10-16T23:28:57.522277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'19","last_scrub_stamp":"2023-10-16T23:28:57.522221+0000","last_deep_scrub":"26'19","last_deep_scrub_stamp":"2023-10-16T23:28:57.522221+0000","last_clean_scrub_stamp":"2023-10-16T23:28:57.522221+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:12:23.848118+0000","scrub_duration":0.014520379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4472,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:08.898043+0000","last_change":"2023-10-16T23:29:08.898342+0000","last_active":"2023-10-16T23:29:08.898043+0000","last_peered":"2023-10-16T23:29:08.898043+0000","last_clean":"2023-10-16T23:29:08.898043+0000","last_became_active":"2023-10-16T23:27:40.727288+0000","last_became_peered":"2023-10-16T23:27:40.727288+0000","last_unstale":"2023-10-16T23:29:08.898043+0000","last_undegraded":"2023-10-16T23:29:08.898043+0000","last_fullsized":"2023-10-16T23:29:08.898043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:08.897996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:08.897996+0000","last_clean_scrub_stamp":"2023-10-16T23:29:08.897996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:42:40.677946+0000","scrub_duration":0.0041386900000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"26'5","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:58.491424+0000","last_change":"2023-10-16T23:28:58.491742+0000","last_active":"2023-10-16T23:28:58.491424+0000","last_peered":"2023-10-16T23:28:58.491424+0000","last_clean":"2023-10-16T23:28:58.491424+0000","last_became_active":"2023-10-16T23:27:40.331517+0000","last_became_peered":"2023-10-16T23:27:40.331517+0000","last_unstale":"2023-10-16T23:28:58.491424+0000","last_undegraded":"2023-10-16T23:28:58.491424+0000","last_fullsized":"2023-10-16T23:28:58.491424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2023-10-16T23:28:58.491358+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2023-10-16T23:28:58.491358+0000","last_clean_scrub_stamp":"2023-10-16T23:28:58.491358+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:51:11.739497+0000","scrub_duration":0.010820824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:00.251873+0000","last_change":"2023-10-16T23:29:00.252151+0000","last_active":"2023-10-16T23:29:00.251873+0000","last_peered":"2023-10-16T23:29:00.251873+0000","last_clean":"2023-10-16T23:29:00.251873+0000","last_became_active":"2023-10-16T23:27:40.333012+0000","last_became_peered":"2023-10-16T23:27:40.333012+0000","last_unstale":"2023-10-16T23:29:00.251873+0000","last_undegraded":"2023-10-16T23:29:00.251873+0000","last_fullsized":"2023-10-16T23:29:00.251873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:00.251827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:00.251827+0000","last_clean_scrub_stamp":"2023-10-16T23:29:00.251827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T03:52:14.889398+0000","scrub_duration":0.0029792669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:15.178193+0000","last_change":"2023-10-16T23:29:15.178447+0000","last_active":"2023-10-16T23:29:15.178193+0000","last_peered":"2023-10-16T23:29:15.178193+0000","last_clean":"2023-10-16T23:29:15.178193+0000","last_became_active":"2023-10-16T23:27:40.760680+0000","last_became_peered":"2023-10-16T23:27:40.760680+0000","last_unstale":"2023-10-16T23:29:15.178193+0000","last_undegraded":"2023-10-16T23:29:15.178193+0000","last_fullsized":"2023-10-16T23:29:15.178193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:15.178139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:15.178139+0000","last_clean_scrub_stamp":"2023-10-16T23:29:15.178139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:10:40.347181+0000","scrub_duration":0.0036559560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:48.540009+0000","last_change":"2023-10-16T23:28:48.540264+0000","last_active":"2023-10-16T23:28:48.540009+0000","last_peered":"2023-10-16T23:28:48.540009+0000","last_clean":"2023-10-16T23:28:48.540009+0000","last_became_active":"2023-10-16T23:27:40.338706+0000","last_became_peered":"2023-10-16T23:27:40.338706+0000","last_unstale":"2023-10-16T23:28:48.540009+0000","last_undegraded":"2023-10-16T23:28:48.540009+0000","last_fullsized":"2023-10-16T23:28:48.540009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:48.539954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:48.539954+0000","last_clean_scrub_stamp":"2023-10-16T23:28:48.539954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:45.324079+0000","scrub_duration":0.0038093760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:18.207342+0000","last_change":"2023-10-16T23:29:18.207605+0000","last_active":"2023-10-16T23:29:18.207342+0000","last_peered":"2023-10-16T23:29:18.207342+0000","last_clean":"2023-10-16T23:29:18.207342+0000","last_became_active":"2023-10-16T23:27:40.712756+0000","last_became_peered":"2023-10-16T23:27:40.712756+0000","last_unstale":"2023-10-16T23:29:18.207342+0000","last_undegraded":"2023-10-16T23:29:18.207342+0000","last_fullsized":"2023-10-16T23:29:18.207342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:18.207292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:18.207292+0000","last_clean_scrub_stamp":"2023-10-16T23:29:18.207292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:36:37.438577+0000","scrub_duration":0.0033421290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:02.515267+0000","last_change":"2023-10-16T23:29:02.515267+0000","last_active":"2023-10-16T23:29:02.515267+0000","last_peered":"2023-10-16T23:29:02.515267+0000","last_clean":"2023-10-16T23:29:02.515267+0000","last_became_active":"2023-10-16T23:27:40.755714+0000","last_became_peered":"2023-10-16T23:27:40.755714+0000","last_unstale":"2023-10-16T23:29:02.515267+0000","last_undegraded":"2023-10-16T23:29:02.515267+0000","last_fullsized":"2023-10-16T23:29:02.515267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:02.514934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:02.514934+0000","last_clean_scrub_stamp":"2023-10-16T23:29:02.514934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:39:47.595627+0000","scrub_duration":0.003702679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:57.017486+0000","last_change":"2023-10-16T23:28:57.017752+0000","last_active":"2023-10-16T23:28:57.017486+0000","last_peered":"2023-10-16T23:28:57.017486+0000","last_clean":"2023-10-16T23:28:57.017486+0000","last_became_active":"2023-10-16T23:27:40.331428+0000","last_became_peered":"2023-10-16T23:27:40.331428+0000","last_unstale":"2023-10-16T23:28:57.017486+0000","last_undegraded":"2023-10-16T23:28:57.017486+0000","last_fullsized":"2023-10-16T23:28:57.017486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:57.017438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:57.017438+0000","last_clean_scrub_stamp":"2023-10-16T23:28:57.017438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:45.421142+0000","scrub_duration":0.0034634449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:13.350648+0000","last_change":"2023-10-16T23:29:13.350648+0000","last_active":"2023-10-16T23:29:13.350648+0000","last_peered":"2023-10-16T23:29:13.350648+0000","last_clean":"2023-10-16T23:29:13.350648+0000","last_became_active":"2023-10-16T23:27:40.760779+0000","last_became_peered":"2023-10-16T23:27:40.760779+0000","last_unstale":"2023-10-16T23:29:13.350648+0000","last_undegraded":"2023-10-16T23:29:13.350648+0000","last_fullsized":"2023-10-16T23:29:13.350648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:13.350294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:13.350294+0000","last_clean_scrub_stamp":"2023-10-16T23:29:13.350294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:04:56.833201+0000","scrub_duration":0.004336871,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:00.969242+0000","last_change":"2023-10-16T23:29:00.969511+0000","last_active":"2023-10-16T23:29:00.969242+0000","last_peered":"2023-10-16T23:29:00.969242+0000","last_clean":"2023-10-16T23:29:00.969242+0000","last_became_active":"2023-10-16T23:27:40.317622+0000","last_became_peered":"2023-10-16T23:27:40.317622+0000","last_unstale":"2023-10-16T23:29:00.969242+0000","last_undegraded":"2023-10-16T23:29:00.969242+0000","last_fullsized":"2023-10-16T23:29:00.969242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:00.969194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:00.969194+0000","last_clean_scrub_stamp":"2023-10-16T23:29:00.969194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:49.372898+0000","scrub_duration":0.0033320379999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:14.223546+0000","last_change":"2023-10-16T23:29:14.223876+0000","last_active":"2023-10-16T23:29:14.223546+0000","last_peered":"2023-10-16T23:29:14.223546+0000","last_clean":"2023-10-16T23:29:14.223546+0000","last_became_active":"2023-10-16T23:27:40.705956+0000","last_became_peered":"2023-10-16T23:27:40.705956+0000","last_unstale":"2023-10-16T23:29:14.223546+0000","last_undegraded":"2023-10-16T23:29:14.223546+0000","last_fullsized":"2023-10-16T23:29:14.223546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:14.223496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:14.223496+0000","last_clean_scrub_stamp":"2023-10-16T23:29:14.223496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:04:57.706402+0000","scrub_duration":0.0037136740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:02.432748+0000","last_change":"2023-10-16T23:29:02.433013+0000","last_active":"2023-10-16T23:29:02.432748+0000","last_peered":"2023-10-16T23:29:02.432748+0000","last_clean":"2023-10-16T23:29:02.432748+0000","last_became_active":"2023-10-16T23:27:40.344158+0000","last_became_peered":"2023-10-16T23:27:40.344158+0000","last_unstale":"2023-10-16T23:29:02.432748+0000","last_undegraded":"2023-10-16T23:29:02.432748+0000","last_fullsized":"2023-10-16T23:29:02.432748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-10-16T23:29:02.432697+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-10-16T23:29:02.432697+0000","last_clean_scrub_stamp":"2023-10-16T23:29:02.432697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:42:34.212647+0000","scrub_duration":0.0038963000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:50.412806+0000","last_change":"2023-10-16T23:28:50.413057+0000","last_active":"2023-10-16T23:28:50.412806+0000","last_peered":"2023-10-16T23:28:50.412806+0000","last_clean":"2023-10-16T23:28:50.412806+0000","last_became_active":"2023-10-16T23:27:40.712632+0000","last_became_peered":"2023-10-16T23:27:40.712632+0000","last_unstale":"2023-10-16T23:28:50.412806+0000","last_undegraded":"2023-10-16T23:28:50.412806+0000","last_fullsized":"2023-10-16T23:28:50.412806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:28:50.412753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:28:50.412753+0000","last_clean_scrub_stamp":"2023-10-16T23:28:50.412753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:13.627037+0000","scrub_duration":0.003558257,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:40.596739+0000","last_change":"2023-10-16T23:28:40.596984+0000","last_active":"2023-10-16T23:28:40.596739+0000","last_peered":"2023-10-16T23:28:40.596739+0000","last_clean":"2023-10-16T23:28:40.596739+0000","last_became_active":"2023-10-16T23:27:40.356809+0000","last_became_peered":"2023-10-16T23:27:40.356809+0000","last_unstale":"2023-10-16T23:28:40.596739+0000","last_undegraded":"2023-10-16T23:28:40.596739+0000","last_fullsized":"2023-10-16T23:28:40.596739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-10-16T23:28:40.596681+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-10-16T23:28:40.596681+0000","last_clean_scrub_stamp":"2023-10-16T23:28:40.596681+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:45:06.830528+0000","scrub_duration":0.0040939920000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:38.587665+0000","last_change":"2023-10-16T23:29:38.587970+0000","last_active":"2023-10-16T23:29:38.587665+0000","last_peered":"2023-10-16T23:29:38.587665+0000","last_clean":"2023-10-16T23:29:38.587665+0000","last_became_active":"2023-10-16T23:27:40.724910+0000","last_became_peered":"2023-10-16T23:27:40.724910+0000","last_unstale":"2023-10-16T23:29:38.587665+0000","last_undegraded":"2023-10-16T23:29:38.587665+0000","last_fullsized":"2023-10-16T23:29:38.587665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:38.587611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:38.587611+0000","last_clean_scrub_stamp":"2023-10-16T23:29:38.587611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:46:15.994626+0000","scrub_duration":0.0042228819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:01.278714+0000","last_change":"2023-10-16T23:29:01.278983+0000","last_active":"2023-10-16T23:29:01.278714+0000","last_peered":"2023-10-16T23:29:01.278714+0000","last_clean":"2023-10-16T23:29:01.278714+0000","last_became_active":"2023-10-16T23:27:40.344531+0000","last_became_peered":"2023-10-16T23:27:40.344531+0000","last_unstale":"2023-10-16T23:29:01.278714+0000","last_undegraded":"2023-10-16T23:29:01.278714+0000","last_fullsized":"2023-10-16T23:29:01.278714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2023-10-16T23:29:01.278657+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2023-10-16T23:29:01.278657+0000","last_clean_scrub_stamp":"2023-10-16T23:29:01.278657+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:51:38.750967+0000","scrub_duration":0.0085448030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:17.659966+0000","last_change":"2023-10-16T23:29:17.660277+0000","last_active":"2023-10-16T23:29:17.659966+0000","last_peered":"2023-10-16T23:29:17.659966+0000","last_clean":"2023-10-16T23:29:17.659966+0000","last_became_active":"2023-10-16T23:27:40.719758+0000","last_became_peered":"2023-10-16T23:27:40.719758+0000","last_unstale":"2023-10-16T23:29:17.659966+0000","last_undegraded":"2023-10-16T23:29:17.659966+0000","last_fullsized":"2023-10-16T23:29:17.659966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:17.659916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:17.659916+0000","last_clean_scrub_stamp":"2023-10-16T23:29:17.659916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T05:11:05.041471+0000","scrub_duration":0.0041757160000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:06.198247+0000","last_change":"2023-10-16T23:29:06.198508+0000","last_active":"2023-10-16T23:29:06.198247+0000","last_peered":"2023-10-16T23:29:06.198247+0000","last_clean":"2023-10-16T23:29:06.198247+0000","last_became_active":"2023-10-16T23:27:40.344589+0000","last_became_peered":"2023-10-16T23:27:40.344589+0000","last_unstale":"2023-10-16T23:29:06.198247+0000","last_undegraded":"2023-10-16T23:29:06.198247+0000","last_fullsized":"2023-10-16T23:29:06.198247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2023-10-16T23:29:06.198193+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2023-10-16T23:29:06.198193+0000","last_clean_scrub_stamp":"2023-10-16T23:29:06.198193+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:42:37.978143+0000","scrub_duration":0.0065836169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:12.277801+0000","last_change":"2023-10-16T23:29:12.278045+0000","last_active":"2023-10-16T23:29:12.277801+0000","last_peered":"2023-10-16T23:29:12.277801+0000","last_clean":"2023-10-16T23:29:12.277801+0000","last_became_active":"2023-10-16T23:27:40.705936+0000","last_became_peered":"2023-10-16T23:27:40.705936+0000","last_unstale":"2023-10-16T23:29:12.277801+0000","last_undegraded":"2023-10-16T23:29:12.277801+0000","last_fullsized":"2023-10-16T23:29:12.277801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:12.277747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:12.277747+0000","last_clean_scrub_stamp":"2023-10-16T23:29:12.277747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:51:50.411382+0000","scrub_duration":0.0031714410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:00.139719+0000","last_change":"2023-10-16T23:29:00.139719+0000","last_active":"2023-10-16T23:29:00.139719+0000","last_peered":"2023-10-16T23:29:00.139719+0000","last_clean":"2023-10-16T23:29:00.139719+0000","last_became_active":"2023-10-16T23:27:40.323352+0000","last_became_peered":"2023-10-16T23:27:40.323352+0000","last_unstale":"2023-10-16T23:29:00.139719+0000","last_undegraded":"2023-10-16T23:29:00.139719+0000","last_fullsized":"2023-10-16T23:29:00.139719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-10-16T23:29:00.139362+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-10-16T23:29:00.139362+0000","last_clean_scrub_stamp":"2023-10-16T23:29:00.139362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:12:26.465259+0000","scrub_duration":0.0029808759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:29:09.490698+0000","last_change":"2023-10-16T23:29:09.490994+0000","last_active":"2023-10-16T23:29:09.490698+0000","last_peered":"2023-10-16T23:29:09.490698+0000","last_clean":"2023-10-16T23:29:09.490698+0000","last_became_active":"2023-10-16T23:27:40.748525+0000","last_became_peered":"2023-10-16T23:27:40.748525+0000","last_unstale":"2023-10-16T23:29:09.490698+0000","last_undegraded":"2023-10-16T23:29:09.490698+0000","last_fullsized":"2023-10-16T23:29:09.490698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T23:29:09.490647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T23:29:09.490647+0000","last_clean_scrub_stamp":"2023-10-16T23:29:09.490647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:29.180267+0000","scrub_duration":0.0033377290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"26'6","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T23:28:56.489024+0000","last_change":"2023-10-16T23:28:56.489024+0000","last_active":"2023-10-16T23:28:56.489024+0000","last_peered":"2023-10-16T23:28:56.489024+0000","last_clean":"2023-10-16T23:28:56.489024+0000","last_became_active":"2023-10-16T23:27:40.338565+0000","last_became_peered":"2023-10-16T23:27:40.338565+0000","last_unstale":"2023-10-16T23:28:56.489024+0000","last_undegraded":"2023-10-16T23:28:56.489024+0000","last_fullsized":"2023-10-16T23:28:56.489024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2023-10-16T23:28:56.488647+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2023-10-16T23:28:56.488647+0000","last_clean_scrub_stamp":"2023-10-16T23:28:56.488647+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:35:44.892351+0000","scrub_duration":0.008659211,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5270,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":10540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71,"ondisk_log_size":71,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509473,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":103608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:29:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78600000000000003,"15min":0.78700000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1060000000000001,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":1.127},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.85699999999999998,"15min":0.84699999999999998},"min":{"1min":0.70199999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.087,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":1.147}]},{"osd":1,"last update":"Mon Oct 16 23:29:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.876,"15min":0.873},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.014,"5min":1.02,"15min":1.0209999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.246,"5min":1.456,"15min":1.456},"last":0.80200000000000005}]},{"osd":2,"last update":"Mon Oct 16 23:29:28 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.94299999999999995,"15min":0.94899999999999995},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":1.028},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.012,"15min":1.0149999999999999},"min":{"1min":0.68899999999999995,"5min":0.63,"15min":0.63},"max":{"1min":1.21,"5min":2.056,"15min":2.056},"last":0.89100000000000001}]},{"osd":3,"last update":"Mon Oct 16 23:29:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.99199999999999999,"15min":0.99399999999999999},"min":{"1min":0.78400000000000003,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.054,"5min":1.0820000000000001,"15min":1.087},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.93200000000000005}]},{"osd":4,"last update":"Mon Oct 16 23:29:28 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":1.0649999999999999,"15min":1.091},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2569999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.1970000000000001,"15min":1.22},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.327,"5min":1.516,"15min":1.516},"last":1.1020000000000001}]},{"osd":5,"last update":"Mon Oct 16 23:29:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":1.163,"15min":1.1930000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.369,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.095,"5min":1.22,"15min":1.2410000000000001},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.3169999999999999,"5min":1.659,"15min":1.659},"last":1.1899999999999999}]},{"osd":7,"last update":"Mon Oct 16 23:29:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.2509999999999999,"15min":1.2689999999999999},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.377,"5min":1.544,"15min":1.544},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.105,"5min":1.2569999999999999,"15min":1.2829999999999999},"min":{"1min":0.878,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.5269999999999999,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":1.071}]}]},{"osd":5,"up_from":15,"seq":64424509473,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":278528,"data_stored":104260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83199999999999996,"15min":0.83099999999999996},"min":{"1min":0.64000000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.109,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.91300000000000003,"15min":0.90900000000000003},"min":{"1min":0.62,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3180000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.054}]},{"osd":1,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.97299999999999998,"15min":0.97899999999999998},"min":{"1min":0.64700000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.2190000000000001,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.155},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.92200000000000004,"15min":0.92000000000000004},"min":{"1min":0.66700000000000004,"5min":0.622,"15min":0.622},"max":{"1min":1.1890000000000001,"5min":1.649,"15min":1.649},"last":0.88900000000000001}]},{"osd":2,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.97499999999999998,"15min":0.97699999999999998},"min":{"1min":0.65600000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2470000000000001,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.177},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1.012,"15min":1.024},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.23,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.0229999999999999}]},{"osd":3,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.004,"15min":1.0109999999999999},"min":{"1min":0.626,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.3440000000000001,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.111,"15min":1.123},"min":{"1min":0.83099999999999996,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.3200000000000001,"5min":2.5129999999999999,"15min":2.5129999999999999},"last":1.0840000000000001}]},{"osd":4,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":1.0980000000000001,"15min":1.1259999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.3140000000000001,"5min":3.0640000000000001,"15min":3.0640000000000001},"last":1.103},{"interface":"front","average":{"1min":1.006,"5min":1.1559999999999999,"15min":1.181},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.385,"5min":3.1669999999999998,"15min":3.1669999999999998},"last":0.66700000000000004}]},{"osd":6,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.1919999999999999,"15min":1.2190000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.4199999999999999,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.1819999999999999,"15min":1.208},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.3560000000000001,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.92200000000000004}]},{"osd":7,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.2470000000000001,"15min":1.2709999999999999},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.3959999999999999,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.157,"5min":1.3069999999999999,"15min":1.3320000000000001},"min":{"1min":0.78000000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.363,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":1.1339999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509475,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":108136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.56599999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1839999999999999,"5min":1.319,"15min":1.319},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.85299999999999998,"15min":0.84899999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.78800000000000003}]},{"osd":1,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.90200000000000002,"15min":0.90000000000000002},"min":{"1min":0.68899999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.877,"15min":0.86799999999999999},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.83099999999999996}]},{"osd":2,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.89000000000000001,"15min":0.88100000000000001},"min":{"1min":0.65300000000000002,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.228,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":1.141},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.96099999999999997,"15min":0.96399999999999997},"min":{"1min":0.68799999999999994,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.99199999999999999}]},{"osd":3,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.95799999999999996,"15min":0.96299999999999997},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.1950000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.014,"15min":1.012},"min":{"1min":0.67400000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3240000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.0269999999999999}]},{"osd":5,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.98499999999999999,"15min":0.98099999999999998},"min":{"1min":0.67100000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.052,"15min":1.0620000000000001},"min":{"1min":0.64600000000000002,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4059999999999999,"5min":1.421,"15min":1.421},"last":1.0840000000000001}]},{"osd":6,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.097,"15min":1.105},"min":{"1min":0.69199999999999995,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.248,"5min":1.556,"15min":1.556},"last":1.254},{"interface":"front","average":{"1min":1.179,"5min":1.1930000000000001,"15min":1.1950000000000001},"min":{"1min":1.018,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":1.3520000000000001,"5min":1.399,"15min":1.399},"last":1.175}]},{"osd":7,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.175,"15min":1.1930000000000001},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.3100000000000001,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.1970000000000001,"15min":1.2010000000000001},"min":{"1min":0.91300000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.393,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.3260000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509474,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":103698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:29:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.59299999999999997,"15min":0.57699999999999996},"min":{"1min":0.41799999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.64300000000000002,"15min":0.628},"min":{"1min":0.46899999999999997,"5min":0.315,"15min":0.315},"max":{"1min":1.0569999999999999,"5min":1.081,"15min":1.081},"last":0.91900000000000004}]},{"osd":1,"last update":"Mon Oct 16 23:29:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.624,"15min":0.61899999999999999},"min":{"1min":0.432,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.86599999999999999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.72299999999999998,"15min":0.70799999999999996},"min":{"1min":0.45200000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0600000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.78400000000000003}]},{"osd":2,"last update":"Mon Oct 16 23:29:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.746,"15min":0.74099999999999999},"min":{"1min":0.46100000000000002,"5min":0.371,"15min":0.371},"max":{"1min":1.0760000000000001,"5min":1.131,"15min":1.131},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83299999999999996,"15min":0.83199999999999996},"min":{"1min":0.48399999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.147,"5min":1.859,"15min":1.859},"last":1.075}]},{"osd":4,"last update":"Mon Oct 16 23:29:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.91800000000000004,"15min":0.90800000000000003},"min":{"1min":0.66200000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2450000000000001,"5min":1.53,"15min":1.53},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.028,"5min":0.99199999999999999,"15min":0.98599999999999999},"min":{"1min":0.627,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.385,"5min":1.514,"15min":1.514},"last":1.115}]},{"osd":5,"last update":"Mon Oct 16 23:29:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0069999999999999,"15min":1.008},"min":{"1min":0.81499999999999995,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3280000000000001,"5min":1.571,"15min":1.571},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.069,"15min":1.0740000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.323,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.2649999999999999}]},{"osd":6,"last update":"Mon Oct 16 23:29:30 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0009999999999999,"15min":0.98299999999999998},"min":{"1min":0.85099999999999998,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.306,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.165},{"interface":"front","average":{"1min":1.101,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.71199999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.4350000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.89100000000000001}]},{"osd":7,"last update":"Mon Oct 16 23:29:30 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.101,"15min":1.1020000000000001},"min":{"1min":0.82599999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.377,"5min":2.379,"15min":2.379},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.0589999999999999,"15min":1.052},"min":{"1min":0.73399999999999999,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3280000000000001,"5min":1.349,"15min":1.349},"last":1.3029999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509473,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":103608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.59199999999999997,"15min":0.58499999999999996},"min":{"1min":0.39400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.98899999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.63200000000000001,"15min":0.61799999999999999},"min":{"1min":0.30199999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.76900000000000002}]},{"osd":2,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.56899999999999995,"15min":0.55500000000000005},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81899999999999995,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.66700000000000004,"15min":0.65700000000000003},"min":{"1min":0.35399999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.95099999999999996,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.82299999999999995}]},{"osd":3,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.749,"15min":0.72699999999999998},"min":{"1min":0.39000000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.36499999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":1.0149999999999999}]},{"osd":4,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.92600000000000005,"15min":0.91800000000000004},"min":{"1min":0.75,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.264,"5min":1.371,"15min":1.371},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.89600000000000002,"15min":0.89400000000000002},"min":{"1min":0.60499999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.2809999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.3560000000000001}]},{"osd":5,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.97099999999999997,"15min":0.96799999999999997},"min":{"1min":0.79900000000000004,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3640000000000001,"5min":2.431,"15min":2.431},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0389999999999999,"15min":1.0349999999999999},"min":{"1min":0.626,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.4510000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":1.0580000000000001}]},{"osd":6,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":0.96699999999999997,"15min":0.95299999999999996},"min":{"1min":0.64700000000000002,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1930000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.008,"15min":1.0009999999999999},"min":{"1min":0.76700000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4139999999999999,"5min":2.222,"15min":2.222},"last":1.25}]},{"osd":7,"last update":"Mon Oct 16 23:29:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.0580000000000001,"15min":1.0409999999999999},"min":{"1min":0.66900000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3939999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.115},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.034,"15min":1.0209999999999999},"min":{"1min":0.752,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.3440000000000001,"5min":1.716,"15min":1.716},"last":1.0860000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509475,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":868352,"data_stored":694558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 23:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46400000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.119,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0109999999999999,"5min":1.528,"15min":1.528},"last":0.58799999999999997}]},{"osd":2,"last update":"Mon Oct 16 23:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.89100000000000001,"5min":1.603,"15min":1.603},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0820000000000001,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.72399999999999998}]},{"osd":3,"last update":"Mon Oct 16 23:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.745,"15min":0.73499999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.94799999999999995,"15min":0.95199999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1930000000000001,"5min":1.635,"15min":1.635},"last":0.91000000000000003}]},{"osd":4,"last update":"Mon Oct 16 23:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.93700000000000006,"15min":0.94099999999999995},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.121,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.873},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.046,"15min":1.0669999999999999},"min":{"1min":0.67300000000000004,"5min":0.626,"15min":0.626},"max":{"1min":1.1850000000000001,"5min":1.694,"15min":1.694},"last":0.81599999999999995}]},{"osd":5,"last update":"Mon Oct 16 23:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0229999999999999,"15min":1.026},"min":{"1min":0.755,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.25,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.996},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97899999999999998,"15min":0.97999999999999998},"min":{"1min":0.57799999999999996,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2929999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.79200000000000004}]},{"osd":6,"last update":"Mon Oct 16 23:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.109,"15min":1.1240000000000001},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.228,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0940000000000001,"15min":1.1040000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2929999999999999,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.048}]},{"osd":7,"last update":"Mon Oct 16 23:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.107,"15min":1.113},"min":{"1min":0.81200000000000006,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.26,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.046,"15min":1.046},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3520000000000001,"5min":1.881,"15min":1.881},"last":0.97199999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542178,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":698664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.88300000000000001,"15min":0.88900000000000001},"min":{"1min":0.60499999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2030000000000001,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.89600000000000002,"15min":0.90100000000000002},"min":{"1min":0.60499999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.0409999999999999,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.875}]},{"osd":1,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.95699999999999996,"15min":0.95499999999999996},"min":{"1min":0.67900000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.21,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.046},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.96199999999999997,"15min":0.95799999999999996},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.329,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.66800000000000004}]},{"osd":2,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.95499999999999996,"15min":0.95799999999999996},"min":{"1min":0.746,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.165,"5min":1.333,"15min":1.333},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.01,"5min":0.98099999999999998,"15min":0.97599999999999998},"min":{"1min":0.76300000000000001,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.1799999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.90600000000000003}]},{"osd":3,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.028,"15min":1.0389999999999999},"min":{"1min":0.80300000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.165,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.014,"15min":1.022},"min":{"1min":0.71199999999999997,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.238,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.97599999999999998}]},{"osd":4,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":1.0600000000000001,"15min":1.0800000000000001},"min":{"1min":0.69399999999999995,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.242,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.046,"5min":1.169,"15min":1.1890000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.427,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.93300000000000005}]},{"osd":5,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.052,"15min":1.0660000000000001},"min":{"1min":0.63500000000000001,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.216,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.2050000000000001,"15min":1.2230000000000001},"min":{"1min":0.72699999999999998,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.3720000000000001,"5min":2.165,"15min":2.165},"last":0.82199999999999995}]},{"osd":6,"last update":"Mon Oct 16 23:29:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.1819999999999999,"15min":1.204},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.29,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.175,"5min":1.2909999999999999,"15min":1.3100000000000001},"min":{"1min":0.83999999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.5289999999999999,"5min":2.742,"15min":2.742},"last":0.95899999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542178,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":270336,"data_stored":103608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 23:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.48599999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.84999999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.53000000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.66400000000000003}]},{"osd":1,"last update":"Mon Oct 16 23:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.75600000000000001,"15min":0.73699999999999999},"min":{"1min":0.68300000000000005,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.70099999999999996,"15min":0.69199999999999995},"min":{"1min":0.55800000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93600000000000005,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.99299999999999999}]},{"osd":3,"last update":"Mon Oct 16 23:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.77500000000000002,"15min":0.76100000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.139,"5min":1.145,"15min":1.145},"last":1.028},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.69699999999999995,"15min":0.67700000000000005},"min":{"1min":0.38400000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":1.048}]},{"osd":4,"last update":"Mon Oct 16 23:29:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.84799999999999998,"15min":0.83199999999999996},"min":{"1min":0.75,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1399999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.90200000000000002,"15min":0.88900000000000001},"min":{"1min":0.63100000000000001,"5min":0.621,"15min":0.621},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.85299999999999998}]},{"osd":5,"last update":"Mon Oct 16 23:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.95799999999999996,"15min":0.93999999999999995},"min":{"1min":0.75600000000000001,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.92300000000000004,"15min":0.91300000000000003},"min":{"1min":0.76400000000000001,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2070000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.151}]},{"osd":6,"last update":"Mon Oct 16 23:29:31 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":0.98399999999999999,"15min":0.97599999999999998},"min":{"1min":0.74299999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.113},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.04,"15min":1.024},"min":{"1min":0.77300000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":1.093}]},{"osd":7,"last update":"Mon Oct 16 23:29:28 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.01,"15min":0.996},"min":{"1min":0.85199999999999998,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.0660000000000001,"15min":1.0509999999999999},"min":{"1min":0.88800000000000001,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3400000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.96099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T23:30:01.557 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-16T23:30:01.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.715+0000 7efbfd201640 1 Processor -- start 2023-10-16T23:30:01.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.715+0000 7efbfd201640 1 -- start start 2023-10-16T23:30:01.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.715+0000 7efbfd201640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efbf80bd450 0x7efbf80bd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:01.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.715+0000 7efbfd201640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efbf80b7fd0 0x7efbf8070170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:01.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.715+0000 7efbfd201640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbf814ca10 con 0x7efbf80b5ee0 2023-10-16T23:30:01.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.715+0000 7efbfd201640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbf80bdd70 con 0x7efbf80b7fd0 2023-10-16T23:30:01.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.715+0000 7efbfd201640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbf814cf40 con 0x7efbf80bd450 2023-10-16T23:30:01.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.715+0000 7efbf759e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efbf80b7fd0 0x7efbf8070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:01.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.715+0000 7efbf659c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efbf80b5ee0 0x7efbf8145bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45378/0 (socket says 172.21.15.12:45378) 2023-10-16T23:30:01.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.715+0000 7efbf659c640 1 -- 172.21.15.12:0/2532848144 learned_addr learned my addr 172.21.15.12:0/2532848144 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:30:01.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.715+0000 7efbf6d9d640 1 --2- 172.21.15.12:0/2532848144 >> v2:172.21.15.31:3300/0 conn(0x7efbf80bd450 0x7efbf80bd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:01.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.715+0000 7efbf759e640 1 -- 172.21.15.12:0/2532848144 >> v2:172.21.15.31:3300/0 conn(0x7efbf80bd450 msgr2=0x7efbf80bd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:30:01.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.715+0000 7efbf759e640 1 --2- 172.21.15.12:0/2532848144 >> v2:172.21.15.31:3300/0 conn(0x7efbf80bd450 0x7efbf80bd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:01.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.715+0000 7efbf759e640 1 -- 172.21.15.12:0/2532848144 >> v1:172.21.15.12:6789/0 conn(0x7efbf80b5ee0 legacy=0x7efbf8145bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:01.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.715+0000 7efbf759e640 1 -- 172.21.15.12:0/2532848144 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf814cc60 con 0x7efbf80b7fd0 2023-10-16T23:30:01.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.715+0000 7efbf5d9b640 1 -- 172.21.15.12:0/2532848144 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3086888908 0 0) 0x7efbf814ca10 con 0x7efbf80b5ee0 2023-10-16T23:30:01.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.715+0000 7efbf759e640 1 --2- 172.21.15.12:0/2532848144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf80b7fd0 0x7efbf8070170 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efbf80c1ab0 tx=0x7efbe801c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab82a067ebda532e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:01.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbf5d9b640 1 -- 172.21.15.12:0/2532848144 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe80ab600 con 0x7efbf80b7fd0 2023-10-16T23:30:01.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbf5d9b640 1 -- 172.21.15.12:0/2532848144 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe80a7050 con 0x7efbf80b7fd0 2023-10-16T23:30:01.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbf5d9b640 1 -- 172.21.15.12:0/2532848144 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe80ab980 con 0x7efbf80b7fd0 2023-10-16T23:30:01.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbfd201640 1 -- 172.21.15.12:0/2532848144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf80b7fd0 msgr2=0x7efbf8070170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:01.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbfd201640 1 --2- 172.21.15.12:0/2532848144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf80b7fd0 0x7efbf8070170 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efbf80c1ab0 tx=0x7efbe801c340 comp rx=0 tx=0).stop 2023-10-16T23:30:01.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbfd201640 1 -- 172.21.15.12:0/2532848144 shutdown_connections 2023-10-16T23:30:01.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbfd201640 1 --2- 172.21.15.12:0/2532848144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf80b7fd0 0x7efbf8070170 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:01.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbfd201640 1 --2- 172.21.15.12:0/2532848144 >> v2:172.21.15.31:3300/0 conn(0x7efbf80bd450 0x7efbf80bd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:01.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbfd201640 1 -- 172.21.15.12:0/2532848144 >> 172.21.15.12:0/2532848144 conn(0x7efbf80c0c80 msgr2=0x7efbf80c1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:30:01.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbfd201640 1 -- 172.21.15.12:0/2532848144 shutdown_connections 2023-10-16T23:30:01.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbfd201640 1 -- 172.21.15.12:0/2532848144 wait complete. 2023-10-16T23:30:01.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbfd201640 1 Processor -- start 2023-10-16T23:30:01.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbfd201640 1 -- start start 2023-10-16T23:30:01.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbfd201640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efbf80b5ee0 0x7efbf8144790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbfd201640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efbf80b7fd0 0x7efbf814b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbfd201640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf80bd450 0x7efbf81e4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbfd201640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf8147d00 con 0x7efbf80bd450 2023-10-16T23:30:01.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbfd201640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf8145530 con 0x7efbf80b5ee0 2023-10-16T23:30:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbfd201640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf81e5dc0 con 0x7efbf80b7fd0 2023-10-16T23:30:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbf759e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf80bd450 0x7efbf81e4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbf759e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf80bd450 0x7efbf81e4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42962/0 (socket says 172.21.15.12:42962) 2023-10-16T23:30:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbf759e640 1 -- 172.21.15.12:0/4071179377 learned_addr learned my addr 172.21.15.12:0/4071179377 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:30:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbf659c640 1 --2- 172.21.15.12:0/4071179377 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efbf80b7fd0 0x7efbf814b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbf6d9d640 1 --2- 172.21.15.12:0/4071179377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efbf80b5ee0 0x7efbf8144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbf759e640 1 -- 172.21.15.12:0/4071179377 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efbf80b7fd0 msgr2=0x7efbf814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:01.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbf759e640 1 --2- 172.21.15.12:0/4071179377 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efbf80b7fd0 0x7efbf814b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:01.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbf759e640 1 -- 172.21.15.12:0/4071179377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efbf80b5ee0 msgr2=0x7efbf8144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:01.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbf759e640 1 --2- 172.21.15.12:0/4071179377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efbf80b5ee0 0x7efbf8144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:01.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbf759e640 1 -- 172.21.15.12:0/4071179377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe8009420 con 0x7efbf80bd450 2023-10-16T23:30:01.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbf759e640 1 --2- 172.21.15.12:0/4071179377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf80bd450 0x7efbf81e4e50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7efbe80ae040 tx=0x7efbe80190e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:01.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbef7fe640 1 -- 172.21.15.12:0/4071179377 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe80b4430 con 0x7efbf80bd450 2023-10-16T23:30:01.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbef7fe640 1 -- 172.21.15.12:0/4071179377 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe80b4590 con 0x7efbf80bd450 2023-10-16T23:30:01.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbfd201640 1 -- 172.21.15.12:0/4071179377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf8142160 con 0x7efbf80bd450 2023-10-16T23:30:01.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbef7fe640 1 -- 172.21.15.12:0/4071179377 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe80b4920 con 0x7efbf80bd450 2023-10-16T23:30:01.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.719+0000 7efbfd201640 1 -- 172.21.15.12:0/4071179377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf8141e60 con 0x7efbf80bd450 2023-10-16T23:30:01.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.723+0000 7efbfd201640 1 -- 172.21.15.12:0/4071179377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbf8140ce0 con 0x7efbf80bd450 2023-10-16T23:30:01.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.723+0000 7efbef7fe640 1 -- 172.21.15.12:0/4071179377 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7efbe80b2040 con 0x7efbf80bd450 2023-10-16T23:30:01.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.723+0000 7efbef7fe640 1 --2- 172.21.15.12:0/4071179377 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efbd8065e60 0x7efbd8068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:01.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.723+0000 7efbef7fe640 1 -- 172.21.15.12:0/4071179377 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7efbf8070ec0 con 0x7efbf80bd450 2023-10-16T23:30:01.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.723+0000 7efbf6d9d640 1 --2- 172.21.15.12:0/4071179377 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efbd8065e60 0x7efbd8068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:01.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.723+0000 7efbf6d9d640 1 --2- 172.21.15.12:0/4071179377 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efbd8065e60 0x7efbd8068320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efbf0003fd0 tx=0x7efbf00039a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:01.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.727+0000 7efbef7fe640 1 -- 172.21.15.12:0/4071179377 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7efbf8140ce0 con 0x7efbf80bd450 2023-10-16T23:30:01.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.883+0000 7efbfd201640 1 -- 172.21.15.12:0/4071179377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7efbf81410c0 con 0x7efbf80bd450 2023-10-16T23:30:01.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.891+0000 7efbef7fe640 1 -- 172.21.15.12:0/4071179377 <== mon.0 v2:172.21.15.12:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efbe80eae70 con 0x7efbf80bd450 2023-10-16T23:30:01.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.891+0000 7efbef7fe640 1 -- 172.21.15.12:0/4071179377 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7efbf81410c0 con 0x7efbf80bd450 2023-10-16T23:30:01.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.895+0000 7efbfd201640 1 -- 172.21.15.12:0/4071179377 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efbd8065e60 msgr2=0x7efbd8068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:01.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.895+0000 7efbfd201640 1 --2- 172.21.15.12:0/4071179377 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efbd8065e60 0x7efbd8068320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efbf0003fd0 tx=0x7efbf00039a0 comp rx=0 tx=0).stop 2023-10-16T23:30:01.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.895+0000 7efbfd201640 1 -- 172.21.15.12:0/4071179377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf80bd450 msgr2=0x7efbf81e4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:01.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.895+0000 7efbfd201640 1 --2- 172.21.15.12:0/4071179377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf80bd450 0x7efbf81e4e50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7efbe80ae040 tx=0x7efbe80190e0 comp rx=0 tx=0).stop 2023-10-16T23:30:01.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.895+0000 7efbfd201640 1 -- 172.21.15.12:0/4071179377 shutdown_connections 2023-10-16T23:30:01.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.895+0000 7efbfd201640 1 --2- 172.21.15.12:0/4071179377 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7efbd8065e60 0x7efbd8068320 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:01.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.895+0000 7efbfd201640 1 --2- 172.21.15.12:0/4071179377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf80bd450 0x7efbf81e4e50 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:01.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.895+0000 7efbfd201640 1 --2- 172.21.15.12:0/4071179377 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efbf80b7fd0 0x7efbf814b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:01.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.895+0000 7efbfd201640 1 --2- 172.21.15.12:0/4071179377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efbf80b5ee0 0x7efbf8144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:01.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.895+0000 7efbfd201640 1 -- 172.21.15.12:0/4071179377 >> 172.21.15.12:0/4071179377 conn(0x7efbf80c0c80 msgr2=0x7efbf813f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:30:01.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.895+0000 7efbfd201640 1 -- 172.21.15.12:0/4071179377 shutdown_connections 2023-10-16T23:30:01.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:01.895+0000 7efbfd201640 1 -- 172.21.15.12:0/4071179377 wait complete. 2023-10-16T23:30:01.916 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-16T23:30:01.917 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T23:30:02.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.035+0000 7fe0cd6bc640 1 Processor -- start 2023-10-16T23:30:02.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.035+0000 7fe0cd6bc640 1 -- start start 2023-10-16T23:30:02.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.035+0000 7fe0cd6bc640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0c80c1130 0x7fe0c80b8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:02.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.035+0000 7fe0cd6bc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe0c814c520 0x7fe0c814c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:02.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.035+0000 7fe0cd6bc640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c80b40c0 con 0x7fe0c814cec0 2023-10-16T23:30:02.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.035+0000 7fe0cd6bc640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c80b3ca0 con 0x7fe0c814c520 2023-10-16T23:30:02.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.035+0000 7fe0cd6bc640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c80b7ce0 con 0x7fe0c80c1130 2023-10-16T23:30:02.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.035+0000 7fe0c67fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe0c814c520 0x7fe0c814c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:02.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.035+0000 7fe0c67fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe0c814c520 0x7fe0c814c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42972/0 (socket says 172.21.15.12:42972) 2023-10-16T23:30:02.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.035+0000 7fe0c67fc640 1 -- 172.21.15.12:0/2123711415 learned_addr learned my addr 172.21.15.12:0/2123711415 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:30:02.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.035+0000 7fe0c6ffd640 1 --2- 172.21.15.12:0/2123711415 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0c80c1130 0x7fe0c80b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:02.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.035+0000 7fe0c67fc640 1 -- 172.21.15.12:0/2123711415 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0c80c1130 msgr2=0x7fe0c80b8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:30:02.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.035+0000 7fe0c67fc640 1 --2- 172.21.15.12:0/2123711415 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0c80c1130 0x7fe0c80b8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.035+0000 7fe0c67fc640 1 -- 172.21.15.12:0/2123711415 >> v1:172.21.15.31:6789/0 conn(0x7fe0c814cec0 legacy=0x7fe0c80b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:02.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.035+0000 7fe0c67fc640 1 -- 172.21.15.12:0/2123711415 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c80c1510 con 0x7fe0c814c520 2023-10-16T23:30:02.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0c67fc640 1 --2- 172.21.15.12:0/2123711415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c814c520 0x7fe0c814c980 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009870 tx=0x7fe0bc01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59456d0e551d974 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:02.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0c5ffb640 1 -- 172.21.15.12:0/2123711415 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c80bac70 con 0x7fe0c814c520 2023-10-16T23:30:02.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0c5ffb640 1 -- 172.21.15.12:0/2123711415 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe0bc0a7070 con 0x7fe0c814c520 2023-10-16T23:30:02.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0c5ffb640 1 -- 172.21.15.12:0/2123711415 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc0ab880 con 0x7fe0c814c520 2023-10-16T23:30:02.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0cd6bc640 1 -- 172.21.15.12:0/2123711415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c814c520 msgr2=0x7fe0c814c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:02.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0cd6bc640 1 --2- 172.21.15.12:0/2123711415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c814c520 0x7fe0c814c980 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009870 tx=0x7fe0bc01c420 comp rx=0 tx=0).stop 2023-10-16T23:30:02.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0cd6bc640 1 -- 172.21.15.12:0/2123711415 shutdown_connections 2023-10-16T23:30:02.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0cd6bc640 1 --2- 172.21.15.12:0/2123711415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c814c520 0x7fe0c814c980 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0cd6bc640 1 --2- 172.21.15.12:0/2123711415 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0c80c1130 0x7fe0c80b8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0cd6bc640 1 -- 172.21.15.12:0/2123711415 >> 172.21.15.12:0/2123711415 conn(0x7fe0c806ba20 msgr2=0x7fe0c80c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:30:02.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0cd6bc640 1 -- 172.21.15.12:0/2123711415 shutdown_connections 2023-10-16T23:30:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0cd6bc640 1 -- 172.21.15.12:0/2123711415 wait complete. 2023-10-16T23:30:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0cd6bc640 1 Processor -- start 2023-10-16T23:30:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0cd6bc640 1 -- start start 2023-10-16T23:30:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0cd6bc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0c80c1130 0x7fe0c8148220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:02.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0cd6bc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c814c520 0x7fe0c8142af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:02.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0cd6bc640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0c814cec0 0x7fe0c8143030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:02.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0cd6bc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c81eba00 con 0x7fe0c814c520 2023-10-16T23:30:02.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0cd6bc640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c8148760 con 0x7fe0c80c1130 2023-10-16T23:30:02.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0cd6bc640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c80b48a0 con 0x7fe0c814cec0 2023-10-16T23:30:02.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0c67fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c814c520 0x7fe0c8142af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:02.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0c67fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c814c520 0x7fe0c8142af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42984/0 (socket says 172.21.15.12:42984) 2023-10-16T23:30:02.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0c67fc640 1 -- 172.21.15.12:0/4190830450 learned_addr learned my addr 172.21.15.12:0/4190830450 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:30:02.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0c77fe640 1 --2- 172.21.15.12:0/4190830450 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0c814cec0 0x7fe0c8143030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:02.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0c6ffd640 1 --2- 172.21.15.12:0/4190830450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0c80c1130 0x7fe0c8148220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:02.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0c67fc640 1 -- 172.21.15.12:0/4190830450 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0c814cec0 msgr2=0x7fe0c8143030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:02.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0c67fc640 1 --2- 172.21.15.12:0/4190830450 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0c814cec0 0x7fe0c8143030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0c67fc640 1 -- 172.21.15.12:0/4190830450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0c80c1130 msgr2=0x7fe0c8148220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:02.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0c67fc640 1 --2- 172.21.15.12:0/4190830450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0c80c1130 0x7fe0c8148220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0c67fc640 1 -- 172.21.15.12:0/4190830450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc0094d0 con 0x7fe0c814c520 2023-10-16T23:30:02.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.039+0000 7fe0c67fc640 1 --2- 172.21.15.12:0/4190830450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c814c520 0x7fe0c8142af0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc01ccc0 tx=0x7fe0bc01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:02.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.043+0000 7fe0af7fe640 1 -- 172.21.15.12:0/4190830450 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc0be3f0 con 0x7fe0c814c520 2023-10-16T23:30:02.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.043+0000 7fe0af7fe640 1 -- 172.21.15.12:0/4190830450 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe0bc0be550 con 0x7fe0c814c520 2023-10-16T23:30:02.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.043+0000 7fe0cd6bc640 1 -- 172.21.15.12:0/4190830450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c80b4b80 con 0x7fe0c814c520 2023-10-16T23:30:02.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.043+0000 7fe0af7fe640 1 -- 172.21.15.12:0/4190830450 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc0be920 con 0x7fe0c814c520 2023-10-16T23:30:02.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.043+0000 7fe0cd6bc640 1 -- 172.21.15.12:0/4190830450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c80b6290 con 0x7fe0c814c520 2023-10-16T23:30:02.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.043+0000 7fe0cd6bc640 1 -- 172.21.15.12:0/4190830450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c81ebb40 con 0x7fe0c814c520 2023-10-16T23:30:02.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.043+0000 7fe0af7fe640 1 -- 172.21.15.12:0/4190830450 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fe0bc0c7440 con 0x7fe0c814c520 2023-10-16T23:30:02.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.043+0000 7fe0af7fe640 1 --2- 172.21.15.12:0/4190830450 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe0b4065e60 0x7fe0b4068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:02.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.043+0000 7fe0af7fe640 1 -- 172.21.15.12:0/4190830450 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe0bc11e2a0 con 0x7fe0c814c520 2023-10-16T23:30:02.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.043+0000 7fe0c6ffd640 1 --2- 172.21.15.12:0/4190830450 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe0b4065e60 0x7fe0b4068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:02.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.043+0000 7fe0c6ffd640 1 --2- 172.21.15.12:0/4190830450 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe0b4065e60 0x7fe0b4068320 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8009af0 tx=0x7fe0b8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:02.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.047+0000 7fe0af7fe640 1 -- 172.21.15.12:0/4190830450 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fe0c81ebb40 con 0x7fe0c814c520 2023-10-16T23:30:02.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.239+0000 7fe0cd6bc640 1 -- 172.21.15.12:0/4190830450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0c81ebb40 con 0x7fe0c814c520 2023-10-16T23:30:02.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.239+0000 7fe0af7fe640 1 -- 172.21.15.12:0/4190830450 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3127 (secure 0 0 0) 0x7fe0c81ebb40 con 0x7fe0c814c520 2023-10-16T23:30:02.245 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:30:02.245 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3365013557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3365013557},{"type":"v1","addr":"172.21.15.31:6835","nonce":3365013557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T23:27:40.686789+0000","modified":"2023-10-16T23:27:43.696789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6833/593938276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":593938276},{"type":"v1","addr":"172.21.15.12:6833","nonce":593938276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T23:30:02.246 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2023-10-16T23:30:02.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.243+0000 7fe0cd6bc640 1 -- 172.21.15.12:0/4190830450 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe0b4065e60 msgr2=0x7fe0b4068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:02.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.243+0000 7fe0cd6bc640 1 --2- 172.21.15.12:0/4190830450 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe0b4065e60 0x7fe0b4068320 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8009af0 tx=0x7fe0b8008040 comp rx=0 tx=0).stop 2023-10-16T23:30:02.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.243+0000 7fe0cd6bc640 1 -- 172.21.15.12:0/4190830450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c814c520 msgr2=0x7fe0c8142af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:02.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.243+0000 7fe0cd6bc640 1 --2- 172.21.15.12:0/4190830450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c814c520 0x7fe0c8142af0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc01ccc0 tx=0x7fe0bc01ac60 comp rx=0 tx=0).stop 2023-10-16T23:30:02.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.243+0000 7fe0cd6bc640 1 -- 172.21.15.12:0/4190830450 shutdown_connections 2023-10-16T23:30:02.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.243+0000 7fe0cd6bc640 1 --2- 172.21.15.12:0/4190830450 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fe0b4065e60 0x7fe0b4068320 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.243+0000 7fe0cd6bc640 1 --2- 172.21.15.12:0/4190830450 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe0c814cec0 0x7fe0c8143030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.243+0000 7fe0cd6bc640 1 --2- 172.21.15.12:0/4190830450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0c814c520 0x7fe0c8142af0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.243+0000 7fe0cd6bc640 1 --2- 172.21.15.12:0/4190830450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0c80c1130 0x7fe0c8148220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.243+0000 7fe0cd6bc640 1 -- 172.21.15.12:0/4190830450 >> 172.21.15.12:0/4190830450 conn(0x7fe0c806ba20 msgr2=0x7fe0c8145dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:30:02.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.243+0000 7fe0cd6bc640 1 -- 172.21.15.12:0/4190830450 shutdown_connections 2023-10-16T23:30:02.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.243+0000 7fe0cd6bc640 1 -- 172.21.15.12:0/4190830450 wait complete. 2023-10-16T23:30:02.264 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T23:30:02.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.387+0000 7fb00d315640 1 Processor -- start 2023-10-16T23:30:02.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.387+0000 7fb00d315640 1 -- start start 2023-10-16T23:30:02.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.387+0000 7fb00d315640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb0080c1da0 0x7fb008070c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:02.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.387+0000 7fb00d315640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0080bb420 0x7fb008138520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:02.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.387+0000 7fb00d315640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0080704e0 con 0x7fb008138a60 2023-10-16T23:30:02.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.387+0000 7fb00d315640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0080bb180 con 0x7fb0080c1da0 2023-10-16T23:30:02.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.387+0000 7fb00d315640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00814f430 con 0x7fb0080bb420 2023-10-16T23:30:02.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.387+0000 7fb0067fc640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0080bb420 0x7fb008138520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:02.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.387+0000 7fb006ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb0080c1da0 0x7fb008070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:02.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.387+0000 7fb0067fc640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0080bb420 0x7fb008138520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.12:39470/0 (socket says 172.21.15.12:39470) 2023-10-16T23:30:02.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.387+0000 7fb0077fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb008138a60 0x7fb00806e6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.12:34584/0 (socket says 172.21.15.12:34584) 2023-10-16T23:30:02.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.387+0000 7fb0077fe640 1 -- 172.21.15.12:0/2286478872 learned_addr learned my addr 172.21.15.12:0/2286478872 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:30:02.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.387+0000 7fb006ffd640 1 -- 172.21.15.12:0/2286478872 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0080bb420 msgr2=0x7fb008138520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:30:02.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.387+0000 7fb006ffd640 1 --2- 172.21.15.12:0/2286478872 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0080bb420 0x7fb008138520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.387+0000 7fb006ffd640 1 -- 172.21.15.12:0/2286478872 >> v1:172.21.15.31:6789/0 conn(0x7fb008138a60 legacy=0x7fb00806e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:02.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.387+0000 7fb005ffb640 1 -- 172.21.15.12:0/2286478872 <== mon.1 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3285160394 0 0) 0x7fb0080704e0 con 0x7fb008138a60 2023-10-16T23:30:02.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.387+0000 7fb006ffd640 1 -- 172.21.15.12:0/2286478872 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0080bada0 con 0x7fb0080c1da0 2023-10-16T23:30:02.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.387+0000 7fb0067fc640 1 --2- 172.21.15.12:0/2286478872 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0080bb420 0x7fb008138520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T23:30:02.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.391+0000 7fb006ffd640 1 --2- 172.21.15.12:0/2286478872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0080c1da0 0x7fb008070c80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faff80097c0 tx=0x7faff801c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d18941284e07f6a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:02.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.391+0000 7fb005ffb640 1 -- 172.21.15.12:0/2286478872 <== mon.1 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff80ad660 con 0x7fb0080c1da0 2023-10-16T23:30:02.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.391+0000 7fb005ffb640 1 -- 172.21.15.12:0/2286478872 <== mon.1 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7faff80ad7c0 con 0x7fb0080c1da0 2023-10-16T23:30:02.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.391+0000 7fb005ffb640 1 -- 172.21.15.12:0/2286478872 <== mon.1 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff80adb70 con 0x7fb0080c1da0 2023-10-16T23:30:02.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.391+0000 7fb00d315640 1 -- 172.21.15.12:0/2286478872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0080c1da0 msgr2=0x7fb008070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:02.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.391+0000 7fb00d315640 1 --2- 172.21.15.12:0/2286478872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0080c1da0 0x7fb008070c80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faff80097c0 tx=0x7faff801c420 comp rx=0 tx=0).stop 2023-10-16T23:30:02.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.391+0000 7fb00d315640 1 -- 172.21.15.12:0/2286478872 shutdown_connections 2023-10-16T23:30:02.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.391+0000 7fb00d315640 1 --2- 172.21.15.12:0/2286478872 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb0080bb420 0x7fb008138520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.391+0000 7fb00d315640 1 --2- 172.21.15.12:0/2286478872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0080c1da0 0x7fb008070c80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.391+0000 7fb00d315640 1 -- 172.21.15.12:0/2286478872 >> 172.21.15.12:0/2286478872 conn(0x7fb00806b830 msgr2=0x7fb00806bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:30:02.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.391+0000 7fb00d315640 1 -- 172.21.15.12:0/2286478872 shutdown_connections 2023-10-16T23:30:02.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.391+0000 7fb00d315640 1 -- 172.21.15.12:0/2286478872 wait complete. 2023-10-16T23:30:02.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.391+0000 7fb00d315640 1 Processor -- start 2023-10-16T23:30:02.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.391+0000 7fb00d315640 1 -- start start 2023-10-16T23:30:02.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fb00d315640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0080bb420 0x7fb008137b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:02.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fb00d315640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb008138a60 0x7fb0081373b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:02.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fb00d315640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb008136a30 0x7fb00812e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:02.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fb00d315640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0081518a0 con 0x7fb0080bb420 2023-10-16T23:30:02.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fb00d315640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0081378f0 con 0x7fb008136a30 2023-10-16T23:30:02.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fb00d315640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0080c10d0 con 0x7fb008138a60 2023-10-16T23:30:02.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fb006ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0080bb420 0x7fb008137b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:02.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fb006ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0080bb420 0x7fb008137b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42986/0 (socket says 172.21.15.12:42986) 2023-10-16T23:30:02.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fb006ffd640 1 -- 172.21.15.12:0/555093376 learned_addr learned my addr 172.21.15.12:0/555093376 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:30:02.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fb0067fc640 1 --2- 172.21.15.12:0/555093376 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb008138a60 0x7fb0081373b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:02.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fb0077fe640 1 --2- 172.21.15.12:0/555093376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb008136a30 0x7fb00812e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:02.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fb006ffd640 1 -- 172.21.15.12:0/555093376 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb008138a60 msgr2=0x7fb0081373b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:02.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fb006ffd640 1 --2- 172.21.15.12:0/555093376 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb008138a60 0x7fb0081373b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fb006ffd640 1 -- 172.21.15.12:0/555093376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb008136a30 msgr2=0x7fb00812e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:02.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fb006ffd640 1 --2- 172.21.15.12:0/555093376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb008136a30 0x7fb00812e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fb006ffd640 1 -- 172.21.15.12:0/555093376 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faffc009420 con 0x7fb0080bb420 2023-10-16T23:30:02.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fb006ffd640 1 --2- 172.21.15.12:0/555093376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0080bb420 0x7fb008137b30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7faff8000c10 tx=0x7faff8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:02.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fafef7fe640 1 -- 172.21.15.12:0/555093376 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff8004230 con 0x7fb0080bb420 2023-10-16T23:30:02.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fafef7fe640 1 -- 172.21.15.12:0/555093376 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7faff8004390 con 0x7fb0080bb420 2023-10-16T23:30:02.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fb00d315640 1 -- 172.21.15.12:0/555093376 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff8009420 con 0x7fb0080bb420 2023-10-16T23:30:02.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fafef7fe640 1 -- 172.21.15.12:0/555093376 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff8003840 con 0x7fb0080bb420 2023-10-16T23:30:02.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fb00d315640 1 -- 172.21.15.12:0/555093376 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0081e7360 con 0x7fb0080bb420 2023-10-16T23:30:02.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fb00d315640 1 -- 172.21.15.12:0/555093376 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0081e7190 con 0x7fb0080bb420 2023-10-16T23:30:02.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fafef7fe640 1 -- 172.21.15.12:0/555093376 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7faff80b4040 con 0x7fb0080bb420 2023-10-16T23:30:02.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fafef7fe640 1 --2- 172.21.15.12:0/555093376 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7faff4065e90 0x7faff4068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:02.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fafef7fe640 1 -- 172.21.15.12:0/555093376 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7faff811ce80 con 0x7fb0080bb420 2023-10-16T23:30:02.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.395+0000 7fb0067fc640 1 --2- 172.21.15.12:0/555093376 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7faff4065e90 0x7faff4068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:02.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.399+0000 7fb0067fc640 1 --2- 172.21.15.12:0/555093376 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7faff4065e90 0x7faff4068350 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb00814bf30 tx=0x7faffc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:02.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.399+0000 7fafef7fe640 1 -- 172.21.15.12:0/555093376 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7faff80ea490 con 0x7fb0080bb420 2023-10-16T23:30:02.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.591+0000 7fb00d315640 1 -- 172.21.15.12:0/555093376 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0081e7550 con 0x7fb0080bb420 2023-10-16T23:30:02.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.595+0000 7fafef7fe640 1 -- 172.21.15.12:0/555093376 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3127 (secure 0 0 0) 0x7faff80bec50 con 0x7fb0080bb420 2023-10-16T23:30:02.598 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:30:02.599 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3365013557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3365013557},{"type":"v1","addr":"172.21.15.31:6835","nonce":3365013557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T23:27:40.686789+0000","modified":"2023-10-16T23:27:43.696789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6833/593938276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":593938276},{"type":"v1","addr":"172.21.15.12:6833","nonce":593938276}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T23:30:02.599 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2023-10-16T23:30:02.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.595+0000 7fb00d315640 1 -- 172.21.15.12:0/555093376 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7faff4065e90 msgr2=0x7faff4068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:02.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.595+0000 7fb00d315640 1 --2- 172.21.15.12:0/555093376 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7faff4065e90 0x7faff4068350 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb00814bf30 tx=0x7faffc008040 comp rx=0 tx=0).stop 2023-10-16T23:30:02.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.595+0000 7fb00d315640 1 -- 172.21.15.12:0/555093376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0080bb420 msgr2=0x7fb008137b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:02.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.595+0000 7fb00d315640 1 --2- 172.21.15.12:0/555093376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0080bb420 0x7fb008137b30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7faff8000c10 tx=0x7faff8019220 comp rx=0 tx=0).stop 2023-10-16T23:30:02.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.595+0000 7fb00d315640 1 -- 172.21.15.12:0/555093376 shutdown_connections 2023-10-16T23:30:02.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.595+0000 7fb00d315640 1 --2- 172.21.15.12:0/555093376 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7faff4065e90 0x7faff4068350 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.595+0000 7fb00d315640 1 --2- 172.21.15.12:0/555093376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb008136a30 0x7fb00812e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.595+0000 7fb00d315640 1 --2- 172.21.15.12:0/555093376 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb008138a60 0x7fb0081373b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.595+0000 7fb00d315640 1 --2- 172.21.15.12:0/555093376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0080bb420 0x7fb008137b30 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.595+0000 7fb00d315640 1 -- 172.21.15.12:0/555093376 >> 172.21.15.12:0/555093376 conn(0x7fb00806b830 msgr2=0x7fb00806e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:30:02.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.595+0000 7fb00d315640 1 -- 172.21.15.12:0/555093376 shutdown_connections 2023-10-16T23:30:02.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.595+0000 7fb00d315640 1 -- 172.21.15.12:0/555093376 wait complete. 2023-10-16T23:30:02.617 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T23:30:02.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.727+0000 7fd81162b640 1 Processor -- start 2023-10-16T23:30:02.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.727+0000 7fd81162b640 1 -- start start 2023-10-16T23:30:02.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd81162b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd80c0c1130 0x7fd80c14fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:02.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd81162b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd80c071510 0x7fd80c150070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd81162b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd80c06f350 con 0x7fd80c0ba570 2023-10-16T23:30:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd81162b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd80c1505b0 con 0x7fd80c0c1130 2023-10-16T23:30:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd81162b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c06f630 con 0x7fd80c071510 2023-10-16T23:30:02.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd80b7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd80c0ba570 0x7fd80c0bbf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45386/0 (socket says 172.21.15.12:45386) 2023-10-16T23:30:02.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd80b7fe640 1 -- 172.21.15.12:0/538082562 learned_addr learned my addr 172.21.15.12:0/538082562 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:30:02.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd80affd640 1 --2- 172.21.15.12:0/538082562 >> v2:172.21.15.31:3300/0 conn(0x7fd80c0c1130 0x7fd80c14fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:02.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd80a7fc640 1 --2- 172.21.15.12:0/538082562 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd80c071510 0x7fd80c150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:02.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd809ffb640 1 -- 172.21.15.12:0/538082562 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4026202500 0 0) 0x7fd80c06f350 con 0x7fd80c0ba570 2023-10-16T23:30:02.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd809ffb640 1 -- 172.21.15.12:0/538082562 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7f4003530 con 0x7fd80c0ba570 2023-10-16T23:30:02.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd809ffb640 1 -- 172.21.15.12:0/538082562 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 444965108 0 0) 0x7fd7f4003530 con 0x7fd80c0ba570 2023-10-16T23:30:02.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd809ffb640 1 -- 172.21.15.12:0/538082562 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd80c071510 msgr2=0x7fd80c150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:30:02.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd809ffb640 1 --2- 172.21.15.12:0/538082562 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd80c071510 0x7fd80c150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd809ffb640 1 -- 172.21.15.12:0/538082562 >> v2:172.21.15.31:3300/0 conn(0x7fd80c0c1130 msgr2=0x7fd80c14fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:30:02.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd809ffb640 1 --2- 172.21.15.12:0/538082562 >> v2:172.21.15.31:3300/0 conn(0x7fd80c0c1130 0x7fd80c14fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd809ffb640 1 -- 172.21.15.12:0/538082562 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80c14f610 con 0x7fd80c0ba570 2023-10-16T23:30:02.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd809ffb640 1 -- 172.21.15.12:0/538082562 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7fd804001a00 con 0x7fd80c0ba570 2023-10-16T23:30:02.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd80affd640 1 --2- 172.21.15.12:0/538082562 >> v2:172.21.15.31:3300/0 conn(0x7fd80c0c1130 0x7fd80c14fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T23:30:02.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd809ffb640 1 -- 172.21.15.12:0/538082562 >> v1:172.21.15.12:6789/0 conn(0x7fd80c0ba570 legacy=0x7fd80c0bbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:02.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd809ffb640 1 --2- 172.21.15.12:0/538082562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7f4003980 0x7fd7f4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:02.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd809ffb640 1 --2- 172.21.15.12:0/538082562 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd80c071510 0x7fd7f40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:02.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd809ffb640 1 --2- 172.21.15.12:0/538082562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7f4004d10 0x7fd7f4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:02.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd809ffb640 1 -- 172.21.15.12:0/538082562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c1505b0 con 0x7fd7f4003980 2023-10-16T23:30:02.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd809ffb640 1 -- 172.21.15.12:0/538082562 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c06f630 con 0x7fd7f4004d10 2023-10-16T23:30:02.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd809ffb640 1 -- 172.21.15.12:0/538082562 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f400b990 con 0x7fd80c071510 2023-10-16T23:30:02.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd80affd640 1 --2- 172.21.15.12:0/538082562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7f4003980 0x7fd7f4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:02.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd80a7fc640 1 --2- 172.21.15.12:0/538082562 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd80c071510 0x7fd7f40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:02.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd80affd640 1 -- 172.21.15.12:0/538082562 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd80c071510 msgr2=0x7fd7f40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:30:02.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd80affd640 1 --2- 172.21.15.12:0/538082562 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd80c071510 0x7fd7f40047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd80b7fe640 1 --2- 172.21.15.12:0/538082562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7f4004d10 0x7fd7f4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:02.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd80affd640 1 -- 172.21.15.12:0/538082562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7f4004d10 msgr2=0x7fd7f4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:30:02.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd80affd640 1 --2- 172.21.15.12:0/538082562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7f4004d10 0x7fd7f4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd80affd640 1 -- 172.21.15.12:0/538082562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f4003530 con 0x7fd7f4003980 2023-10-16T23:30:02.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.731+0000 7fd80b7fe640 1 --2- 172.21.15.12:0/538082562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7f4004d10 0x7fd7f4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:30:02.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd80affd640 1 --2- 172.21.15.12:0/538082562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7f4003980 0x7fd7f4003da0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009cb0 tx=0x7fd7fc01cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53ed1db498f672d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:02.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd809ffb640 1 -- 172.21.15.12:0/538082562 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc0a5820 con 0x7fd7f4003980 2023-10-16T23:30:02.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd809ffb640 1 -- 172.21.15.12:0/538082562 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd7fc0a5980 con 0x7fd7f4003980 2023-10-16T23:30:02.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd809ffb640 1 -- 172.21.15.12:0/538082562 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc0a5d30 con 0x7fd7f4003980 2023-10-16T23:30:02.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd81162b640 1 -- 172.21.15.12:0/538082562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7f4003980 msgr2=0x7fd7f4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:02.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd81162b640 1 --2- 172.21.15.12:0/538082562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7f4003980 0x7fd7f4003da0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009cb0 tx=0x7fd7fc01cc70 comp rx=0 tx=0).stop 2023-10-16T23:30:02.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd80b7fe640 1 -- 172.21.15.12:0/538082562 reap_dead start 2023-10-16T23:30:02.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd81162b640 1 -- 172.21.15.12:0/538082562 shutdown_connections 2023-10-16T23:30:02.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd81162b640 1 -- 172.21.15.12:0/538082562 >> 172.21.15.12:0/538082562 conn(0x7fd80c06ba20 msgr2=0x7fd80c0c07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:30:02.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd81162b640 1 -- 172.21.15.12:0/538082562 shutdown_connections 2023-10-16T23:30:02.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd81162b640 1 -- 172.21.15.12:0/538082562 wait complete. 2023-10-16T23:30:02.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd81162b640 1 Processor -- start 2023-10-16T23:30:02.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd81162b640 1 -- start start 2023-10-16T23:30:02.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd81162b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7f4003980 0x7fd80c155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:02.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd81162b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd80c0b4f40 0x7fd80c1e91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:02.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd81162b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd80c1e9730 0x7fd80c0b5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:02.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd81162b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c0a7780 con 0x7fd80c0b4f40 2023-10-16T23:30:02.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd81162b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c1e8a80 con 0x7fd7f4003980 2023-10-16T23:30:02.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd81162b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c1e8d60 con 0x7fd80c1e9730 2023-10-16T23:30:02.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd80a7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd80c0b4f40 0x7fd80c1e91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:02.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd80a7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd80c0b4f40 0x7fd80c1e91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43004/0 (socket says 172.21.15.12:43004) 2023-10-16T23:30:02.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd80a7fc640 1 -- 172.21.15.12:0/4019946841 learned_addr learned my addr 172.21.15.12:0/4019946841 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:30:02.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd80affd640 1 --2- 172.21.15.12:0/4019946841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7f4003980 0x7fd80c155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:02.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd80b7fe640 1 --2- 172.21.15.12:0/4019946841 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd80c1e9730 0x7fd80c0b5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:02.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd80a7fc640 1 -- 172.21.15.12:0/4019946841 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd80c1e9730 msgr2=0x7fd80c0b5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:02.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd80a7fc640 1 --2- 172.21.15.12:0/4019946841 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd80c1e9730 0x7fd80c0b5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd80a7fc640 1 -- 172.21.15.12:0/4019946841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7f4003980 msgr2=0x7fd80c155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:02.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd80a7fc640 1 --2- 172.21.15.12:0/4019946841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7f4003980 0x7fd80c155170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.735+0000 7fd80a7fc640 1 -- 172.21.15.12:0/4019946841 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80c1556b0 con 0x7fd80c0b4f40 2023-10-16T23:30:02.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.739+0000 7fd80a7fc640 1 --2- 172.21.15.12:0/4019946841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd80c0b4f40 0x7fd80c1e91f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd800010850 tx=0x7fd800010d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:02.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.739+0000 7fd7f37fe640 1 -- 172.21.15.12:0/4019946841 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8000095d0 con 0x7fd80c0b4f40 2023-10-16T23:30:02.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.739+0000 7fd7f37fe640 1 -- 172.21.15.12:0/4019946841 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd80000eb00 con 0x7fd80c0b4f40 2023-10-16T23:30:02.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.739+0000 7fd81162b640 1 -- 172.21.15.12:0/4019946841 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80c0b2ef0 con 0x7fd80c0b4f40 2023-10-16T23:30:02.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.739+0000 7fd7f37fe640 1 -- 172.21.15.12:0/4019946841 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80000eeb0 con 0x7fd80c0b4f40 2023-10-16T23:30:02.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.739+0000 7fd81162b640 1 -- 172.21.15.12:0/4019946841 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80c0b42a0 con 0x7fd80c0b4f40 2023-10-16T23:30:02.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.739+0000 7fd81162b640 1 -- 172.21.15.12:0/4019946841 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd80c0b2d50 con 0x7fd80c0b4f40 2023-10-16T23:30:02.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.739+0000 7fd7f37fe640 1 -- 172.21.15.12:0/4019946841 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fd80001c400 con 0x7fd80c0b4f40 2023-10-16T23:30:02.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.739+0000 7fd7f37fe640 1 --2- 172.21.15.12:0/4019946841 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd7f8065e90 0x7fd7f8068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:02.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.739+0000 7fd7f37fe640 1 -- 172.21.15.12:0/4019946841 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd800083c80 con 0x7fd80c0b4f40 2023-10-16T23:30:02.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.739+0000 7fd80affd640 1 --2- 172.21.15.12:0/4019946841 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd7f8065e90 0x7fd7f8068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:02.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.739+0000 7fd80affd640 1 --2- 172.21.15.12:0/4019946841 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd7f8065e90 0x7fd7f8068350 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0af000 tx=0x7fd7fc0046d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:02.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.743+0000 7fd7f37fe640 1 -- 172.21.15.12:0/4019946841 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fd80c0b2d50 con 0x7fd80c0b4f40 2023-10-16T23:30:02.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.899+0000 7fd81162b640 1 -- 172.21.15.12:0/4019946841 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd80c0b2d50 con 0x7fd80c0b4f40 2023-10-16T23:30:02.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.903+0000 7fd7f37fe640 1 -- 172.21.15.12:0/4019946841 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17857 (secure 0 0 0) 0x7fd80c0b2d50 con 0x7fd80c0b4f40 2023-10-16T23:30:02.906 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-16T23:30:02.907 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":26,"fsid":"0ce5ccd9-1e4b-4da7-a5f7-b5c8cb738f51","created":"2023-10-16T23:27:16.468087+0000","modified":"2023-10-16T23:28:23.417777+0000","last_up_change":"2023-10-16T23:27:28.136202+0000","last_in_change":"2023-10-16T23:27:18.793212+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T23:27:27.354025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-16T23:27:34.786446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-16T23:27:39.130341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-16T23:27:39.674572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73e70f98-6f5e-4464-b34e-931faac41cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":38075},{"type":"v1","addr":"172.21.15.12:6814","nonce":38075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":38075},{"type":"v1","addr":"172.21.15.12:6819","nonce":38075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":38075},{"type":"v1","addr":"172.21.15.12:6827","nonce":38075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":38075},{"type":"v1","addr":"172.21.15.12:6823","nonce":38075}]},"public_addr":"172.21.15.12:6814/38075","cluster_addr":"172.21.15.12:6819/38075","heartbeat_back_addr":"172.21.15.12:6827/38075","heartbeat_front_addr":"172.21.15.12:6823/38075","state":["exists","up"]},{"osd":1,"uuid":"ff722efe-b3f9-4cc0-bbde-f4d4d8055a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":38076},{"type":"v1","addr":"172.21.15.12:6811","nonce":38076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":38076},{"type":"v1","addr":"172.21.15.12:6818","nonce":38076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":38076},{"type":"v1","addr":"172.21.15.12:6831","nonce":38076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":38076},{"type":"v1","addr":"172.21.15.12:6825","nonce":38076}]},"public_addr":"172.21.15.12:6811/38076","cluster_addr":"172.21.15.12:6818/38076","heartbeat_back_addr":"172.21.15.12:6831/38076","heartbeat_front_addr":"172.21.15.12:6825/38076","state":["exists","up"]},{"osd":2,"uuid":"9baf25db-dce0-4065-90d6-f35867286be2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6809","nonce":38073},{"type":"v1","addr":"172.21.15.12:6810","nonce":38073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":38073},{"type":"v1","addr":"172.21.15.12:6817","nonce":38073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":38073},{"type":"v1","addr":"172.21.15.12:6830","nonce":38073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":38073},{"type":"v1","addr":"172.21.15.12:6826","nonce":38073}]},"public_addr":"172.21.15.12:6810/38073","cluster_addr":"172.21.15.12:6817/38073","heartbeat_back_addr":"172.21.15.12:6830/38073","heartbeat_front_addr":"172.21.15.12:6826/38073","state":["exists","up"]},{"osd":3,"uuid":"8a620ad3-2294-470d-8a8c-66f177f5fbe7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":38074},{"type":"v1","addr":"172.21.15.12:6801","nonce":38074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":38074},{"type":"v1","addr":"172.21.15.12:6803","nonce":38074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":38074},{"type":"v1","addr":"172.21.15.12:6807","nonce":38074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":38074},{"type":"v1","addr":"172.21.15.12:6805","nonce":38074}]},"public_addr":"172.21.15.12:6801/38074","cluster_addr":"172.21.15.12:6803/38074","heartbeat_back_addr":"172.21.15.12:6807/38074","heartbeat_front_addr":"172.21.15.12:6805/38074","state":["exists","up"]},{"osd":4,"uuid":"a8824d77-7405-40f5-9234-60889802b184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":38266},{"type":"v1","addr":"172.21.15.31:6817","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":38266},{"type":"v1","addr":"172.21.15.31:6819","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":38266},{"type":"v1","addr":"172.21.15.31:6823","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":38266},{"type":"v1","addr":"172.21.15.31:6821","nonce":38266}]},"public_addr":"172.21.15.31:6817/38266","cluster_addr":"172.21.15.31:6819/38266","heartbeat_back_addr":"172.21.15.31:6823/38266","heartbeat_front_addr":"172.21.15.31:6821/38266","state":["exists","up"]},{"osd":5,"uuid":"3bb01192-a47c-48e9-9662-285e3f6f4b57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":38264},{"type":"v1","addr":"172.21.15.31:6807","nonce":38264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":38264},{"type":"v1","addr":"172.21.15.31:6811","nonce":38264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":38264},{"type":"v1","addr":"172.21.15.31:6815","nonce":38264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":38264},{"type":"v1","addr":"172.21.15.31:6813","nonce":38264}]},"public_addr":"172.21.15.31:6807/38264","cluster_addr":"172.21.15.31:6811/38264","heartbeat_back_addr":"172.21.15.31:6815/38264","heartbeat_front_addr":"172.21.15.31:6813/38264","state":["exists","up"]},{"osd":6,"uuid":"1e2d18e4-73e6-4a37-826c-35eca4d96935","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":38263},{"type":"v1","addr":"172.21.15.31:6825","nonce":38263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":38263},{"type":"v1","addr":"172.21.15.31:6827","nonce":38263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":38263},{"type":"v1","addr":"172.21.15.31:6831","nonce":38263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":38263},{"type":"v1","addr":"172.21.15.31:6829","nonce":38263}]},"public_addr":"172.21.15.31:6825/38263","cluster_addr":"172.21.15.31:6827/38263","heartbeat_back_addr":"172.21.15.31:6831/38263","heartbeat_front_addr":"172.21.15.31:6829/38263","state":["exists","up"]},{"osd":7,"uuid":"e0f369c0-562b-4440-a5aa-12275c29412b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":38265},{"type":"v1","addr":"172.21.15.31:6801","nonce":38265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":38265},{"type":"v1","addr":"172.21.15.31:6803","nonce":38265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":38265},{"type":"v1","addr":"172.21.15.31:6810","nonce":38265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":38265},{"type":"v1","addr":"172.21.15.31:6806","nonce":38265}]},"public_addr":"172.21.15.31:6801/38265","cluster_addr":"172.21.15.31:6803/38265","heartbeat_back_addr":"172.21.15.31:6810/38265","heartbeat_front_addr":"172.21.15.31:6806/38265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.411815+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.372565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.209700+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.414619+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.316843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.300348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.359800+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T23:27:24.219854+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T23:30:02.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.903+0000 7fd81162b640 1 -- 172.21.15.12:0/4019946841 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd7f8065e90 msgr2=0x7fd7f8068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:02.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.903+0000 7fd81162b640 1 --2- 172.21.15.12:0/4019946841 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd7f8065e90 0x7fd7f8068350 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0af000 tx=0x7fd7fc0046d0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.903+0000 7fd81162b640 1 -- 172.21.15.12:0/4019946841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd80c0b4f40 msgr2=0x7fd80c1e91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:02.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.903+0000 7fd81162b640 1 --2- 172.21.15.12:0/4019946841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd80c0b4f40 0x7fd80c1e91f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd800010850 tx=0x7fd800010d10 comp rx=0 tx=0).stop 2023-10-16T23:30:02.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.903+0000 7fd81162b640 1 -- 172.21.15.12:0/4019946841 shutdown_connections 2023-10-16T23:30:02.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.903+0000 7fd81162b640 1 --2- 172.21.15.12:0/4019946841 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fd7f8065e90 0x7fd7f8068350 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.903+0000 7fd81162b640 1 --2- 172.21.15.12:0/4019946841 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd80c1e9730 0x7fd80c0b5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.903+0000 7fd81162b640 1 --2- 172.21.15.12:0/4019946841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd80c0b4f40 0x7fd80c1e91f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.903+0000 7fd81162b640 1 --2- 172.21.15.12:0/4019946841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7f4003980 0x7fd80c155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:02.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.903+0000 7fd81162b640 1 -- 172.21.15.12:0/4019946841 >> 172.21.15.12:0/4019946841 conn(0x7fd80c06ba20 msgr2=0x7fd80c0b9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:30:02.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.903+0000 7fd81162b640 1 -- 172.21.15.12:0/4019946841 shutdown_connections 2023-10-16T23:30:02.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:02.903+0000 7fd81162b640 1 -- 172.21.15.12:0/4019946841 wait complete. 2023-10-16T23:30:02.924 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-16T23:30:03.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.043+0000 7f6bd9611640 1 Processor -- start 2023-10-16T23:30:03.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.043+0000 7f6bd9611640 1 -- start start 2023-10-16T23:30:03.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.043+0000 7f6bd9611640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6bd406e770 0x7f6bd40c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:03.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.043+0000 7f6bd9611640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6bd40bfc30 0x7f6bd4153150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:03.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.043+0000 7f6bd9611640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd40c01e0 con 0x7f6bd40c1950 2023-10-16T23:30:03.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.043+0000 7f6bd9611640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd40b85b0 con 0x7f6bd406e770 2023-10-16T23:30:03.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.043+0000 7f6bd9611640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd40b8120 con 0x7f6bd40bfc30 2023-10-16T23:30:03.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.043+0000 7f6bd27fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6bd406e770 0x7f6bd40c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:03.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.043+0000 7f6bd27fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6bd406e770 0x7f6bd40c1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43018/0 (socket says 172.21.15.12:43018) 2023-10-16T23:30:03.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.043+0000 7f6bd27fc640 1 -- 172.21.15.12:0/2241729915 learned_addr learned my addr 172.21.15.12:0/2241729915 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:30:03.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.043+0000 7f6bd37fe640 1 --2- 172.21.15.12:0/2241729915 >> v2:172.21.15.31:3300/0 conn(0x7f6bd40bfc30 0x7f6bd4153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:03.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.043+0000 7f6bd27fc640 1 -- 172.21.15.12:0/2241729915 >> v2:172.21.15.31:3300/0 conn(0x7f6bd40bfc30 msgr2=0x7f6bd4153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:30:03.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.043+0000 7f6bd27fc640 1 --2- 172.21.15.12:0/2241729915 >> v2:172.21.15.31:3300/0 conn(0x7f6bd40bfc30 0x7f6bd4153150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:03.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.043+0000 7f6bd27fc640 1 -- 172.21.15.12:0/2241729915 >> v1:172.21.15.31:6789/0 conn(0x7f6bd40c1950 legacy=0x7f6bd4152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:30:03.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.043+0000 7f6bd27fc640 1 -- 172.21.15.12:0/2241729915 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd40b7db0 con 0x7f6bd406e770 2023-10-16T23:30:03.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.047+0000 7f6bd27fc640 1 --2- 172.21.15.12:0/2241729915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bd406e770 0x7f6bd40c1d30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6bd40c2480 tx=0x7f6bc801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9b09df90e00023 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:03.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.047+0000 7f6bd1ffb640 1 -- 172.21.15.12:0/2241729915 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc80ab650 con 0x7f6bd406e770 2023-10-16T23:30:03.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.047+0000 7f6bd1ffb640 1 -- 172.21.15.12:0/2241729915 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6bc80ab7b0 con 0x7f6bd406e770 2023-10-16T23:30:03.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.047+0000 7f6bd1ffb640 1 -- 172.21.15.12:0/2241729915 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc80abb60 con 0x7f6bd406e770 2023-10-16T23:30:03.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.047+0000 7f6bd9611640 1 -- 172.21.15.12:0/2241729915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bd406e770 msgr2=0x7f6bd40c1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:03.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.047+0000 7f6bd9611640 1 --2- 172.21.15.12:0/2241729915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bd406e770 0x7f6bd40c1d30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6bd40c2480 tx=0x7f6bc801c430 comp rx=0 tx=0).stop 2023-10-16T23:30:03.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.047+0000 7f6bd9611640 1 -- 172.21.15.12:0/2241729915 shutdown_connections 2023-10-16T23:30:03.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.047+0000 7f6bd9611640 1 --2- 172.21.15.12:0/2241729915 >> v2:172.21.15.31:3300/0 conn(0x7f6bd40bfc30 0x7f6bd4153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:03.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.047+0000 7f6bd9611640 1 --2- 172.21.15.12:0/2241729915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bd406e770 0x7f6bd40c1d30 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:03.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.047+0000 7f6bd9611640 1 -- 172.21.15.12:0/2241729915 >> 172.21.15.12:0/2241729915 conn(0x7f6bd406b5d0 msgr2=0x7f6bd406b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:30:03.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.047+0000 7f6bd9611640 1 -- 172.21.15.12:0/2241729915 shutdown_connections 2023-10-16T23:30:03.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.047+0000 7f6bd9611640 1 -- 172.21.15.12:0/2241729915 wait complete. 2023-10-16T23:30:03.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bd9611640 1 Processor -- start 2023-10-16T23:30:03.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bd9611640 1 -- start start 2023-10-16T23:30:03.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bd9611640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bd406e770 0x7f6bd41ea880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:03.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bd9611640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bd40bfc30 0x7f6bd4148bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:03.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bd9611640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bd40c1950 0x7f6bd40b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:03.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bd9611640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd41eadc0 con 0x7f6bd40c1950 2023-10-16T23:30:03.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bd9611640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd4149110 con 0x7f6bd406e770 2023-10-16T23:30:03.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bd9611640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd40bb510 con 0x7f6bd40bfc30 2023-10-16T23:30:03.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bd37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bd40c1950 0x7f6bd40b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:03.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bd37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bd40c1950 0x7f6bd40b8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43034/0 (socket says 172.21.15.12:43034) 2023-10-16T23:30:03.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bd37fe640 1 -- 172.21.15.12:0/400739372 learned_addr learned my addr 172.21.15.12:0/400739372 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:30:03.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bd2ffd640 1 --2- 172.21.15.12:0/400739372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bd406e770 0x7f6bd41ea880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:03.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bd37fe640 1 -- 172.21.15.12:0/400739372 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bd40bfc30 msgr2=0x7f6bd4148bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:03.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bd27fc640 1 --2- 172.21.15.12:0/400739372 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bd40bfc30 0x7f6bd4148bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:03.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bd37fe640 1 --2- 172.21.15.12:0/400739372 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bd40bfc30 0x7f6bd4148bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:03.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bd37fe640 1 -- 172.21.15.12:0/400739372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bd406e770 msgr2=0x7f6bd41ea880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:03.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bd37fe640 1 --2- 172.21.15.12:0/400739372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bd406e770 0x7f6bd41ea880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:03.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bd37fe640 1 -- 172.21.15.12:0/400739372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc80094d0 con 0x7f6bd40c1950 2023-10-16T23:30:03.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bd2ffd640 1 --2- 172.21.15.12:0/400739372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bd406e770 0x7f6bd41ea880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:30:03.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bd37fe640 1 --2- 172.21.15.12:0/400739372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bd40c1950 0x7f6bd40b8ae0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc007e40 tx=0x7f6bcc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:03.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bbb7fe640 1 -- 172.21.15.12:0/400739372 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc014620 con 0x7f6bd40c1950 2023-10-16T23:30:03.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bbb7fe640 1 -- 172.21.15.12:0/400739372 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6bcc00ee90 con 0x7f6bd40c1950 2023-10-16T23:30:03.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bd9611640 1 -- 172.21.15.12:0/400739372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd41468f0 con 0x7f6bd40c1950 2023-10-16T23:30:03.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bbb7fe640 1 -- 172.21.15.12:0/400739372 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc014a00 con 0x7f6bd40c1950 2023-10-16T23:30:03.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bd9611640 1 -- 172.21.15.12:0/400739372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd4146e70 con 0x7f6bd40c1950 2023-10-16T23:30:03.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bd9611640 1 -- 172.21.15.12:0/400739372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd40673a0 con 0x7f6bd40c1950 2023-10-16T23:30:03.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.051+0000 7f6bbb7fe640 1 -- 172.21.15.12:0/400739372 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f6bcc014b60 con 0x7f6bd40c1950 2023-10-16T23:30:03.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.055+0000 7f6bbb7fe640 1 --2- 172.21.15.12:0/400739372 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f6bc0065e60 0x7f6bc0068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:03.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.055+0000 7f6bbb7fe640 1 -- 172.21.15.12:0/400739372 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6bcc084350 con 0x7f6bd40c1950 2023-10-16T23:30:03.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.055+0000 7f6bd2ffd640 1 --2- 172.21.15.12:0/400739372 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f6bc0065e60 0x7f6bc0068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:03.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.055+0000 7f6bd2ffd640 1 --2- 172.21.15.12:0/400739372 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f6bc0065e60 0x7f6bc0068320 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4003e40 tx=0x7f6bc4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:03.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.059+0000 7f6bbb7fe640 1 -- 172.21.15.12:0/400739372 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f6bcc051840 con 0x7f6bd40c1950 2023-10-16T23:30:03.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.247+0000 7f6bd9611640 1 -- 172.21.15.12:0/400739372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6bd40bf9d0 con 0x7f6bd40c1950 2023-10-16T23:30:03.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.263+0000 7f6bbb7fe640 1 -- 172.21.15.12:0/400739372 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6bcc053770 con 0x7f6bd40c1950 2023-10-16T23:30:03.269 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-16T23:30:03.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.267+0000 7f6bd9611640 1 -- 172.21.15.12:0/400739372 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f6bc0065e60 msgr2=0x7f6bc0068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:03.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.267+0000 7f6bd9611640 1 --2- 172.21.15.12:0/400739372 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f6bc0065e60 0x7f6bc0068320 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4003e40 tx=0x7f6bc4009040 comp rx=0 tx=0).stop 2023-10-16T23:30:03.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.267+0000 7f6bd9611640 1 -- 172.21.15.12:0/400739372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bd40c1950 msgr2=0x7f6bd40b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:03.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.267+0000 7f6bd9611640 1 --2- 172.21.15.12:0/400739372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bd40c1950 0x7f6bd40b8ae0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc007e40 tx=0x7f6bcc00e4b0 comp rx=0 tx=0).stop 2023-10-16T23:30:03.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.267+0000 7f6bd9611640 1 -- 172.21.15.12:0/400739372 shutdown_connections 2023-10-16T23:30:03.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.267+0000 7f6bd9611640 1 --2- 172.21.15.12:0/400739372 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f6bc0065e60 0x7f6bc0068320 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:03.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.267+0000 7f6bd9611640 1 --2- 172.21.15.12:0/400739372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bd40c1950 0x7f6bd40b8ae0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:03.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.267+0000 7f6bd9611640 1 --2- 172.21.15.12:0/400739372 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6bd40bfc30 0x7f6bd4148bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:03.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.267+0000 7f6bd9611640 1 --2- 172.21.15.12:0/400739372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bd406e770 0x7f6bd41ea880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:03.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.267+0000 7f6bd9611640 1 -- 172.21.15.12:0/400739372 >> 172.21.15.12:0/400739372 conn(0x7f6bd406b5d0 msgr2=0x7f6bd406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:30:03.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.267+0000 7f6bd9611640 1 -- 172.21.15.12:0/400739372 shutdown_connections 2023-10-16T23:30:03.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.267+0000 7f6bd9611640 1 -- 172.21.15.12:0/400739372 wait complete. 2023-10-16T23:30:03.275 INFO:tasks.ceph.mds.a.smithi012.stderr: -4744> 2023-10-16T23:27:41.416+0000 7f28d0e04640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T23:30:03.289 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-16T23:30:03.308 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2023-10-16T23:30:03.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.399+0000 7f233213b640 1 Processor -- start 2023-10-16T23:30:03.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.399+0000 7f233213b640 1 -- start start 2023-10-16T23:30:03.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.399+0000 7f233213b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f232c0bdb80 0x7f232c152f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:03.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.399+0000 7f233213b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f232c0be9f0 0x7f232c153450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:03.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.399+0000 7f233213b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f232c06d640 con 0x7f232c0bef40 2023-10-16T23:30:03.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.399+0000 7f233213b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f232c06d890 con 0x7f232c0be9f0 2023-10-16T23:30:03.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.399+0000 7f233213b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232c06eea0 con 0x7f232c0bdb80 2023-10-16T23:30:03.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.399+0000 7f232bfff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f232c0bef40 0x7f232c0bf3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45398/0 (socket says 172.21.15.12:45398) 2023-10-16T23:30:03.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.399+0000 7f232bfff640 1 -- 172.21.15.12:0/2759118718 learned_addr learned my addr 172.21.15.12:0/2759118718 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:30:03.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.399+0000 7f232b7fe640 1 --2- 172.21.15.12:0/2759118718 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f232c0bdb80 0x7f232c152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:03.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.399+0000 7f232affd640 1 --2- 172.21.15.12:0/2759118718 >> v2:172.21.15.31:3300/0 conn(0x7f232c0be9f0 0x7f232c153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:03.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.399+0000 7f232a7fc640 1 -- 172.21.15.12:0/2759118718 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1699090683 0 0) 0x7f232c06d640 con 0x7f232c0bef40 2023-10-16T23:30:03.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.399+0000 7f232a7fc640 1 -- 172.21.15.12:0/2759118718 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2314003530 con 0x7f232c0bef40 2023-10-16T23:30:03.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232a7fc640 1 -- 172.21.15.12:0/2759118718 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4170726905 0 0) 0x7f2314003530 con 0x7f232c0bef40 2023-10-16T23:30:03.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232a7fc640 1 -- 172.21.15.12:0/2759118718 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f232c0bdb80 msgr2=0x7f232c152f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:30:03.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232a7fc640 1 --2- 172.21.15.12:0/2759118718 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f232c0bdb80 0x7f232c152f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:03.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232a7fc640 1 -- 172.21.15.12:0/2759118718 >> v2:172.21.15.31:3300/0 conn(0x7f232c0be9f0 msgr2=0x7f232c153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:30:03.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232a7fc640 1 --2- 172.21.15.12:0/2759118718 >> v2:172.21.15.31:3300/0 conn(0x7f232c0be9f0 0x7f232c153450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:03.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232a7fc640 1 -- 172.21.15.12:0/2759118718 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232c0bce10 con 0x7f232c0bef40 2023-10-16T23:30:03.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232a7fc640 1 -- 172.21.15.12:0/2759118718 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7f2324001a00 con 0x7f232c0bef40 2023-10-16T23:30:03.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232a7fc640 1 -- 172.21.15.12:0/2759118718 >> v1:172.21.15.12:6789/0 conn(0x7f232c0bef40 legacy=0x7f232c0bf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:03.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232a7fc640 1 --2- 172.21.15.12:0/2759118718 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f232c0bdb80 0x7f2314003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:03.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232a7fc640 1 --2- 172.21.15.12:0/2759118718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2314003f00 0x7f23140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:03.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232a7fc640 1 --2- 172.21.15.12:0/2759118718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2314004d10 0x7f2314005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:03.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232a7fc640 1 -- 172.21.15.12:0/2759118718 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c06d890 con 0x7f2314004d10 2023-10-16T23:30:03.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232a7fc640 1 -- 172.21.15.12:0/2759118718 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c06eea0 con 0x7f2314003f00 2023-10-16T23:30:03.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232a7fc640 1 -- 172.21.15.12:0/2759118718 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231400b9e0 con 0x7f232c0bdb80 2023-10-16T23:30:03.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232bfff640 1 --2- 172.21.15.12:0/2759118718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2314004d10 0x7f2314005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:03.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232affd640 1 --2- 172.21.15.12:0/2759118718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2314003f00 0x7f23140047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:03.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232b7fe640 1 --2- 172.21.15.12:0/2759118718 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f232c0bdb80 0x7f2314003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:03.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232bfff640 1 -- 172.21.15.12:0/2759118718 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f232c0bdb80 msgr2=0x7f2314003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:30:03.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232bfff640 1 --2- 172.21.15.12:0/2759118718 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f232c0bdb80 0x7f2314003980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:03.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232bfff640 1 -- 172.21.15.12:0/2759118718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2314003f00 msgr2=0x7f23140047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:30:03.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232bfff640 1 --2- 172.21.15.12:0/2759118718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2314003f00 0x7f23140047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:03.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232bfff640 1 -- 172.21.15.12:0/2759118718 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2314003530 con 0x7f2314004d10 2023-10-16T23:30:03.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232affd640 1 --2- 172.21.15.12:0/2759118718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2314003f00 0x7f23140047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:30:03.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232bfff640 1 --2- 172.21.15.12:0/2759118718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2314004d10 0x7f2314005190 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f232400a900 tx=0x7f232401fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b898ec5d9d2af611 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:03.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232a7fc640 1 -- 172.21.15.12:0/2759118718 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23240aa6c0 con 0x7f2314004d10 2023-10-16T23:30:03.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232a7fc640 1 -- 172.21.15.12:0/2759118718 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f23240aa820 con 0x7f2314004d10 2023-10-16T23:30:03.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232a7fc640 1 -- 172.21.15.12:0/2759118718 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23240aabf0 con 0x7f2314004d10 2023-10-16T23:30:03.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f233213b640 1 -- 172.21.15.12:0/2759118718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2314004d10 msgr2=0x7f2314005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:03.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f233213b640 1 --2- 172.21.15.12:0/2759118718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2314004d10 0x7f2314005190 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f232400a900 tx=0x7f232401fb20 comp rx=0 tx=0).stop 2023-10-16T23:30:03.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f232bfff640 1 -- 172.21.15.12:0/2759118718 reap_dead start 2023-10-16T23:30:03.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f233213b640 1 -- 172.21.15.12:0/2759118718 shutdown_connections 2023-10-16T23:30:03.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f233213b640 1 -- 172.21.15.12:0/2759118718 >> 172.21.15.12:0/2759118718 conn(0x7f232c073020 msgr2=0x7f232c06b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:30:03.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f233213b640 1 -- 172.21.15.12:0/2759118718 shutdown_connections 2023-10-16T23:30:03.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.403+0000 7f233213b640 1 -- 172.21.15.12:0/2759118718 wait complete. 2023-10-16T23:30:03.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f233213b640 1 Processor -- start 2023-10-16T23:30:03.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f233213b640 1 -- start start 2023-10-16T23:30:03.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f233213b640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f232c1e7880 0x7f232c0bc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:03.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f233213b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f232c149b70 0x7f232c0b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:03.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f233213b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f232c0b7490 0x7f232c1e7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:03.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f233213b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c0b88d0 con 0x7f232c149b70 2023-10-16T23:30:03.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f233213b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c0bc740 con 0x7f232c0b7490 2023-10-16T23:30:03.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f233213b640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232c143060 con 0x7f232c1e7880 2023-10-16T23:30:03.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f232affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f232c149b70 0x7f232c0b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:03.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f232b7fe640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f232c1e7880 0x7f232c0bc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:03.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f232affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f232c149b70 0x7f232c0b6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43068/0 (socket says 172.21.15.12:43068) 2023-10-16T23:30:03.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f232affd640 1 -- 172.21.15.12:0/1860398885 learned_addr learned my addr 172.21.15.12:0/1860398885 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:30:03.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f232bfff640 1 --2- 172.21.15.12:0/1860398885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f232c0b7490 0x7f232c1e7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:03.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f232affd640 1 -- 172.21.15.12:0/1860398885 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f232c1e7880 msgr2=0x7f232c0bc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:03.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f232affd640 1 --2- 172.21.15.12:0/1860398885 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f232c1e7880 0x7f232c0bc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:03.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f232affd640 1 -- 172.21.15.12:0/1860398885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f232c0b7490 msgr2=0x7f232c1e7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:03.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f232affd640 1 --2- 172.21.15.12:0/1860398885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f232c0b7490 0x7f232c1e7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:03.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f232affd640 1 -- 172.21.15.12:0/1860398885 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232c0b9700 con 0x7f232c149b70 2023-10-16T23:30:03.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f232affd640 1 --2- 172.21.15.12:0/1860398885 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f232c149b70 0x7f232c0b6f50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f231c010950 tx=0x7f231c010e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:03.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f2313fff640 1 -- 172.21.15.12:0/1860398885 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c00ec20 con 0x7f232c149b70 2023-10-16T23:30:03.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f2313fff640 1 -- 172.21.15.12:0/1860398885 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f231c00ed80 con 0x7f232c149b70 2023-10-16T23:30:03.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f233213b640 1 -- 172.21.15.12:0/1860398885 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232c1e81a0 con 0x7f232c149b70 2023-10-16T23:30:03.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f2313fff640 1 -- 172.21.15.12:0/1860398885 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c004240 con 0x7f232c149b70 2023-10-16T23:30:03.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f233213b640 1 -- 172.21.15.12:0/1860398885 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232c142300 con 0x7f232c149b70 2023-10-16T23:30:03.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f233213b640 1 -- 172.21.15.12:0/1860398885 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232c073a30 con 0x7f232c149b70 2023-10-16T23:30:03.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f2313fff640 1 -- 172.21.15.12:0/1860398885 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7f231c0043a0 con 0x7f232c149b70 2023-10-16T23:30:03.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.407+0000 7f2313fff640 1 --2- 172.21.15.12:0/1860398885 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2318065e90 0x7f2318068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:03.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.411+0000 7f2313fff640 1 -- 172.21.15.12:0/1860398885 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f231c083840 con 0x7f232c149b70 2023-10-16T23:30:03.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.411+0000 7f232b7fe640 1 --2- 172.21.15.12:0/1860398885 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2318065e90 0x7f2318068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:03.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.411+0000 7f232b7fe640 1 --2- 172.21.15.12:0/1860398885 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2318065e90 0x7f2318068350 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2320009ae0 tx=0x7f2320008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:03.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.411+0000 7f2313fff640 1 -- 172.21.15.12:0/1860398885 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7f231c050eb0 con 0x7f232c149b70 2023-10-16T23:30:03.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:03.595+0000 7f233213b640 1 -- 172.21.15.12:0/1860398885 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f232c0673a0 con 0x7f232c149b70 2023-10-16T23:30:04.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.291+0000 7f2313fff640 1 -- 172.21.15.12:0/1860398885 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f231c0544d0 con 0x7f232c149b70 2023-10-16T23:30:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.295+0000 7f233213b640 1 -- 172.21.15.12:0/1860398885 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2318065e90 msgr2=0x7f2318068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:04.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.295+0000 7f233213b640 1 --2- 172.21.15.12:0/1860398885 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2318065e90 0x7f2318068350 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2320009ae0 tx=0x7f2320008040 comp rx=0 tx=0).stop 2023-10-16T23:30:04.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.295+0000 7f233213b640 1 -- 172.21.15.12:0/1860398885 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f232c149b70 msgr2=0x7f232c0b6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:04.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.295+0000 7f233213b640 1 --2- 172.21.15.12:0/1860398885 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f232c149b70 0x7f232c0b6f50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f231c010950 tx=0x7f231c010e10 comp rx=0 tx=0).stop 2023-10-16T23:30:04.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.295+0000 7f233213b640 1 -- 172.21.15.12:0/1860398885 shutdown_connections 2023-10-16T23:30:04.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.295+0000 7f233213b640 1 --2- 172.21.15.12:0/1860398885 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7f2318065e90 0x7f2318068350 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:04.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.295+0000 7f233213b640 1 --2- 172.21.15.12:0/1860398885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f232c0b7490 0x7f232c1e7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:04.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.295+0000 7f233213b640 1 --2- 172.21.15.12:0/1860398885 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f232c149b70 0x7f232c0b6f50 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:04.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.295+0000 7f233213b640 1 --2- 172.21.15.12:0/1860398885 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f232c1e7880 0x7f232c0bc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:04.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.295+0000 7f233213b640 1 -- 172.21.15.12:0/1860398885 >> 172.21.15.12:0/1860398885 conn(0x7f232c073020 msgr2=0x7f232c14cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:30:04.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.295+0000 7f233213b640 1 -- 172.21.15.12:0/1860398885 shutdown_connections 2023-10-16T23:30:04.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.295+0000 7f233213b640 1 -- 172.21.15.12:0/1860398885 wait complete. 2023-10-16T23:30:04.318 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-16T23:30:04.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb60d343640 1 Processor -- start 2023-10-16T23:30:04.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb60d343640 1 -- start start 2023-10-16T23:30:04.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb60d343640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb6080b7f50 0x7fb608153350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:04.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb60d343640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb60814fa40 0x7fb6080bf930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:04.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb60d343640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb608152ec0 con 0x7fb60806e6d0 2023-10-16T23:30:04.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb60d343640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6080708a0 con 0x7fb6080b7f50 2023-10-16T23:30:04.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb60d343640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6080c0ef0 con 0x7fb60814fa40 2023-10-16T23:30:04.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb6067fc640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb60806e6d0 0x7fb6080bf220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45408/0 (socket says 172.21.15.12:45408) 2023-10-16T23:30:04.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb6067fc640 1 -- 172.21.15.12:0/2152740675 learned_addr learned my addr 172.21.15.12:0/2152740675 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:30:04.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb606ffd640 1 --2- 172.21.15.12:0/2152740675 >> v2:172.21.15.31:3300/0 conn(0x7fb6080b7f50 0x7fb608153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:04.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb6077fe640 1 --2- 172.21.15.12:0/2152740675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb60814fa40 0x7fb6080bf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:04.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb605ffb640 1 -- 172.21.15.12:0/2152740675 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876970639 0 0) 0x7fb608152ec0 con 0x7fb60806e6d0 2023-10-16T23:30:04.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb605ffb640 1 -- 172.21.15.12:0/2152740675 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5f4003530 con 0x7fb60806e6d0 2023-10-16T23:30:04.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb605ffb640 1 -- 172.21.15.12:0/2152740675 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 765282754 0 0) 0x7fb5f4003530 con 0x7fb60806e6d0 2023-10-16T23:30:04.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb605ffb640 1 -- 172.21.15.12:0/2152740675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb60814fa40 msgr2=0x7fb6080bf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:30:04.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb605ffb640 1 --2- 172.21.15.12:0/2152740675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb60814fa40 0x7fb6080bf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:04.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb605ffb640 1 -- 172.21.15.12:0/2152740675 >> v2:172.21.15.31:3300/0 conn(0x7fb6080b7f50 msgr2=0x7fb608153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:30:04.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb605ffb640 1 --2- 172.21.15.12:0/2152740675 >> v2:172.21.15.31:3300/0 conn(0x7fb6080b7f50 0x7fb608153350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:04.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb605ffb640 1 -- 172.21.15.12:0/2152740675 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6080be4f0 con 0x7fb60806e6d0 2023-10-16T23:30:04.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb605ffb640 1 -- 172.21.15.12:0/2152740675 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3009290077 0 0) 0x7fb5f8001680 con 0x7fb60806e6d0 2023-10-16T23:30:04.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb605ffb640 1 -- 172.21.15.12:0/2152740675 >> v1:172.21.15.12:6789/0 conn(0x7fb60806e6d0 legacy=0x7fb6080bf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:04.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb605ffb640 1 --2- 172.21.15.12:0/2152740675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5f4003980 0x7fb5f4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:04.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb605ffb640 1 --2- 172.21.15.12:0/2152740675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5f40047d0 0x7fb5f4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:04.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb605ffb640 1 --2- 172.21.15.12:0/2152740675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb60814fa40 0x7fb5f4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:04.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb605ffb640 1 -- 172.21.15.12:0/2152740675 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6080708a0 con 0x7fb5f4003980 2023-10-16T23:30:04.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb605ffb640 1 -- 172.21.15.12:0/2152740675 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f400b990 con 0x7fb5f40047d0 2023-10-16T23:30:04.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb605ffb640 1 -- 172.21.15.12:0/2152740675 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f400bad0 con 0x7fb60814fa40 2023-10-16T23:30:04.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb606ffd640 1 --2- 172.21.15.12:0/2152740675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5f4003980 0x7fb5f4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:04.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb6067fc640 1 --2- 172.21.15.12:0/2152740675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5f40047d0 0x7fb5f4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:04.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb6077fe640 1 --2- 172.21.15.12:0/2152740675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb60814fa40 0x7fb5f4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:04.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb606ffd640 1 -- 172.21.15.12:0/2152740675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb60814fa40 msgr2=0x7fb5f4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:30:04.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb606ffd640 1 --2- 172.21.15.12:0/2152740675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb60814fa40 0x7fb5f4005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:04.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb606ffd640 1 -- 172.21.15.12:0/2152740675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5f40047d0 msgr2=0x7fb5f4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T23:30:04.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb606ffd640 1 --2- 172.21.15.12:0/2152740675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5f40047d0 0x7fb5f4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:04.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.495+0000 7fb606ffd640 1 -- 172.21.15.12:0/2152740675 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f4003530 con 0x7fb5f4003980 2023-10-16T23:30:04.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.499+0000 7fb606ffd640 1 --2- 172.21.15.12:0/2152740675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5f4003980 0x7fb5f4003da0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0009ae0 tx=0x7fb5f001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab340f6ba0f33460 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:04.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.499+0000 7fb605ffb640 1 -- 172.21.15.12:0/2152740675 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00a5550 con 0x7fb5f4003980 2023-10-16T23:30:04.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.499+0000 7fb605ffb640 1 -- 172.21.15.12:0/2152740675 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb5f00a56b0 con 0x7fb5f4003980 2023-10-16T23:30:04.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.499+0000 7fb605ffb640 1 -- 172.21.15.12:0/2152740675 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00a5a80 con 0x7fb5f4003980 2023-10-16T23:30:04.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.499+0000 7fb60d343640 1 -- 172.21.15.12:0/2152740675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5f4003980 msgr2=0x7fb5f4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:04.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.499+0000 7fb60d343640 1 --2- 172.21.15.12:0/2152740675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5f4003980 0x7fb5f4003da0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0009ae0 tx=0x7fb5f001ca00 comp rx=0 tx=0).stop 2023-10-16T23:30:04.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.499+0000 7fb6077fe640 1 -- 172.21.15.12:0/2152740675 reap_dead start 2023-10-16T23:30:04.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.499+0000 7fb60d343640 1 -- 172.21.15.12:0/2152740675 shutdown_connections 2023-10-16T23:30:04.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.499+0000 7fb60d343640 1 -- 172.21.15.12:0/2152740675 >> 172.21.15.12:0/2152740675 conn(0x7fb6080c4fd0 msgr2=0x7fb6080c53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:30:04.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.499+0000 7fb60d343640 1 -- 172.21.15.12:0/2152740675 shutdown_connections 2023-10-16T23:30:04.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.499+0000 7fb60d343640 1 -- 172.21.15.12:0/2152740675 wait complete. 2023-10-16T23:30:04.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.499+0000 7fb60d343640 1 Processor -- start 2023-10-16T23:30:04.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.499+0000 7fb60d343640 1 -- start start 2023-10-16T23:30:04.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.499+0000 7fb60d343640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5f4003980 0x7fb608146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:04.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.499+0000 7fb60d343640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb608147930 0x7fb608144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:04.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.503+0000 7fb60d343640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb608143e60 0x7fb6081442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:04.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.503+0000 7fb60d343640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6081488d0 con 0x7fb608143e60 2023-10-16T23:30:04.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.503+0000 7fb60d343640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6080bc110 con 0x7fb608147930 2023-10-16T23:30:04.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.503+0000 7fb60d343640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6081482a0 con 0x7fb5f4003980 2023-10-16T23:30:04.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.503+0000 7fb6077fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb608143e60 0x7fb6081442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:04.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.503+0000 7fb6077fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb608143e60 0x7fb6081442e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43088/0 (socket says 172.21.15.12:43088) 2023-10-16T23:30:04.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.503+0000 7fb6077fe640 1 -- 172.21.15.12:0/1770638216 learned_addr learned my addr 172.21.15.12:0/1770638216 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:30:04.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.503+0000 7fb6067fc640 1 --2- 172.21.15.12:0/1770638216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb608147930 0x7fb608144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:04.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.503+0000 7fb606ffd640 1 --2- 172.21.15.12:0/1770638216 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5f4003980 0x7fb608146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:04.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.503+0000 7fb6077fe640 1 -- 172.21.15.12:0/1770638216 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5f4003980 msgr2=0x7fb608146f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:04.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.503+0000 7fb6077fe640 1 --2- 172.21.15.12:0/1770638216 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5f4003980 0x7fb608146f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:04.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.503+0000 7fb6077fe640 1 -- 172.21.15.12:0/1770638216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb608147930 msgr2=0x7fb608144e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:04.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.503+0000 7fb6077fe640 1 --2- 172.21.15.12:0/1770638216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb608147930 0x7fb608144e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:04.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.503+0000 7fb6077fe640 1 -- 172.21.15.12:0/1770638216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb608153a10 con 0x7fb608143e60 2023-10-16T23:30:04.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.503+0000 7fb6067fc640 1 --2- 172.21.15.12:0/1770638216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb608147930 0x7fb608144e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T23:30:04.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.503+0000 7fb6077fe640 1 --2- 172.21.15.12:0/1770638216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb608143e60 0x7fb6081442e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb6080c10f0 tx=0x7fb60000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:04.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.503+0000 7fb5ff7fe640 1 -- 172.21.15.12:0/1770638216 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb600017400 con 0x7fb608143e60 2023-10-16T23:30:04.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.503+0000 7fb5ff7fe640 1 -- 172.21.15.12:0/1770638216 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb600011040 con 0x7fb608143e60 2023-10-16T23:30:04.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.503+0000 7fb5ff7fe640 1 -- 172.21.15.12:0/1770638216 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6000177e0 con 0x7fb608143e60 2023-10-16T23:30:04.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.503+0000 7fb60d343640 1 -- 172.21.15.12:0/1770638216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb608145350 con 0x7fb608143e60 2023-10-16T23:30:04.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.503+0000 7fb60d343640 1 -- 172.21.15.12:0/1770638216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6081484f0 con 0x7fb608143e60 2023-10-16T23:30:04.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.503+0000 7fb60d343640 1 -- 172.21.15.12:0/1770638216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6081474b0 con 0x7fb608143e60 2023-10-16T23:30:04.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.503+0000 7fb5ff7fe640 1 -- 172.21.15.12:0/1770638216 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7fb600021440 con 0x7fb608143e60 2023-10-16T23:30:04.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.503+0000 7fb5ff7fe640 1 --2- 172.21.15.12:0/1770638216 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb5e8065e60 0x7fb5e8068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:04.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.503+0000 7fb5ff7fe640 1 -- 172.21.15.12:0/1770638216 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fb600083b50 con 0x7fb608143e60 2023-10-16T23:30:04.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.503+0000 7fb606ffd640 1 --2- 172.21.15.12:0/1770638216 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb5e8065e60 0x7fb5e8068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:04.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.507+0000 7fb606ffd640 1 --2- 172.21.15.12:0/1770638216 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb5e8065e60 0x7fb5e8068320 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb5f00af000 tx=0x7fb5f00046d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:04.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.507+0000 7fb5ff7fe640 1 -- 172.21.15.12:0/1770638216 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7fb600051110 con 0x7fb608143e60 2023-10-16T23:30:04.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:04.659+0000 7fb60d343640 1 -- 172.21.15.12:0/1770638216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb6080673a0 con 0x7fb608143e60 2023-10-16T23:30:05.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.295+0000 7fb5ff7fe640 1 -- 172.21.15.12:0/1770638216 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb600054730 con 0x7fb608143e60 2023-10-16T23:30:05.301 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2023-10-16T23:30:05.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.299+0000 7fb60d343640 1 -- 172.21.15.12:0/1770638216 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb5e8065e60 msgr2=0x7fb5e8068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:05.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.299+0000 7fb60d343640 1 --2- 172.21.15.12:0/1770638216 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb5e8065e60 0x7fb5e8068320 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb5f00af000 tx=0x7fb5f00046d0 comp rx=0 tx=0).stop 2023-10-16T23:30:05.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.299+0000 7fb60d343640 1 -- 172.21.15.12:0/1770638216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb608143e60 msgr2=0x7fb6081442e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:05.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.299+0000 7fb60d343640 1 --2- 172.21.15.12:0/1770638216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb608143e60 0x7fb6081442e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb6080c10f0 tx=0x7fb60000f4a0 comp rx=0 tx=0).stop 2023-10-16T23:30:05.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.303+0000 7fb60d343640 1 -- 172.21.15.12:0/1770638216 shutdown_connections 2023-10-16T23:30:05.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.303+0000 7fb60d343640 1 --2- 172.21.15.12:0/1770638216 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7fb5e8065e60 0x7fb5e8068320 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:05.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.303+0000 7fb60d343640 1 --2- 172.21.15.12:0/1770638216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb608143e60 0x7fb6081442e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:05.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.303+0000 7fb60d343640 1 --2- 172.21.15.12:0/1770638216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb608147930 0x7fb608144e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:05.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.303+0000 7fb60d343640 1 --2- 172.21.15.12:0/1770638216 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5f4003980 0x7fb608146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:05.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.303+0000 7fb60d343640 1 -- 172.21.15.12:0/1770638216 >> 172.21.15.12:0/1770638216 conn(0x7fb6080c4fd0 msgr2=0x7fb60814ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:30:05.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.303+0000 7fb60d343640 1 -- 172.21.15.12:0/1770638216 shutdown_connections 2023-10-16T23:30:05.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.303+0000 7fb60d343640 1 -- 172.21.15.12:0/1770638216 wait complete. 2023-10-16T23:30:05.328 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-16T23:30:05.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.447+0000 7efffb0d9640 1 Processor -- start 2023-10-16T23:30:05.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.447+0000 7efffb0d9640 1 -- start start 2023-10-16T23:30:05.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.447+0000 7efffb0d9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efff40b9980 0x7efff414ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:05.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.447+0000 7efffb0d9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff40ba670 con 0x7efff40bca10 2023-10-16T23:30:05.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.447+0000 7efffb0d9640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff40b9e10 con 0x7efff40bb010 2023-10-16T23:30:05.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.447+0000 7efffb0d9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff40b7df0 con 0x7efff40b9980 2023-10-16T23:30:05.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.447+0000 7efff3fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efff40b9980 0x7efff414ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:05.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.447+0000 7efff8e75640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efff40bca10 0x7efff414f850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45416/0 (socket says 172.21.15.12:45416) 2023-10-16T23:30:05.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.447+0000 7efff3fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efff40b9980 0x7efff414ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43102/0 (socket says 172.21.15.12:43102) 2023-10-16T23:30:05.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.447+0000 7efff8e75640 1 -- 172.21.15.12:0/1499667004 learned_addr learned my addr 172.21.15.12:0/1499667004 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-16T23:30:05.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.451+0000 7efff3fff640 1 -- 172.21.15.12:0/1499667004 >> v1:172.21.15.31:6789/0 conn(0x7efff40bb010 legacy=0x7efff414c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:05.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.451+0000 7efff3fff640 1 -- 172.21.15.12:0/1499667004 >> v1:172.21.15.12:6789/0 conn(0x7efff40bca10 legacy=0x7efff414f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:05.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.451+0000 7efff37fe640 1 -- 172.21.15.12:0/1499667004 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1781814209 0 0) 0x7efff40ba670 con 0x7efff40bca10 2023-10-16T23:30:05.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.451+0000 7efff3fff640 1 -- 172.21.15.12:0/1499667004 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff40b7550 con 0x7efff40b9980 2023-10-16T23:30:05.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.451+0000 7efff3fff640 1 --2- 172.21.15.12:0/1499667004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff40b9980 0x7efff414ff60 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7effe40097f0 tx=0x7effe401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328f35dde5f6e355 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:05.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.451+0000 7efff37fe640 1 -- 172.21.15.12:0/1499667004 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe40ab600 con 0x7efff40b9980 2023-10-16T23:30:05.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.451+0000 7efff37fe640 1 -- 172.21.15.12:0/1499667004 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7effe40a7050 con 0x7efff40b9980 2023-10-16T23:30:05.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.451+0000 7efff37fe640 1 -- 172.21.15.12:0/1499667004 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe40ab9a0 con 0x7efff40b9980 2023-10-16T23:30:05.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.451+0000 7efffb0d9640 1 -- 172.21.15.12:0/1499667004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff40b9980 msgr2=0x7efff414ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:05.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.451+0000 7efffb0d9640 1 --2- 172.21.15.12:0/1499667004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff40b9980 0x7efff414ff60 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7effe40097f0 tx=0x7effe401c360 comp rx=0 tx=0).stop 2023-10-16T23:30:05.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.451+0000 7efffb0d9640 1 -- 172.21.15.12:0/1499667004 shutdown_connections 2023-10-16T23:30:05.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.451+0000 7efffb0d9640 1 --2- 172.21.15.12:0/1499667004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff40b9980 0x7efff414ff60 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:05.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.451+0000 7efffb0d9640 1 -- 172.21.15.12:0/1499667004 >> 172.21.15.12:0/1499667004 conn(0x7efff40bd240 msgr2=0x7efff40bd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:30:05.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.451+0000 7efffb0d9640 1 -- 172.21.15.12:0/1499667004 shutdown_connections 2023-10-16T23:30:05.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.451+0000 7efffb0d9640 1 -- 172.21.15.12:0/1499667004 wait complete. 2023-10-16T23:30:05.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efffb0d9640 1 Processor -- start 2023-10-16T23:30:05.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efffb0d9640 1 -- start start 2023-10-16T23:30:05.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efffb0d9640 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efff40bb010 0x7efff414a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:05.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efffb0d9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efff40bca10 0x7efff4148c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:05.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efffb0d9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff4143db0 0x7efff414c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:05.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efffb0d9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff414ca70 con 0x7efff4143db0 2023-10-16T23:30:05.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efffb0d9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff40b6dd0 con 0x7efff40bca10 2023-10-16T23:30:05.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efffb0d9640 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff40b3c50 con 0x7efff40bb010 2023-10-16T23:30:05.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efff9676640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff4143db0 0x7efff414c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:05.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efff9676640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff4143db0 0x7efff414c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43112/0 (socket says 172.21.15.12:43112) 2023-10-16T23:30:05.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efff9676640 1 -- 172.21.15.12:0/2644560712 learned_addr learned my addr 172.21.15.12:0/2644560712 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-16T23:30:05.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efff9676640 1 -- 172.21.15.12:0/2644560712 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efff40bb010 msgr2=0x7efff414a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:05.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efff3fff640 1 --2- 172.21.15.12:0/2644560712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efff40bca10 0x7efff4148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:05.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efff8e75640 1 --2- 172.21.15.12:0/2644560712 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efff40bb010 0x7efff414a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:05.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efff9676640 1 --2- 172.21.15.12:0/2644560712 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efff40bb010 0x7efff414a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:05.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efff9676640 1 -- 172.21.15.12:0/2644560712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efff40bca10 msgr2=0x7efff4148c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:05.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efff9676640 1 --2- 172.21.15.12:0/2644560712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efff40bca10 0x7efff4148c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:05.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efff9676640 1 -- 172.21.15.12:0/2644560712 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe4009420 con 0x7efff4143db0 2023-10-16T23:30:05.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efff3fff640 1 --2- 172.21.15.12:0/2644560712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efff40bca10 0x7efff4148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:30:05.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efff8e75640 1 --2- 172.21.15.12:0/2644560712 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efff40bb010 0x7efff414a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T23:30:05.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efff9676640 1 --2- 172.21.15.12:0/2644560712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff4143db0 0x7efff414c530 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7effec00c730 tx=0x7effec00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:05.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efff17fa640 1 -- 172.21.15.12:0/2644560712 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec003b80 con 0x7efff4143db0 2023-10-16T23:30:05.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efff17fa640 1 -- 172.21.15.12:0/2644560712 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7effec003ce0 con 0x7efff4143db0 2023-10-16T23:30:05.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efff17fa640 1 -- 172.21.15.12:0/2644560712 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec005330 con 0x7efff4143db0 2023-10-16T23:30:05.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efffb0d9640 1 -- 172.21.15.12:0/2644560712 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff40b3750 con 0x7efff4143db0 2023-10-16T23:30:05.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efffb0d9640 1 -- 172.21.15.12:0/2644560712 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff40b61b0 con 0x7efff4143db0 2023-10-16T23:30:05.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.455+0000 7efffb0d9640 1 -- 172.21.15.12:0/2644560712 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff40b3970 con 0x7efff4143db0 2023-10-16T23:30:05.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.459+0000 7efff17fa640 1 -- 172.21.15.12:0/2644560712 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 85536+0+0 (secure 0 0 0) 0x7effec0056a0 con 0x7efff4143db0 2023-10-16T23:30:05.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.459+0000 7efff17fa640 1 --2- 172.21.15.12:0/2644560712 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7effd4065e90 0x7effd4068350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T23:30:05.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.459+0000 7efff17fa640 1 -- 172.21.15.12:0/2644560712 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5768+0+0 (secure 0 0 0) 0x7effec083730 con 0x7efff4143db0 2023-10-16T23:30:05.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.459+0000 7efff8e75640 1 --2- 172.21.15.12:0/2644560712 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7effd4065e90 0x7effd4068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T23:30:05.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.459+0000 7efff8e75640 1 --2- 172.21.15.12:0/2644560712 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7effd4065e90 0x7effd4068350 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7effdc000f70 tx=0x7effdc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T23:30:05.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.463+0000 7efff17fa640 1 -- 172.21.15.12:0/2644560712 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172073 (secure 0 0 0) 0x7efff40b3970 con 0x7efff4143db0 2023-10-16T23:30:05.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:05.619+0000 7efffb0d9640 1 -- 172.21.15.12:0/2644560712 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efff40b3970 con 0x7efff4143db0 2023-10-16T23:30:06.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:06.319+0000 7efff17fa640 1 -- 172.21.15.12:0/2644560712 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7efff40b3970 con 0x7efff4143db0 2023-10-16T23:30:06.325 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2023-10-16T23:30:06.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:06.323+0000 7efffb0d9640 1 -- 172.21.15.12:0/2644560712 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7effd4065e90 msgr2=0x7effd4068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:06.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:06.323+0000 7efffb0d9640 1 --2- 172.21.15.12:0/2644560712 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7effd4065e90 0x7effd4068350 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7effdc000f70 tx=0x7effdc009040 comp rx=0 tx=0).stop 2023-10-16T23:30:06.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:06.323+0000 7efffb0d9640 1 -- 172.21.15.12:0/2644560712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff4143db0 msgr2=0x7efff414c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T23:30:06.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:06.323+0000 7efffb0d9640 1 --2- 172.21.15.12:0/2644560712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff4143db0 0x7efff414c530 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7effec00c730 tx=0x7effec00cbf0 comp rx=0 tx=0).stop 2023-10-16T23:30:06.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:06.323+0000 7efffb0d9640 1 -- 172.21.15.12:0/2644560712 shutdown_connections 2023-10-16T23:30:06.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:06.323+0000 7efffb0d9640 1 --2- 172.21.15.12:0/2644560712 >> [v2:172.21.15.31:6832/37949,v1:172.21.15.31:6833/37949] conn(0x7effd4065e90 0x7effd4068350 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:06.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:06.323+0000 7efffb0d9640 1 --2- 172.21.15.12:0/2644560712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efff4143db0 0x7efff414c530 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:06.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:06.323+0000 7efffb0d9640 1 --2- 172.21.15.12:0/2644560712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efff40bca10 0x7efff4148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:06.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:06.323+0000 7efffb0d9640 1 --2- 172.21.15.12:0/2644560712 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efff40bb010 0x7efff414a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T23:30:06.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:06.323+0000 7efffb0d9640 1 -- 172.21.15.12:0/2644560712 >> 172.21.15.12:0/2644560712 conn(0x7efff40bd240 msgr2=0x7efff406e860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T23:30:06.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:06.323+0000 7efffb0d9640 1 -- 172.21.15.12:0/2644560712 shutdown_connections 2023-10-16T23:30:06.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-16T23:30:06.323+0000 7efffb0d9640 1 -- 172.21.15.12:0/2644560712 wait complete. 2023-10-16T23:30:06.356 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-16T23:30:06.356 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-16T23:30:06.357 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T23:30:06.368 INFO:tasks.ceph.mds.a:Stopped 2023-10-16T23:30:06.369 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-16T23:30:06.369 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T23:30:06.391 INFO:tasks.ceph.mds.b:Stopped 2023-10-16T23:30:06.391 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-16T23:30:06.392 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-16T23:30:06.392 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T23:30:10.517 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:30:10.520 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:30:10.523 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:30:10.525 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:30:10.528 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:30:12.493 INFO:tasks.ceph.osd.0:Stopped 2023-10-16T23:30:12.494 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-16T23:30:12.495 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T23:30:12.557 INFO:tasks.ceph.osd.1:Stopped 2023-10-16T23:30:12.558 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-16T23:30:12.558 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T23:30:12.634 INFO:tasks.ceph.osd.2:Stopped 2023-10-16T23:30:12.635 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-16T23:30:12.635 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T23:30:12.726 INFO:tasks.ceph.osd.3:Stopped 2023-10-16T23:30:12.726 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-16T23:30:12.727 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T23:30:12.822 INFO:tasks.ceph.osd.4:Stopped 2023-10-16T23:30:12.822 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-16T23:30:12.823 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T23:30:12.918 INFO:tasks.ceph.osd.5:Stopped 2023-10-16T23:30:12.919 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-16T23:30:12.920 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T23:30:13.013 INFO:tasks.ceph.osd.6:Stopped 2023-10-16T23:30:13.014 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-16T23:30:13.014 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T23:30:13.101 INFO:tasks.ceph.osd.7:Stopped 2023-10-16T23:30:13.102 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-16T23:30:13.102 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-16T23:30:13.103 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T23:30:13.130 INFO:tasks.ceph.mgr.y:Stopped 2023-10-16T23:30:13.131 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-16T23:30:13.131 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T23:30:13.160 INFO:tasks.ceph.mgr.x:Stopped 2023-10-16T23:30:13.161 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-16T23:30:13.161 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-16T23:30:13.162 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T23:30:13.187 INFO:tasks.ceph.mon.a:Stopped 2023-10-16T23:30:13.187 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-16T23:30:13.188 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T23:30:13.220 INFO:tasks.ceph.mon.b:Stopped 2023-10-16T23:30:13.221 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-16T23:30:13.221 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T23:30:13.286 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-10-16T23:30:13.286 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-10-16T23:30:13.287 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-10-16T23:30:13.287 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-10-16T23:30:13.287 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-10-16T23:30:13.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-10-16T23:30:13.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-10-16T23:30:13.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-10-16T23:30:13.288 INFO:tasks.ceph.mon.c:Stopped 2023-10-16T23:30:13.289 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-16T23:30:13.289 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-16T23:30:13.306 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-16T23:30:13.307 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-16T23:30:13.530 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-16T23:30:13.530 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-16T23:30:13.714 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-16T23:30:13.715 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-16T23:30:13.857 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-16T23:30:13.857 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-16T23:30:13.985 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi031.front.sepia.ceph.com 2023-10-16T23:30:13.986 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-16T23:30:14.350 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi031.front.sepia.ceph.com 2023-10-16T23:30:14.350 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-16T23:30:14.544 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi031.front.sepia.ceph.com 2023-10-16T23:30:14.544 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-16T23:30:14.719 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi031.front.sepia.ceph.com 2023-10-16T23:30:14.720 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-16T23:30:14.896 INFO:tasks.ceph:Archiving mon data... 2023-10-16T23:30:14.897 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526/data/mon.a.tgz 2023-10-16T23:30:14.898 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2023-10-16T23:30:14.904 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.V0UBaIFRSd 2023-10-16T23:30:14.905 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.V0UBaIFRSd 2023-10-16T23:30:15.013 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.V0UBaIFRSd 2023-10-16T23:30:15.073 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.V0UBaIFRSd is 274KB 2023-10-16T23:30:15.132 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.V0UBaIFRSd 2023-10-16T23:30:15.137 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526/data/mon.b.tgz 2023-10-16T23:30:15.137 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2023-10-16T23:30:15.143 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.HgLVWyndTr 2023-10-16T23:30:15.144 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.HgLVWyndTr 2023-10-16T23:30:15.285 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.HgLVWyndTr 2023-10-16T23:30:15.352 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.HgLVWyndTr is 369KB 2023-10-16T23:30:15.410 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.HgLVWyndTr 2023-10-16T23:30:15.415 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526/data/mon.c.tgz 2023-10-16T23:30:15.416 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2023-10-16T23:30:15.464 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.lJNV4A9bIj 2023-10-16T23:30:15.464 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.lJNV4A9bIj 2023-10-16T23:30:15.594 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.lJNV4A9bIj 2023-10-16T23:30:15.655 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.lJNV4A9bIj is 369KB 2023-10-16T23:30:15.714 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.lJNV4A9bIj 2023-10-16T23:30:15.722 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-16T23:30:15.723 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-16T23:30:15.725 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-16T23:30:15.765 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-16T23:30:15.768 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-16T23:30:15.770 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-16T23:30:15.784 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-16T23:30:15.785 DEBUG:teuthology.orchestra.run.smithi012:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-16T23:30:15.787 DEBUG:teuthology.orchestra.run.smithi031:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-16T23:30:15.812 INFO:teuthology.orchestra.run.smithi012.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-16T23:30:15.821 DEBUG:teuthology.orchestra.run.smithi033:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-16T23:30:15.824 DEBUG:teuthology.orchestra.run.smithi072:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-16T23:30:15.827 DEBUG:teuthology.orchestra.run.smithi138:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-16T23:30:15.840 INFO:teuthology.orchestra.run.smithi033.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-16T23:30:15.840 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-16T23:30:15.850 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-16T23:30:15.858 INFO:teuthology.orchestra.run.smithi138.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-16T23:30:15.862 INFO:tasks.ceph:Archiving crash dumps... 2023-10-16T23:30:15.864 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526/remote/smithi012/crash 2023-10-16T23:30:15.865 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-16T23:30:15.877 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526/remote/smithi031/crash 2023-10-16T23:30:15.878 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-16T23:30:15.898 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526/remote/smithi033/crash 2023-10-16T23:30:15.899 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-16T23:30:15.911 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526/remote/smithi072/crash 2023-10-16T23:30:15.913 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-16T23:30:15.927 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526/remote/smithi138/crash 2023-10-16T23:30:15.928 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-16T23:30:15.942 INFO:tasks.ceph:Shutting down logrotate 2023-10-16T23:30:15.943 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:30:15.946 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:30:15.948 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:30:15.958 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:30:15.974 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T23:30:16.029 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-16T23:30:16.040 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-16T23:30:16.052 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-16T23:30:16.066 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-16T23:30:16.079 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-16T23:30:16.092 INFO:tasks.ceph:Compressing logs... 2023-10-16T23:30:16.093 DEBUG:teuthology.orchestra.run.smithi012:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T23:30:16.095 DEBUG:teuthology.orchestra.run.smithi031:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T23:30:16.098 DEBUG:teuthology.orchestra.run.smithi033:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T23:30:16.110 DEBUG:teuthology.orchestra.run.smithi072:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T23:30:16.122 DEBUG:teuthology.orchestra.run.smithi138:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T23:30:16.859 INFO:tasks.ceph:Archiving logs... 2023-10-16T23:30:16.860 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526/remote/smithi012/log 2023-10-16T23:30:16.861 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-16T23:30:17.068 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526/remote/smithi031/log 2023-10-16T23:30:17.070 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-16T23:30:17.161 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526/remote/smithi033/log 2023-10-16T23:30:17.162 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-16T23:30:17.177 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526/remote/smithi072/log 2023-10-16T23:30:17.178 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-16T23:30:17.194 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526/remote/smithi138/log 2023-10-16T23:30:17.195 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-16T23:30:17.210 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-16T23:30:17.221 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-16T23:30:17.221 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-16T23:30:17.224 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-16T23:30:17.226 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-16T23:30:17.229 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-16T23:30:17.242 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-16T23:30:17.400 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-16T23:30:17.410 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-16T23:30:17.410 DEBUG:teuthology.orchestra.run.smithi012:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T23:30:17.413 DEBUG:teuthology.orchestra.run.smithi031:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T23:30:17.416 DEBUG:teuthology.orchestra.run.smithi033:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T23:30:17.418 DEBUG:teuthology.orchestra.run.smithi072:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T23:30:17.421 DEBUG:teuthology.orchestra.run.smithi138:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T23:30:17.425 INFO:teuthology.orchestra.run.smithi012.stdout: remote refid st t when poll reach delay offset jitter 2023-10-16T23:30:17.425 INFO:teuthology.orchestra.run.smithi012.stdout:============================================================================== 2023-10-16T23:30:17.425 INFO:teuthology.orchestra.run.smithi012.stdout:*hv01.front.sepi 44.4.53.2 2 u 63 64 77 0.066 -2.061 0.171 2023-10-16T23:30:17.426 INFO:teuthology.orchestra.run.smithi012.stdout:+hv02.front.sepi 63.231.80.2 3 u 1 64 177 0.087 +0.351 0.295 2023-10-16T23:30:17.426 INFO:teuthology.orchestra.run.smithi012.stdout:+hv03.front.sepi 74.6.168.72 3 u 63 64 77 0.070 +0.843 0.227 2023-10-16T23:30:17.426 INFO:teuthology.orchestra.run.smithi012.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-16T23:30:17.428 INFO:teuthology.orchestra.run.smithi031.stdout: remote refid st t when poll reach delay offset jitter 2023-10-16T23:30:17.428 INFO:teuthology.orchestra.run.smithi031.stdout:============================================================================== 2023-10-16T23:30:17.428 INFO:teuthology.orchestra.run.smithi031.stdout:+hv01.front.sepi 44.4.53.2 2 u 64 64 77 0.067 -2.465 0.727 2023-10-16T23:30:17.429 INFO:teuthology.orchestra.run.smithi031.stdout:*hv02.front.sepi 63.231.80.2 3 u 5 64 177 0.106 -0.220 0.677 2023-10-16T23:30:17.429 INFO:teuthology.orchestra.run.smithi031.stdout:+hv03.front.sepi 74.6.168.72 3 u 65 64 77 0.073 +0.802 0.755 2023-10-16T23:30:17.429 INFO:teuthology.orchestra.run.smithi031.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-16T23:30:17.431 INFO:teuthology.orchestra.run.smithi033.stdout: remote refid st t when poll reach delay offset jitter 2023-10-16T23:30:17.431 INFO:teuthology.orchestra.run.smithi033.stdout:============================================================================== 2023-10-16T23:30:17.432 INFO:teuthology.orchestra.run.smithi033.stdout:+hv01.front.sepi 44.4.53.2 2 u 66 64 77 0.075 -2.246 0.814 2023-10-16T23:30:17.432 INFO:teuthology.orchestra.run.smithi033.stdout:*hv02.front.sepi 63.231.80.2 3 u 66 64 77 0.058 +0.364 1.159 2023-10-16T23:30:17.432 INFO:teuthology.orchestra.run.smithi033.stdout:+hv03.front.sepi 74.6.168.72 3 u 65 64 77 0.092 +0.937 0.809 2023-10-16T23:30:17.432 INFO:teuthology.orchestra.run.smithi033.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-16T23:30:17.433 INFO:teuthology.orchestra.run.smithi072.stdout: remote refid st t when poll reach delay offset jitter 2023-10-16T23:30:17.433 INFO:teuthology.orchestra.run.smithi072.stdout:============================================================================== 2023-10-16T23:30:17.433 INFO:teuthology.orchestra.run.smithi072.stdout:*hv01.front.sepi 44.4.53.2 2 u 63 64 77 0.119 -2.693 1.527 2023-10-16T23:30:17.434 INFO:teuthology.orchestra.run.smithi072.stdout:+hv02.front.sepi 63.231.80.2 3 u 61 64 77 0.119 -0.474 1.266 2023-10-16T23:30:17.434 INFO:teuthology.orchestra.run.smithi072.stdout:+hv03.front.sepi 74.6.168.72 3 u 65 64 77 0.100 +0.525 1.024 2023-10-16T23:30:17.434 INFO:teuthology.orchestra.run.smithi072.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-16T23:30:17.435 INFO:teuthology.orchestra.run.smithi138.stdout: remote refid st t when poll reach delay offset jitter 2023-10-16T23:30:17.436 INFO:teuthology.orchestra.run.smithi138.stdout:============================================================================== 2023-10-16T23:30:17.436 INFO:teuthology.orchestra.run.smithi138.stdout:*hv01.front.sepi 44.4.53.2 2 u 63 64 77 0.087 -0.931 3.021 2023-10-16T23:30:17.436 INFO:teuthology.orchestra.run.smithi138.stdout:+hv02.front.sepi 63.231.80.2 3 u 64 64 77 0.149 +1.317 3.097 2023-10-16T23:30:17.436 INFO:teuthology.orchestra.run.smithi138.stdout:+hv03.front.sepi 74.6.168.72 3 u 63 64 77 0.100 +2.268 3.180 2023-10-16T23:30:17.437 INFO:teuthology.orchestra.run.smithi138.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-16T23:30:17.437 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-16T23:30:17.446 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-16T23:30:17.447 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-16T23:30:17.488 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-16T23:30:17.539 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-16T23:30:17.589 INFO:teuthology.task.internal:Duration was 876.102043 seconds 2023-10-16T23:30:17.590 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-16T23:30:17.639 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-16T23:30:17.640 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-16T23:30:17.642 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-16T23:30:17.645 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-16T23:30:17.649 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-16T23:30:17.652 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-16T23:30:17.721 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-16T23:30:17.722 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi012.front.sepia.ceph.com 2023-10-16T23:30:17.723 DEBUG:teuthology.orchestra.run.smithi012:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-16T23:30:17.733 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi031.front.sepia.ceph.com 2023-10-16T23:30:17.734 DEBUG:teuthology.orchestra.run.smithi031:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-16T23:30:17.744 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi033.front.sepia.ceph.com 2023-10-16T23:30:17.744 DEBUG:teuthology.orchestra.run.smithi033:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-16T23:30:17.755 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi072.front.sepia.ceph.com 2023-10-16T23:30:17.755 DEBUG:teuthology.orchestra.run.smithi072:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-16T23:30:17.765 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi138.front.sepia.ceph.com 2023-10-16T23:30:17.766 DEBUG:teuthology.orchestra.run.smithi138:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-16T23:30:17.776 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-16T23:30:17.777 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T23:30:17.779 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T23:30:17.788 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T23:30:17.798 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T23:30:17.809 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T23:30:17.839 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-16T23:30:17.839 DEBUG:teuthology.orchestra.run.smithi012:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-16T23:30:17.843 DEBUG:teuthology.orchestra.run.smithi031:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-16T23:30:17.852 DEBUG:teuthology.orchestra.run.smithi033:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-16T23:30:17.862 DEBUG:teuthology.orchestra.run.smithi072:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-16T23:30:17.874 DEBUG:teuthology.orchestra.run.smithi138:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-16T23:30:17.933 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-16T23:30:17.943 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-16T23:30:17.943 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-16T23:30:17.954 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-16T23:30:17.969 DEBUG:teuthology.orchestra.run.smithi033:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-16T23:30:17.980 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-16T23:30:17.992 DEBUG:teuthology.orchestra.run.smithi138:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-16T23:30:18.006 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-16T23:30:18.016 DEBUG:teuthology.orchestra.run.smithi012:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-16T23:30:18.018 DEBUG:teuthology.orchestra.run.smithi031:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-16T23:30:18.021 DEBUG:teuthology.orchestra.run.smithi033:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-16T23:30:18.023 DEBUG:teuthology.orchestra.run.smithi072:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-16T23:30:18.027 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = core 2023-10-16T23:30:18.031 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = core 2023-10-16T23:30:18.033 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = core 2023-10-16T23:30:18.038 DEBUG:teuthology.orchestra.run.smithi138:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-16T23:30:18.047 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = core 2023-10-16T23:30:18.061 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = core 2023-10-16T23:30:18.075 DEBUG:teuthology.orchestra.run.smithi012:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-16T23:30:18.093 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T23:30:18.093 DEBUG:teuthology.orchestra.run.smithi031:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-16T23:30:18.099 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T23:30:18.100 DEBUG:teuthology.orchestra.run.smithi033:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-16T23:30:18.104 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T23:30:18.105 DEBUG:teuthology.orchestra.run.smithi072:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-16T23:30:18.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T23:30:18.110 DEBUG:teuthology.orchestra.run.smithi138:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-16T23:30:18.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T23:30:18.122 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-16T23:30:18.133 INFO:teuthology.task.internal:Transferring archived files... 2023-10-16T23:30:18.134 DEBUG:teuthology.misc:Transferring archived files from smithi012:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526/remote/smithi012 2023-10-16T23:30:18.135 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-16T23:30:18.157 DEBUG:teuthology.misc:Transferring archived files from smithi031:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526/remote/smithi031 2023-10-16T23:30:18.157 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-16T23:30:18.176 DEBUG:teuthology.misc:Transferring archived files from smithi033:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526/remote/smithi033 2023-10-16T23:30:18.177 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-16T23:30:18.197 DEBUG:teuthology.misc:Transferring archived files from smithi072:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526/remote/smithi072 2023-10-16T23:30:18.197 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-16T23:30:18.216 DEBUG:teuthology.misc:Transferring archived files from smithi138:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526/remote/smithi138 2023-10-16T23:30:18.216 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-16T23:30:18.236 INFO:teuthology.task.internal:Removing archive directory... 2023-10-16T23:30:18.236 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-16T23:30:18.239 DEBUG:teuthology.orchestra.run.smithi031:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-16T23:30:18.241 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-16T23:30:18.244 DEBUG:teuthology.orchestra.run.smithi072:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-16T23:30:18.258 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-16T23:30:18.279 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-16T23:30:18.291 INFO:teuthology.task.internal:Not uploading archives. 2023-10-16T23:30:18.291 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-16T23:30:18.346 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-16T23:30:18.347 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-16T23:30:18.348 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-10-16T23:30:18.348 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-10-16T23:30:18.349 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-10-16T23:30:18.349 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-10-16T23:30:18.349 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-10-16T23:30:18.350 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-10-16T23:30:18.350 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-10-16T23:30:18.350 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-10-16T23:30:18.352 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-16T23:30:18.355 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-16T23:30:18.356 INFO:teuthology.orchestra.run.smithi012.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 16 23:30 /home/ubuntu/cephtest 2023-10-16T23:30:18.357 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-16T23:30:18.359 INFO:teuthology.orchestra.run.smithi031.stdout: 655473 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 16 23:30 /home/ubuntu/cephtest 2023-10-16T23:30:18.360 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-16T23:30:18.361 INFO:teuthology.orchestra.run.smithi033.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 16 23:30 /home/ubuntu/cephtest 2023-10-16T23:30:18.364 INFO:teuthology.orchestra.run.smithi072.stdout: 655477 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 16 23:30 /home/ubuntu/cephtest 2023-10-16T23:30:18.366 INFO:teuthology.orchestra.run.smithi138.stdout: 655473 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 16 23:30 /home/ubuntu/cephtest 2023-10-16T23:30:18.368 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-16T23:30:18.390 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-16T23:30:18.491 INFO:teuthology.nuke:Checking targets against current locks 2023-10-16T23:30:18.518 DEBUG:teuthology.nuke:shortname: smithi012 2023-10-16T23:30:18.518 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T23:30:18.542 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 23:05:30.462800', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMxAWQppE48F403WDGJsdsQyiDaEu4+p1ofBC4gxaVoFttdj0/M9w7TEZVP76fWdOhqx8/MLnefW1JJv9yEC1gw='} 2023-10-16T23:30:18.547 DEBUG:teuthology.nuke:shortname: smithi031 2023-10-16T23:30:18.547 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T23:30:18.568 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 23:05:30.457350', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDm1x/fmXG3KROxUPCqJXA4e96W7HQNf5+6CI0iJowdpSxfKt9lfTsuLZug7Pi8QIlDzFfVAPPWqfQ+fv/mZl3k='} 2023-10-16T23:30:18.575 DEBUG:teuthology.nuke:shortname: smithi033 2023-10-16T23:30:18.576 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T23:30:18.600 DEBUG:teuthology.nuke:shortname: smithi072 2023-10-16T23:30:18.600 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T23:30:18.605 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 23:05:30.459312', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK/nAGApqx0VNNkrmqQAz+LU9/R0Q3vIETJvMXf92q/w3MTqUlnVwultvLaCdOzrS/WT/OvHo+APpB0R0JfPOQ4='} 2023-10-16T23:30:18.612 INFO:teuthology.orchestra.console.smithi012:Power off 2023-10-16T23:30:18.613 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T23:30:18.631 INFO:teuthology.orchestra.console.smithi031:Power off 2023-10-16T23:30:18.632 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T23:30:18.640 DEBUG:teuthology.nuke:shortname: smithi138 2023-10-16T23:30:18.642 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T23:30:18.647 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 23:05:30.461056', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCuL74Xu58QHvckEI31wgy0qjUJB2IzOwO1byfnLnRDXZdKbmDlS0mpWOBHJ0DeQsnhDw6n/Lj2cS8qSxuZx2xo='} 2023-10-16T23:30:18.650 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2023-10-16T23:30:18.650 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T23:30:18.666 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2023-10-16T23:30:18.667 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T23:30:18.676 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-10-16T23:30:18.678 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429526', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 23:05:30.464343', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGktYTOmphqzUFGOpOfDH/SIj8g9vzxqkQ52gDiN44/QGExzrXBgT5LGiQZ+QxKKiIDT29dOQTX/rhaXDXq/iQc='} 2023-10-16T23:30:18.689 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-10-16T23:30:18.702 INFO:teuthology.orchestra.console.smithi033:Power off 2023-10-16T23:30:18.703 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T23:30:18.718 INFO:teuthology.orchestra.console.smithi072:Power off 2023-10-16T23:30:18.719 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T23:30:18.732 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-10-16T23:30:18.732 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T23:30:18.743 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-10-16T23:30:18.744 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T23:30:18.759 INFO:teuthology.orchestra.console.smithi138:Power off 2023-10-16T23:30:18.759 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T23:30:18.769 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-10-16T23:30:18.770 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-10-16T23:30:18.781 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off 2023-10-16T23:30:18.782 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T23:30:18.805 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2023-10-16T23:30:22.677 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T23:30:22.690 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T23:30:22.771 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T23:30:22.779 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T23:30:22.788 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-10-16T23:30:22.800 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-10-16T23:30:22.807 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T23:30:22.882 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-10-16T23:30:22.889 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-10-16T23:30:22.918 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2023-10-16T23:30:26.790 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T23:30:26.802 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T23:30:26.883 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T23:30:26.891 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T23:30:26.902 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-10-16T23:30:26.912 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-10-16T23:30:26.919 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T23:30:26.995 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-10-16T23:30:27.003 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-10-16T23:30:27.028 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2023-10-16T23:30:27.096 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-10-16T23:30:27.104 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-10-16T23:30:27.129 INFO:teuthology.orchestra.console.smithi138:Power off completed 2023-10-16T23:30:30.906 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T23:30:30.914 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T23:30:31.017 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-10-16T23:30:31.023 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-10-16T23:30:31.119 INFO:teuthology.orchestra.console.smithi012:Power off completed 2023-10-16T23:30:31.125 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-10-16T23:30:31.230 INFO:teuthology.run:Summary data: description: fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file} duration: 876.1020429134369 failure_reason: 'Command failed on smithi033 with status 8: ''TESTDIR=/home/ubuntu/cephtest bash -s''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=b59c4ef01fcd4a3b9daf49243444c329 status: fail success: false 2023-10-16T23:30:31.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T23:30:31.320 INFO:teuthology.run:FAIL